Cross-device service calling method, system, and storage medium

Abstract

The present application relates to the technical field of cross-device control. Provided are a cross-device service calling method, a system, and a storage medium. In the method, a user may use a simple and quick operation to trigger a first electronic device to query surrounding online devices and cross-device services provided by the online devices; the first electronic device may, on the basis of a user operation, call and start the cross-device service provided by one of the online devices, e.g. calling and starting the cross-device service provided by a second electronic device; and then, the user may collect or generate an object at the side of the second electronic device by using the called service, and, after being generated, the object can be transmitted back to the first electronic device. A simple and quick mode is provided, so as to call a service in the second electronic device by means of the first electronic device to collect or generate an object and then transmit same back to the present electronic device.

Description

A method, system and storage medium for calling services across devices

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office on November 3, 2023, with application number 202311463257.6 and application name “A method, electronic device, system and storage medium for calling services across devices”, the entire contents of which are incorporated by reference into this application.

[0002] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office on January 10, 2024, with application number 202410046013.6 and application name “A method, system and storage medium for calling services across devices”, the entire contents of which are incorporated by reference into this application. Technical Field

[0003] The present application relates to the field of cross-device control technology, and in particular to a method, system, and storage medium for calling services across devices. Background Art

[0004] Electronic devices can include multiple types, such as mobile phones that are convenient for taking photos but not for studying or working, and laptops that are convenient for studying or working but not for taking photos. In some scenarios, users can use their mobile phones to take photos and their laptops for studying or working. However, when a user uses a laptop for studying or working, if they need to take photos and transfer them to the laptop, they need to first take photos with the mobile phone, then establish a communication connection between the mobile phone and the laptop, and then transfer the photos taken with the mobile phone to the laptop. This method is understandably cumbersome.

[0005] Summary of the Invention

[0006] The present application provides a method, system and storage medium for calling services across devices, which can provide a simple and fast way to call the services in another electronic device through one electronic device to complete the collection of photos or other objects and then transmit them back to the electronic device.

[0007] To achieve the above objectives, this application adopts the following technical solutions:

[0008] In a first aspect, the present application provides a method for invoking a service across devices, comprising:

[0009] The first electronic device displays a first interface, which is an interface of a first application;

[0010] After receiving the first operation, the first electronic device displays a second interface, where the second interface includes a first control related to the first service of the second electronic device;

[0011] After receiving the second operation on the first control, the first electronic device sends the first instruction to the second electronic device;

[0012] After receiving the first instruction, the second electronic device displays a third interface, which includes the second control and is an interface corresponding to the first service of the second electronic device;

[0013] After receiving the third operation on the second control, the second electronic device sends the first object obtained through the first service to the first electronic device;

[0014] After receiving the first object, the first electronic device displays an identifier of the first object;

[0015] After receiving the fourth operation, the first electronic device displays a fourth interface including an editing window of the second application and an identifier of the first object;

[0016] After receiving the fifth operation performed on the area where the identifier of the first object is located, the first electronic device inserts the first object into the editing area of ​​the editing window of the second application.

[0017] In the present application, a first electronic device can trigger the electronic device to display a service (e.g., a first service) of another electronic device (e.g., a second electronic device) associated with the first electronic device through a first operation on any interface, and the user triggers the first electronic device to call the first service in the second electronic device by operating a control related to the first service of the second electronic device; after the first service of the second electronic device is started, the first object can be obtained and the first object can be transmitted back to the first electronic device; it can be understood that this method of calling a service on another electronic device across devices is very simple and fast;

[0018] In addition, after the first electronic device receives the first object transmitted back by the second electronic device, it can display a thumbnail of the object on the display screen, and then the user can open the second application to insert the object in the editing area of ​​the second application. It can be understood that the user does not need to trigger the cross-device call in the editing window interval of the second application displayed on the electronic device, but can also trigger the cross-device call in the interface of the first application that is unrelated to the second application (of course, the interface can be any interface). This cross-device call method is more flexible.

[0019] As an implementation of the first aspect, the first operation includes a sixth operation and a seventh operation, the sixth operation being a sliding operation starting from the top of the screen of the first electronic device. After receiving the first operation, the first electronic device displays a second interface, including:

[0020] After receiving the sixth operation, the first electronic device displays a smart interconnection card;

[0021] After receiving the seventh operation, the first electronic device displays the second interface. The seventh operation is applied to the area where the smart interconnection card is located.

[0022] In this application, in order to avoid user misoperation, the smart interconnection card related to cross-device calls can be displayed first, and then the services of other electronic devices that can be called across devices can be triggered by operations on the smart interconnection card.

[0023] As another implementation of the first aspect, the first interface includes a taskbar, the taskbar includes a first icon, and the first operation is an operation performed on the first icon.

[0024] In the present application, when the Windows operating system is involved, the services of other electronic devices that can be called across devices can also be triggered through the first icon related to the cross-device calling function in the taskbar.

[0025] As another implementation of the first aspect, the second operation is a click operation on the first control;

[0026] Alternatively, the second interface includes an icon of the first electronic device, and the second operation is a drag operation starting from the area where the first control is located and ending at the area where the icon of the first electronic device is located.

[0027] In this application, two methods are provided: click or drag to trigger the first electronic device to call the relevant service in the second electronic device. The methods are relatively diverse and can be set according to different models or different applicable groups. For example, some electronic devices without touch screens are not suitable for drag operations. For some electronic devices used by young people, drag operations may be more suitable.

[0028] As another implementation of the first aspect, the second operation is a drag operation with the area where the first control is located as a starting point and the area where the icon of the first electronic device is located as an end point, and the method further includes:

[0029] During the dragging process corresponding to the second operation, a first floating control is displayed at the contact point of the second operation, wherein the first floating control includes an icon of the first service and / or text information of the first service, and the first floating control is used to prompt the user that the first floating control currently being dragged is the first service;

[0030] After the second operation is completed, the icon of the first service and / or text information of the first service is displayed around the icon of the first electronic device.

[0031] In this application, the icon and / or text information of the first service in the first floating price control can prompt the user of the currently called service. Dragging it around the icon of the first electronic device can avoid accurately triggering the electronic device to be called when there are multiple electronic devices that can be called across devices on the same interface.

[0032] As another implementation of the first aspect, after the first electronic device receives the second operation acting on the first control and before the first electronic device displays the identifier of the first object, the method further includes:

[0033] The first electronic device displays a fifth interface, which includes: a second floating control and a blocking window, the second floating control includes a smart interconnection icon and / or a first text message, and the blocking window is used to prompt the user that the first electronic device is calling the first service of the second electronic device.

[0034] In this application, it is not suitable to run multiple applications in the foreground at the same time in the Android system. In order to avoid the interruption of cross-device calls caused by other operations of the user, a blocking window can be set. Of course, a second floating control can also be set to remind the user that a cross-device call is currently in progress.

[0035] As another implementation of the first aspect, the first electronic device displaying the identifier of the first object includes:

[0036] The first electronic device cancels display of the blocking window on the fifth interface and displays the identifier of the first object on the fifth interface.

[0037] In the present application, the blocking window is used to avoid interrupting the current cross-device call. Therefore, after the first electronic device ends a cross-device call, the blocking window can be canceled so that the user can use the received object.

[0038] As another implementation of the first aspect, the first interface includes an editing window of the first application, and the fifth interface also includes an editing window of the first application;

[0039] After the first electronic device displays the identifier of the first object on the fifth interface, the method further includes:

[0040] The first electronic device receives an eighth operation, where the eighth operation is a drag operation starting from the area where the identifier of the first object is located and ending at the editing area of ​​the editing window of the first application;

[0041] In response to the eighth operation, the first electronic device inserts the first object in the editing area of ​​the editing window of the first application.

[0042] In this application, the electronic device may also call the first service of the second electronic device while displaying the first application with the first object inserted. After receiving the object returned by the first service of the second electronic device, the object can be directly operated on the current interface and inserted into the editing area of ​​the first application.

[0043] As another implementation of the first aspect, the fifth operation is a drag operation starting from the area where the identifier of the first object is located and ending at the editing area of ​​the editing window of the second application.

[0044] As another implementation of the first aspect, after the first electronic device displays the identifier of the first object on the fifth interface, the method further includes:

[0045] After receiving the ninth operation on the second floating control on the fifth interface, the first electronic device sends a second instruction to the second electronic device;

[0046] After receiving the second instruction, the second electronic device displays a sixth interface, which includes the third control and is an interface corresponding to the first service of the second electronic device;

[0047] After receiving the ninth operation on the third control, the second electronic device sends the second object obtained through the first service to the first electronic device;

[0048] After receiving the second object, the first electronic device displays an identifier of the second object.

[0049] In the present application, after calling the first service of the second electronic device once, the first service of the second electronic device can be continuously called to obtain the object again through a cross-device call.

[0050] As another implementation of the first aspect, when the first electronic device displays multiple identifiers of multiple objects received from the first electronic device, the multiple identifiers of the multiple objects are displayed in a stacked or tiled manner; or, the identifier of the most recently received object is displayed, and the identifiers of the objects received in the past are canceled.

[0051] In this application, a variety of display methods are used to cope with different application scenarios; for example, when the screen of the electronic device is small, the display can be stacked so that the user can view the received objects in a limited area; when the screen of the electronic device is large, the display can be tiled so that the user can view each object.

[0052] As another implementation of the first aspect, the ninth operation includes a tenth operation and an eleventh operation. After receiving the ninth operation on the second floating control of the fifth interface, the first electronic device sends a second instruction to the second electronic device, including:

[0053] After receiving a tenth operation on the second floating control of the fifth interface, the first electronic device displays a first floating window, where the first floating window includes a fourth control related to the first service of the second electronic device;

[0054] After receiving the eleventh operation acting on the fourth control, the first electronic device sends a second instruction to the second electronic device.

[0055] In this application, in order to avoid misoperation, two consecutive steps can be used to trigger the electronic device to call the same service of the same electronic device again to obtain another object of the same type; it can be understood that the re-triggering method is quick and simple.

[0056] As another implementation of the first aspect, after the first electronic device displays the identifier of the first object, the method further includes:

[0057] After receiving the twelfth operation, the first electronic device displays a seventh interface, where the seventh interface includes a fifth control related to the second service of the second electronic device;

[0058] After receiving the thirteenth operation acting on the fifth control, the first electronic device sends a third instruction to the second electronic device, where the third instruction is used to call the second service of the second electronic device to obtain a third object.

[0059] In the present application, after calling the first service of the second electronic device, the second service of the second electronic device may be called to obtain different types of objects through cross-device calling.

[0060] As another implementation of the first aspect, after the first electronic device displays the identifier of the first object, the method further includes:

[0061] After receiving the fourteenth operation, the first electronic device displays an eighth interface, where the eighth interface includes a sixth control related to the first service of the third electronic device;

[0062] After receiving the fourteenth operation acting on the sixth control, the first electronic device sends a fourth instruction to the third electronic device, where the fourth instruction is used to call the first service of the third electronic device to obtain a fourth object.

[0063] In this application, for a first electronic device, when there are multiple other electronic devices around that can be called by the first electronic device, after calling the second electronic device, the third electronic device can also be called, so that there is more flexibility when editing documents on the first electronic device, and it can be applied in more application scenarios.

[0064] As another implementation of the first aspect, the second operation is a click operation on the first control. After the first electronic device receives the second operation on the first control, before the first electronic device displays the identifier of the first object, the method further includes:

[0065] The first electronic device displays a first window, where the first window is used to prompt a user that the first electronic device is calling a first service of the second electronic device.

[0066] As another implementation of the first aspect, before the first electronic device displays the identifier of the first object, the method further includes:

[0067] The first electronic device cancels display of the first window.

[0068] As another implementation of the first aspect, after the first electronic device displays the identifier of the first object for a first duration, the method further includes:

[0069] The first electronic device cancels display of the identifier of the first object.

[0070] In the present application, a disappearance mechanism of the identifier of the first object is set, so that objects that are not of interest to the user are automatically canceled from display without the need for user triggering, thereby improving the user experience.

[0071] As another implementation of the first aspect, after the first electronic device cancels display of the first window, the method further includes:

[0072] The first electronic device displays a second window, wherein the second window includes a seventh control;

[0073] After the first electronic device receives the fifteenth operation acting on the seventh control, the first electronic device cancels display of the second window;

[0074] After the first electronic device cancels display of the second window, it displays the first window.

[0075] As another implementation of the first aspect, after the first electronic device displays the identifier of the first object, the method further includes:

[0076] The first electronic device displays a ninth interface, which is any interface including a task bar, and the task bar includes the first icon;

[0077] After the first electronic device receives the sixteenth operation on the first icon, the third window is displayed. The sixteenth operation is different from the first operation. The third window includes an eighth control related to the first service of the second electronic device.

[0078] After the first electronic device receives the seventeenth operation acting on the eighth control, it cancels the display of the third window, displays the fourth window, and sends the fifth instruction to the second electronic device, where the fifth instruction is used to call the first service of the second electronic device; the fourth window is used to prompt the user that the first electronic device is calling the first service of the second electronic device.

[0079] This application also provides another quick way to trigger the first electronic device to call the same service of the same electronic device again to obtain another object of the same type.

[0080] As another implementation of the first aspect, the third operation includes an eighteenth operation and a nineteenth operation; after the second electronic device receives the third operation acting on the second control, the second electronic device sends the first object obtained through the first service to the first electronic device, including:

[0081] After receiving the eighteenth operation on the second control, the second electronic device displays a tenth interface including the first object and the ninth control;

[0082] After receiving the nineteenth operation acting on the ninth control, the second electronic device sends the first object to the first electronic device.

[0083] As another implementation of the first aspect, after the second electronic device receives a nineteenth operation acting on the ninth control, the method further includes:

[0084] The second electronic device displays an eleventh interface, the status bar of the eleventh interface displays the third floating control, and the eleventh interface is the system desktop or the interface displayed before the second electronic device displays the third interface;

[0085] After the second electronic device receives the twentieth operation on the third floating control, the second electronic device displays the twelfth interface.

[0086] In this application, it is also possible to trigger the second electronic device to be called again to obtain another object of the same service by the first electronic device. This method is more suitable for scenarios where users use the second electronic device to obtain multiple objects of multiple different types, thereby improving user experience.

[0087] As another implementation of the first aspect, the twentieth operation includes a twenty-first operation and a twenty-second operation. After the second electronic device receives the twentieth operation acting on the third floating control, the second electronic device displays a twelfth interface, including:

[0088] After receiving the twenty-first operation on the third floating control, the second electronic device displays a fifth window, the fifth window including a tenth control; the tenth control is related to the first service of the second electronic device;

[0089] After receiving the twenty-second operation acting on the tenth control, the second electronic device displays a thirteenth interface, where the thirteenth interface is used to obtain the object through the first service of the second electronic device.

[0090] In the present application, two steps can also be used to trigger the first electronic device to call the same service again to obtain another object, thereby avoiding the situation of misoperation. In a second aspect, an electronic device is provided, including a processor, the processor is used to run a computer program stored in a memory to implement the steps performed by the first electronic device or the steps performed by the second electronic device in the first aspect of the present application.

[0091] In a third aspect, a computer-readable storage medium is provided, which stores a computer program. When the computer program is executed by one or more processors, it implements the steps performed by the first electronic device or the steps performed by the second electronic device in the first aspect of the present application.

[0092] In a fourth aspect, a system for calling services across devices is provided, including a first electronic device and a second electronic device, wherein the first electronic device and the second electronic device implement any one of the methods in the first aspect of the present application.

[0093] In a fifth aspect, an embodiment of the present application provides a computer program product, which, when running on a device, enables the electronic device to execute the steps executed by the first electronic device or the steps executed by the second electronic device in the first aspect of the present application.

[0094] It can be understood that the beneficial effects of the second to fifth aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0095] FIG1 is a schematic diagram of a hardware structure of an electronic device provided in an embodiment of the present application;

[0096] FIG2 is a schematic diagram of an interface for a cross-device call entry in a tablet computer provided in an embodiment of the present application;

[0097] 3 to 5 are schematic diagrams of interfaces in a tablet computer when a mobile phone's camera service is invoked via the tablet computer according to an embodiment of the present application;

[0098] FIG6 is a schematic diagram of an interface on a mobile phone side that is invoked when a mobile phone's camera service is invoked via a tablet computer according to an embodiment of the present application;

[0099] Figures 7 and 8 are schematic diagrams of interfaces after a tablet computer receives photos from a mobile phone according to an embodiment of the present application;

[0100] FIG9 is a schematic diagram of an interface for re-calling a mobile phone's camera service triggered by a tablet computer according to an embodiment of the present application;

[0101] FIG10 is a schematic diagram of an interface when a tablet computer is triggered to call a photo taking service again through a mobile phone according to an embodiment of the present application;

[0102] FIG11 is a schematic diagram of an interface in a laptop computer when a mobile phone's camera service is invoked via a laptop computer according to an embodiment of the present application;

[0103] FIG12 is a schematic diagram of an interface after a laptop computer receives a photo taken by a mobile phone according to an embodiment of the present application;

[0104] FIG13 is a schematic diagram of an interface for re-calling the mobile phone's photo taking service triggered by a laptop provided by an embodiment of the present application;

[0105] FIG14 is a schematic diagram of an interface for re-calling the mobile phone's photo taking service by triggering it from a laptop provided by an embodiment of the present application;

[0106] FIG15 is a schematic diagram showing the display method of the object received by the caller provided in an embodiment of the present application. DETAILED DESCRIPTION

[0107] In the following description, specific details such as specific system structures and technologies are provided for illustration rather than limitation to facilitate a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details.

[0108] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, integers, steps, operations, elements and / or components, but does not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or collections thereof.

[0109] It should also be understood that in the embodiments of this application, "one or more" refers to one, two, or more than two; "and / or" describes the relationship between associated objects, indicating that three relationships can exist; for example, A and / or B can mean: A exists alone, A and B exist simultaneously, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the associated objects are in an "or" relationship.

[0110] In addition, in the description of this application specification and the appended claims, the terms "first", "second", "third", "fourth", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0111] References to "one embodiment" or "some embodiments" in this specification mean that a particular feature, structure, or characteristic described in conjunction with that embodiment is included in one or more embodiments of the present application. Thus, phrases such as "in one embodiment," "in some embodiments," "in other embodiments," and "in other embodiments" appearing in various places in this specification do not necessarily refer to the same embodiment, but rather mean "one or more but not all embodiments," unless otherwise specifically emphasized. The terms "including," "comprising," "having," and variations thereof all mean "including but not limited to," unless otherwise specifically emphasized.

[0112] The present invention provides a method for cross-device service invocation, enabling one electronic device to call a service on another electronic device. The electronic device may be a tablet computer, mobile phone, wearable device, laptop computer, ultra-mobile personal computer (UMPC), netbook, personal digital assistant (PDA), or other electronic device. The two electronic devices may be of the same or different types, and the present invention does not limit the specific types of the electronic devices.

[0113] Figure 1 shows a schematic diagram of the structure of an electronic device. Electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display 194, and a subscriber identification module (SIM) card interface 195.

[0114] The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0115] It should be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0116] The processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units can be independent devices or integrated into one or more processors. Among them, the controller can be the nerve center and command center of the electronic device 100. The controller can generate an operation control signal based on the instruction opcode and the timing signal to complete the control of instruction fetching and execution. As an example, the embodiment of the present application can implement the method for cross-device calling services provided by the embodiment of the present application through a processor.

[0117] The internal memory 121 can be used to store computer-executable program code, which includes instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. As an example, the internal memory can be used to store program code corresponding to a cross-device call service; it can also be used to store photos or other objects received from another electronic device that have been captured or generated.

[0118] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0119] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0120] As an example, in an embodiment of the present application, the electronic device as the caller and the electronic device as the callee can communicate through their respective wireless communication modules and transmit photos or other objects or other related instructions.

[0121] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150 , and antenna 2 is coupled to wireless communication module 160 , so that electronic device 100 can communicate with the network and other devices through wireless communication technology.

[0122] The pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In some embodiments, the pressure sensor 180A can be provided on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. A capacitive pressure sensor can be a device comprising at least two parallel plates having a conductive material. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure based on the change in capacitance. When a touch operation is applied to the display screen 194, the electronic device 100 detects the intensity of the touch operation based on the pressure sensor 180A. The electronic device 100 can also calculate the position of the touch based on the detection signal of the pressure sensor 180A.

[0123] The touch sensor 180K is also called a "touch panel." The touch sensor 180K can be disposed on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen." The touch sensor 180K is used to detect touch operations applied thereto or in the vicinity thereof. The touch sensor can transmit the detected touch operations to the application processor to determine the type of touch event. Visual output related to the touch operations can be provided via the display screen 194. In other embodiments, the touch sensor 180K can also be disposed on the surface of the electronic device 100, in a location different from that of the display screen 194.

[0124] The embodiments of the present application can detect various gestures input by the user through a pressure sensor and / or a touch sensor.

[0125] Electronic device 100 implements display functionality through a GPU, display screen 194, and an application processor. A GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.

[0126] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1. The embodiment of the present application can display the interfaces in the various figures provided in the embodiment of the present application through the display screen.

[0127] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0128] The embodiments of the present application do not particularly limit the specific structure of the execution subject of the method for calling a service across devices. As long as the code recording the method for calling a service across devices according to the embodiments of the present application can be run to communicate according to the method for calling a service across devices provided by the embodiments of the present application. For example, the execution subject of the method for calling a service across devices provided by the embodiments of the present application can be a functional module in an electronic device that can call and execute a program, or a communication device used in an electronic device, such as a chip.

[0129] Electronic devices can be of various types, for example, a mobile phone that is convenient for taking photos but not for studying or working, and a laptop or tablet computer that is convenient for studying or working but not for taking photos. In some scenarios, a user may use a mobile phone for taking photos and a laptop or tablet computer for studying or working; however, when the user needs to insert photos taken with the mobile phone into a document on the laptop or tablet computer, the photos taken with the mobile phone must first be transferred to the laptop or tablet computer, and then the transferred photos must be inserted into the document on the laptop or tablet computer.

[0130] As an example scenario, college students can bring mobile phones and tablets into the classroom. During class, college students can use the tablet to take class notes, or use the mobile phone that is easy to take pictures to take pictures of the class handouts presented by the teacher; if they need to insert the pictures of the class handouts taken by the mobile phone into the class notes recorded by the tablet, they need to use the device collaboration function between the mobile phone and the tablet or instant messaging software to transfer the pictures taken by the mobile phone to the tablet, and then insert the pictures transferred to the tablet into the class notes on the tablet.

[0131] As another scenario example, when a reporter uses a laptop to write a press release, if he needs to insert photos taken with a mobile phone into the press release, he also needs to use the device collaboration function between the mobile phone and the laptop or instant messaging software to transfer the pictures taken with the mobile phone to the laptop, and then insert the pictures transferred to the laptop into the press release.

[0132] The above scenarios are all examples of inserting pictures taken by a mobile phone into the document editing interface of a document editing application on a laptop (or tablet). In actual applications, an object collected or generated by another electronic device can be inserted into any application of an electronic device that has the function of inserting objects (for example, documents, videos, audio, pictures, handwriting, etc.). For example, insert audio, pictures and videos collected by a mobile phone, mobile phone screen recordings, documents scanned by a mobile phone, handwriting, copied text, written documents, etc. into the note application of a laptop; insert audio, pictures and videos collected by another mobile phone, mobile phone screen recordings, documents scanned by a mobile phone, handwriting, copied text, written documents, etc. into the memo of a mobile phone.

[0133] The embodiments of the present application provide a method for calling services across devices, which can call a service (e.g., a photo taking service, a voice recording service, a screenshot service, a screen recording service, a scanning service, a handwriting service, etc.) in another electronic device (e.g., electronic device B) in one electronic device (e.g., electronic device A), so that electronic device A can obtain an object collected or generated in real time by the called service in electronic device B. The object may include but is not limited to: documents, videos, audios, pictures, handwritings, text, etc. The object can be inserted into any application of electronic device A that has the function of inserting objects, or it can be stored in the storage space of the electronic device (e.g., a disk) instead of being inserted into any application of electronic device A.

[0134] In addition, it should be noted that a physical channel exists between electronic device B and electronic device A for transmitting information. For example, electronic device B and electronic device A are connected via Wi-Fi Direct, or electronic device B and electronic device A are located on the same local area network, or electronic device B and electronic device A are connected via Bluetooth. Of course, in actual applications, electronic device A and electronic device B may also have other forms of communication connections.

[0135] From a security perspective, you can also set up a system where electronic device A can only call electronic device B, which is registered under the same account as electronic device A. This prevents your electronic device from being called by another user's electronic device when multiple electronic devices are on the same local area network. The electronic devices under the same account can be multiple electronic devices that are associated with each other and belong to the same user. Electronic devices under the same account can call each other.

[0136] 2 to 8 are schematic diagrams of interfaces for cross-device service invocation provided by embodiments of the present application. This schematic diagram takes the example of a tablet computer invoking a camera service on a mobile phone and inserting photos taken with the camera service on the mobile phone into a note application on the tablet computer.

[0137] Referring to FIG. 2 (a), an editing interface 10 of a third-party note-taking application on a tablet computer is shown. The note-taking application can be any application with document editing capabilities. Users can enter text, insert audio, documents, images, videos, etc., in this editing interface 10. This editing interface 10 can be used as an example of a first interface.

[0138] The user enters a downward swipe gesture (this operation is an example of the sixth operation) in the editing interface shown in FIG2(a). This downward swipe gesture is a downward swipe gesture starting from the top of the tablet screen. This downward swipe gesture can trigger the tablet to display the control center interface 11 shown in FIG2(b). The control center interface 11 is an interface for users to quickly access commonly used applications and functions, such as the auto-rotation control 110 shown in the figure. The controls for accessing other commonly used applications and functions in the control center interface 11 are not listed one by one.

[0139] A smart interconnection card 111 is also displayed in the control center interface 11 shown in (b) of FIG2 . The smart interconnection card 111 is used to quickly access the smart interconnection function provided by the tablet computer.

[0140] The user clicks the smart interconnection card 111 in the control center interface 11 shown in Figure 2 (b), triggering the tablet computer to display the smart interconnection interface 12 shown in Figure 3 (a) (which can be used as an example of the second interface). The user can use the smart interconnection interface 12 on the tablet computer to call services on other electronic devices.

[0141] It can be understood that the embodiments of the present application provide a simple and quick way to enter the smart interconnection interface by displaying the smart interconnection card in the control center. In specific implementation, since the display of the control center is independent of the interface currently displayed on the tablet computer, even if the tablet computer is displaying any interface other than a third-party note-taking application, the user can trigger the electronic device to display the control center interface through a swipe gesture, thereby entering the smart interconnection interface through the smart interconnection card in the control center interface.

[0142] It is understood that, in fact, the operation acting on the smart interconnect card can be recorded as the seventh operation. Alternatively, the sixth operation and the seventh operation can be collectively referred to as the first operation.

[0143] As another example, in a specific implementation, other shortcut gestures (for example, a circle gesture on the screen, a sliding gesture starting from a corner of the screen, etc.) can also be used to trigger the tablet computer to enter the interface shown in (a) in Figure 3 from any interface. This application will not give examples through diagrams.

[0144] As shown in FIG3 (a), the smart interconnection interface 12 displays electronic devices under the same account as the tablet computer, such as the Magic 5 mobile phone and the Magic Book X14 laptop computer. Of course, the electronic device itself, the tablet computer PAD V8, is also displayed. In actual use, the smart interconnection interface 12 highlights the icon 122 of the electronic device, for example, the icon of the tablet computer PAD V8.

[0145] The icons 123 of electronic devices that are under the same account as the current electronic device and that do not currently have a physical channel connection with the current electronic device are displayed in grayscale. For example, the icon of the laptop computer MagicBook 14 is displayed in grayscale. In a specific implementation, the laptop computer MagicBook 14 is under the same account as the current electronic device, but is not currently on the same local area network as the current electronic device, does not have a Wi-Fi direct connection, has not established a connection via Bluetooth, and does not have any other physical channel connection.

[0146] The service tab 121 provided by an electronic device that is under the same account as the electronic device and currently has a communication connection with the electronic device (for example, in the same local area network) can be directly displayed. For example, the service tab 121 provided by the mobile phone Magic 5 is displayed. The services that the mobile phone Magic 5 can provide are displayed in the service tab 121: screen sharing, network sharing, scanning service, and photo service. Of course, the name of the mobile phone: Magic 5 and the operation instructions: Drag the service you want to flow to the electronic device can also be displayed below the service tab.

[0147] As another example, in actual applications, the icons of electronic devices that are under the same account as the current electronic device and currently have no physical channel connection with the current electronic device may not be displayed.

[0148] The present application provides a method for invoking a cross-device service by dragging a gesture. In actual applications, a cross-device service can also be invoked by a single click. The corresponding operation description is: click to activate the service you want to flow. Both the drag gesture and the single click operation can be used as an example of a second operation.

[0149] Through this display method, users can quickly identify which device is the current electronic device, which device is offline, and which cross-device service can be used on which device. The display method is simple and easy to understand. On the other hand, the user can also be prompted by operating instructions on how to call cross-device services.

[0150] As another embodiment of the present application, in actual application, the smart interconnection interface triggered by the operation shown in (b) in Figure 2 can also: highlight the icon of the electronic device and mark it as "this device", grayscale display the icons of electronic devices that are under the same account as the electronic device and currently have no communication connection with the electronic device, and highlight the icons of electronic devices that are under the same account as the electronic device and currently have a communication connection with the electronic device.

[0151] The user clicks on the highlighted icon of an electronic device that is under the same account as this electronic device and currently has a communication connection with this electronic device, triggering the display of the service tab of the electronic device whose icon was clicked, that is, displaying the interface shown in (a) in Figure 3. This application will no longer use diagrams to illustrate this process.

[0152] When a user wants to use the tablet PAD V8 to call the camera service in the mobile phone Magic 5, the user can click the control 1211 in the service tab 121, or the user can input a drag gesture on the screen from the area where the control 1211 is located to the area where the tablet PAD V8 icon 122 is located. The control 1211 corresponds to the camera service in the mobile phone Magic 5.

[0153] A drag gesture can include three consecutive operations: a long-press selection operation, a drag operation, and a hand-lift release operation. After the tablet detects a long-press selection operation on control 1211 (as an example of a first control), it displays a floating control 1212 (as an example of a first floating control) in the area where control 1211 is located. After the tablet detects a drag operation following the long-press selection operation, it displays floating control 1212 along the drag operation trajectory, that is, floating control 1212 follows the user's dragging trajectory. The long-press duration for the long-press selection operation can be set according to specific circumstances.

[0154] FIG3( b ) illustrates a user dragging a floating control 1212. In practice, floating control 1212 may be displayed in the area where the user's finger touches or in the area surrounding the touch. Floating control 1212 includes an icon for the corresponding photo service and a caption "Photo Service," indicating that the currently selected service is the photo service.

[0155] After the tablet detects that the control 1211 is long pressed and selected, a floating control 1212 is displayed in the area where the control 1211 is located, which can prompt the user that the Magic 5 camera service represented by the control 1211 has been selected and that subsequent drag operations can be performed.

[0156] During the dragging process, the floating control 1212 is displayed in the area where the contact point of the user's finger is located or in the area around the contact point, which can prompt the user that the object currently dragged is the photo taking service corresponding to the floating control 1212.

[0157] After the user drags the floating control 1212 to the area where the icon 122 of the electronic device PAD V8 is located, the user lifts his finger, triggering the tablet computer to display the interface 13 shown in (a) of FIG. 4 .

[0158] In actual applications, the control 1212 may not be displayed during the dragging process.

[0159] 4 (a), after the tablet detects a hand-raising and releasing operation after the contact point of the user's finger moves to the area where the icon 122 of the PAD V8 is located (the release operation corresponds to the action of the user lifting the finger), a control 131 is displayed in the area around the icon 122 of the PAD V8, and the control 131 includes an icon for the photo service.

[0160] By displaying the control 131 in the area surrounding the icon 122 of the PAD V8 after detecting the hand-raising and releasing operation, the user can be prompted that the electronic device PAD V8 starts to call the photo-taking service of other electronic devices.

[0161] In actual use, after detecting that the user's finger has moved to the area where the PAD V8 icon 122 is located and then released, the tablet computer needs to establish a cross-device call connection with the mobile phone Magic 5 where the selected photo service is located. This cross-device call connection is a communication connection established through a handshake protocol or other means based on the physical channel between the electronic device and the mobile phone Magic 5. After the call connection is successfully established, the electronic device displays the interface 14 shown in Figure 4 (b).

[0162] The interface 14 shown in (b) in Figure 4 is similar to the interface 10 before the smart interconnection interface is called up through the control center, that is, it is similar to the interface 10 shown in (a) in Figure 2. The difference is that when the tablet computer displays the interface 14 shown in (b) in Figure 4, the tablet computer has already established a cross-device call connection with the mobile phone Magic 5, so in the interface 14 shown in (b) in Figure 4, a floating control 141 is displayed in the top status bar (as an example of a second floating control). The floating control 141 includes an icon of the smart interconnection function and the name of the smart interconnection function "Trust Ring". In actual applications, the floating control 141 can also be displayed in other locations on the screen. It should be noted that the name of the smart interconnection function can be set according to the specific situation, and any text information in the embodiment of the present application is only an example.

[0163] The user can be prompted by the floating control 141 that the electronic device has currently established a cross-device call connection with other electronic devices. Of course, in actual applications, the floating control 141 can also implement other functions, which can be seen in subsequent Figures 9 and 10 for details.

[0164] After establishing a cross-device call connection between the tablet and the Magic 5 phone, the tablet also needs to use this cross-device call connection to enable the camera function in the Magic 5 phone to access the Magic 5's photo service. For example, the tablet sends a call instruction for the photo service to the Magic 5 phone, which can start the Magic 5 phone's camera application. In response, after the Magic 5 phone's camera application is started, it can return a message to the tablet indicating that the camera has been started.

[0165] The instructions for establishing a cross-device call connection and calling the photo service may be considered as the first instruction.

[0166] After receiving the information that the camera application has been started from the mobile phone Magic 5, the tablet computer displays the interface 15 shown in Figure 5. The interface 15 shown in Figure 5 is an interface that displays the blocking window based on the interface 14.

[0167] The interface 15 shown in FIG5 includes a blocking window 151 , which includes a prompt message: the user's electronic device is using “magic15” for “photography service”, please perform other operations later. The blocking window 151 also includes a control 1511 .

[0168] Among them, the blocking window 151 is used to prompt the user that the electronic device has successfully called the photo-taking service provided by the camera application in other electronic devices; on the other hand, it is also used to prompt the user that the electronic device is currently calling the cross-device service of other electronic devices, and other operations currently performed on the electronic device may stop the current photo-taking service.

[0169] When the user wants to stop the current photographing service or cross-device call connection, the user can click the control 1511 in the blocking window 151, so the blocking window 151 also provides the function of stopping the current photographing service or cross-device call connection.

[0170] As an example, after detecting a click on control 1511, the tablet computer may stop calling the camera service on the Magic 5 phone, but maintain the cross-device call connection between the tablet computer and the Magic 5 phone. The user can re-call the camera service or other cross-device services on the Magic 5 phone through the cross-device call connection between the tablet computer and the Magic 5 phone. If the cross-device call connection is not interrupted, the re-calling of the camera service or other cross-device services on the Magic 5 phone can be referred to the description in the subsequent FIG. 9.

[0171] As another example, after the tablet computer detects a click operation on the control 1511 , the cross-device call connection between the tablet computer and the mobile phone Magic5 may be interrupted.

[0172] The specific implementation method of the embodiment of this application is not limited.

[0173] As another example, since the time for establishing a cross-device call connection between the electronic device and the mobile phone Magic 5 and for starting the camera in the mobile phone through the cross-device call connection is relatively short, in actual applications, the display time of the interfaces shown in (a) in Figure 4 and (b) in Figure 4 is relatively short. From the user's perspective, the user may see the interface shown in Figure 5 without even observing the display time of the interface shown in Figure 4.

[0174] In addition, after the operation on the interface shown in (b) of Figure 3, the tablet computer may no longer display the interfaces shown in Figures 4 and 5, but directly display the interface displayed before the interface corresponding to the smart interconnection function is called up, for example, the interface shown in (a) of Figure 2, or after waiting to receive photos sent back by the camera service of the mobile phone Magic 5, display the interface displayed before the interface corresponding to the smart interconnection function is called up, and display thumbnails of the photos on this interface. The embodiments of the present application do not limit the specific implementation method.

[0175] As mentioned above, the camera application of the mobile phone Magic 5 has been started. After the camera application in the mobile phone Magic 5 is started, the mobile phone Magic 5 displays the interface 16 corresponding to the photo service called across devices. This interface is an example of the third interface.

[0176] Referring to FIG. 6 (a), an example of an interface 16 corresponding to the photo service provided in an embodiment of the present application is shown. This interface 16 includes some controls related to photo taking, such as a flash control 161 for turning the flash on or off; a setting control 162 for setting parameters related to photo taking (e.g., photo ratio, shutter speed, etc.); a focal length control 163 for setting the photo focal length; a photo control 164 (this control is an example of a second control) for taking a photo and generating a photo; and a camera switching area 165 for switching between the front camera and the rear camera. This interface 16 also includes a preview area 166 for displaying a preview image captured by the camera.

[0177] After the user clicks the photo control 164 in the interface 16 , the mobile phone displays the confirmation interface 17 shown in (b) of FIG6 in response to the click operation on the photo control 164 (as an example of the eighteenth operation).

[0178] The confirmation interface 17 displays a photo 171 obtained by taking the photo. It also includes a cancel control 172 and a confirm control 173 (as an example of a ninth control). The cancel control 172 is used to delete the photo 171 and return to the photo taking interface to take the photo again; the confirm control 173 is used to confirm the transfer of the photo 171 to the tablet computer.

[0179] After the user confirms that they want to transfer photo 171 to the tablet computer PAD V8 that is calling the Magic 5 mobile phone, they click confirmation control 173. After receiving the click operation on confirmation control 173 (as an example of the nineteenth operation), the Magic 5 mobile phone transfers photo 171 to the tablet computer PAD V8. Simultaneously, the Magic 5 mobile phone displays interface 18 shown in FIG6(c). Of course, the eighteenth and nineteenth operations can be collectively referred to as the third operation.

[0180] If the mobile phone Magic 5 displays the system desktop before the camera service is called to display the interface 16 shown in (a) of FIG6 , the electronic device displays the system desktop in response to the click operation on the confirmation control 173 .

[0181] If the mobile phone Magic 5 displays other interfaces before the camera service is called to display the interface 16 shown in (a) in FIG6 , the electronic device displays the other interfaces in response to the click operation on the confirmation control 173 .

[0182] If the mobile phone Magic 5 is in a screen-off state before the camera service is called to display the interface 16 shown in (a) of FIG6 , the electronic device displays the system desktop in response to the click operation on the confirmation control 173 .

[0183] Of course, in actual application, it can also be set that no matter what interface or screen-off state the mobile phone Magic 5 displays before the photo service is called, the electronic device displays the system desktop in response to the click operation on the confirmation control 173.

[0184] The embodiments of the present application do not limit the specific implementation method.

[0185] In this embodiment of the present application, the system desktop is shown in Figure 6(c) as an example (an example of the eleventh interface). A floating control 181 (an example of a third floating control) is also displayed in the status bar of the system desktop. Floating control 181 displays an icon for the smart interconnection function and a text prompt for the currently invoked photo service, "Photo Service." Of course, floating control 181 can also be displayed elsewhere on the system desktop.

[0186] The floating control 181 is used to remind the user that the electronic device (mobile phone Magic 5) is currently being used by other electronic devices to call the photo service. The floating control 141 can also realize other functions, which can be seen in the subsequent FIG10 for details.

[0187] As another embodiment of the present application, when the mobile phone magic 5 displays the interface described in (a) in Figure 6, after receiving the operation on the photo control 164, it directly transmits the generated photo to the tablet side and displays the interface shown in (b) in Figure 6, that is, there is no interface 17 for confirmation.

[0188] As another embodiment of the present application, when the tablet computer displays the interface 15 shown in FIG5 , the user can click the control 1511 in the blocking window 151 on the interface 15 to trigger the tablet computer to cancel the call to the mobile phone's camera service.

[0189] In actual applications, after a cross-device call connection is established between a tablet computer and a mobile phone, when at least one call has been completed through the cross-device call connection to realize the return of photos, when the tablet computer calls the photo service in the mobile phone again through the cross-device call connection to take a photo, the blocking window will continue to be displayed on the tablet computer. After the tablet computer receives a click operation on the control 1511 in the blocking window, it will cancel this call, but will not disconnect the cross-device call connection between the tablet computer and the mobile phone.

[0190] If a complete call (i.e., a photo upload) has not yet been completed through the cross-device call connection, the tablet computer will disconnect the cross-device call connection between the tablet computer and the mobile phone after receiving a click operation on the control 1511 in the blocking window while the blocking window is displayed. This is because, in this scenario, it is usually possible that the user's mistaken operation has caused the cross-device call connection between the tablet computer and the mobile phone to be established and the photo service on the mobile phone to be activated.

[0191] While the photo-taking interface (for example, interface 16 and interface 17 in FIG6 ) is displayed on the mobile phone side, if the user clicks on the control 1511 on the blocking window on the tablet computer, the mobile phone side will close the photo-taking interface and display the interface displayed before the photo-taking interface. When the interface displayed before the photo-taking interface is displayed, whether the status bar of the interface displays the floating control 181 is related to whether the cross-device call connection between the tablet computer and the mobile phone is disconnected. For example, if a click operation on the control 1511 triggers the disconnection of the cross-device call connection between the tablet computer and the mobile phone, the status bar on the mobile phone side will no longer display the floating control 181; if a click operation on the control 1511 triggers the cancellation of this call between the tablet computer and the mobile phone, but the cross-device call connection is not disconnected, the status bar on the mobile phone side will display the floating control 181.

[0192] Of course, while the interface (for example, interface 18 in FIG6 ) is displayed after the mobile phone completes taking the photo and transmits it back, although the blocking window on the tablet computer side is no longer displayed, when the cross-device call connection between the tablet computer and the mobile phone side is interrupted, the floating control 181 displayed in the status bar of interface 18 will also disappear.

[0193] After the mobile phone Magic 5 transmits the photographed photo 171 (as an example of the first object) to the tablet computer PAD V8, the interface diagram in the tablet computer may refer to the interface 19 shown in (a) of FIG. 7 .

[0194] 7 (a) shown in the interface 19, based on the interface 15 shown in FIG5, the blocking window 151 disappears, and a thumbnail 191 of the photo 171 obtained by calling the camera service in the mobile phone magic 5 is displayed in the lower left corner of the screen.

[0195] The user may input a drag gesture from the area where the thumbnail 191 (as an example of identification of the first object) is located to the editing area of ​​the third-party note application on the screen, thereby inserting the photo 171 into the editing area of ​​the third-party note application.

[0196] As mentioned above, the drag gesture can include three consecutive operations: a long press selection operation, a drag operation, and a hand-lifting and release operation; after the tablet detects the long press selection operation on the thumbnail 191, the thumbnail 191 switches the floating control 192; after the tablet detects the drag operation after the long press selection operation, the floating control 192 is displayed along the trajectory of the drag operation, that is, the floating control 192 is displayed following the user's dragging trajectory.

[0197] Referring to FIG. 7( b ), a schematic diagram illustrating the process of a user dragging floating control 192 is shown. In practice, floating control 192 may be displayed in the area where the user's finger touches. A thumbnail of photo 171 is displayed in floating control 192 . The size of the thumbnail displayed in floating control 192 may be smaller than the size of thumbnail 191 . Alternatively, the size of the thumbnail displayed in floating control 192 may be larger than the size of thumbnail 191 . Furthermore, the thumbnail in floating control 192 or thumbnail 191 may include part or all of the content in photo 171 .

[0198] After the tablet computer detects that the thumbnail 191 is long-pressed and selected, the thumbnail 191 is switched to a floating control 192 to prompt the user that the thumbnail 191 has been selected and that subsequent dragging operations can be performed.

[0199] During the dragging process, the floating control 192 is displayed in the area where the contact point of the user's finger is located, which can prompt the user that the object currently dragged is the photo 171 corresponding to the floating control 192.

[0200] After dragging the floating control 192 to the editing area of ​​the third-party note application, the user lifts his finger, triggering the tablet computer to display the interface 20 shown in FIG. 8 .

[0201] 8 , a photo 171 has been inserted into the editing area of ​​the third-party note application.

[0202] This embodiment of the application, using Figures 2 to 8, describes a process for using a tablet to call a mobile phone's camera service to take a photo, and then inserting the resulting photo into the tablet's note-taking application. This process initiates a cross-device call through the tablet's control center, without being limited to a specific application; and the entire process is simple and efficient.

[0203] As another example, based on the interface shown in (a) in Figure 7, the user can close the current note application (which can be recorded as the first application) and reopen another second application with the function of inserting photos. For example, by returning to the system desktop and clicking the icon of the second application, the second application is opened, so that the tablet computer displays the editing window of the second application. The above operation is an example of the fourth operation. Of course, when the tablet computer displays the system desktop and the editing window of the second application, a thumbnail of the photo will be displayed floating on the display screen. This interface is an example of the fourth interface. The user can drag the thumbnail of the photo to the editing area of ​​the editing window of the second application to insert the photo into the editing area of ​​the second application.

[0204] Of course, the system desktop can also be understood as an application. Therefore, the interface shown in (a) in Figure 7 can also be the interface corresponding to when the thumbnails of photos are displayed on the system desktop. Accordingly, the user triggers the electronic device to display the control center by pulling down in the interface corresponding to the system desktop.

[0205] Of course, in actual applications, when calling different services on the same electronic device again or calling services on different electronic devices, a similar approach can be used. However, due to the different time periods and regions, the first, second, and Nth operations will be used to distinguish them. Those skilled in the art can directly and meaninglessly determine the cross-device call process by combining the accompanying drawings and text content. Therefore, we will not explain each operation, each interface, each control, or each window in detail.

[0206] After inserting a photo taken using the phone's camera service into the tablet's note-taking app, the cross-device connection between the tablet and phone remains intact. While the cross-device connection remains intact, the phone's status bar displays the icon for the Smart Connect feature. For details, see floating control 181 displayed in the status bar area of ​​the phone's system desktop, as shown in FIG6(c). The tablet's status bar displays the icon for the Smart Connect feature, as shown in FIG8(c).

[0207] It should be noted that the cross-device call connection between the tablet and the mobile phone can be kept alive for a certain period of time, for example, 1 minute, 3 minutes, 5 minutes or 10 minutes, etc. The specific keep-alive time can be set according to actual conditions.

[0208] The start time of the keep-alive duration can be the time when the cross-device call connection between the tablet computer and the mobile phone was successfully established for the last time; it can also be the time when the camera application corresponding to the photo service in the mobile phone is started; it can also be the time when information (for example, photos taken by taking photos) was last transmitted through the cross-device call connection between the tablet computer and the mobile phone.

[0209] While the cross-device call connection between the tablet and the mobile phone is being kept alive, the user can also use the floating control 141 displayed on the tablet's status bar or the floating control 181 displayed on the mobile phone's status bar to enable the tablet to call the camera service in the mobile phone to take photos again.

[0210] First, let's take the example of calling the camera service in the mobile phone again triggered by a tablet computer.

[0211] Referring to interface 21 shown in (a) of FIG9 , this interface 21 can be interface 20 after inserting photo 171 as shown in FIG8 , or any interface with floating control 141 in the status bar. As an example, if a user determines that photo 171 does not meet their requirements and removes photo 171 from interface 20, interface 20 after deleting photo 171 becomes interface 21. Of course, this interface can also be the system desktop displayed on the tablet computer through a gesture operation. Alternatively, interface 21 can also be the interface of another application on the tablet computer.

[0212] The user clicks the floating control 141 in the interface 21 to view another electronic device currently called and the service called across devices.

[0213] In response to a click on floating control 141, the tablet displays interface 22 shown in FIG9(b). Interface 22 displays a floating window 221 at the top of the screen. Floating window 221 includes a prompt message: "Capture using Magic 5" is possible, and the captured content will be transmitted back to the device. Therefore, floating window 221 serves to inform the user that the electronic device is currently invoking the Magic 5 photography service.

[0214] The floating window 221 also includes a control 2211. When the user clicks the control 2211, the tablet computer can be triggered to call the camera service in the mobile phone Magic 5 again to take a photo.

[0215] As an example, after the tablet detects a click on control 2211, it also needs to activate the camera function on the Magic 5 phone through a cross-device call connection to invoke the Magic 5's camera service. For example, similar to the above embodiment, the tablet sends a call instruction for the camera service to the Magic 5 phone, which can activate the Magic 5's camera application. Accordingly, after the Magic 5's camera application is activated, it can return a message to the tablet indicating that the camera has been activated. Upon receiving the message from the Magic 5 phone indicating that the camera application has been activated, the tablet displays a blocking window.

[0216] The interface of the tablet computer displaying the blocked window may refer to interface 15 shown in FIG. 5 .

[0217] After the phone's camera app is successfully launched, the phone's interface for taking photos can be seen in Figure 6. The interface after the photo taken by the phone is transferred back to the tablet can be seen in Figures 7 and 8. Specifically, the user sequentially follows the interfaces shown in Figures 9, 6, 7, and 8 to call the phone's camera service on the tablet to obtain a photo, transfer the photo back to the tablet, and insert it into the editing area. Of course, the photo transferred back here is different from photo 171.

[0218] As another example, in actual application, after the operation shown in FIG9 (a), the tablet computer can also directly activate the camera function of the mobile phone Magic 5 through a cross-device call connection to call the photo service of the mobile phone Magic 5. There is no need to continue to display the floating window 221 shown in FIG9 (b).

[0219] The process of triggering the tablet computer to re-call the camera service on the mobile phone side through the floating control 141 as shown in Figure 9 is simpler and more efficient. The corresponding operations in Figure 9 can be the tenth operation and the eleventh operation (the two operations can be collectively referred to as the ninth operation). Similarly, the tablet computer can also be triggered to re-call the camera service on the mobile phone through a ninth operation. Window 221 can be used as an example of a first floating window. Control 2211 can be used as an example of a fourth control. The instruction to re-call the camera service can also be recorded as the second instruction, the third instruction, or even the Nth instruction, etc.

[0220] In actual applications, if the tablet computer calls the camera service on the mobile phone, and the user also wants to continue to call other services of the mobile phone through the tablet computer, such as the scanning service; while the tablet computer displays the blocking window, the user first needs to click the control 1511 in the blocking window to interrupt the current calling process and maintain the cross-device calling connection between the tablet computer and the mobile phone, or directly interrupt the cross-device calling connection between the tablet computer and the mobile phone; then, through the control center, re-call the scanning service in the mobile phone, for example, through the operations of Figures 2 and 3 to trigger the tablet computer to re-call the scanning service in the mobile phone. Of course, the object of the operation in Figures 2 and 3 is no longer the camera service, but the scanning service. If the previous cross-device calling connection has been interrupted, then it is necessary to re-establish the cross-device calling connection between the tablet computer and the mobile phone, and then initiate a call to the scanning service through the cross-device calling connection; if the previous cross-device calling connection has not been interrupted, then the call to the scanning service can be initiated through the cross-device calling connection that has been established.

[0221] Of course, a cross-device service can implement one or more functions. For example, the photo service can realize photo taking. In actual applications, it can also realize recording. Accordingly, controls related to recording need to be set in the photo taking interface on the mobile phone side. Similarly, the scanning service can realize one or more functions. For example, the scanning service can realize the function of scanning paper documents to obtain the text in the paper documents. The scanning service can also realize the function of scanning paper documents to obtain the PDF format file corresponding to the paper documents. Accordingly, controls corresponding to each function need to be set in the interface corresponding to the scanning service on the mobile phone side. The scanning service is an example of the second service. The related operations and interfaces will not be explained again. You can refer to the previous description for details.

[0222] As another embodiment of the present application, if the tablet computer calls the camera service on the mobile phone Magic 5, and the user wants to continue to call the cross-device service of the mobile phone Magic 4 through the tablet computer; during the period when the tablet computer displays the blocking window, the cross-device service on another mobile phone Magic 4 cannot be called through the control center. Instead, it is necessary to first click the control 1511 in the blocking window to trigger the electronic device to cancel the call to the camera service of the mobile phone Magic 5, and then call the cross-device service on another mobile phone Magic 4 through the control center; during the period when the tablet computer does not display the blocking window, the cross-device service on another mobile phone Magic 4 can be called through the control center; for example, the operation shown in Figures 2 and 3 triggers the tablet computer to re-call the camera service or scanning service in the mobile phone Magic 4. Magic 4 is an example of a third electronic device. The process of calling the third electronic device refers to the process of calling the second electronic device, and no distinction is made for the name of each interface, each operation, or even each window or each control. In actual application, it is named in the order of first, second, and Nth.

[0223] The following takes the example of a mobile phone's camera service being called again by a tablet computer after being triggered by the mobile phone as an example.

[0224] Referring to FIG10(a), the interface may be the interface 18 shown in FIG6(c). The status bar of the interface 18 includes a floating control 181. Of course, the interface may also be any interface whose status bar includes a floating control 181. Of course, the interface may also be any interface whose status bar displays a floating control 181.

[0225] As an example, the interface may also be an interface of a calendar application after the user clicks a calendar icon on the system desktop, or may be an interface of a memo application after the user clicks a memo icon.

[0226] The user clicks (as an example of the twenty-first operation) the floating control 181 (as an example of the third floating control) in the interface 18 to check which electronic device has called the photo taking service of the electronic device (mobile phone Magic 5).

[0227] In response to a click on floating control 181, the mobile phone displays interface 23 shown in FIG10(b). Interface 23 displays a floating window 231 (an example of a fifth window) at the top of the screen. Floating window 231 includes a prompt message: "The content of this electronic device's "photograph" will be transferred to "pad V8"." Thus, floating window 231 serves to inform the user that the electronic device's photo service has been invoked by tablet computer PAD V8, and the resulting photo will be transferred to tablet computer PAD V8.

[0228] The floating window 231 also includes a control 2311. When the user clicks (as an example of the twenty-second operation) the control 2311 (as an example of the tenth control), the tablet computer can be triggered to call the camera service in the mobile phone Magic 5 again to take a photo.

[0229] As an example, after the mobile phone detects a click operation on control 2311, it activates the camera application in the electronic device. After the camera application in the mobile phone is activated, the mobile phone can send a message to the tablet computer indicating that the camera has been activated. At the same time, the mobile phone displays a photo service interface (also referred to as the thirteenth interface), which can refer to interface 16 shown in (a) of Figure 6.

[0230] As another example, when the mobile phone Magic 5 displays the interface shown in Figure 10 (a), if a click operation is received on the floating control 181, the mobile phone directly opens the camera application in the electronic device. There is no need to display Figure 10 (b) to open the camera application in the electronic device through the floating window 231 shown in Figure 10 (b).

[0231] After receiving the information from the mobile phone indicating that the camera application has been started, the tablet computer displays a blocking window on the interface currently displayed on the tablet computer. The blocking window can be referred to as 151 shown in FIG. 5 .

[0232] After the tablet displays the blocking window 151 and the phone displays the photo service interface 16, the tablet has successfully invoked the photo service on the phone. The subsequent user interface for taking photos on the phone can be seen in FIG6 ; the interface after the photos taken on the phone are transferred back to the tablet can be seen in FIG7 and FIG8 .

[0233] The process of triggering the tablet computer to call the camera service on the mobile phone side again through the floating control 181 as shown in FIG10 is also simple and efficient.

[0234] The above embodiments all use a tablet computer, Pad V8, to call the camera service on a mobile phone, Magic 5, as an example. In actual applications, the tablet computer model is not limited to the "Pad V8" in the above example, nor is the mobile phone model limited to the "Magic 5" in the above example. The camera service is only one example of a cross-device service. Of course, a tablet computer calling a mobile phone is only one example of one electronic device calling another electronic device's cross-device service. In actual applications, any electronic device can call any cross-device service on another electronic device.

[0235] The following embodiments of the present application are described using a computer (eg, a laptop) calling a camera service in a mobile phone as an example. This example no longer uses inserting a received photo into an editing interface provided by any application as an example.

[0236] 11 and 12 , which are schematic diagrams of interfaces for the cross-device calling service provided in an embodiment of the present application.

[0237] 11( a ) shows an interface 24 displayed on a computer, which includes a user management window 241. The name of the user management window 241 is not limited, and may be called the Honor Super Workstation.

[0238] In a specific implementation, when the computer displays any interface, the user can double-click (as an example of a first operation) the control 242 (as an example of a first icon) in the taskbar to trigger the electronic device to display the user management window 241. In actual applications, the double-clicking operation is only an example, and the control 242 in the taskbar is also only an example of an entry to the user management window 241. In actual applications, the user management window 241 can also be entered through other entrances.

[0239] Multiple tabs are displayed in the user management window 241: a trust ring tab 2411, a note tab, a glory document tab, and a global favorites tab.

[0240] The default selected tab in the user management window 241 may be the first tab in the column of tabs. The right side of the user management window 241 displays content corresponding to the selected tab.

[0241] As an example, when the trust ring tab 2411 is selected, the right side of the user management window 241 displays content related to the trust ring, that is, the smart interconnection function provided by the embodiment of the present application.

[0242] The smart interconnection function corresponding to the trust ring may include multiple cross-device services, such as screen sharing, service sharing, keyboard and mouse sharing, remote control, network sharing, etc. Of course, the smart interconnection function also includes the service call in the embodiment of the present application.

[0243] When the trust ring tab 2411 is selected, the right side of the user management window 241 displays electronic devices under the same account as the laptop, for example, the mobile phone Magic 5. Of course, the electronic device itself also needs to be displayed.

[0244] As shown in the figure, the icon of the electronic device is displayed, and “this device” is displayed in the icon, so as to indicate that the icon corresponds to the electronic device through the characters “this device”.

[0245] As another example, the type and model of the electronic device may be displayed in the icon of the electronic device according to the above tablet computer example. For example, the icon may display: magicbook 14.

[0246] The embodiment of the present application does not limit the specific display method of the icon of the electronic device.

[0247] In actual application, the icon 2412 of the electronic device is highlighted in the user management window 241. The icon 2412 of the electronic device can be displayed on the inner ring line.

[0248] Icons of electronic devices that are under the same account as the current electronic device and that do not currently have a communication connection with the current electronic device can be displayed in grayscale. For example, the icon of the tablet computer PAD V8 can be displayed in grayscale. Furthermore, icons of electronic devices that are under the same account as the current electronic device and that do not currently have a communication connection with the current electronic device can be displayed on a different circular line than the icon of the current electronic device. For example, they can be displayed on the outer circular line.

[0249] The service tabs of electronic devices that are under the same account and currently on the same network as this electronic device can be directly displayed. For example, the service tab 2413 of the Magic 5 mobile phone is displayed. The service tab 2413 shows the services that the Magic 5 mobile phone can provide: screen sharing, scanning service, and photo service. Of course, the name of the mobile phone: Magic 5 and the operation instructions: click / drag the service to complete the flow can also be displayed below the service tab. Since the Magic 5 mobile phone and this electronic device are on the same network, the service tab of the Magic 5 mobile phone can be displayed on the same inner circle as the laptop.

[0250] Through this display method, users can quickly identify which device is the current electronic device, which device is offline, and which cross-device service can be used on which device. The display method is simple and easy to understand. On the other hand, the user can also be prompted by operating instructions on how to call cross-device services.

[0251] The display of various types of electronic devices in this interface is for example only and does not constitute any limitation.

[0252] When a user wants to use the camera service in the mobile phone Magic 5 through the electronic device, the user can click the control 2414 in the service tab 2413, or the user can input a drag gesture on the screen from the area where the control 2414 is located to the area where the electronic device icon 2412 is located. The control 2414 corresponds to the camera service in the mobile phone Magic 5.

[0253] In the embodiment of the present application, a click gesture is used as an example. After the user clicks control 2414, the laptop computer establishes a cross-device call connection with the mobile phone Magic 5 in response to the click operation on control 2414, and sends a call instruction to the mobile phone Magic 5 based on the cross-device call connection. The call instruction can start the camera application in the mobile phone Magic 5. Accordingly, after the camera application of the mobile phone Magic 5 is started, it can return information that the camera has been started to the laptop computer.

[0254] After receiving the camera activation information sent by the mobile phone Magic 5, the laptop computer displays the interface 25 shown in (b) of FIG11 .

[0255] The user management window 241 is displayed in both the interface 25 shown in FIG11(b) and the interface 24 shown in FIG11(a). However, the display content of the user management window 241 is changed.

[0256] As shown in (b) of Figure 11, the service tab of the mobile phone Magic 5 is updated to the icon 2522 of the mobile phone Magic 5. This icon 2522 can also be displayed in grayscale. The icons 2522 of electronic devices on the same network as the device are displayed on the inner ring line where the device is located; the icons 2415 of electronic devices not on the same network as the device are displayed on the outer ring line. In this way, you can quickly distinguish which electronic device is on the same network as the device and which electronic device is not on the same network as the device.

[0257] A control 2521 is displayed in the area near the electronic device icon 2412 , and the control 2521 indicates that the electronic device has successfully called the cross-device service.

[0258] In the interface 25 shown in (b) of FIG11 , a service window 251 (as an example of a first window) is also displayed. The service window 251 includes a prompt message: Use “magic 5” to take a photo. The service window 251 also includes a control 2511 .

[0259] Service window 251 notifies the user that the electronic device has successfully invoked the camera service provided by the camera application of another electronic device. It also notifies the user that the electronic device is currently invoking the camera service of another electronic device. Service window 251 includes controls 2511 and 2522. Control 2511 is used to stop the current camera service or to invoke a cross-device connection. Control 2522 is used to close service window 251.

[0260] As an example, after detecting a click on control 2511, the laptop computer may stop calling the camera service on the Magic 5 mobile phone, but maintain the cross-device call connection between the laptop computer and the Magic 5 mobile phone. The user can re-call the camera service or other cross-device services on the Magic 5 mobile phone through the cross-device call connection between the laptop computer and the Magic 5 mobile phone. If the cross-device call connection is not interrupted, the re-calling of the camera service on the Magic 5 mobile phone can be described in the subsequent Figures 13 and 14.

[0261] As another example, after the laptop detects a click operation on the control 2511, the cross-device call connection between the laptop and the mobile phone Magic5 can be interrupted.

[0262] The specific implementation method of the embodiment of this application is not limited.

[0263] As yet another example, after the laptop detects a click operation on the control 2512 , the service window may be closed.

[0264] As mentioned above, the camera app on the Magic 5 is already launched. After launching the camera app on the Magic 5, the Magic 5 displays the interface corresponding to the cross-device camera service. Users can take photos on the Magic 5 and transfer the photos to the laptop.

[0265] Among them, the interface on the side of the magic 5 mobile phone and the process of taking and transmitting photos can be shown in Figure 6 and related descriptions, and the process will not be described in detail.

[0266] After the mobile phone Magic 5 transmits the photo 171 taken to the tablet computer PAD V8, the interface diagram in the tablet computer can refer to the interface 26 shown in (a) of FIG. 12 .

[0267] The service window 251 in the laptop disappears, and a thumbnail 261 of the photo 171 obtained by calling the camera service in the magic 5 mobile phone is displayed in the lower right corner of the laptop screen.

[0268] As an example, there is an editing window of an application in which pictures can be inserted in the current interface 26 , and the user can insert a photo 171 in the editing window through a drag gesture. The detailed process can be referred to the dragging process shown in FIG. 7 and FIG. 8 .

[0269] As another example, there is no editing window of an application for inserting a picture in the current interface 26, and the thumbnail 261 of the photo 171 is displayed for a certain period of time (for example, 10 seconds, 30 seconds, 1 minute, 3 minutes, etc.) and then disappears. Of course, the photo 171 has been stored in the laptop. For example, it is stored in the laptop's disk, and the user can access the photo 171 stored in the laptop's disk through the gallery application. When accessing the photo 171 stored in the laptop's disk, the user can edit the photo 171 (for example, cut, doodle, etc.), and can also share the photo to other applications (for example, document editing applications, instant messaging applications, printing applications, etc.).

[0270] 12( b ), after the thumbnail 261 of the photo 171 disappears or is dragged to another editing interface, a service window 271 is displayed in the lower right corner of the notebook computer.

[0271] As another example, while the photo thumbnail 261 is displayed on the interface 26, the laptop computer may also display a service window 271 (as an example of a second window). That is, although not shown in the figure, the thumbnail 261 of the returned object and the service window 271 can be displayed on the interface at the same time. In a specific implementation, different display positions can be set so that the two displays do not affect each other.

[0272] The service window 271 includes prompt information: photo service, connected to "magic 5". This prompt information is used to indicate that the user has established a cross-device call connection with the mobile phone magic 5 and called the photo service of the mobile phone magic 5.

[0273] Service window 271 also includes controls 2711, 2712 (as an example of the seventh control), and 2713. Control 2711 is used to close the current service window 271. Control 2712 is used to call the camera service in the mobile phone Magic 5 again to take a photo. Control 2713 is used to disconnect the cross-device call connection between the laptop and the mobile phone Magic 5.

[0274] Of course, if the photo thumbnail 261 is displayed and the photo service in the mobile phone magic 5 is called again to take a photo, the thumbnail of the photo taken again can be superimposed on or below the thumbnail 261, which is no longer shown in the figure in this application.

[0275] In a specific implementation, if at least two photos are stacked together, a drag gesture with the area where the stacked photos are located as the starting point can trigger the electronic device to drag only the top photo; of course, the drag gesture with the area where the stacked photos are located as the starting point can also be set to trigger the electronic device to drag all stacked photos.

[0276] As another example, if at least two photos are stacked together, the user can trigger the electronic device to tile and display multiple photos by clicking (or double-clicking); a drag gesture with the area where any tiled photo is located as the starting point can trigger the electronic device to drag the photo. Of course, when the electronic device tiled multiple photos, the user can also trigger the electronic device to select the tiled photos in the circled area through corresponding operations (for example, by drawing a circle). After selecting all or part of the tiled photos, a drag gesture with the area where the selected tiled photos are located as the starting point can trigger the electronic device to drag the selected tiled photos. Of course, other operations can also be used to trigger the selection of all tiled photos at once.

[0277] In actual applications, if the electronic device receives multiple returned photos, the multiple returned photos can also be directly tiled and displayed.

[0278] In addition, you can also set it to display only one photo at a time. When a photo is received, the thumbnail of the newly received photo replaces the thumbnail of the previously displayed photo.

[0279] In actual use, if a laptop computer calls the camera service on a mobile phone, and the user also wants to continue to call other services on the mobile phone through the laptop computer, such as the scanning service, the user can cancel the current camera service call by clicking control 2511 in window 251, but without interrupting the cross-device call connection between the laptop computer and the mobile phone. Then, by double-clicking control 242 in the taskbar, the laptop computer can re-call the mobile phone's scanning service in the manner shown in FIG11. Alternatively, the user can interrupt the cross-device call connection between the laptop computer and the mobile phone by clicking control 2713 in window 271, and then, by double-clicking control 242 in the taskbar, the laptop computer can re-call the mobile phone's scanning service in the manner shown in FIG11. Of course, the operation in FIG11 is no longer directed to the camera service, but to the scanning service. If the previous cross-device call connection has been interrupted, then the cross-device call connection between the laptop computer and the mobile phone needs to be re-established, and then the scanning service call can be initiated through the cross-device call connection. If the previous cross-device call connection has not been interrupted, the scanning service call can be initiated through the already established cross-device call connection.

[0280] As another embodiment of the present application, if the laptop computer calls the photo-taking service on the mobile phone Magic 5, the user also wants to continue to call the cross-device service of the mobile phone Magic 4 through the laptop computer; regardless of whether the laptop computer is using the photo-taking service in the mobile phone Magic 5, the user can continue to call the cross-device service on another mobile phone Magic 4 directly through the control 242 in the taskbar.

[0281] According to the above content, it can be understood that the laptop computer may simultaneously receive two materials of the same type or two materials of different types transmitted back by two mobile phones.

[0282] In this case, the materials received by each mobile phone can be displayed in two areas respectively according to the different return devices; the method of displaying materials in each area refers to the method of displaying multiple photos in the above embodiment; the materials displayed in each area may be different types of materials.

[0283] Different types of materials can also be displayed in different areas according to the different types of materials. The way of displaying materials in each area refers to the way of displaying multiple photos in the above embodiment; the materials displayed in each area may be materials of the same type from different mobile phones.

[0284] Of course, the materials sent back by multiple devices can also be displayed in one area. The method of displaying the materials in the area refers to the method of displaying multiple photos in the above embodiment.

[0285] The present embodiment, using Figures 11 and 12, describes a process for using a laptop to call a mobile phone's camera service to take a photo, and then transferring the resulting photo to the laptop. This process triggers the display of a user management window via a control in the laptop's taskbar. Cross-device calls initiated through the user management window are not limited to specific applications, and the entire process is simple and efficient.

[0286] As shown in (b) of FIG. 12 , the service window 271 displayed on the laptop computer can trigger the calling of the camera service in the mobile phone again to take a photo and transmit it back.

[0287] Of course, in actual applications, the cross-device call connection between the laptop and the mobile phone can be kept alive for a certain period of time. During this period, the laptop displays a service window 271. After the cross-device call connection between the laptop and the mobile phone ends or is interrupted, the service window 271 disappears. Therefore, the service window also serves to remind the user that the cross-device call connection between the laptop and the mobile phone is valid. For details about the keep-alive period of the cross-device call connection between the laptop and the mobile phone, please refer to the description of the above embodiment and will not be repeated here.

[0288] The following description will be made by taking the re-calling of the camera service in the mobile phone triggered from the service window 271 of the notebook computer as an example.

[0289] 13(a), the user clicks control 2712 in service window 271 to re-invoke the camera service on the mobile phone Magic 5. In response to the click on control 2712 in service window 271, the laptop sends a call instruction for the camera service to the mobile phone Magic 5, which can activate the camera application on the mobile phone Magic 5. Correspondingly, after the camera application on the mobile phone Magic 5 is activated, it can return a message to the laptop indicating that the camera has been activated.

[0290] 13(b), after receiving the information from the mobile phone Magic 5 indicating that the camera application has been activated, the laptop computer closes the service window 271 and displays the service window 251. The service window 251 shown in FIG13(b) is the same as the service window 251 shown in FIG11(b).

[0291] After the camera application in the mobile phone is successfully started, the interface of the photo-taking process on the mobile phone side can be shown in Figure 6; the interface after the photos taken on the mobile phone side are transferred back to the tablet side can be shown in Figures 7 and 8.

[0292] It can be understood that the process of triggering the laptop to call the camera service on the mobile phone side again through the service window 271 as shown in Figure 13 is simpler and more efficient.

[0293] In a specific implementation, service window 271 can be closed. For example, control 2711 in service window 271 shown in FIG12 is used to close the service window. When the service window is closed and the cross-device call connection between the laptop and the mobile phone is maintained, the embodiment of the present application can also implement another method for the laptop to call the camera service on the mobile phone again.

[0294] Referring to (a) in FIG14 , the user triggers the electronic device to display a sidebar 281 on the right side of the screen by clicking on the control 242 of the taskbar. The sidebar 281 displays recent messages, recent documents, recent clipboards, etc. Since the display of the taskbar is independent of the currently displayed interface, in actual applications, the interface shown in (a) in FIG14 can be any interface. This interface can be recorded as the ninth interface. Of course, the displayed sidebar is only an example. In actual applications, a single click operation on the control 242 (as an example of the sixteenth operation) can trigger the display of the service window 2811.

[0295] Among them, service window 2811 (as an example of the third window) is the latest message. The content of service window 2811 is the same as that of service window 271. Therefore, the user can also trigger the camera service in the mobile phone again through the service window 2811 in the sidebar.

[0296] As an example, the user clicks (as an example of the seventeenth operation) control 28111 (as an example of the eighth control) in service window 2811 to again invoke the camera service in mobile phone Magic 5. In response to the click operation on control 28111 in service window 2811, the laptop computer sends a call instruction for the camera service to mobile phone Magic 5, which can activate the camera application of mobile phone Magic 5; accordingly, after the camera application of mobile phone Magic 5 is activated, it can return information that the camera has been activated to the laptop computer.

[0297] 14(b), after receiving the information from the mobile phone Magic 5 indicating that the camera application has been launched, the laptop computer closes the sidebar 281 and displays the service window 251 (as an example of the fourth window). The service window 251 shown in FIG14(b) is the same as the service window 251 shown in FIG11(b).

[0298] After the camera application in the mobile phone is successfully started, the interface of the photo-taking process on the mobile phone side can be shown in Figure 6; the interface after the photos taken on the mobile phone side are transferred back to the tablet side can be shown in Figures 7 and 8.

[0299] It can be understood that the process of triggering the laptop to call the camera service on the mobile phone side again through the service window 2811 in the sidebar as shown in Figure 14 is also relatively simple and efficient.

[0300] Similarly, the camera service in the mobile phone triggered by the mobile phone can be called again by the laptop computer. The process of calling the camera service in the mobile phone triggered by the mobile phone again by the laptop computer can be shown in Figures 10, 6 and 12.

[0301] Of course, since the mobile phone is called by the laptop computer Magic Book 14 at this time, the content displayed in the floating window 231 is: service sharing, photo service, and the content of "photographing" of this machine will be transmitted to "Magic Book 14".

[0302] The above embodiment only takes calling a photo service to obtain photos as an example. In actual applications, other forms of objects can also be received through other cross-device services. For example, the object received by the caller can also be documents, text, and other content.

[0303] When the received object is a picture, what is displayed on the screen is: a thumbnail of the received picture, and the thumbnail can be displayed in vertical or horizontal direction.

[0304] For example, referring to (a) in FIG. 15 , when the aspect ratio is greater than 1, the display is vertical; and referring to (b) in FIG. 15 , when the aspect ratio is less than 1, the display is horizontal.

[0305] 15 (c), when the received object is a document (eg, a document generated by a table extracted by table extraction), the icon, name, date, and size of the document are displayed;

[0306] 15( d ), when the received object is text (eg, text content extracted by scanning or text recognition), part or all of the content in the text is displayed.

[0307] Of course, the displayed content can also be understood as the identifier of the object, and the identifiers of different types of objects may be different. In addition, after the caller receives the object transmitted by the callee, the object is displayed in the lower left or lower right corner of the screen. If the object is not dragged to the editing interface by the user or does not disappear, the user obtains another object on the callee side and transmits the object to the caller. The two objects will be displayed in the lower left or lower right corner of the caller's screen. The two objects can be displayed stacked, for example, according to the order in which the caller receives the objects, the object received first is placed at the bottom and the object received later is placed at the top.

[0308] As another example, when the receiving system is Android, the object can be displayed in the lower left corner of the screen; when the receiving system is Windows, the object can be displayed in the lower right corner of the screen. Of course, for other systems, the received object can also be displayed in the lower left or lower right corner of the screen, depending on the situation, or can be displayed in other locations on the screen. This embodiment of the present application is not limited to this.

[0309] In the embodiment of the present application, multiple interfaces are provided, and there are some windows or controls in the interfaces for triggering the execution of the next step or displaying the next interface. The content displayed in these windows or controls is only an example.

[0310] In addition, other content in the interface that is not related to these windows or controls is only used as an example and does not mean that these other content must exist in the interface.

[0311] It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0312] An embodiment of the present application further provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the steps in the above-mentioned method embodiments can be implemented.

[0313] An embodiment of the present application further provides a computer program product. When the computer program product is run on an electronic device, the electronic device can implement the steps in the above-mentioned various method embodiments.

[0314] An embodiment of the present application also provides a system for calling a service across devices. The system for calling a service across devices includes a first electronic device and a second electronic device. The first electronic device and the second electronic device can implement the above-mentioned cross-device service calling method.

[0315] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, which can be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and when the computer program is executed by the processor, it can implement the steps of the above-mentioned various method embodiments. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may include at least: any entity or device capable of carrying the computer program code to the first device, a recording medium, a computer memory, a read-only memory (ROM), a random access memory (RAM), an electric carrier signal, a telecommunication signal and a software distribution medium. For example, a USB flash drive, a mobile hard disk, a magnetic disk or an optical disk. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electric carrier signals and telecommunication signals.

[0316] The present application also provides a chip system, comprising a processor coupled to a memory, the processor executing a computer program stored in the memory to implement the steps of any method embodiment of the present application. The chip system can be a single chip or a chip module composed of multiple chips.

[0317] In the above embodiments, the description of each embodiment has its own focus. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant description of other embodiments.

[0318] Those skilled in the art will appreciate that the units and method steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0319] The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present application, and should all be included in the scope of protection of the present application.

Claims

1. A method for calling a service across devices, characterized in that: include: The first electronic device displays a first interface, where the first interface is an interface of a first application; After receiving the first operation, the first electronic device displays a second interface, where the second interface includes a first control, and the first control is related to a first service of the second electronic device; After receiving the second operation on the first control, the first electronic device sends a first instruction to the second electronic device; After receiving the first instruction, the second electronic device displays a third interface, the third interface includes a second control, and the third interface is an interface corresponding to the first service of the second electronic device; After receiving the third operation acting on the second control, the second electronic device sends the first object obtained through the first service to the first electronic device; After receiving the first object, the first electronic device displays an identification of the first object; After receiving the fourth operation, the first electronic device displays a fourth interface, where the fourth interface includes an editing window of the second application and an identifier of the first object; After receiving the fifth operation acting on the area where the identifier of the first object is located, the first electronic device inserts the first object into the editing area of ​​the editing window of the second application.

2. The method according to claim 1, characterized in that The first operation includes a sixth operation and a seventh operation, the sixth operation is a sliding operation starting from the top of the screen of the first electronic device, and after receiving the first operation, the first electronic device displays a second interface, including: After receiving the sixth operation, the first electronic device displays a smart interconnection card; After receiving the seventh operation, the first electronic device displays the second interface, and the seventh operation is performed in the area where the smart interconnection card is located.

3. The method according to claim 1, characterized in that The first interface includes a task bar, the task bar includes a first icon, and the first operation is an operation performed on the first icon.

4. The method according to claim 2 or 3, characterized in that The second operation is a click operation on the first control; Alternatively, the second interface includes an icon of the first electronic device, and the second operation is a drag operation with the area where the first control is located as a starting point and the area where the icon of the first electronic device is located as an end point.

5. The method according to claim 4, characterized in that The second operation is a drag operation with the area where the first control is located as a starting point and the area where the icon of the first electronic device is located as an end point, and the method further includes: During the dragging process corresponding to the second operation, a first floating control is displayed at the contact point of the second operation, wherein the first floating control includes an icon of the first service and / or text information of the first service, and the first floating control is used to prompt the user that the first floating control currently being dragged is the first service; After the second operation is completed, the icon of the first service and / or text information of the first service is displayed around the icon of the first electronic device.

6. The method according to claim 2, characterized in that After the first electronic device receives the second operation acting on the first control and before the first electronic device displays the identifier of the first object, the method further includes: The first electronic device displays a fifth interface, which includes: a second floating control and a blocking window, the second floating control includes a smart interconnection icon and / or a first text message, and the blocking window is used to prompt the user that the first electronic device is calling the first service of the second electronic device.

7. The method according to claim 6, characterized in that The first electronic device displays the identification of the first object including: The first electronic device cancels display of the blocking window on the fifth interface and displays the identifier of the first object on the fifth interface.

8. The method according to claim 7, characterized in that The first interface includes an editing window of a first application, and the fifth interface also includes an editing window of the first application; After the first electronic device displays the identifier of the first object on the fifth interface, the method further includes: The first electronic device receives an eighth operation, where the eighth operation is a drag operation starting from the area where the identifier of the first object is located and ending at the editing area of ​​the editing window of the first application; In response to the eighth operation, the first electronic device inserts the first object in an editing area of ​​an editing window of the first application.

9. The method according to claim 1, characterized in that The fifth operation is a drag operation starting from the area where the identifier of the first object is located and ending at the editing area of ​​the editing window of the second application.

10. The method according to claim 7, characterized in that After the first electronic device displays the identifier of the first object on the fifth interface, the method further includes: After receiving a ninth operation on the second floating control of the fifth interface, the first electronic device sends a second instruction to the second electronic device; After receiving the second instruction, the second electronic device displays a sixth interface, the sixth interface includes a third control, and the sixth interface is an interface corresponding to the first service of the second electronic device; After receiving a ninth operation on the third control, the second electronic device sends a second object obtained through the first service to the first electronic device; After receiving the second object, the first electronic device displays an identifier of the second object.

11. The method according to claim 10, characterized in that When the first electronic device displays multiple identifiers of multiple objects received from the first electronic device, the multiple identifiers of the multiple objects are displayed in an overlapping or tiled manner; or, the identifier of the most recently received object is displayed and the identifiers of the objects received in the past are canceled.

12. The method according to claim 10, characterized in that The ninth operation includes a tenth operation and an eleventh operation, and after receiving the ninth operation acting on the second floating control of the fifth interface, the first electronic device sends a second instruction to the second electronic device, including: After receiving the tenth operation on the second floating control of the fifth interface, the first electronic device displays a first floating window, wherein the first floating window includes a fourth control, and the fourth control is related to the first service of the second electronic device; After receiving the eleventh operation acting on the fourth control, the first electronic device sends the second instruction to the second electronic device.

13. The method according to claim 1, characterized in that After the first electronic device displays the identifier of the first object, the method further includes: After receiving the twelfth operation, the first electronic device displays a seventh interface, where the seventh interface includes a fifth control, and the fifth control is related to the second service of the second electronic device; After receiving the thirteenth operation acting on the fifth control, the first electronic device sends a third instruction to the second electronic device, where the third instruction is used to call the second service of the second electronic device to obtain a third object.

14. The method according to claim 1, wherein: After the first electronic device displays the identifier of the first object, the method further includes: After receiving the fourteenth operation, the first electronic device displays an eighth interface, where the eighth interface includes a sixth control, and the sixth control is related to the first service of the third electronic device; After receiving the fourteenth operation acting on the sixth control, the first electronic device sends a fourth instruction to the third electronic device, where the fourth instruction is used to call the first service of the third electronic device to obtain a fourth object.

15. The method according to claim 4, characterized in that The second operation is a click operation on the first control. After the first electronic device receives the second operation on the first control, before the first electronic device displays the identifier of the first object, the method further includes: The first electronic device displays a first window, where the first window is used to prompt a user that the first electronic device is calling a first service of the second electronic device.

16. The method according to claim 15, characterized in that Before the first electronic device displays the identifier of the first object, the method further includes: The first electronic device cancels display of the first window.

17. The method according to claim 16, characterized in that After the first electronic device displays the identifier of the first object for a first duration, the method further includes: The first electronic device cancels display of the identification of the first object.

18. The method according to any one of claims 15 to 17, characterized in that After the first electronic device cancels display of the first window, the method further includes: The first electronic device displays a second window, wherein the second window includes a seventh control; After the first electronic device receives the fifteenth operation acting on the seventh control, the first electronic device cancels display of the second window; After the first electronic device cancels display of the second window, it displays the first window.

19. The method according to any one of claims 15 to 18, characterized in that After the first electronic device displays the identifier of the first object, the method further includes: The first electronic device displays a ninth interface, where the ninth interface is any interface including a task bar, and the task bar includes a first icon; After the first electronic device receives a sixteenth operation acting on the first icon, the third window is displayed, the sixteenth operation is different from the first operation, the third window includes an eighth control, and the eighth control is related to the first service of the second electronic device; After receiving the seventeenth operation on the eighth control, the first electronic device cancels display of the third window, displays the fourth window, and sends a fifth instruction to the second electronic device, wherein the fifth instruction is used to call The fourth window is used to prompt the user that the first electronic device is calling the first service of the second electronic device.

20. The method of claim 1, wherein: The third operation includes an eighteenth operation and a nineteenth operation; after the second electronic device receives the third operation acting on the second control, the second electronic device sends the first object obtained through the first service to the first electronic device, including: After receiving the eighteenth operation acting on the second control, the second electronic device displays a tenth interface including the first object and the ninth control; After receiving the nineteenth operation acting on the ninth control, the second electronic device sends the first object to the first electronic device.

21. The method of claim 20, wherein: After the second electronic device receives the nineteenth operation acting on the ninth control, the method further includes: The second electronic device displays an eleventh interface, a status bar of the eleventh interface displays a third floating control, and the eleventh interface is a system desktop or an interface displayed by the second electronic device before the third interface is displayed; After the second electronic device receives the twentieth operation on the third floating control, the second electronic device displays a twelfth interface.

22. The method according to claim 21, characterized in that The twentieth operation includes a twenty-first operation and a twenty-second operation. After the second electronic device receives the twentieth operation acting on the third floating control, the second electronic device displays a twelfth interface, including: After receiving the twenty-first operation on the third floating control, the second electronic device displays a fifth window, wherein the fifth window includes a tenth control; the tenth control is related to the first service of the second electronic device; After receiving the twenty-second operation on the tenth control, the second electronic device displays a thirteenth interface, where the thirteenth interface is used to obtain the object through the first service of the second electronic device.

23. A system for calling services across devices, characterized in that: include: A first electronic device and a second electronic device, wherein the first electronic device and the second electronic device are configured to implement the method according to any one of claims 1 to 22.

24. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by one or more processors, the method according to any one of claims 1 to 22 is implemented.

Images