A method, electronic device and system for calling capabilities of other devices

Abstract

The present application provides a method, electronic device and system for calling the capabilities of other devices, the method comprising: a source device requests the capability information of a destination device; the destination device sends the capability information to the source device; when the source device detects a first operation of the user, the source device sends a first content and a first request information to the destination device, the first request information is used to request the destination device to use a first function to process the first content; the destination device uses the first function to process the first content according to the first request information and sends the processing result of the first content to the source device; the source device prompts the user with the processing result. In the embodiment of the present application, the user can use the function of another device on one device, which improves the intelligence of the electronic device, thereby helping to improve the user experience.

Description

[0001] This application claims the Chinese patent application filed with the China Patent Office on August 13, 2020, with application number 202010814247.2, and application name “A method, electronic device and system for obtaining a verification code”, the Chinese patent application filed with the China Patent Office on November 9, 2020, with application number 202011240756.5, and application name “A method, electronic device and system for text input”, the Chinese patent application filed with the China Patent Office on December 22, 2020, with application number 202011527018.9, and application name “A method, electronic device and system for calling the capabilities of other devices”, and the Chinese patent application filed with the China Patent Office on December 22, 2020. The present application claims priority over the Chinese patent application filed on December 22, 2020, with application number 202011527007.0 and application name “A method, electronic device and system for utilizing authorization of other devices”, the Chinese patent application filed on December 22, 2020, with application number 202011526935.5 and application name “A method, electronic device and system for calling the capabilities of other devices”, and the Chinese patent application filed on December 22, 2020, with application number 202011529621.0 and application name “A method, electronic device and system for editing text”, all of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of terminals, and more particularly, to a method, electronic device, and system for invoking capabilities of other devices. Background Art

[0003] Users now own more and more devices, and their interoperability is increasing. Technologies like screen projection and multi-screen interaction are constantly emerging. However, existing inter-device interaction technologies are mostly limited to interface integration and file transfer. Often, users may need to complete difficult tasks on a single device, which can be inconvenient due to the limited capabilities of a single device. Summary of the Invention

[0004] The present application provides a method, electronic device, and system for invoking the capabilities of other devices, so that users can use the functions of another device on one device, thereby improving the intelligence of the electronic device and thus helping to improve the user experience.

[0005] In a first aspect, a system is provided, which includes a first electronic device and a second electronic device, wherein the first electronic device is used to request capability information of the second electronic device; the second electronic device is used to send the capability information to the first electronic device, the capability information including one or more functions, the one or more functions including a first function; the first electronic device is also used to send first content and first request information to the second electronic device when detecting a first operation of the user, the first request information being used to request the second electronic device to process the first content using the first function; the second electronic device is also used to process the first content using the first function according to the first request information and send the processing result of the first content to the first electronic device; the first electronic device is also used to prompt the user of the processing result.

[0006] In the embodiment of the present application, a user can use the functions of a second electronic device on a first electronic device, thereby expanding the capability boundary of the first electronic device, thereby conveniently and efficiently completing tasks that are more difficult for the first electronic device, and helping to improve the user experience.

[0007] In some possible implementations, the interface of the second electronic device may not change during the process from when the second electronic device receives the first content and the first request information to when the second electronic device sends the processing result of the first content to the first electronic device.

[0008] In combination with the first aspect, in certain implementations of the first aspect, the first electronic device is specifically used to: display a function list including the first function when detecting a user selecting the first content; and send the first content and the first request information to the second electronic device when detecting a user selecting the first function.

[0009] In an embodiment of the present application, when the first electronic device detects that the user selects the first content, it can display a function list, which includes the first function of the second electronic device, so that the user can use the first function to process the first content, thereby helping to improve the user experience.

[0010] In combination with the first aspect, in some implementations of the first aspect, the first electronic device is specifically configured to: display the function list according to a type of the first content.

[0011] In the embodiment of the present application, the first electronic device can display the function list according to the type of the first content, so as to avoid the trouble caused to the user by too many functions in the function list, thereby helping to improve the user experience.

[0012] In some possible implementations, the first electronic device is specifically configured to: display the function list when detecting an operation of the user selecting the first content and detecting an operation of the user clicking the right button of the mouse.

[0013] In some possible implementations, the type of the first content is text, and the functions in the function list may include word retrieval and translation. The type of the first content is image, and the functions in the function list may include object recognition and shopping.

[0014] In combination with the first aspect, in certain implementations of the first aspect, the first electronic device is specifically used to: in response to receiving the capability information, display a function list, the function list including the one or more functions; in response to detecting the user's operation of selecting the first function from the one or more functions, start detecting the content selected by the user; in response to detecting the user's operation of selecting the first content, send the first content and the first request information to the second electronic device.

[0015] In an embodiment of the present application, after receiving capability information sent by a second electronic device, a first electronic device may display a function list that may display one or more functions of the second electronic device. After selecting the first function, the user may select the content to be processed, thereby facilitating the user to process the first content using the first function and improving the user experience.

[0016] In combination with the first aspect, in certain implementations of the first aspect, the first electronic device is specifically used to: in response to detecting that the user selects the first content and no user selection of other content is detected within a preset time period from the user selecting the first content, send the first content and the first request information to the second electronic device.

[0017] In an embodiment of the present application, the first electronic device can send the first content and the first request information to the second electronic device when it detects that the user selects the first content and does not detect the user selecting other content within a preset time period. This helps to improve the accuracy of the first electronic device in detecting the content selected by the user, thereby helping to improve the user experience.

[0018] In combination with the first aspect, in certain implementations of the first aspect, the first electronic device is further used to: in response to detecting an operation in which a user selects the second content, send the second content and second request information to the second electronic device, wherein the second request information is used to request the second electronic device to use the first function to process the second content.

[0019] In an embodiment of the present application, after the user selects the first content, if the first electronic device continues to detect that the user has selected the second content, the first electronic device can directly send the second content and the second request information to the second electronic device without the user clicking the first function again, which helps to improve the convenience of the user when using the first function to process the second content, thereby helping to improve the user experience.

[0020] In combination with the first aspect, in certain implementations of the first aspect, the first electronic device is specifically used to: in response to the user selecting the first content and clicking the first button, send the first content and the first request information to the second electronic device, wherein the first button is associated with the first function.

[0021] In an embodiment of the present application, when the first electronic device detects that the user selects the first content and clicks the shortcut key, it can send the first content and the first request information to the second electronic device, so as to facilitate the user to use the first function to process the first content, thereby helping to improve the user experience.

[0022] In some possible implementations, the first electronic device is further configured to: before sending the first content and the first request information to the second electronic device, detect an operation by a user to associate the first function with the first button.

[0023] In combination with the first aspect, in some implementations of the first aspect, the account logged in on the first electronic device is associated with the account logged in on the second electronic device.

[0024] In combination with the first aspect, in some implementations of the first aspect, the first function is a text editing function, and the first electronic device is specifically used to: obtain audio content when detecting the first operation; display the first text content corresponding to the audio content and send the first text content and the first request information to the second electronic device, and the first request information is used to request the second electronic device to perform text editing on the first text content; the second electronic device is specifically used to: display the first text content in response to receiving the first text content and the first request information; display the second text content in response to detecting the user's editing operation on the first text content, and the second text content is the text content after editing the first text content; send the second text content to the first electronic device; the first electronic device is specifically used to: replace the first text content with the second text content.

[0025] In an embodiment of the present application, after acquiring audio content, the first electronic device may send the first text content corresponding to the audio content to the second electronic device and request the second electronic device to edit the first text content. After detecting that the user has edited the first text content, the second electronic device may send the edited second text content to the first electronic device, so that the first electronic device can replace the first text content with the second text content.

[0026] For example, mobile phones, due to their small screens and lack of keyboards, may cause inconvenience to users' editing operations. After the mobile phone determines that the laptop has text editing capabilities, it can send the first text content corresponding to the acquired audio content to the laptop. After the laptop detects the user's edit of the first text content, it sends the edited second text content to the mobile phone. The mobile phone can then replace the first text content with the second text content, thereby improving the user's efficiency when editing text.

[0027] In some possible implementations, the first operation is the first electronic device detecting that the user clicks on the audio recording to text operation.

[0028] In combination with the first aspect, in some implementations of the first aspect, the editing operation includes a format modification operation on the first text content, wherein the second electronic device is further used to send format information of the second text content to the first electronic device.

[0029] In an embodiment of the present application, upon detecting a user's operation to modify the format of the first text content, the second electronic device may further transmit the format information of the second text content to the second electronic device. This helps the first electronic device determine the character information of the second text content and the format information corresponding to the character information, thereby helping to improve the efficiency of the user in editing the text content.

[0030] In combination with the first aspect, in certain implementations of the first aspect, the format information of the second text content includes one or more of the font color, font size, font background color, font italicization, font underline, and carriage return operations in the second text content.

[0031] In combination with the first aspect, in certain implementations of the first aspect, the first content includes text content, the first function is a translation function, and the first electronic device is specifically used to: when detecting the first operation, send the text content and the first request information to the second electronic device, and the first request information is used to request the second electronic device to use the translation function to translate the text content; the second electronic device is specifically used to: use the translation function to translate the text content and send the translation result to the first electronic device; the first electronic device is also used to prompt the user of the translation result.

[0032] In combination with the first aspect, in certain implementations of the first aspect, the first content includes image information, the first function is an object recognition function, and the first electronic device is specifically used to: when detecting the first operation, send the image information and the first request information to the second electronic device, and the first request information is used to request the second electronic device to use the object recognition function to recognize the object in the image information; the second electronic device is specifically used to: use the object recognition function to recognize the object in the image information and send the recognition result to the first electronic device; the first electronic device is also used to prompt the user with the recognition result.

[0033] In combination with the first aspect, in certain implementations of the first aspect, the first content includes first image information, the first function is a photo editing function, and the first electronic device is specifically used to: when detecting the first operation, display one or more image parameters, and the one or more image parameters include a first image parameter; detecting the user's operation of adjusting the first image parameter to a first value, sending the first image information and the first request information to the second electronic device, and the first request information is used to request the second electronic device to use the photo editing function to adjust the first image parameter of the first image information to the first value; the second electronic device is specifically used to: use the photo editing function to adjust the first image parameter of the first image information to the first value to obtain second image information; send the second image information to the first electronic device; the first electronic device is also used to replace the first image information with the second image information.

[0034] In a second aspect, a method for calling capabilities of other devices is provided, which is applied to a first electronic device, and the method includes: the first electronic device requests capability information of a second electronic device; the first electronic device receives the capability information sent by the second electronic device, the capability information includes one or more functions, and the one or more functions include a first function; when the first electronic device detects a first operation of a user, the first electronic device sends first content and first request information to the second electronic device, and the first request information is used to request the second electronic device to use the first function to process the first content; the first electronic device receives the processing result of the second electronic device on the first content; the first electronic device prompts the user with the processing result.

[0035] In the embodiment of the present application, a user can use the functions of a second electronic device on a first electronic device, thereby expanding the capability boundary of the first electronic device, thereby conveniently and efficiently completing tasks that are more difficult for the first electronic device, and helping to improve the user experience.

[0036] In combination with the second aspect, in certain implementations of the second aspect, when the first electronic device detects the user's first operation, it sends the first content and the first request information to the second electronic device, including: when detecting the user's operation of selecting the first content, the first electronic device displays a function list, and the function list includes the first function; when detecting the user's operation of selecting the first function, the first electronic device sends the first content and the first request information to the second electronic device.

[0037] In an embodiment of the present application, when the first electronic device detects that the user selects the first content, it can display a function list, which includes the first function of the second electronic device, so that the user can use the first function to process the first content, thereby helping to improve the user experience.

[0038] In combination with the second aspect, in some implementations of the second aspect, the first electronic device displays a function list, including: the first electronic device displays the function list according to the type of the first content.

[0039] In the embodiment of the present application, the first electronic device can display the function list according to the type of the first content, so as to avoid the trouble caused to the user by too many functions in the function list, thereby helping to improve the user experience.

[0040] In some possible implementations, the first electronic device is specifically configured to: display the function list when detecting an operation of the user selecting the first content and detecting an operation of the user clicking the right button of the mouse.

[0041] In some possible implementations, the type of the first content is text, and the functions in the function list may include word retrieval and translation. The type of the first content is image, and the functions in the function list may include object recognition and shopping.

[0042] In combination with the second aspect, in certain implementations of the second aspect, when the first electronic device detects the user's first operation, it sends the first content and the first request information to the second electronic device, including: in response to receiving the capability information, the first electronic device displays a function list, and the function list includes the one or more functions; in response to detecting the user's operation of selecting the first function from the one or more functions, the first electronic device starts to detect the content selected by the user; in response to detecting the user's operation of selecting the first content, the first electronic device sends the first content and the first request information to the second electronic device.

[0043] In an embodiment of the present application, after receiving the capability information sent by the second electronic device, the first electronic device may display a function list, in which one or more functions of the second electronic device may be displayed. The user may select the content to be processed after selecting the first function, which facilitates the user to use the first function to process the first content, and helps to improve the user experience. In conjunction with the second aspect, in certain implementations of the second aspect, in response to detecting that the user selects the first content, the first electronic device sends the first content and the first request information to the second electronic device, including: in response to detecting that the user selects the first content and no user selection of other content is detected within a preset time period from the user selecting the first content, the first electronic device sends the first content and the first request information to the second electronic device.

[0044] In an embodiment of the present application, the first electronic device can send the first content and the first request information to the second electronic device when it detects that the user selects the first content and does not detect the user selecting other content within a preset time period. This helps to improve the accuracy of the first electronic device in detecting the content selected by the user, thereby helping to improve the user experience.

[0045] In combination with the second aspect, in certain implementations of the second aspect, the method further includes: in response to detecting an operation in which a user selects a second content, the first electronic device sends the second content and second request information to the second electronic device, wherein the second request information is used to request the second electronic device to use the first function to process the second content.

[0046] In an embodiment of the present application, after the user selects the first content, if the first electronic device continues to detect that the user has selected the second content, the first electronic device can directly send the second content and the second request information to the second electronic device without the user clicking the first function again, which helps to improve the convenience of the user when using the first function to process the second content, thereby helping to improve the user experience.

[0047] In combination with the second aspect, in certain implementations of the second aspect, when the first electronic device detects the user's first operation, it sends the first content and the first request information to the second electronic device, including: in response to the user selecting the first content and clicking the first button, the first electronic device sends the first content and the first request information to the second electronic device, wherein the first button is associated with the first function.

[0048] In an embodiment of the present application, when the first electronic device detects that the user selects the first content and clicks the shortcut key, it can send the first content and the first request information to the second electronic device, so as to facilitate the user to use the first function to process the first content, thereby helping to improve the user experience.

[0049] In combination with the second aspect, in some implementations of the second aspect, the account logged in on the first electronic device is associated with the account logged in on the second electronic device.

[0050] In some possible implementations, the account logged in on the first electronic device and the account logged in on the second electronic device are the same; or, the account logged in on the first electronic device and the account logged in on the second electronic device are in the same family group.

[0051] In combination with the second aspect, in some implementations of the second aspect, the first function is a text editing function, and the first electronic device sends a first content and a first request information to the second electronic device when detecting a first operation of the user, including: the first electronic device obtains audio content when detecting the first operation; the first electronic device displays the first text content corresponding to the audio content and sends the first text content and the first request information to the second electronic device, and the first request information is used to request the second electronic device to perform text editing on the first text content; the first electronic device receives and prompts the user with the processing result of the second electronic device on the first content, including: the first electronic device receives the second text content sent by the second electronic device and uses the second text content to replace the first text content, and the second text content is the text content detected by the second electronic device after the user edits the first text content.

[0052] In combination with the second aspect, in some implementations of the second aspect, the processing result also includes format information of the second text content.

[0053] In combination with the second aspect, in certain implementations of the second aspect, the format information of the second text content includes one or more of the font color, font size, font background color, font italicization, font underline, and carriage return operations in the second text content.

[0054] In combination with the second aspect, in certain implementations of the second aspect, the first content includes text content, the first function is a translation function, and the first electronic device sends the first content and first request information to the second electronic device when detecting the user's first operation, including: when detecting the first operation, the first electronic device sends the text content and the first request information to the second electronic device, and the first request information is used to request the second electronic device to use the translation function to translate the text content; the first electronic device receives and prompts the user with the processing result of the second electronic device on the first content, including: the first electronic device receives and prompts the user with the translation result of the second electronic device on the text content.

[0055] In combination with the second aspect, in certain implementations of the second aspect, the first content includes image information, the first function is an object recognition function, and the first electronic device sends the first content and the first request information to the second electronic device when detecting the user's first operation, including: when detecting the first operation, the first electronic device sends the image information and the first request information to the second electronic device, and the first request information is used to request the second electronic device to use the object recognition function to recognize the object in the image information; the first electronic device receives and prompts the user with the processing result of the second electronic device on the first content, including: the first electronic device receives and prompts the user with the object recognition result of the second electronic device on the object.

[0056] In combination with the second aspect, in certain implementations of the second aspect, the first content includes first image information, the first function is a photo editing function, and when the first electronic device detects the user's first operation, it sends the first content and a first request message to the second electronic device, including: when the first operation is detected, one or more image parameters are displayed, and the one or more image parameters include a first image parameter; when the user adjusts the first image parameter to a first value, the first image information and the first request message are sent to the second electronic device, and the first request message is used to request the second electronic device to use the photo editing function to adjust the first image parameter of the first image information to the first value; the first electronic device receives and prompts the user that the second electronic device is paired, including: the first electronic device receives the second image information sent by the second electronic device, and the second image information is the image information after the first image parameter of the first image information is adjusted to the first value; the first electronic device uses the second image information to replace the first image information.

[0057] In a third aspect, a method for calling capabilities of other devices is provided, which is applied to a second electronic device, and the method includes: the second electronic device receives a first request message sent by the first electronic device, and the first request message is used to request capability information of the second electronic device; the second electronic device sends the capability information to the first electronic device, and the capability information includes one or more functions, and the one or more functions include a first function; the second electronic device receives a first content and a second request message sent by the first electronic device, and the second request message is used for the second electronic device to process the first content using the first function; the second electronic device processes the first content using the first function according to the second request message and sends the processing result of the first content to the first electronic device.

[0058] In combination with the third aspect, in certain implementations of the third aspect, the account logged in on the first electronic device is associated with the account logged in on the second electronic device.

[0059] In combination with the third aspect, in certain implementations of the third aspect, the second electronic device receives the first content and the second request information sent by the first electronic device, including: the second electronic device receives the first text content and the second request information sent by the first electronic device, and the second request information is used to request the second electronic device to edit the first text content; the second electronic device uses the first function to process the first content according to the second request information and sends the processing result of the first content to the first electronic device, including: in response to receiving the first text content and the second request information, the second electronic device displays the first text content; in response to detecting the user's editing operation on the first text content, the second electronic device displays the second text content, and the second text content is the text content edited from the first text content; the second electronic device sends the second text content to the first electronic device.

[0060] In combination with the third aspect, in certain implementations of the third aspect, the editing operation includes a format modification operation on the first text content, and the method further includes: the second electronic device sending format information of the second text content to the first electronic device.

[0061] In combination with the third aspect, in certain implementations of the third aspect, the format information of the second text content includes one or more of the font color, font size, font background color, font italicization, font underline, and carriage return operations in the second text content.

[0062] In combination with the third aspect, in certain implementations of the third aspect, the second electronic device receives the first content and the second request information sent by the first electronic device, including: the second electronic device receives the text content and the second request information sent by the first electronic device, and the second request information is used to request the second electronic device to use the translation function to translate the text content; the second electronic device uses the first function to process the first content according to the second request information and sends the processing result of the first content to the first electronic device, including: the second electronic device uses the translation function to translate the text content and sends the translation result to the first electronic device.

[0063] In combination with the third aspect, in certain implementations of the third aspect, the second electronic device receives the first content and the second request information sent by the first electronic device, including: the second electronic device receives the image information and the second request information sent by the first electronic device, and the second request information is used to request the second electronic device to use the object recognition function to recognize the object in the image information; the second electronic device uses the first function to process the first content according to the second request information and sends the processing result of the first content to the first electronic device, including: the second electronic device uses the object recognition function to recognize the object in the image information and sends the recognition result to the first electronic device.

[0064] In combination with the third aspect, in certain implementations of the third aspect, the second electronic device receives the first content and the second request information sent by the first electronic device, including: the second electronic device receives the first image information and the second request information sent by the first electronic device, the second request information being used to request the second electronic device to use a photo editing function to adjust the first image parameter of the first image information to a first value; the second electronic device uses the first function to process the first content according to the second request information and sends the processing result of the first content to the first electronic device, including: the second electronic device uses the photo editing function to adjust the first image parameter of the first image information to the first value to obtain second image information; the second electronic device sends the second image information to the first electronic device.

[0065] In a fourth aspect, a device is provided, comprising: a sending unit for requesting capability information of a second electronic device; a receiving unit for receiving the capability information sent by the second electronic device, wherein the capability information includes one or more functions, wherein the one or more functions include a first function; a detecting unit for detecting a first operation of a user; the sending unit is further used to send first content and first request information to the second electronic device in response to the first operation, wherein the first request information is used to request the second electronic device to use the first function to process the first content; the receiving unit is further used to receive a processing result of the first content by the second electronic device; and a prompting unit is used to prompt the user of the processing result.

[0066] In a fifth aspect, a device is provided, comprising: a receiving unit for receiving a first request information sent by the first electronic device, the first request information being used to request capability information of the device; a sending unit for sending the capability information to the first electronic device, the capability information including one or more functions, the one or more functions including a first function; the receiving unit is also used to receive a first content and a second request information sent by the first electronic device, the second request information being used for the device to process the first content using the first function; a processing unit for processing the first content using the first function according to the second request information; and the sending unit is also used to send the processing result of the first content to the first electronic device.

[0067] In a sixth aspect, an electronic device is provided, comprising: one or more processors; a memory; and one or more computer programs. The one or more computer programs are stored in the memory, and the one or more computer programs include instructions. When the instructions are executed by the electronic device, the electronic device performs the method of any possible implementation of the second aspect.

[0068] In a seventh aspect, an electronic device is provided, comprising: one or more processors; a memory; and one or more computer programs. The one or more computer programs are stored in the memory, and the one or more computer programs include instructions. When the instructions are executed by the electronic device, the electronic device performs the method of any possible implementation of the third aspect.

[0069] In an eighth aspect, a computer program product comprising instructions is provided, which, when the computer program product is run on a first electronic device, enables the electronic device to execute the method described in the second aspect; or, when the computer program product is run on a second electronic device, enables the electronic device to execute the method described in the third aspect.

[0070] In the ninth aspect, a computer-readable storage medium is provided, comprising instructions, which, when the instructions are executed on a first electronic device, cause the electronic device to execute the method described in the second aspect; or, when the instructions are executed on a second electronic device, cause the electronic device to execute the method described in the third aspect.

[0071] In a tenth aspect, a chip is provided for executing instructions. When the chip is running, the chip executes the method described in the second aspect; or, the chip executes the method described in the third aspect.

[0072] In the eleventh aspect, a system is provided, which includes a first electronic device and a second electronic device, wherein the first electronic device has a first function, wherein the first electronic device is used to detect a first operation of a user; the first electronic device is also used to send a request message to the second electronic device in response to the first operation, and the request message is used to request first image information on the second electronic device; the second electronic device is used to send the first image information to the second electronic device in response to the request message; and the first electronic device is also used to process the first image information using the first function.

[0073] In an embodiment of the present application, a user can use a first electronic device to quickly process image information on a second electronic device, thereby enriching the interconnection and function sharing capabilities between the first electronic device and the second electronic device, thereby helping to improve the user's cross-device usage experience.

[0074] In combination with the eleventh aspect, in certain implementations of the eleventh aspect, the first electronic device is further used to send a processing result of the first image information to the second electronic device; and the second electronic device is further used to display the processing result.

[0075] In an embodiment of the present application, after obtaining the processing result, the first electronic device can send the processing result to the second electronic device, and the second electronic device can display the processing result, so that the user can view the processing result on the second electronic device, which helps to improve the user's cross-device usage experience.

[0076] In combination with the eleventh aspect, in certain implementations of the eleventh aspect, the first electronic device is further used to display a processing result of the first image information.

[0077] In an embodiment of the present application, after obtaining the processing result, the first electronic device can display the processing result on the first electronic device, thereby facilitating the user to view the processing result on the first electronic device, and helping to improve the user's cross-device usage experience.

[0078] In combination with the eleventh aspect, in certain implementations of the eleventh aspect, the first function includes a first sub-function and a second sub-function, and the first electronic device is specifically used to: when the first image information includes first content, use the first sub-function to process the first content; or, when the first image information includes second content, use the second sub-function to process the second content.

[0079] In an embodiment of the present application, the first electronic device can determine which function to use to process the content based on the content included in the first image information, without the user having to select a function. This improves the intelligence of the electronic device and also helps to improve the user's cross-device usage experience.

[0080] In some possible implementations, if the first image information includes text, the first electronic device may use a translation function to translate the text, or the first electronic device may use a word retrieval function to perform a word retrieval operation on the text.

[0081] In some possible implementations, if the first image information includes an image of an object, the first electronic device may use an object recognition function to recognize the object.

[0082] In combination with the eleventh aspect, in certain implementations of the eleventh aspect, the first electronic device further has a second function, and the first electronic device is specifically used to: in response to receiving the first image information, prompt the user to use the first function or the second function to process the first image information; in response to the user selecting the first function, use the first function to process the first image information.

[0083] In an embodiment of the present application, after obtaining the first image information, the first electronic device can prompt the user which function to use to process the image information. This helps to improve the accuracy of processing the image information and helps to improve the user's cross-device usage experience.

[0084] In combination with the eleventh aspect, in certain implementations of the eleventh aspect, the first electronic device is specifically used to: in response to receiving the first image information, display the first image information, the first image information including a first part and a second part; in response to the user's second operation on the first part, use the first function to process the first part.

[0085] In an embodiment of the present application, if the first image information includes a first part and a second part, the first electronic device can first display the first part and the second part. When the user's second operation on the first part is detected, the first electronic device can process the first part. This helps to improve the accuracy of processing the image information and helps to improve the user's cross-device usage experience.

[0086] In some possible implementations, the first electronic device is specifically used to: in response to detecting the second operation, prompt the user to use the first function or the second function to process the first part; in response to the user selecting the first function, use the first function to process the first part.

[0087] In combination with the eleventh aspect, in certain implementations of the eleventh aspect, the first electronic device is specifically used to: in response to the first operation, prompt the user whether to process the image information on the second electronic device; in response to the user's determination to process the image information on the second electronic device, send the request information to the second electronic device.

[0088] In combination with the eleventh aspect, in certain implementations of the eleventh aspect, the first electronic device is further used to: detect a third operation of the user; and process image information displayed by the first electronic device in response to the third operation.

[0089] In an embodiment of the present application, when the first electronic device detects the user's first operation, it can prompt the user to confirm whether to process the image information on the first electronic device or the second electronic device. This helps to improve the accuracy of processing the image information and helps to improve the user's cross-device usage experience.

[0090] In combination with the eleventh aspect, in certain implementations of the eleventh aspect, the request information includes information of a first moment, where the first moment is the moment when the first electronic device detects the first operation, and the second electronic device is further used to: determine the first image information based on the first moment.

[0091] In an embodiment of the present application, the first electronic device can carry information of the first moment in the request information, so as to facilitate the second electronic device to find the image information at (or near) the first moment and send the image information at (or near) the first moment to the first electronic device. This helps to improve the accuracy of the first electronic device in processing the image information and helps to improve the user's cross-device usage experience.

[0092] In combination with the eleventh aspect, in certain implementations of the eleventh aspect, the request information further includes information of a first duration, and the second electronic device is specifically used to determine the first image information based on the first moment and the first duration.

[0093] In an embodiment of the present application, considering that there will be a certain amount of time between the user seeing the relevant screen on the second electronic device and the user triggering the first operation on the first electronic device, the first electronic device can carry information about the first time length in the request information, thereby helping the second electronic device to determine the image information at (or near) the time when the first electronic device wants to obtain it. This helps to improve the accuracy of the first electronic device in processing the image information and helps to improve the user's cross-device usage experience.

[0094] In some possible implementations, the first duration is a duration preset in the first electronic device.

[0095] In some possible implementations, the first duration is a duration set by a user and detected by the first electronic device.

[0096] In some possible implementations, the first duration is a duration determined by the first electronic device based on user information of an owner of the first electronic device.

[0097] In combination with the eleventh aspect, in certain implementations of the eleventh aspect, the first image information includes text information, and the first electronic device is specifically used to: use a translation function to translate the text content to obtain a translation result; or use a word retrieval function to perform a word retrieval operation on the text content to obtain a word retrieval result.

[0098] In an embodiment of the present application, a user can use a first electronic device to quickly translate, retrieve words, save character strings, and perform other operations on image information of a second electronic device, thereby enriching the capabilities of cross-device interconnection and function sharing, and helping to improve the user's cross-device usage experience.

[0099] In combination with the eleventh aspect, in certain implementations of the eleventh aspect, the first image information includes an image of an object, and the first electronic device is specifically used to: use an object recognition function to recognize the object and obtain a recognition result.

[0100] In an embodiment of the present application, a user can use a first electronic device to quickly identify an object, view shopping links for the object, and perform other operations on the image information of a second electronic device, thereby enriching the capabilities of cross-device interconnection and function sharing, and helping to improve the user's cross-device usage experience.

[0101] In combination with the eleventh aspect, in certain implementations of the eleventh aspect, the account logged in on the first electronic device is associated with the account logged in on the second electronic device.

[0102] In the twelfth aspect, a method for calling the capabilities of other devices is provided, which is applied to a first electronic device, and the first electronic device has a first function. The method includes: the first electronic device detects a first operation of a user; in response to the first operation, the first electronic device sends a request information to a second electronic device, and the request information is used to request first image information on the second electronic device; the first electronic device receives the first image information sent by the second electronic device; and the first electronic device uses the first function to process the first image information.

[0103] In an embodiment of the present application, a user can use a first electronic device to quickly process image information on a second electronic device, thereby enriching the interconnection and function sharing capabilities between the first electronic device and the second electronic device, thereby helping to improve the user's cross-device usage experience.

[0104] In combination with the twelfth aspect, in some implementations of the twelfth aspect, the method further includes: the first electronic device sending a processing result of the first image information to the second electronic device.

[0105] In an embodiment of the present application, after obtaining the processing result, the first electronic device can send the processing result to the second electronic device, and the second electronic device can display the processing result, so that the user can view the processing result on the second electronic device, which helps to improve the user's cross-device usage experience.

[0106] In combination with the twelfth aspect, in some implementations of the twelfth aspect, the method further includes: the first electronic device displays a processing result of the first image information.

[0107] In an embodiment of the present application, after obtaining the processing result, the first electronic device can display the processing result on the first electronic device, thereby facilitating the user to view the processing result on the first electronic device, and helping to improve the user's cross-device usage experience.

[0108] In combination with the twelfth aspect, in certain implementations of the twelfth aspect, the first function includes a first sub-function and a second sub-function, and the first electronic device uses the first function to process the first image information, including: when the first image information includes first content, the first electronic device uses the first sub-function to process the first content; or, when the first image information includes second content, the first electronic device uses the second sub-function to process the second content.

[0109] In an embodiment of the present application, the first electronic device can determine which function to use to process the content based on the content included in the first image information, without the user having to select a function. This improves the intelligence of the electronic device and also helps to improve the user's cross-device usage experience.

[0110] In combination with the twelfth aspect, in certain implementations of the twelfth aspect, the first electronic device further has a second function, and before the first electronic device uses the first function to process the first image information, the method includes: in response to receiving the first image information, the first electronic device prompts the user to use the first function or the second function to process the first image information; wherein, the first electronic device uses the first function to process the first image information, including: in response to the user selecting the first function, the first electronic device uses the first function to process the first image information.

[0111] In an embodiment of the present application, after obtaining the first image information, the first electronic device can prompt the user which function to use to process the image information. This helps to improve the accuracy of processing the image information and helps to improve the user's cross-device usage experience.

[0112] In combination with the twelfth aspect, in certain implementations of the twelfth aspect, before the first electronic device uses the first function to process the first image information, the method includes: in response to receiving the first image information, the first electronic device displays the first image information, and the first image information includes a first part and a second part; wherein, the first electronic device uses the first function to process the first image information, including: in response to the user's second operation on the first part, the first electronic device uses the first function to process the first part.

[0113] In an embodiment of the present application, if the first image information includes a first part and a second part, the first electronic device can first display the first part and the second part. When the user's second operation on the first part is detected, the first electronic device can process the first part. This helps to improve the accuracy of processing the image information and helps to improve the user's cross-device usage experience.

[0114] In combination with the twelfth aspect, in certain implementations of the twelfth aspect, in response to the first operation, the first electronic device sends a request message to the second electronic device, including: in response to the first operation, the first electronic device prompts the user whether to process the image information on the second electronic device; in response to the user's determination to process the image information on the second electronic device, the first electronic device sends the request message to the second electronic device.

[0115] In combination with the twelfth aspect, in some implementations of the twelfth aspect, the method further includes: the first electronic device detects a third operation of the user; and in response to the third operation, the first electronic device processes the image information displayed by the first electronic device.

[0116] In an embodiment of the present application, when the first electronic device detects the user's first operation, it can prompt the user to confirm whether to process the image information on the first electronic device or the second electronic device. This helps to improve the accuracy of processing the image information and helps to improve the user's cross-device usage experience.

[0117] In combination with the twelfth aspect, in some implementations of the twelfth aspect, the request information includes information of a first moment, where the first moment is the moment when the first electronic device detects the first operation.

[0118] In an embodiment of the present application, the first electronic device can carry information of the first moment in the request information, so as to facilitate the second electronic device to find the image information at (or near) the first moment and send the image information at (or near) the first moment to the first electronic device. This helps to improve the accuracy of the first electronic device in processing the image information and helps to improve the user's cross-device usage experience.

[0119] In combination with the twelfth aspect, in certain implementations of the twelfth aspect, the first image information includes text information, and the first electronic device uses the first function to process the first image information, including: the first electronic device uses the translation function to translate the text content to obtain a translation result; or, the first electronic device uses the word retrieval function to perform a word retrieval operation on the text content to obtain a word retrieval result.

[0120] In an embodiment of the present application, a user can use a first electronic device to quickly translate, retrieve words, save character strings, and perform other operations on image information of a second electronic device, thereby enriching the capabilities of cross-device interconnection and function sharing, and helping to improve the user's cross-device usage experience.

[0121] In combination with the twelfth aspect, in certain implementations of the twelfth aspect, the first image information includes an image of an object, and the first electronic device uses the first function to process the first image information, including: the first electronic device uses the object recognition function to recognize the object and obtain a recognition result.

[0122] In an embodiment of the present application, a user can use a first electronic device to quickly identify an object, view shopping links for the object, and perform other operations on the image information of a second electronic device, thereby enriching the capabilities of cross-device interconnection and function sharing, and helping to improve the user's cross-device usage experience.

[0123] In combination with the twelfth aspect, in certain implementations of the twelfth aspect, the account logged in on the first electronic device is associated with the account logged in on the second electronic device.

[0124] In the thirteenth aspect, a device is provided, which includes: a detection unit for detecting a first operation of a user; a sending unit for sending a request information to a second electronic device in response to the first operation, wherein the request information is used to request first image information on the second electronic device; a receiving unit for receiving the first image information sent by the second electronic device; and a processing unit for processing the first image information using the first function.

[0125] In a fourteenth aspect, an electronic device is provided, comprising: one or more processors; a memory; and one or more computer programs. The one or more computer programs are stored in the memory, and the one or more computer programs include instructions. When the instructions are executed by the electronic device, the electronic device performs the method of any possible implementation of the twelfth aspect.

[0126] In a fifteenth aspect, a computer program product comprising instructions is provided, which, when run on a first electronic device, enables the first electronic device to execute the method described in the twelfth aspect.

[0127] In the sixteenth aspect, a computer-readable storage medium is provided, comprising instructions, which, when executed on a first electronic device, cause the first electronic device to execute the method described in the twelfth aspect.

[0128] In the seventeenth aspect, a chip is provided for executing instructions. When the chip is running, the chip executes the method described in the above-mentioned twelfth aspect.

[0129] The present application provides a method, electronic device, and system for authorization using other devices, which helps reduce the repetitive operations and complex memory when users log in or register on multiple devices, and helps improve the convenience of users when logging in or registering accounts.

[0130] In an eighteenth aspect, a system is provided, which includes a first electronic device and a second electronic device, the first electronic device being used to display a first interface, which is an account login or account registration interface of a first application; the first electronic device being further used to send a first request message to the second electronic device in response to detecting that a user performs an account login or account registration operation on the first application through a second application, the first request message being used to request the second application on the second electronic device to authorize the first application; the second electronic device being used to send a second request message to a server corresponding to the second application based on the first request message, the second request message being used to request first information, the first information being used by the first electronic device to request information of a first account, the first account being the account for login to the second application on the second electronic device; the second electronic device being further used to receive the first message sent by the server and send the first message to the first electronic device; the first electronic device being further used to request information of the first account from the server based on the first message; the first electronic device being further used to receive information of the first account sent by the server and perform account login or account registration for the first application based on the information of the first account.

[0131] In an embodiment of the present application, when the first electronic device logs in to or registers an account for the first application through the second application, it can use the second electronic device that has already installed the second application. This allows the user to log in to or register an account conveniently and quickly, helps reduce the repeated operations and complex memory when the user logs in or registers on multiple devices, thereby helping to improve the user experience.

[0132] In some possible implementations, the first electronic device can save information of the second electronic device (for example, information of applications installed in the second electronic device). When it is detected that a user logs in to or registers an account for the first application through the second application, the first electronic device can send the first request information to the second electronic device.

[0133] In some possible implementations, the first information is an access token.

[0134] In combination with the eighteenth aspect, in certain implementations of the eighteenth aspect, the first electronic device is further used to: before sending the first request information to the second electronic device, send a query request, wherein the query request is used to request the electronic device that receives the query request to determine whether the second application is installed; and receive a first response sent by the second electronic device, wherein the first response is used to indicate that the second electronic device has installed the second application.

[0135] In an embodiment of the present application, when a first electronic device detects that a user has logged in to or registered an account for the first application through a second application, it can also query whether the second application is installed on other electronic devices. The first electronic device can send the first request information to the second electronic device that has installed the second application, thereby allowing the user to log in to or register an account conveniently and quickly, helping to reduce the repeated operations and complex memory required for users to log in or register on multiple devices, thereby improving the user experience.

[0136] In some possible implementations, the first electronic device is further used to: send a query request before sending the first request information to the second electronic device, wherein the query request is used to request the electronic device that receives the query request to determine whether the second application is installed and logged in; receive a first response sent by the second electronic device, wherein the first response is used to indicate that the second electronic device has installed and logged in to the second application; and in response to receiving the response, the first electronic device sends the first request information to the second electronic device.

[0137] In combination with the eighteenth aspect, in certain implementations of the eighteenth aspect, the first electronic device is further used to: receive a second response sent by a third electronic device, the second response being used to indicate that the third electronic device has installed the second application; prompting the user to choose to authorize the first application through the second electronic device or the second application on the third electronic device; and in response to the user selecting the operation of the second electronic device, sending the first request information to the second electronic device.

[0138] In an embodiment of the present application, when the first electronic device receives responses from multiple electronic devices, the first electronic device can prompt the user to select one of the devices, and the user can select a suitable device from them, which makes it convenient for the user to log in to or register an account for the first application and helps to improve the user experience.

[0139] In some possible implementations, when the first electronic device receives responses from multiple electronic devices (for example, including a second electronic device and a third electronic device), the first electronic device may send the first request information to the second electronic device that is closest to the first electronic device.

[0140] In combination with the eighteenth aspect, in certain implementations of the eighteenth aspect, the second electronic device is further used to: prompt the user whether to agree that the first application uses the information of the first account before sending the second request information to the server; and send the second request information to the server in response to the user agreeing that the first application uses the information of the first account.

[0141] In an embodiment of the present application, the second electronic device can prompt the user whether to agree that the first application uses the information of the first account, and then request the first information from the server after the user agrees. This helps to improve the security of the account login or account registration process.

[0142] In combination with the eighteenth aspect, in certain implementations of the eighteenth aspect, the second electronic device is specifically used to: in response to receiving the first request information, send the first request information to the server; in response to receiving a third response to the first request information sent by the server, prompt the user whether to agree that the first application uses the information of the first account; in response to the user agreeing that the first application uses the information of the first account, send the second request information to the server.

[0143] In some possible implementations, the third response may be an authorization code.

[0144] In combination with the eighteenth aspect, in certain implementations of the eighteenth aspect, the first request information includes identification information of the first application.

[0145] In an embodiment of the present application, carrying the identification information of the first application in the first request information helps the server to verify the identification information of the first application, which helps to improve the security during account login or account registration.

[0146] In combination with the eighteenth aspect, in certain implementations of the eighteenth aspect, the first electronic device is a device that does not have the second application installed.

[0147] In the nineteenth aspect, a method for authorization using other devices is provided, which is applied to a first electronic device, and the method includes: the first electronic device displays a first interface, which is an account login or account registration interface of a first application; the first electronic device sends a first request message to the second electronic device in response to detecting that a user performs an account login or account registration operation on the first application through a second application, and the first request message is used to request the second application on the second electronic device to authorize the first application; the first electronic device receives the first information from the second electronic device, and the first information is used by the first electronic device to request information of a first account, and the first account is the account for logging in to the second application on the second electronic device, wherein the first information is obtained by the second electronic device from a server; the first electronic device requests information of the first account from the server based on the first information; the first electronic device receives the information of the first account sent by the server and performs account login or account registration for the first application based on the information of the first account.

[0148] In an embodiment of the present application, when the first electronic device logs in to or registers an account for the first application through the second application, it can use the second electronic device that has already installed the second application. This allows the user to log in to or register an account conveniently and quickly, helps reduce the repeated operations and complex memory when the user logs in or registers on multiple devices, thereby helping to improve the user experience.

[0149] In some possible implementations, the first electronic device can save information of the second electronic device (for example, information of applications installed in the second electronic device). When it is detected that a user logs in to or registers an account for the first application through the second application, the first electronic device can send the first request information to the second electronic device.

[0150] In some possible implementations, the first information is an access token.

[0151] In combination with the nineteenth aspect, in certain implementations of the nineteenth aspect, before sending the first request information to the second electronic device, the method includes: sending a query request, the query request being used to request the electronic device that receives the query request to determine whether the second application is installed; and receiving a first response sent by the second electronic device, the first response being used to indicate that the second electronic device has installed the second application.

[0152] In an embodiment of the present application, when a first electronic device detects that a user has logged in to or registered an account for the first application through a second application, it can also query whether the second application is installed on other electronic devices. The first electronic device can send the first request information to the second electronic device that has installed the second application, thereby allowing the user to log in to or register an account conveniently and quickly, helping to reduce the repeated operations and complex memory required for users to log in or register on multiple devices, thereby improving the user experience.

[0153] In combination with the nineteenth aspect, in certain implementations of the nineteenth aspect, before sending the first request information to the second electronic device, the method includes: receiving a second response sent by a third electronic device, the second response being used to indicate that the third electronic device has installed the second application; prompting the user to choose to authorize the first application through the second electronic device or the second application on the third electronic device; wherein, sending the first request information to the second electronic device includes: sending the first request information to the second electronic device in response to the user selecting the operation of the second electronic device.

[0154] In some possible implementations, the method further includes: before sending the first request information to the second electronic device, the first electronic device sends a query request, wherein the query request is used to request the electronic device that receives the query request to determine whether the second application is installed and logged in; the first electronic device receives a first response sent by the second electronic device, wherein the first response is used to indicate that the second electronic device has installed and logged in to the second application; in response to receiving the response, the first electronic device sends the first request information to the second electronic device.

[0155] In combination with the nineteenth aspect, in certain implementations of the nineteenth aspect, the first request information includes identification information of the first application.

[0156] In an embodiment of the present application, carrying the identification information of the first application in the first request information helps the server to verify the identification information of the first application, which helps to improve the security during account login or account registration.

[0157] In combination with the nineteenth aspect, in certain implementations of the nineteenth aspect, the first electronic device is a device that does not have the second application installed.

[0158] In the twentieth aspect, a method for authorization using other devices is provided, which is applied to a second electronic device, and the method includes: the second electronic device receives a first request message sent by a first electronic device, and the first request message is used to request the second application on the second electronic device to authorize the first application; the second electronic device sends a second request message to the server corresponding to the second application based on the first request message, and the second request message is used to request the first information, and the first information is used by the first electronic device to request information of a first account, and the first account is the account for logging in to the second application on the second electronic device; the second electronic device receives the first information sent by the server; and the second electronic device sends the first information to the first electronic device.

[0159] In an embodiment of the present application, when the first electronic device logs in to or registers an account for the first application through the second application, it can use the second electronic device that has already installed the second application. This allows the user to log in to or register an account conveniently and quickly, helps reduce the repeated operations and complex memory when the user logs in or registers on multiple devices, thereby helping to improve the user experience.

[0160] In combination with the twentieth aspect, in certain implementations of the twentieth aspect, before the second electronic device receives the first request information sent by the first electronic device, the method also includes: the second electronic device receives a query request sent by the first electronic device, the query request being used to request the electronic device that receives the query request to determine whether the second application is installed; the second electronic device sends a first response to the first electronic device, the first response being used to indicate that the second electronic device has installed the second application.

[0161] In an embodiment of the present application, when a first electronic device detects that a user has logged in to or registered an account for the first application through a second application, it can also query whether the second application is installed on other electronic devices. The first electronic device can send the first request information to the second electronic device that has installed the second application, thereby allowing the user to log in to or register an account conveniently and quickly, helping to reduce the repeated operations and complex memory required for users to log in or register on multiple devices, thereby improving the user experience.

[0162] In combination with the twentieth aspect, in certain implementations of the twentieth aspect, the method further includes: before sending the second request information to the server corresponding to the second application, prompting the user whether to agree that the first application uses the information of the first account; in response to the user's operation of agreeing that the first application uses the information of the first account, sending the second request information to the server.

[0163] In an embodiment of the present application, the second electronic device can prompt the user whether to agree that the first application uses the information of the first account, and then request the first information from the server after the user agrees. This helps to improve the security of the account login or account registration process.

[0164] In combination with the twentieth aspect, in certain implementations of the twentieth aspect, the second electronic device sends a second request message to the server corresponding to the second application based on the first request message, including: in response to receiving the first request message, the second electronic device sends the first request message to the server; in response to receiving a third response to the first request message sent by the server, the second electronic device prompts the user whether to agree that the first application uses the information of the first account; in response to the user agreeing to the first application's operation on the information of the first account, the second request message is sent to the server.

[0165] In some possible implementations, the third response may be an authorization code.

[0166] In combination with the twentieth aspect, in certain implementations of the twentieth aspect, the first request information includes identification information of the first application.

[0167] In an embodiment of the present application, carrying the identification information of the first application in the first request information helps the server to verify the identification information of the first application, which helps to improve the security during account login or account registration.

[0168] In combination with the twentieth aspect, in certain implementations of the twentieth aspect, the first electronic device is a device on which the second application is not installed.

[0169] In the twenty-first aspect, a device is provided, comprising: a display unit for displaying a first interface, which is an account login or account registration interface of a first application; a detection unit for detecting an operation of a user performing an account login or account registration operation on the first application through a second application; a sending unit for sending a first request message to a second electronic device in response to the operation, wherein the first request message is used to request the second application on the second electronic device to authorize the first application; a receiving unit for receiving first information from the second electronic device, wherein the first information is used by the device to request information of a first account, wherein the first account is an account for logging in to the second application on the second electronic device, wherein the first information is obtained by the second electronic device from a server; the sending unit is also used to request information of the first account from the server based on the first information; the receiving unit is used to receive the information of the first account sent by the server and perform account login or account registration of the first application based on the information of the first account.

[0170] In the twenty-second aspect, a device is provided, comprising: a receiving unit for receiving a first request message sent by a first electronic device, the first request message being used to request the second application on the device to authorize the first application; a sending unit for sending a second request message to a server corresponding to the second application based on the first request message, the second request message being used to request the first information, the first information being used by the first electronic device to request information of a first account, the first account being the account used to log in to the second application on the device; the receiving unit being further used to receive the first information sent by the server; and the sending unit being further used to send the first information to the first electronic device.

[0171] In aspect 23, an electronic device is provided, comprising: one or more processors; a memory; and one or more computer programs. The one or more computer programs are stored in the memory, and the one or more computer programs include instructions. When the instructions are executed by the electronic device, the electronic device performs the method of any possible implementation of aspect 19.

[0172] In aspect 24, an electronic device is provided, comprising: one or more processors; a memory; and one or more computer programs. The one or more computer programs are stored in the memory, and the one or more computer programs include instructions. When the instructions are executed by the electronic device, the electronic device performs the method of any possible implementation of aspect 20.

[0173] In aspect 25, a computer program product comprising instructions is provided, which, when the computer program product is run on a first electronic device, enables the electronic device to execute the method described in aspect 19; or, when the computer program product is run on a second electronic device, enables the electronic device to execute the method described in aspect 20.

[0174] In aspect 26, a computer-readable storage medium is provided, comprising instructions, which, when the instructions are executed on a first electronic device, cause the electronic device to execute the method described in aspect 19; or, when the instructions are executed on a second electronic device, cause the electronic device to execute the method described in aspect 20.

[0175] In aspect 27, a chip is provided for executing instructions. When the chip is running, the chip executes the method described in aspect 19; or, the chip executes the method described in aspect 20.

[0176] The present application provides a method, electronic device, and system for obtaining verification codes, which help improve the efficiency of obtaining verification codes, thereby improving user experience.

[0177] In aspect 28, a system is provided, which includes a first electronic device and a second electronic device, wherein the first electronic device is used to request verification code information from the second electronic device and request the server to send the verification code information to the electronic device corresponding to the first account when an operation of obtaining a verification code is detected through a first account, and the electronic device corresponding to the first account includes the second electronic device; the second electronic device is used to send the verification code information to the first electronic device when receiving the verification code information sent by the server.

[0178] In the embodiment of the present application, when the first electronic device needs to obtain a verification code, it can request the verification code information from the second electronic device. When the second electronic device receives the verification code information sent by the server, it can send the verification code information to the first electronic device. This eliminates the need for the user to check the second electronic device and actively memorize the verification code, providing convenience for the user, improving the efficiency of obtaining the verification code, and thus enhancing the user experience.

[0179] In some possible implementations, the first account is a mobile phone number or an email address.

[0180] In some possible implementations, the first account may be the mobile phone number corresponding to the phone card of the second electronic device; the first electronic device may be an electronic device without a phone card or the mobile phone number corresponding to the phone card of the first electronic device may be different from the first account.

[0181] In combination with the twenty-eighth aspect, in certain implementations of the twenty-eighth aspect, the first electronic device is further used to send a query request before requesting the verification code information from the second electronic device, where the query request is used to request account information of surrounding devices, where the surrounding devices include the second electronic device; the second electronic device is further used to send response information to the first electronic device, where the response information includes information of the first account; the first electronic device is further used to request the verification code information from the second electronic device based on the response information.

[0182] In an embodiment of the present application, a first electronic device can send a query request to surrounding devices and determine the second electronic device based on the account information carried in the response sent by the surrounding devices, thereby requesting verification code information from the second electronic device. In this way, the first electronic device does not need to save the account information of the second electronic device in advance. Instead, when the verification code is needed, it can determine the second electronic device from the surrounding devices in real time, which helps to improve the accuracy of obtaining the verification code.

[0183] In combination with the twenty-eighth aspect, in certain implementations of the twenty-eighth aspect, the first electronic device is further used to send a query request before requesting the verification code information from the second electronic device, and the query request is used to request the surrounding devices to determine whether the accounts of the surrounding devices include the first account, and the surrounding devices include the second electronic device; the second electronic device is further used to send response information to the first electronic device, and the response information is used to indicate that the account of the second electronic device includes the first account; the first electronic device is further used to request the verification code information from the second electronic device based on the response information.

[0184] In an embodiment of the present application, a first electronic device can query the accounts of surrounding devices to see whether the first account is included in the account information of surrounding devices through a query request, and the surrounding devices can determine whether the first account is included in their account information. After receiving the response from the second electronic device, the first electronic device can determine that the second electronic device is the device that receives the verification code information, and thus request the verification code information from the second electronic device. In this way, the first electronic device does not need to save the account information of the second electronic device in advance. Instead, when it needs to obtain the verification code, it can determine the second electronic device from the surrounding devices in real time, which helps to improve the accuracy of obtaining the verification code.

[0185] In some possible implementations, the query request may carry information of the first account. The second electronic device obtains the first account by parsing the query request, so that the second electronic device can determine whether the first account is included in the second electronic device's account.

[0186] In some possible implementations, the query request may carry information of the first account and indication information, where the indication information is used to instruct the surrounding device to determine whether the accounts of the surrounding device include the first account.

[0187] In some possible implementations, the first electronic device may store device information of the second electronic device, where the device information of the second electronic device includes the account information of the second electronic device. The first electronic device may determine that the second electronic device is the device for receiving the verification code information upon determining that the account information of the second electronic device includes the first account.

[0188] In an embodiment of the present application, the first electronic device may store account information of one or more electronic devices in advance. In this way, when the first electronic device needs to obtain a verification code through the first account, the first electronic device may first determine the second electronic device from the one or more electronic devices. If the first electronic device can determine the second electronic device from the one or more electronic devices, the first electronic device may request verification code information from the second electronic device. This avoids the process of the first electronic device determining the second electronic device from surrounding devices, thereby improving the efficiency of the first electronic device in obtaining the verification code.

[0189] In some possible implementations, if the first electronic device determines that one or more electronic devices do not include the second electronic device corresponding to the first account, the first electronic device may determine the second electronic device by sending a query request to surrounding devices.

[0190] In combination with the twenty-eighth aspect, in certain implementations of the twenty-eighth aspect, the verification code information includes the content of a short message or the content of an email, wherein the first electronic device is further used to extract the verification code from the content of the short message or the content of the email.

[0191] In the embodiment of the present application, the second electronic device can obtain a short message or email from the server and send the content of the short message or email to the first electronic device. The first electronic device can then extract the verification code from the content of the short message or email. This eliminates the need for the user to check the second electronic device and actively memorize the verification code, providing convenience for the user and improving the efficiency of obtaining the verification code, thereby enhancing the user experience.

[0192] In combination with the twenty-eighth aspect, in certain implementations of the twenty-eighth aspect, the verification code information includes the verification code, wherein the second electronic device is further used to extract the verification code from the short message or email sent by the server.

[0193] In an embodiment of the present application, the second electronic device can obtain a short message or email from the server, extract the verification code from it, and send it to the first electronic device. This saves the user from the process of checking the second electronic device and actively memorizing the verification code, provides convenience to the user, improves the efficiency of obtaining the verification code, and thus improves the user experience.

[0194] In combination with the twenty-eighth aspect, in certain implementations of the twenty-eighth aspect, the first electronic device is further used to prompt the user with the verification code based on the verification code information, or to fill the verification code into the verification code input box.

[0195] In an embodiment of the present application, after obtaining the verification code, the first electronic device can prompt the user for the verification code or automatically fill the verification code into the verification code input box. The user can enter the verification code in the verification code input box through the prompt of the first electronic device, or the user can directly proceed to the next step, which saves the user from the process of checking the second electronic device and actively memorizing the verification code, provides convenience to the user, improves the efficiency of obtaining the verification code, and thus improves the user experience. In the twenty-ninth aspect, a method for obtaining a verification code is provided, which is applied to a first electronic device, and the method includes: when the first electronic device detects the operation of obtaining the verification code through the first account, the second electronic device is requested for verification code information and the server is requested to send the verification code information to the electronic device corresponding to the first account, and the electronic device corresponding to the first account includes the second electronic device; the first electronic device receives the verification code information sent by the second electronic device.

[0196] In the embodiment of the present application, when the first electronic device needs to obtain a verification code, it can request the verification code information from the second electronic device. When the second electronic device receives the verification code information sent by the server, it can send the verification code information to the first electronic device. This eliminates the need for the user to check the second electronic device and actively memorize the verification code, providing convenience for the user, improving the efficiency of obtaining the verification code, and thus enhancing the user experience.

[0197] In some possible implementations, the first account is a mobile phone number or an email address.

[0198] In some possible implementations, the first account may be the mobile phone number corresponding to the phone card of the second electronic device; the first electronic device may be an electronic device without a phone card or the mobile phone number corresponding to the phone card of the first electronic device may be different from the first account.

[0199] In combination with the twenty-ninth aspect, in some implementations of the twenty-ninth aspect, the method further includes: before the first electronic device requests verification code information from the second electronic device, the query request is used to request account information of surrounding devices, and the surrounding devices include the second electronic device; the first electronic device receives response information sent by the second electronic device, and the response information includes information of the first account; wherein, the first electronic device requests verification code information from the second electronic device, including: the first electronic device requests the verification code information from the second electronic device based on the response information.

[0200] In an embodiment of the present application, a first electronic device can send a query request to surrounding devices and determine the second electronic device based on the account information carried in the response sent by the surrounding devices, thereby requesting verification code information from the second electronic device. In this way, the first electronic device does not need to save the account information of the second electronic device in advance. Instead, when the verification code is needed, it can determine the second electronic device from the surrounding devices in real time, which helps to improve the accuracy of obtaining the verification code.

[0201] In combination with the twenty-ninth aspect, in some implementations of the twenty-ninth aspect, the method further includes: before the first electronic device requests verification code information from the second electronic device, the query request is used to request the surrounding devices to determine whether the accounts of the surrounding devices include the first account, and the surrounding devices include the second electronic device; the first electronic device receives response information sent by the second electronic device, and the response information is used to indicate that the account of the second electronic device includes the first account; wherein, the first electronic device requests verification code information from the second electronic device, including: the first electronic device requests the verification code information from the second electronic device based on the response information.

[0202] In an embodiment of the present application, a first electronic device can query the accounts of surrounding devices to see whether the first account is included in the account information of surrounding devices through a query request, and the surrounding devices can determine whether the first account is included in their account information. After receiving the response from the second electronic device, the first electronic device can determine that the second electronic device is the device that receives the verification code information, and thus request the verification code information from the second electronic device. In this way, the first electronic device does not need to save the account information of the second electronic device in advance. Instead, when it needs to obtain the verification code, it can determine the second electronic device from the surrounding devices in real time, which helps to improve the accuracy of obtaining the verification code.

[0203] In some possible implementations, the query request may carry information of the first account.

[0204] In combination with the 29th aspect, in certain implementations of the 29th aspect, the verification code information includes the content of a short message or the content of an email, and the method further includes: the first electronic device extracting the verification code from the content of the short message or the content of the email.

[0205] In the embodiment of the present application, the second electronic device can obtain a short message or email from the server and send the content of the short message or email to the first electronic device. The first electronic device can then extract the verification code from the content of the short message or email. This eliminates the need for the user to check the second electronic device and actively memorize the verification code, providing convenience for the user and improving the efficiency of obtaining the verification code, thereby enhancing the user experience.

[0206] In combination with the twenty-ninth aspect, in certain implementations of the twenty-ninth aspect, the verification code information includes the verification code.

[0207] In an embodiment of the present application, the second electronic device can obtain a short message or email from the server, extract the verification code from it, and send it to the first electronic device. This saves the user from the process of checking the second electronic device and actively memorizing the verification code, provides convenience to the user, improves the efficiency of obtaining the verification code, and thus improves the user experience.

[0208] In combination with the twenty-ninth aspect, in certain implementations of the twenty-ninth aspect, the method further includes: the first electronic device prompting the user with the verification code based on the verification code information, or filling the verification code into the verification code input box.

[0209] In an embodiment of the present application, after obtaining the verification code, the first electronic device can prompt the user for the verification code or automatically fill the verification code into the verification code input box. The user can enter the verification code in the verification code input box through the prompt of the first electronic device, or the user can directly proceed to the next step, which saves the user from the process of checking the second electronic device and actively memorizing the verification code, provides convenience to the user, improves the efficiency of obtaining the verification code, and thus improves the user experience. In the thirtieth aspect, a method for obtaining a verification code is provided, which is applied to a second electronic device, and the method includes: the second electronic device receives the verification code request information sent by the first electronic device and receives the verification code information sent by the server for the first account, and the verification code request information is used to request the verification code information; the second electronic device sends the verification code information to the first electronic device according to the verification code request information.

[0210] In the embodiment of the present application, upon receiving the verification code request information sent by the first electronic device and the verification code information sent by the server, the second electronic device can send the verification code information to the first electronic device. This eliminates the need for the user to check the second electronic device and actively memorize the verification code, providing convenience for the user, improving the efficiency of obtaining the verification code, and thus enhancing the user experience.

[0211] In combination with the 30th aspect, in certain implementations of the 30th aspect, the method further includes: before receiving the verification code request information, the second electronic device receives a query request sent by the first electronic device, and the query request is used to request the account information of the second electronic device; the second electronic device sends response information to the first electronic device based on the query request, and the response information includes the first account information.

[0212] In an embodiment of the present application, after receiving a query request from the first electronic device, the second electronic device can send a response to the first electronic device, and the response carries the first account information. The first electronic device can then use the first account information to determine that the second electronic device is the device receiving the verification code information. This eliminates the need for the first electronic device to store the second electronic device's account information in advance. Instead, when the verification code is needed, the first electronic device can identify the second electronic device from surrounding devices in real time, helping to improve the accuracy of obtaining the verification code.

[0213] In combination with the 30th aspect, in certain implementations of the 30th aspect, the method further includes: before receiving the verification code request information, the second electronic device receives a query request sent by the first electronic device, and the query request is used to request the second electronic device to determine whether the account of the second electronic device includes the first account; the second electronic device sends response information to the first electronic device, and the response information is used to indicate that the account of the second electronic device includes the first account.

[0214] In an embodiment of the present application, the first electronic device can query whether the accounts of surrounding devices include the first account through a query request, and the second electronic device can determine whether its account includes the first account. The second electronic device can send an affirmative (ACK) response to the first electronic device, so that the first electronic device determines that the second electronic device is the device that receives the verification code information. In this way, the first electronic device does not need to save the account information of the second electronic device in advance, but can determine the second electronic device from the surrounding devices in real time when it needs to obtain the verification code, which helps to improve the accuracy of obtaining the verification code.

[0215] In combination with the 30th aspect, in certain implementations of the 30th aspect, the verification code information includes the verification code, and before sending the verification code information to the first electronic device, the method also includes: the second electronic device extracts the verification code in the short message or the email sent by the server.

[0216] In an embodiment of the present application, the second electronic device can obtain a short message or email from the server, extract the verification code from it, and send it to the first electronic device. This saves the user from the process of checking the second electronic device and actively memorizing the verification code, provides convenience to the user, improves the efficiency of obtaining the verification code, and thus improves the user experience.

[0217] In a thirty-first aspect, a device for obtaining a verification code is provided, which is set in a first electronic device, and the device includes: a detection unit, for detecting an operation of obtaining a verification code through a first account; a sending unit, for requesting verification code information from a second electronic device in response to the operation and requesting a server to send the verification code information to the electronic device corresponding to the first account, and the electronic device corresponding to the first account includes the second electronic device; a receiving unit, for receiving the verification code information sent by the second electronic device.

[0218] In aspect 32, a device for obtaining a verification code is provided, which is arranged in a second electronic device, and includes: a receiving unit, used to receive a verification code request message sent by a first electronic device and receive the verification code information sent by a server for the first account, the verification code request message is used to request the verification code information, and the device corresponding to the first account includes the second electronic device; a sending unit, used to send the verification code information to the first electronic device.

[0219] In aspect 33, an electronic device is provided, comprising: one or more processors; a memory; and one or more computer programs. The one or more computer programs are stored in the memory, and the one or more computer programs include instructions. When the instructions are executed by the electronic device, the electronic device performs the method for obtaining a verification code in any possible implementation of aspect 29.

[0220] In aspect 34, an electronic device is provided, comprising: one or more processors; a memory; and one or more computer programs. The one or more computer programs are stored in the memory, and the one or more computer programs include instructions. When the instructions are executed by the electronic device, the electronic device performs the method for obtaining a verification code in any possible implementation of aspect 30.

[0221] In aspect 35, a computer program product comprising instructions is provided, which, when the computer program product is run on a first electronic device, enables the first electronic device to execute the method for obtaining a verification code as described in aspect 29 above; or, when the computer program product is run on a second electronic device, enables the second electronic device to execute the method for obtaining a verification code as described in aspect 30 above.

[0222] In aspect 36, a computer-readable storage medium is provided, comprising instructions, which, when the instructions are executed on a first electronic device, cause the first electronic device to execute the method for obtaining a verification code as described in aspect 29 above; or, when the instructions are executed on a second electronic device, cause the second electronic device to execute the method for obtaining a verification code as described in aspect 30 above.

[0223] In aspect 37, a chip is provided for executing instructions. When the chip is running, the chip executes the method for obtaining a verification code as described in aspect 29 above; or, when the chip is running, the chip executes the method for obtaining a verification code as described in aspect 30 above.

[0224] The present application provides a text input method, electronic device, and system, which help improve the convenience of users when entering text on the device, while also reducing interference to the user.

[0225] In aspect 38, a system is provided, which includes a first electronic device and a second electronic device, the first electronic device being used to display a text input interface through a display screen, the text input interface including a text input box; the first electronic device being used to send a first message in response to displaying the text input interface, the first message being used to indicate that the first electronic device needs to input text; the second electronic device being used to detect a user's preset operation and listen for the first message; the second electronic device being used to detect a user's input of first content and send the first content to the first electronic device in response to detecting the user's preset operation and receiving the first message; the first electronic device being used to display text content corresponding to the first content in the text input box.

[0226] In the embodiment of the present application, when text input is required on the first electronic device, the user can simply pick up any nearby device (e.g., a mobile phone, a tablet) to input text. This helps improve the convenience of text input for the user, thereby enhancing the user experience. Furthermore, before the user performs a preset operation on the second electronic device or receives the first message, the second electronic device will not display any prompt information that may interfere with the user, thus avoiding interference with the user and thus improving the user experience.

[0227] In some possible implementations, the first electronic device is specifically configured to: in response to displaying the text input interface, send multiple first messages within a preset time period.

[0228] In some possible implementations, the second electronic device is specifically configured to: in response to detecting a preset operation of the user, start monitoring the first message; and in response to receiving the first message, detect content input by the user.

[0229] In the embodiment of the present application, the second electronic device starts to monitor the first message after detecting the user's preset operation, which can avoid interference to the user caused by the device prompting the user for input when the preset operation is not detected.

[0230] In some possible implementations, the second electronic device is specifically configured to: detect a preset operation of the user in response to receiving the first message; and detect content input by the user in response to detecting the preset operation of the user.

[0231] In an embodiment of the present application, the second electronic device can always be in a state of listening to the first message. When the second electronic device receives the first message, it starts to detect the user's preset operation. This can avoid interference to the user caused by other electronic devices that receive the first message but do not detect the preset operation and prompt the user for input.

[0232] In some possible implementations, the second electronic device is specifically used to: detect a user's preset operation in response to receiving the first message; and detect content input by the user in response to detecting the user's preset operation and when the time interval between receiving the first message and detecting the user's preset operation is less than the preset time interval.

[0233] In the embodiment of the present application, the other electronic devices may not detect the user's operation for a period of time after receiving the first message, and the user may not use the other electronic devices to input. Then, when the other electronic devices detect the user's preset operation, the other electronic devices may ignore the first message, or the other electronic devices may not prompt the user for input.

[0234] In some possible implementations, the second electronic device is specifically used to: in response to detecting a preset operation of the user and receiving the first message, and the first electronic device is within a preset angle range of the second electronic device (for example, the device facing the second electronic device is the first electronic device), detect the content input by the user.

[0235] In combination with aspect 38, in certain implementations of aspect 38, the second electronic device is specifically used to: display an input method in response to detecting a preset operation of the user and receiving the first message; and detect text content input by the user through the input method.

[0236] In the embodiment of the present application, when the second electronic device detects the user's preset operation and receives the first message, it can display the input method, which helps improve the user's convenience when entering text, thereby improving the user experience. At the same time, before the user performs the preset operation on the second electronic device and receives the first message, the second electronic device will not display any prompt information that may cause interference to the user, thereby avoiding interference with the user and helping to improve the user experience.

[0237] In combination with aspect 38, in certain implementations of aspect 38, the second electronic device is specifically used to: detect the voice content input by the user in response to detecting a preset operation of the user and receiving the first message; send the first voice content to the first electronic device in response to detecting the operation of the user inputting the first voice content; wherein the first electronic device is specifically used to: determine the text content corresponding to the first voice content; and display the text content in the text input box.

[0238] In the embodiment of the present application, when the second electronic device detects the user's preset operation and receives the first message, it can monitor the user's voice input, which helps improve the user's convenience when entering text, thereby improving the user experience. At the same time, before the user performs the preset operation on the second electronic device and receives the first message, the second electronic device will not display any prompt information that may cause interference to the user, thereby avoiding interference with the user and helping to improve the user experience.

[0239] In some possible implementations, the second electronic device is specifically used to: prompt the user to select text input or voice input in response to detecting a preset operation of the user and receiving the first message; display the input method when detecting that the user selects a text input operation; and detect the voice content of the user input when detecting that the user selects a voice input operation.

[0240] In combination with aspect 38, in certain implementations of aspect 38, the second electronic device is further used to: display a first prompt message before detecting the content input by the user, and the first prompt message is used to prompt that the second electronic device is a device that can input into the first electronic device.

[0241] In the embodiment of the present application, when the second electronic device detects the user's preset operation and receives the first message, it can prompt the user to input text through a reminder box, which helps the user to clearly understand that the second electronic device can be used as an input device.

[0242] In combination with aspect 38, in certain implementations of aspect 38, the first electronic device is further used to: display a second prompt message through the display screen before displaying the text content in the text input box, and the second prompt message is used to prompt the user to input to the first electronic device through the second electronic device.

[0243] In an embodiment of the present application, before receiving user input from the second electronic device, the first electronic device can prompt the user to input through the second electronic device through a display screen, which helps the user to understand that the second electronic device can be used as an input device.

[0244] In combination with the thirty-eighth aspect, in certain implementations of the thirty-eighth aspect, the second electronic device is specifically used to: start monitoring the first message when detecting that the user has started the first application.

[0245] In combination with the thirty-eighth aspect, in certain implementations of the thirty-eighth aspect, the first application is a remote control application.

[0246] In combination with the thirty-eighth aspect, in some implementations of the thirty-eighth aspect, the first electronic device is a smart TV.

[0247] In combination with aspect 38, in certain implementations of aspect 38, the first content includes information of a first account, and the second electronic device is further used to send indication information to the first electronic device in response to detecting an operation in which a user inputs the first content, and the indication information is used to indicate that the second electronic device is a device that includes the first account.

[0248] In an embodiment of the present application, when the second electronic device detects that the first content input by the user includes information about the first account, it can also indicate to the first electronic device that the second electronic device is a device that includes the first account. In this way, when the first electronic device detects that the user is using the first account to obtain a verification code, the first electronic device can directly request the verification code information from the second electronic device without querying surrounding devices that include the first account.

[0249] In combination with aspect 38, in certain implementations of aspect 38, the first electronic device is further used to, when detecting an operation of obtaining a verification code through the first account, request verification code information from the second electronic device and request the server to send the verification code information to the electronic device corresponding to the first account; the second electronic device is further used to, when receiving the verification code information sent by the server, send the verification code information to the first electronic device.

[0250] In aspect thirty-ninth, a method for text input is provided, which is applied to an electronic device and is characterized in that the method includes: the electronic device detects a user's preset operation and listens for a first message, the first message being used to indicate that another electronic device needs to perform text input; in response to detecting the user's preset operation and receiving the first message, the electronic device detects the first content input by the user and sends the first content to the other electronic device.

[0251] In some possible implementations, in response to detecting the user's preset operation and receiving the first message, the electronic device detects the content input by the user, including: in response to detecting the user's preset operation, starting to listen to the first message; in response to receiving the first message, detecting the content input by the user.

[0252] In some possible implementations, in response to detecting the user's preset operation and receiving the first message, the electronic device detects the content input by the user, including: in response to receiving the first message, detecting the user's preset operation; in response to detecting the user's preset operation, detecting the content input by the user.

[0253] In some possible implementations, in response to detecting the user's preset operation and receiving the first message, the electronic device detects the content input by the user, including: detecting the user's preset operation in response to receiving the first message; detecting the content input by the user in response to detecting the user's preset operation and when the time interval between receiving the first message and detecting the user's preset operation is less than the preset time interval.

[0254] In some possible implementations, in response to detecting the user's preset operation and receiving the first message, the electronic device detects the content input by the user, including: in response to detecting the user's preset operation and receiving the first message, and the first electronic device is within a preset angle range of the second electronic device (for example, the device facing the second electronic device is the first electronic device), detecting the content input by the user.

[0255] In combination with the thirty-ninth aspect, in certain implementations of the thirty-ninth aspect, in response to detecting the user's preset operation and receiving the first message, the electronic device detects the user's input, including: in response to detecting the user's preset operation and receiving the first message, the electronic device displays an input method; the electronic device detects the text content input by the user through the input method.

[0256] In combination with the thirty-ninth aspect, in certain implementations of the thirty-ninth aspect, in response to detecting the user's preset operation and receiving the first message, the electronic device detects the user's input, including: in response to detecting the user's preset operation and receiving the first message, the electronic device detects the voice content of the user's input.

[0257] In some possible implementations, in response to detecting the user's preset operation and receiving the first message, the electronic device detects the user's input, including: in response to detecting the user's preset operation and receiving the first message, prompting the user to select text input or voice input; when detecting that the user selects the text input operation, displaying the input method; when detecting that the user selects the voice input operation, detecting the voice content of the user input.

[0258] In combination with the thirty-ninth aspect, in certain implementations of the thirty-ninth aspect, before the electronic device detects the content input by the user, the method also includes: the electronic device displays a prompt message, and the prompt message is used to prompt the user that the electronic device is a device that can input into the other electronic device.

[0259] In combination with the thirty-ninth aspect, in certain implementations of the thirty-ninth aspect, the electronic device detects a preset operation of the user, including: the electronic device detects an operation of the user launching a first application.

[0260] In combination with the thirty-ninth aspect, in certain implementations of the thirty-ninth aspect, the first application is a remote control application.

[0261] In combination with the thirty-ninth aspect, in some implementations of the thirty-ninth aspect, the other electronic device is a smart TV.

[0262] In combination with the thirty-ninth aspect, in certain implementations of the thirty-ninth aspect, the first content includes information of a first account, and the method further includes: in response to detecting an operation in which a user inputs the first content, the electronic device sends an indication information to the other electronic device, and the indication information is used to indicate that the electronic device is a device that includes the first account.

[0263] In combination with aspect 39, in certain implementations of aspect 39, the method further includes: receiving a request message sent by the first electronic device, the request message being used to request verification code information; when the verification code information sent by the server is received through the first account, the electronic device sends the verification code information to the other electronic device.

[0264] In the fortieth aspect, a device for text input is provided, which includes: a first detection unit for detecting a user's preset operation; a receiving unit for monitoring a first message, wherein the first message is used to indicate that another electronic device needs to perform text input; a second detection unit for responding to the first detection unit detecting the user's preset operation and the receiving unit receiving the first message; and a sending unit for sending the first content to the other electronic device in response to the second detection unit detecting that the user inputs the first content.

[0265] In a forty-first aspect, an electronic device is provided, comprising: one or more processors; a memory; and one or more computer programs. The one or more computer programs are stored in the memory, and the one or more computer programs include instructions. When the instructions are executed by the electronic device, the electronic device performs the text input method of any possible implementation of the thirty-ninth aspect.

[0266] In aspect 42, a computer program product comprising instructions is provided, which, when run on a first electronic device, enables the electronic device to execute the text input method described in aspect 39 above.

[0267] In the forty-third aspect, a computer-readable storage medium is provided, comprising instructions, which, when executed on an electronic device, enable the electronic device to execute the text input method described in the thirty-ninth aspect.

[0268] In the forty-fourth aspect, a chip is provided for executing instructions. When the chip is running, the chip executes the text input method described in the thirty-ninth aspect.

[0269] The present application provides a method, electronic device, and system for editing text, which help improve the user's editing efficiency in text editing.

[0270] In the forty-fifth aspect, a system is provided, which includes a first electronic device and a second electronic device, wherein the first electronic device is used to obtain audio content; the first electronic device is also used to send first information to the second electronic device, the first information being the audio content, or the first information being first text content corresponding to the audio content; the second electronic device is used to display the first text content based on the first information; the second electronic device is also used to display a second text content in response to a user's editing operation on the first text content, the second text content being the text content after editing the first text content.

[0271] In an embodiment of the present application, the first electronic device can send the text content corresponding to the acquired audio content to the second electronic device, so that the text content can be displayed on the second electronic device, thereby facilitating the user to edit the text content on the second electronic device, thereby helping to improve the user's efficiency in editing the text content.

[0272] In some possible implementations, the first electronic device may store information of one or more electronic devices. When the first electronic device obtains audio, the first electronic device may select a second electronic device suitable for text editing from the one or more electronic devices, thereby sending the first information to the second electronic device.

[0273] In some possible implementations, in response to receiving the first information, the second electronic device may open the first application and display the first text content in the first application; the second electronic device may edit the first text content through the input method of the second electronic device.

[0274] In combination with the 45th aspect, in some implementations of the 45th aspect, the second electronic device is further used to send the second text content to the first electronic device.

[0275] In some possible implementations, the second electronic device is further configured to send the second text content to the first electronic device when detecting the user's first operation.

[0276] In some possible implementations, the first operation is an operation in which the user clicks Save.

[0277] In the embodiment of the present application, the second electronic device can obtain the text content edited by the user and send the edited text content to the first electronic device, so that the first electronic device can save the edited text content. Without the user's additional operation, the first electronic device can also obtain the edited text content.

[0278] In combination with the 45th aspect, in certain implementations of the 45th aspect, the editing operation includes a format modification operation on the first text content, wherein the second electronic device is further used to send format information of the second text content to the first electronic device.

[0279] In an embodiment of the present application, when the user modifies the format of the text content, the second electronic device can also send format information of the edited text content to the first electronic device, so that the first electronic device can restore the text content edited by the user on the second electronic device according to the format information.

[0280] In combination with the 45th aspect, in certain implementations of the 45th aspect, the format information of the second text content includes one or more of the font color, font size, font background color, font italicization, font underline, and carriage return operations in the second text content.

[0281] In combination with aspect 45, in certain implementations of aspect 45, the first electronic device is further used to: display the first text content based on the audio content before receiving the second text content sent by the second electronic device; and replace the first text content with the second text content after receiving the second text content sent by the second electronic device.

[0282] In an embodiment of the present application, the first electronic device can display the corresponding first text content when obtaining the audio content. After the first electronic device receives the second text content edited by the user sent by the second electronic device, the first electronic device can use the second text content to replace the previous first text content, thereby facilitating the user to view the edited text content on the first electronic device and the second electronic device at the same time, which helps to improve the user experience.

[0283] In combination with aspect 45, in certain implementations of aspect 45, the first electronic device is further used to send a query request, which is used for the device that receives the query request to determine whether it has a text editing function; in response to receiving a response sent by the second electronic device, the first information is sent to the second electronic device, and the response is used to indicate that the second electronic device has a text editing function.

[0284] In an embodiment of the present application, the first electronic device may query for a device with a text editing function before sending the first information to the second electronic device. After the first electronic device determines that the second electronic device has a text editing function, it may send the first information to the second electronic device, thereby facilitating the user to edit the text content on the second electronic device and helping to improve the user's efficiency in text editing.

[0285] In combination with aspect 45, in certain implementations of aspect 45, the second electronic device is specifically used to: in response to receiving the first information, prompt the user whether to perform text editing on the second electronic device; in response to the user determining to perform text editing on the second electronic device, display the first text content.

[0286] In an embodiment of the present application, upon receiving the first information, the second electronic device may first prompt the user to determine whether they agree to edit the text on the second electronic device. If the second electronic device detects that the user agrees, it may display the text content. This helps avoid interruptions to the user, allowing the user to select a device they deem appropriate for text editing, thereby improving the user experience.

[0287] In some possible implementations, the first electronic device may also send a request message to the second electronic device, where the request message is used to request the second electronic device to edit the first text content; the second electronic device may respond to the request message and prompt the user whether to agree to edit the text content on the second electronic device; if the second electronic device detects that the user agrees to edit the text content on the second electronic device, the second electronic device may display the first text content.

[0288] In combination with aspect 45, in certain implementations of aspect 45, the first information is the first text content, and the first electronic device is specifically used to: in response to obtaining the audio content, convert the audio content into the first text content; and send the first text content to the second electronic device.

[0289] In an embodiment of the present application, after obtaining the audio content, the first electronic device can convert the audio content into text content, and then send the text content to the second electronic device. The second electronic device can display the corresponding text content, thereby facilitating the user to edit the text content.

[0290] In combination with the 45th aspect, in certain implementations of the 45th aspect, the first information is the audio content, and the second electronic device is specifically used to: in response to receiving the audio content, convert the audio content into the first text content; and display the first text content.

[0291] In an embodiment of the present application, the first electronic device can send the acquired audio content to the second electronic device, and the second electronic device can convert the audio content into text content and display the text content, thereby facilitating the user to edit the text content.

[0292] In combination with the 45th aspect, in certain implementations of the 45th aspect, the account of the first electronic device and the account of the second electronic device are associated.

[0293] In the forty-sixth aspect, a text editing method is provided, which is applied to a first electronic device, and the method includes: the first electronic device obtains audio content; the first electronic device sends first information to a second electronic device, where the first information is the audio content, or the first information is first text content corresponding to the audio content, so that the second electronic device displays the first text content according to the first information and detects the user's editing operation on the first text content.

[0294] In combination with aspect 46, in certain implementations of aspect 46, the method further includes: the first electronic device receives second text content sent by the second electronic device, and the second text content is the text content after the user edits the first text content on the second electronic device.

[0295] In combination with the 46th aspect, in some implementations of the 46th aspect, the method also includes: the first electronic device receives format information of the second text content sent by the second electronic device.

[0296] In combination with the forty-sixth aspect, in certain implementations of the forty-sixth aspect, the format information of the second text content includes one or more of the font color, font size, font background color, font italicization, font underline, and carriage return operations in the second text content.

[0297] In combination with aspect 46, in certain implementations of aspect 46, the method further includes: before receiving the second text content sent by the second electronic device, the first electronic device displays the first text content based on the audio content; after receiving the second text content sent by the second electronic device, the first electronic device replaces the first text content with the second text content.

[0298] In combination with aspect 46, in certain implementations of aspect 46, the method includes: before sending the first information to the second electronic device, the first electronic device sends a query request, and the query request is used for the device receiving the query request to determine whether it has a text editing function; in response to receiving a response sent by the second electronic device, the first electronic device sends the first information to the second electronic device, and the response is used to indicate that the second electronic device has a text editing function.

[0299] In combination with aspect 46, in certain implementations of aspect 46, the first information is the first text content, and the method further includes: in response to obtaining the audio content, the first electronic device converts the audio content into the first text content; and the first electronic device sends the first text content to the second electronic device.

[0300] In combination with the 46th aspect, in certain implementations of the 46th aspect, the account of the first electronic device and the account of the second electronic device are associated.

[0301] In the forty-seventh aspect, a text editing method is provided, which is applied to a second electronic device, and the method includes: the second electronic device receives first information sent by the first electronic device, the first information is audio content obtained by the first electronic device, or the first information is first text content corresponding to the audio content; the second electronic device displays the first text content according to the first information; in response to the user's editing operation on the first text content, the second electronic device displays a second text content, and the second text content is the text content after editing the first text content.

[0302] In combination with the 47th aspect, in some implementations of the 47th aspect, the method further includes: the second electronic device sending the second text content to the first electronic device.

[0303] In combination with aspect 47, in certain implementations of aspect 47, the editing operation includes a format modification operation on the first text content, and the method further includes: the second electronic device sending format information of the second text content to the first electronic device.

[0304] In combination with aspect 47, in certain implementations of aspect 47, the format information of the second text content includes one or more of the font color, font size, font background color, font italicization, font underline, and carriage return operations in the second text content.

[0305] In combination with aspect 47, in certain implementations of aspect 47, the method further includes: before receiving the first information sent by the first electronic device, the second electronic device receives a query request sent by the first electronic device, and the query request enables the second electronic device to determine whether it has a text editing function; the second electronic device sends a response to the first electronic device, and the response is used to indicate that the second electronic device has a text editing function.

[0306] In combination with aspect 47, in certain implementations of aspect 47, the second electronic device displays the first text content based on the first information, including: in response to receiving the first information, the second electronic device prompts the user whether to perform text editing on the second electronic device; in response to the user determining to perform text editing on the second electronic device, the second electronic device displays the first text content.

[0307] In combination with aspect 47, in certain implementations of aspect 47, the first information is the audio content, and before the second electronic device displays the first text content, the method further includes: in response to receiving the audio content, converting the audio content into the first text content.

[0308] In combination with the 47th aspect, in certain implementations of the 47th aspect, the account of the first electronic device and the account of the second electronic device are associated.

[0309] In the forty-eighth aspect, a device is provided, comprising: an acquisition unit for acquiring audio content; a sending unit for sending first information to a second electronic device, where the first information is the audio content, or the first information is first text content corresponding to the audio content, so that the second electronic device displays the first text content according to the first information and detects the user's editing operation on the first text content.

[0310] In the forty-ninth aspect, a device is provided, comprising: a receiving unit for receiving first information sent by a first electronic device, the first information being audio content acquired by the first electronic device, or the first information being first text content corresponding to the audio content; a display unit for displaying the first text content based on the first information; a detection unit for detecting a user's editing operation on the first text content; and the display unit further for displaying a second text content, the second text content being the text content after editing the first text content.

[0311] In a fiftieth aspect, an electronic device is provided, comprising: one or more processors; a memory; and one or more computer programs. The one or more computer programs are stored in the memory, and the one or more computer programs include instructions. When the instructions are executed by the electronic device, the electronic device performs the method of any possible implementation of the forty-sixth aspect.

[0312] In a fifty-first aspect, an electronic device is provided, comprising: one or more processors; a memory; and one or more computer programs. The one or more computer programs are stored in the memory, and the one or more computer programs include instructions. When the instructions are executed by the electronic device, the electronic device performs the method of any possible implementation of the forty-seventh aspect.

[0313] In aspect 52, a computer program product comprising instructions is provided, which, when the computer program product is run on a first electronic device, enables the electronic device to execute the method described in aspect 46; or, when the computer program product is run on a second electronic device, enables the electronic device to execute the method described in aspect 47.

[0314] In aspect 53, a computer-readable storage medium is provided, comprising instructions, which, when the instructions are executed on a first electronic device, cause the electronic device to execute the method described in aspect 46; or, when the instructions are executed on a second electronic device, cause the electronic device to execute the method described in aspect 47.

[0315] In aspect 54, a chip is provided for executing instructions. When the chip is running, the chip executes the method described in aspect 46; or, the chip executes the method described in aspect 47.

[0316] In the fifty-fifth aspect, a system is provided, which includes a first electronic device and a second electronic device, the first electronic device being used to send first content to the second electronic device; the second electronic device being further used to process the first content according to the type of the first content to obtain a processing result; the second electronic device being further used to send the processing result to the first electronic device; and the first electronic device being further used to prompt the user with the processing result.

[0317] In combination with aspect 55, in some possible implementations of aspect 55, the second electronic device is further used to, before receiving the first content, send a first request message to the first electronic device in response to detecting a first operation of the user, and the first request message is used to request the first content; the first electronic device is specifically used to: in response to receiving the first request message, send the first content to the second electronic device.

[0318] In combination with the fifty-fifth aspect, in some possible implementations of the fifty-fifth aspect, the first electronic device is specifically used to: in response to detecting a second operation of the user, send the first content to the second electronic device.

[0319] In combination with aspect 55, in some possible implementations of aspect 55, the second electronic device is specifically used to: prompt the user to use the first function or the second function to process the first image information according to the type of the first content; and in response to the user selecting the first function, use the first function to process the first content.

[0320] In combination with aspect 55, in some possible implementations of aspect 55, the second electronic device is specifically used to: when the type of the first content is the first type, use the first function to process the first content; or, when the type of the first content is the second type, use the second function to process the first content.

[0321] In combination with aspect 55, in some possible implementations of aspect 55, the second electronic device is specifically used to: in response to receiving the first content, display the first content, the first content including a first part and a second part; in response to the user's third operation on the first part, process the first part according to the type of the first part.

[0322] In the fifty-sixth aspect, a method for calling the capabilities of other devices is provided, which is applied to a second electronic device, and the method includes: the second electronic device receives the first content sent by the first electronic device; the second electronic device processes the first content according to the type of the first content to obtain a processing result; and the second electronic device sends the processing result to the first electronic device.

[0323] In combination with aspect 56, in some possible implementations of aspect 56, the method also includes: before receiving the first content, in response to detecting a first operation of the user, the second electronic device sends a first request message to the first electronic device, and the first request message is used to request the first content.

[0324] In combination with aspect 56, in some possible implementations of aspect 56, the second electronic device processes the first content according to the type of the first content, including: the second electronic device prompts the user to use the first function or the second function to process the first content according to the type of the first content; in response to the user selecting the first function, the second electronic device uses the first function to process the first content.

[0325] In combination with aspect 56, in some possible implementations of aspect 56, the second electronic device processes the first content according to the type of the first content, including: when the type of the first content is a first type, the second electronic device uses a first function to process the first content; or, when the type of the first content is a second type, the second electronic device uses a second function to process the first content.

[0326] In combination with aspect 56, in some possible implementations of aspect 56, the second electronic device processes the first content according to the type of the first content, including: in response to receiving the first content, the second electronic device displays the first content, the first content including a first part and a second part; in response to the user's third operation on the first part, the second electronic device processes the first part according to the type of the first part.

[0327] In the fifty-seventh aspect, a device is provided, which includes: a receiving unit for receiving first content sent by the first electronic device; a processing unit for processing the first content according to the type of the first content to obtain a processing result; and a sending unit for sending the processing result to the first electronic device.

[0328] In aspect 58, an electronic device is provided, comprising: one or more processors; a memory; and one or more computer programs. The one or more computer programs are stored in the memory, and the one or more computer programs include instructions. When the instructions are executed by the electronic device, the electronic device performs the method of any possible implementation of aspect 56.

[0329] In aspect fifty-ninth, a computer program product comprising instructions is provided, which, when the computer program product is run on an electronic device, enables the electronic device to execute the method described in aspect fifty-six above.

[0330] In the sixtieth aspect, a computer-readable storage medium is provided, comprising instructions, which, when executed on an electronic device, cause the electronic device to execute the method described in the fifty-sixth aspect.

[0331] In the sixty-first aspect, a chip is provided for executing instructions. When the chip is running, the chip executes the method described in the fifty-sixth aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0332] Figure 1 This is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application.

[0333] Figure 2 This is a software structure diagram provided in an embodiment of the present application.

[0334] Figure 3 This is a schematic diagram of a network architecture provided in an embodiment of the present application.

[0335] Figure 4 This is the notification processing method provided in the embodiment of this application.

[0336] Figure 5 It is a set of graphical user interfaces provided by the embodiments of this application.

[0337] Figure 6 This is another set of graphical user interfaces provided by the embodiments of the present application.

[0338] Figure 7 This is another set of graphical user interfaces provided by the embodiments of the present application.

[0339] Figure 8 This is another set of graphical user interfaces provided by the embodiments of the present application.

[0340] Figure 9 This is another set of graphical user interfaces provided by the embodiments of the present application.

[0341] Figure 10 This is another set of graphical user interfaces provided by the embodiments of the present application.

[0342] Figure 11 This is another set of graphical user interfaces provided by the embodiments of the present application.

[0343] Figure 12 This is another set of graphical user interfaces provided by the embodiments of the present application.

[0344] Figure 13 This is another set of graphical user interfaces provided by the embodiments of the present application.

[0345] Figure 14 This is another set of graphical user interfaces provided by the embodiments of the present application.

[0346] Figure 15 This is another set of graphical user interfaces provided by the embodiments of the present application.

[0347] Figure 16This is another set of graphical user interfaces provided by the embodiments of the present application.

[0348] Figure 17 This is another set of graphical user interfaces provided by the embodiments of the present application.

[0349] Figure 18 This is another set of graphical user interfaces provided by the embodiments of the present application.

[0350] Figure 19 This is another set of graphical user interfaces provided by the embodiments of the present application.

[0351] Figure 20 This is another set of graphical user interfaces provided by the embodiments of the present application.

[0352] Figure 21 This is another set of graphical user interfaces provided by the embodiments of the present application.

[0353] Figure 22 This is another set of graphical user interfaces provided by the embodiments of the present application.

[0354] Figure 23 This is another set of graphical user interfaces provided by the embodiments of the present application.

[0355] Figure 24 This is another set of graphical user interfaces provided by the embodiments of the present application.

[0356] Figure 25 This is another set of graphical user interfaces provided by the embodiments of the present application.

[0357] Figure 26 This is another set of graphical user interfaces provided by the embodiments of the present application.

[0358] Figure 27 This is another set of graphical user interfaces provided by the embodiments of the present application.

[0359] Figure 28 This is another set of graphical user interfaces provided by the embodiments of the present application.

[0360] Figure 29 This is another set of graphical user interfaces provided by the embodiments of the present application.

[0361] Figure 30 This is another set of graphical user interfaces provided by the embodiments of the present application.

[0362] Figure 31 This is another set of graphical user interfaces provided by the embodiments of the present application.

[0363] Figure 32 This is another set of graphical user interfaces provided by the embodiments of the present application.

[0364] Figure 33This is another set of graphical user interfaces provided by the embodiments of the present application.

[0365] Figure 34 This is another set of graphical user interfaces provided by the embodiments of the present application.

[0366] Figure 35 This is another set of graphical user interfaces provided by the embodiments of the present application.

[0367] Figure 36 This is another set of graphical user interfaces provided by the embodiments of the present application.

[0368] Figure 37 This is another set of graphical user interfaces provided by the embodiments of the present application.

[0369] Figure 38 This is another set of graphical user interfaces provided by the embodiments of the present application.

[0370] Figure 39 This is another set of graphical user interfaces provided by the embodiments of the present application.

[0371] Figure 40 This is another set of graphical user interfaces provided by the embodiments of the present application.

[0372] Figure 41 This is another set of graphical user interfaces provided by the embodiments of the present application.

[0373] Figure 42 It is a schematic diagram of the system architecture provided in the embodiment of the present application.

[0374] Figure 43 This is a schematic flowchart of a method for calling device capabilities provided in an embodiment of the present application.

[0375] Figure 44 This is the interaction process between device A (e.g., a mobile phone) and device B (e.g., a smart TV) provided in an embodiment of the present application.

[0376] Figure 45 This is the process of converting video resources into image information by the device A provided in the embodiment of the present application.

[0377] Figure 46 This is another schematic flowchart of the method for calling other device capabilities provided in an embodiment of the present application.

[0378] Figure 47 This is another schematic flowchart of the method for calling other device capabilities provided in an embodiment of the present application.

[0379] Figure 48 This is another schematic diagram of the system architecture provided by the embodiment of the present application.

[0380] Figure 49 This is a schematic flowchart of a method for device A to obtain user data provided in an embodiment of the present application.

[0381] Figure 50 This is a schematic flowchart of a method for authorization using other devices provided in an embodiment of the present application.

[0382] Figure 51 This is another schematic flowchart of the method for authorization using other devices provided in an embodiment of the present application.

[0383] Figure 52 This is another schematic flowchart of the method for authorization using other devices provided in an embodiment of the present application.

[0384] Figure 53 This is a schematic flowchart of a method for obtaining a verification code provided in an embodiment of the present application.

[0385] Figure 54 This is a schematic diagram of the process of device B transmitting a verification code to device A provided in an embodiment of the present application.

[0386] Figure 55 This is a schematic diagram of the process of parsing and reorganizing the verification code notification by device B provided in an embodiment of the present application.

[0387] Figure 56 This is another schematic flowchart of the method for obtaining a verification code provided in an embodiment of the present application.

[0388] Figure 57 This is another schematic flowchart of the method for obtaining a verification code provided in an embodiment of the present application.

[0389] Figure 58 This is another schematic diagram of the system architecture diagram provided in an embodiment of the present application.

[0390] Figure 59 This is a schematic flowchart of the text input method provided in an embodiment of the present application.

[0391] Figure 60 This is another schematic diagram of the system architecture diagram provided in an embodiment of the present application.

[0392] Figure 61 It is a schematic flow chart of the text editing method provided in an embodiment of the present application.

[0393] Figure 62 This is another schematic diagram of the system architecture diagram provided in an embodiment of the present application.

[0394] Figure 63 This is a schematic flowchart of a method for taking a screenshot of an image provided in an embodiment of the present application.

[0395] Figure 64 This is a schematic diagram of a process of transmitting image information between a first electronic device and a second electronic device provided in an embodiment of the present application.

[0396] Figure 65 This is a schematic flowchart of a method for calling the camera of other devices to capture images provided in an embodiment of the present application.

[0397] Figure 66 This is a schematic flowchart of a method for calling other devices to play audio or image information provided in an embodiment of the present application.

[0398] Figure 67 This is another set of graphical user interfaces provided by the embodiments of the present application.

[0399] Figure 68 This is another set of graphical user interfaces provided by the embodiments of the present application.

[0400] Figure 69 This is another set of graphical user interfaces provided by the embodiments of the present application.

[0401] Figure 70 This is another set of graphical user interfaces provided by the embodiments of the present application.

[0402] Figure 71 This is a schematic flowchart of a method for calling other device capabilities provided in an embodiment of the present application. DETAILED DESCRIPTION

[0403] The technical solutions in the embodiments of the present application will be described below in conjunction with the accompanying drawings in the embodiments of the present application. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "plurality" or "multiple" refers to two or more than two.

[0404] In the following, the terms "first" and "second" are used for descriptive purposes only and should not be understood to indicate or imply relative importance or implicitly specify the number of the technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of this embodiment, unless otherwise specified, "plurality" means two or more.

[0405] The method provided in the embodiments of the present application can be applied to electronic devices such as mobile phones, tablet computers, wearable devices, in-vehicle devices, augmented reality (AR) / virtual reality (VR) devices, laptop computers, ultra-mobile personal computers (UMPCs), netbooks, and personal digital assistants (PDAs). The embodiments of the present application do not impose any restrictions on the specific types of electronic devices.

[0406] For example, Figure 1 : The figure shows a schematic structural diagram of an electronic device 100. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display 194, and a subscriber identification module (SIM) card interface 195. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0407] It should be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0408] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0409] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0410] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.

[0411] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface.

[0412] The I2C interface is a bidirectional synchronous serial bus that includes a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple I2C bus lines. The processor 110 may be coupled to the touch sensor 180K, the charger, the flash, the camera 193, and the like via different I2C bus interfaces. For example, the processor 110 may be coupled to the touch sensor 180K via the I2C interface, enabling communication between the processor 110 and the touch sensor 180K via the I2C bus interface, thereby implementing the touch function of the electronic device 100.

[0413] The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the I2S interface, enabling the function of answering calls through a Bluetooth headset.

[0414] The PCM interface can also be used for audio communication, sampling, quantizing, and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface, enabling the function of answering calls via a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

[0415] The UART interface is a universal serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is typically used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 via the UART interface to implement Bluetooth functionality. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the UART interface, enabling the function of playing music through Bluetooth headphones.

[0416] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display 194 and the camera 193. MIPI interfaces include the camera serial interface (CSI) and the display serial interface (DSI). In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to implement the camera function of the electronic device 100. The processor 110 and the display 194 communicate via the DSI interface to implement the display function of the electronic device 100.

[0417] The GPIO interface can be configured via software. The GPIO interface can be configured as either a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to the camera 193, display 194, wireless communication module 160, audio module 170, sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0418] The USB interface 130 is an interface that complies with USB standards and may be a Mini USB interface, a Micro USB interface, a USB Type-C interface, or the like. The USB interface 130 can be used to connect a charger to charge the electronic device 100, or to transfer data between the electronic device 100 and peripheral devices. It can also be used to connect headphones to play audio. This interface can also be used to connect other electronic devices, such as augmented reality devices.

[0419] It is understood that the interface connection relationship between the modules illustrated in the embodiments of the present application is merely an illustrative illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods from the above embodiments, or a combination of multiple interface connection methods.

[0420] The charging management module 140 is configured to receive charging input from a charger. The charger can be either a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 can receive wireless charging input via the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also provide power to the electronic device via the power management module 141.

[0421] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and provides power to the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage, impedance). In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.

[0422] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0423] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.

[0424] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0425] The modem processor may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.) or displays an image or video through the display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

[0426] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0427] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0428] Electronic device 100 implements display functionality through a GPU, display screen 194, and an application processor. A GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.

[0429] Display screen 194 is used to display images, videos, and the like. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-oLed, or a quantum dot light-emitting diode (QLED). In some embodiments, electronic device 100 may include one or N display screens 194, where N is a positive integer greater than one.

[0430] The electronic device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.

[0431] The ISP processes data fed back by camera 193. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, which is then passed to the ISP for processing and converted into a visible image. The ISP can also perform algorithmic optimization on image noise, brightness, and skin tone. It can also optimize parameters such as exposure and color temperature of the captured scene. In some embodiments, the ISP can be located within camera 193.

[0432] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0433] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0434] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. This allows electronic device 100 to play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, and MPEG4.

[0435] The NPU is a neural network (NN) computing processor. Drawing on the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it rapidly processes input information and can continuously self-learn. The NPU can enable intelligent cognitive applications in electronic device 100, such as image recognition, face recognition, speech recognition, and text comprehension.

[0436] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 via the external memory interface 120 to implement data storage functions. For example, files such as music and videos can be stored on the external memory card.

[0437] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area can store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0438] The electronic device 100 can implement audio functions such as music playback and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0439] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be provided in the processor 110, or some functional modules of the audio module 170 can be provided in the processor 110.

[0440] The speaker 170A, also called a "speaker", is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or listen to hands-free calls through the speaker 170A.

[0441] The receiver 170B, also called a "handset", is used to convert audio electrical signals into sound signals. When the electronic device 100 receives a call or a voice message, the user can place the receiver 170B close to the ear to hear the voice.

[0442] Microphone 170C, also known as "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to the microphone 170C to input the sound signal into the microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In other embodiments, the electronic device 100 can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify the source of sound, realize directional recording function, etc.

[0443] The headphone jack 170D is used to connect a wired headphone and can be the USB interface 130 or a 3.5mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0444] Pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In some embodiments, pressure sensor 180A can be located on display screen 194. There are many types of pressure sensors 180A, such as resistive, inductive, and capacitive. A capacitive pressure sensor can include at least two parallel plates made of conductive material. When force acts on pressure sensor 180A, the capacitance between the electrodes changes. Electronic device 100 determines the intensity of the pressure based on this change in capacitance. When a touch operation is applied to display screen 194, electronic device 100 detects the touch intensity based on pressure sensor 180A. Electronic device 100 can also calculate the touch location based on the detection signal from pressure sensor 180A. In some embodiments, touch operations applied to the same touch location but with different touch intensities can correspond to different operation instructions. For example, when a touch operation with an intensity less than a first pressure threshold is applied to a short message application icon, a command to view short messages is executed. When a touch operation with an intensity greater than or equal to the first pressure threshold is applied to a short message application icon, a command to create a new short message is executed.

[0445] The gyroscope sensor 180B can be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (i.e., x, y, and z axes) can be determined by the gyroscope sensor 180B. The gyroscope sensor 180B can be used for anti-shake shooting. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of the electronic device 100 shaking, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to offset the shaking of the electronic device 100 through reverse movement to achieve anti-shake. The gyroscope sensor 180B can also be used for navigation and somatosensory game scenes.

[0446] The air pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device 100 calculates the altitude using the air pressure value measured by the air pressure sensor 180C to assist in positioning and navigation.

[0447] The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip case. In some embodiments, when the electronic device 100 is a flip phone, the electronic device 100 can detect the opening and closing of the flip cover based on the magnetic sensor 180D. Based on the detected opening and closing status of the case or flip cover, features such as automatic unlocking of the flip cover can be configured.

[0448] Accelerometer 180E can detect the magnitude of acceleration of electronic device 100 in all directions (generally three axes). It can also detect the magnitude and direction of gravity when electronic device 100 is stationary. It can also be used to identify the electronic device's posture, enabling applications such as switching between landscape and portrait modes and pedometers.

[0449] The distance sensor 180F is used to measure distance. The electronic device 100 can measure distance using infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 can use the distance sensor 180F to measure distance to achieve fast focusing.

[0450] The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 100 emits infrared light outward through the light emitting diode. The electronic device 100 uses a photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100. When insufficient reflected light is detected, the electronic device 100 can determine that there is no object near the electronic device 100. The electronic device 100 can use the proximity light sensor 180G to detect that the user is holding the electronic device 100 close to the ear to talk, so as to automatically turn off the screen to save power. The proximity light sensor 180G can also be used in leather case mode and pocket mode to automatically unlock and lock the screen.

[0451] Ambient light sensor 180L is used to sense ambient light brightness. Electronic device 100 can adaptively adjust the brightness of display screen 194 based on the perceived ambient light. Ambient light sensor 180L can also be used to automatically adjust white balance when taking photos. Ambient light sensor 180L can also work with proximity light sensor 180G to detect whether electronic device 100 is in a pocket to prevent accidental touches.

[0452] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application locks, fingerprint photography, fingerprint call answering, etc.

[0453] The temperature sensor 180J is used to detect temperature. In some embodiments, the electronic device 100 uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold, the electronic device 100 reduces the performance of the processor located near the temperature sensor 180J to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the electronic device 100 heats the battery 142 to prevent the electronic device 100 from shutting down abnormally due to low temperature. In other embodiments, when the temperature is lower than another threshold, the electronic device 100 boosts the output voltage of the battery 142 to prevent abnormal shutdown due to low temperature.

[0454] The touch sensor 180K is also called a "touch panel." The touch sensor 180K can be disposed on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen." The touch sensor 180K is used to detect touch operations applied thereto or in the vicinity thereof. The touch sensor can transmit the detected touch operations to the application processor to determine the type of touch event. Visual output related to the touch operations can be provided via the display screen 194. In other embodiments, the touch sensor 180K can also be disposed on the surface of the electronic device 100, in a location different from that of the display screen 194.

[0455] The bone conduction sensor 180M can obtain vibration signals. In some embodiments, the bone conduction sensor 180M can obtain vibration signals from the vibrating bones of the human body. The bone conduction sensor 180M can also contact the human pulse to receive blood pressure pulse signals. In some embodiments, the bone conduction sensor 180M can also be set in headphones to form bone conduction headphones. The audio module 170 can parse out voice signals based on the vibration signals of the vibrating bones of the human body obtained by the bone conduction sensor 180M to implement voice functions. The application processor can parse heart rate information based on the blood pressure pulse signals obtained by the bone conduction sensor 180M to implement heart rate detection functions.

[0456] The buttons 190 include a power button, a volume button, and the like. The buttons 190 may be mechanical buttons or touch buttons. The electronic device 100 may receive key inputs and generate key signal inputs related to user settings and function control of the electronic device 100.

[0457] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. For touch operations acting on different areas of the display screen 194, motor 191 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

[0458] The indicator 192 may be an indicator light, which may be used to indicate the charging status, power level changes, messages, missed calls, notifications, etc.

[0459] The SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to or disconnected from the electronic device 100 by inserting it into or removing it from the SIM card interface 195. The electronic device 100 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, and the like. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of the multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to implement functions such as calls and data communications. In some embodiments, the electronic device 100 uses an embedded SIM (eSIM) card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

[0460] It should be understood that the phone card in the embodiments of the present application includes but is not limited to a SIM card, an eSIM card, a universal subscriber identity module (USIM), a universal integrated circuit card (UICC), and the like.

[0461] The software system of the electronic device 100 can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. In the embodiment of the present application, the Android system with a layered architecture is used as an example to illustrate the software structure of the electronic device 100.

[0462] Figure 2 This is a block diagram of the software structure of the electronic device 100 according to an embodiment of the present application. The layered architecture divides the software into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer. The application layer may include a series of application packages.

[0463] like Figure 2 As shown, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc.

[0464] The application framework layer provides an application programming interface (API) and programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0465] like Figure 2 As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

[0466] The window manager is used to manage window programs. The window manager can obtain the display size, determine whether there is a status bar, lock the screen, take screenshots, etc.

[0467] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0468] The view system includes visual controls, such as those for displaying text and images. The view system is used to build applications. A display interface can consist of one or more views. For example, a display interface containing a text notification icon might include a view for displaying text and a view for displaying images.

[0469] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including answering, hanging up, etc.).

[0470] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0471] The Notification Manager allows applications to display notifications in the status bar. These messages can be displayed briefly and then disappear automatically without user interaction. For example, the Notification Manager is used to notify users of completed downloads and message reminders. The Notification Manager can also display notifications in the top status bar of the system as icons or scrolling text, such as notifications from background applications, or as dialog windows on the screen. Examples include displaying text messages in the status bar, emitting alert sounds, vibrating electronic devices, or flashing indicator lights.

[0472] Android Runtime includes core libraries and a virtual machine. Android runtime is responsible for scheduling and management of the Android system.

[0473] The core library consists of two parts: one is the function that needs to be called by the Java language, and the other is the Android core library.

[0474] The application layer and application framework layer run in a virtual machine. The virtual machine executes Java files in the application layer and application framework layer as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.

[0475] The system library can include multiple functional modules, such as a surface manager, media libraries, a 3D graphics processing library (such as OpenGL ES), and a 2D graphics engine (such as SGL).

[0476] The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.

[0477] The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library can support a variety of audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0478] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0479] A 2D graphics engine is a drawing engine for 2D drawings.

[0480] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, and sensor driver.

[0481] It should be understood that the technical solutions in the embodiments of the present application can be used in Android, IOS, Hongmeng and other systems.

[0482] Before introducing the technical solutions of the embodiments of the present application, we first Figure 3 and Figure 4 The network architecture and notification method provided by the embodiments of the present application are introduced.

[0483] like Figure 3 As shown in (a), Figure 3(a) in the figure shows a schematic diagram of a network architecture 200 provided in an embodiment of the present application. The network architecture 200 includes multiple electronic devices. Among them, the electronic devices may include a mobile phone 201, a watch 202, a smart speaker 203, a personal computer (or laptop) 204, a smart TV 205, a tablet computer 206, etc., and the embodiment of the present application does not impose any restrictions on this. Among them, each electronic device can communicate with each other. The multiple electronic devices can be connected to a local area network (LAN) via a wired or Wi-Fi connection; they can also communicate through a mobile network or the Internet.

[0484] For example, when the network architecture 200 is located in a home environment, multiple electronic devices may be located in the same local area network. Figure 3 As shown in (a), the network architecture 200 may further include a router 207, which may be configured as an access point (AP) for providing a signal source for the network. Furthermore, each electronic device in the network architecture 200 may access the router 207 as a station (STA). The router 207 may communicate with each electronic device separately via a wired network or a wireless network. Exemplarily, a Wi-Fi link is established between each electronic device through the Wi-Fi protocol to enable communication between devices. Specifically, a peer-to-peer (P2P) connection (or Wi-Fi Direct) is established between each electronic device, or each electronic device accesses the same router 207 to enable communication between devices.

[0485] Optionally, the devices may also use the Bluetooth protocol to establish a Bluetooth link, and realize communication between the devices based on the Bluetooth link; or, the electronic devices may also be interconnected through a cellular network; or, the electronic devices may also be interconnected through a switching device (for example, a USB data cable or a Dock device), thereby realizing the communication function between the electronic devices. The embodiments of the present application do not limit this.

[0486] In one possible implementation, the network architecture 200 further includes a third-party server 208. The third-party server 208 may be a server for third-party application software, connected to the electronic device via a network. The third-party server 208 may send notification information to the electronic device. The number of third-party servers 208 is not limited to one and may be multiple, which is not a limitation herein.

[0487] like Figure 3 As shown in (b), Figure 3(b) shows another schematic diagram of a network architecture 300 provided in an embodiment of the present application. The network architecture 300 includes multiple electronic devices. Among them, the electronic devices may include a smart phone 201, a smart watch 202, a smart speaker 203, a personal computer 204, a smart TV 205, a tablet computer 206, etc., and the embodiment of the present application does not impose any restrictions on this. Among them, there is a central device between multiple electronic devices, such as a smart phone 201. A Wi-Fi P2P GO, namely Group Owner, is created on the central device, and other devices connect to this GO as P2P GC, namely Group Client, so that these devices form a one-to-many network and can communicate with each other.

[0488] In one possible implementation, the network architecture further includes a third-party server 208. The third-party server 208 may be a server for third-party application software and is connected to the smartphone 201 via a network. The third-party server 208 sends notification information to the smartphone 201. The number of third-party servers 208 is not limited to one and may be multiple, which is not a limitation herein.

[0489] like Figure 3 As shown in (c), Figure 3 (c) in the figure shows another schematic diagram of a network architecture 400 provided in an embodiment of the present application. The network architecture 300 includes multiple electronic devices. Among them, the electronic devices may include a smartphone 201, a smart watch 202, a smart speaker 203, a personal computer 204, a smart TV 205, a tablet computer 206, etc., and the embodiment of the present application does not impose any restrictions on this. Among them, the smartphone 201, the smart watch 202, the smart speaker 203, the personal computer 204, the smart TV 205, and the tablet computer 206 can be devices under the same account (for example, a Huawei account), then the devices under the account can establish a connection through the cloud server 209.

[0490] The following combination Figure 4 The present invention provides a method for invoking the capabilities of other devices, including:

[0491] S401: A first device obtains a first task.

[0492] Exemplarily, the first device is a smart TV. When the focus of the smart TV is a text input box or a key in an input method, the first task acquired by the smart TV is that the user currently needs to input text.

[0493] Exemplarily, the first device is a laptop computer. When the laptop computer detects that a user obtains a verification code through a mobile phone number, the first task obtained by the laptop computer is to enter a verification code.

[0494] Exemplarily, the first device is a laptop computer. When the laptop computer detects that the user has selected a text content and right-clicked, the first task acquired by the laptop computer is that the user may copy, paste, translate, or extract words from the text content.

[0495] Exemplarily, the first device is a laptop computer. When the laptop computer detects a user logging in by using a second application on the login interface of the first application, the first task obtained by the laptop computer is that the user wishes to log in to the first application using the account information of the second application.

[0496] S402: The first device requests the second device to execute the first task.

[0497] In the embodiment of the present application, the first device may be a device capable of performing a first task. Although the first device is capable of performing the first task, there may be other devices around the first device that are more suitable for performing the first task (for example, a second device). In this case, the first device may request the second device to perform the first task.

[0498] For example, the first task acquired by the smart TV is that the user currently needs to perform text input. Although the smart TV has a text input function, the smart TV can request a mobile phone (a device that is more suitable for performing text input) to perform text input.

[0499] For example, the first task acquired by the smart TV is a task of playing audio. Although the smart TV has the ability to play audio, there may be other devices around the smart TV that are more suitable for playing audio (for example, smart speakers), so the smart TV can request the smart speaker to play audio.

[0500] In the embodiment of the present application, the first device may also be a device that does not have the ability to perform the first task.

[0501] For example, the first task obtained by the laptop is to enter a verification code. Since the laptop does not include a SIM card corresponding to the mobile phone number entered by the user, the laptop can send a verification code request to the device including the SIM card (for example, a mobile phone). The verification code request is used to request the mobile phone to send the obtained verification code to the laptop.

[0502] For example, the first task acquired by the laptop computer is that the user may translate text content or perform other operations. Since the laptop computer does not include a translation function, the laptop computer can send the text content and request information to a device that includes a translation function (for example, a mobile phone). The request information is used to request the mobile phone to translate the text content.

[0503] For example, the first task obtained by the laptop is that the user wants to log in to the first application using the account information of the second application. When the laptop determines that the second application is not installed on the laptop, it can send an authorization request to the device (for example, a mobile phone) where the second application is installed. The authorization request is used to request the second application on the mobile phone to authorize the first application.

[0504] S403: The second device sends a processing result of the first task to the first device.

[0505] For example, after the smart TV requests the mobile phone to input text, the mobile phone can detect the text content input by the user on the mobile phone and synchronize the detected text content to the smart TV in real time.

[0506] Exemplarily, after the laptop sends a verification code request to the mobile phone, the mobile phone may send the obtained verification code to the laptop.

[0507] For example, the laptop computer may send the text content and the request information to the mobile phone, and the mobile phone may translate the text content and send the translation result to the laptop computer.

[0508] For example, after the laptop sends an authorization request to the mobile phone, the mobile phone can send information for authorizing login (e.g., an access token) to the laptop, so that the laptop can use the information for authorizing login to request the account information of the second application from the server of the second application.

[0509] In an embodiment of the present application, when the first device does not have the ability to perform the first task, or when the first device finds that there is a device that is more suitable for performing the first task, the first device can request a device that has the ability to perform the first task or a device that is more suitable for performing the first task to perform the first task, thereby helping the user to complete the first task conveniently and quickly, and helping to improve the user experience.

[0510] The following describes the embodiments of the present application in detail with reference to a graphical user interface (GUI).

[0511] Figure 5 It is a set of GUIs provided in the embodiments of this application.

[0512] See also Figure 5In the GUI shown in (a), the laptop displays a text (in English) on the screen, while the mobile phone displays the desktop of the mobile phone. When the laptop detects that the user has selected the text "Today is...first" and clicked the right button of the mouse, it displays the following Figure 5 The GUI shown in (b) in FIG.

[0513] In one embodiment, a wireless connection (eg, Bluetooth, Wi-Fi, or NFC) may be established between the laptop computer and the mobile phone; or, the laptop computer and the mobile phone may be connected via a wired connection.

[0514] In one embodiment, the same account (e.g., Huawei ID) is logged in on the laptop and the mobile phone; or, the Huawei IDs logged in on the laptop and the mobile phone are in the same family group; or, the mobile phone has authorized the laptop to access the mobile phone's capabilities.

[0515] See also Figure 5 In the GUI shown in (b), in response to detecting that the user has selected the English content and has clicked the right button of the mouse, the laptop computer can display a function list 501. The function list 501 includes cut, copy, paste, word retrieval and translation functions. Cut, copy and paste are the functions of the laptop computer, and word retrieval and translation are the functions of the mobile phone. When the laptop computer detects that the user has selected the translation function 502, it displays the following: Figure 5 The GUI shown in (c) in FIG.

[0516] In one embodiment, the laptop computer can request the mobile phone's capability information when establishing a wireless connection (or wired connection) with the mobile phone. After receiving the request, the mobile phone can send its own capability information (e.g., translation, smart object recognition, word retrieval, smart assistant, etc.) to the laptop computer. Thus, when the laptop computer detects that the user has selected the English content and has clicked the right button of the mouse, the mobile phone's functions (e.g., Figure 5 (the word retrieval and translation functions shown in the function list in (b)).

[0517] In one embodiment, if the same account (for example, Huawei ID) is logged in on a mobile phone and a laptop, the laptop can also request the capability information of other devices under the account from the cloud server. After receiving the request, the cloud server can send a request to other devices under the account (other devices may include mobile phones), and the request is used to request the capability information of other devices. After receiving the capability information of other devices, the cloud server can send the capability information of other devices to the laptop. Thus, when the laptop detects that the user has selected the English content and detects that the user has clicked the right button of the mouse, the functions of the mobile phone (such as Figure 5 (the word retrieval and translation functions shown in the function list in (b)).

[0518] In one embodiment, Figure 5 The word retrieval and translation functions shown in the function list 501 in (b) can come from different devices. For example, the laptop computer determines that the capability information of mobile phone A includes the word retrieval function and the capability information of mobile phone B includes the translation function. Therefore, when the mobile phone detects that the user has selected the English content and clicked the right button of the mouse, the function from mobile phone A (such as Figure 5 The word retrieval function shown in the function list in (b) of the mobile phone B) and the function from the mobile phone B (such as Figure 5 translation function shown in the function list in (b)).

[0519] In one embodiment, when the notebook computer detects that the user has selected English content, the notebook computer can display the function list 501 without detecting that the user has clicked the right button of the mouse.

[0520] See also Figure 5 In the GUI shown in (c) of FIG, in response to detecting that a user selects the translation function 502, the laptop computer sends the original text content and a request message to the mobile phone, wherein the request message is used to request the mobile phone to translate the original text content. After receiving the request message and the original text content, the mobile phone can translate the original text content to obtain the corresponding translation content. The mobile phone can send the translation content to the laptop computer. After receiving the translation content, the laptop computer can display a prompt box 503, wherein the prompt box 503 includes the translation content.

[0521] In one embodiment, in response to detecting that the user has selected the translation function 502, the laptop computer may prompt the user to select a language (e.g., Chinese, Japanese, Korean, Spanish, etc.) to translate the original text into. After the laptop computer detects that the user has selected the operation to translate the original text into Chinese, the laptop computer may send the original text content and a request message to the mobile phone, wherein the request message is used to request the mobile phone to translate the original text content into Chinese.

[0522] In one embodiment, the prompt box 503 can be dragged, and the length and width of the prompt box 503 can also be adjusted, so as to facilitate the user to compare the original text and the translation.

[0523] See also Figure 5 The GUI shown in (d) is another display interface for the laptop computer for the translation result. The mobile phone can overwrite the currently selected original text through a prompt box 504, which includes the translation content (for example, the mobile phone automatically translates the original text into Chinese). The prompt box 504 also includes controls such as copying, saving to local computer, and displaying the original text.

[0524] In one embodiment, after receiving the original text and the request information, the mobile phone can translate the original text. For example, if the default language of the mobile phone is Chinese, the mobile phone can translate the original text into Chinese. If the original text is in Chinese, the mobile phone can translate the original text into English by default.

[0525] In the embodiment of the present application, the user can use the functions of another device on one device, which expands the capability boundary of the device and also enables the device to complete some difficult tasks conveniently and efficiently. Figure 5 The GUI shown here eliminates the need for users to log into a translation website or open a translation app (e.g., switching back and forth between the translation software and the original text). Instead, the laptop displays the translation function from the mobile phone directly on the original text display interface, allowing users to translate the original text in real time using their mobile phone. This improves user efficiency when translating the original text, avoids excessive user operations during translation, and thus enhances the user experience.

[0526] Figure 6 This is another set of GUIs provided in an embodiment of the present application.

[0527] See also Figure 6 In the GUI shown in (a), the laptop displays picture 601 on the display screen, and the mobile phone displays the desktop of the mobile phone. When the laptop detects that the user clicks the right button of the mouse on the picture, it displays the following Figure 6 The GUI shown in (b) in FIG.

[0528] In one embodiment, a wireless connection (eg, Bluetooth, Wi-Fi, or NFC) may be established between the laptop computer and the mobile phone; or, the laptop computer and the mobile phone may be connected via a wired connection.

[0529] In one embodiment, the same account (e.g., Huawei ID) is logged in on the laptop and the mobile phone; or, the Huawei IDs logged in on the laptop and the mobile phone are in the same family group; or, the mobile phone has authorized the laptop to access the mobile phone's capabilities.

[0530] See also Figure 6 In the GUI shown in (b), in response to detecting that the user clicks the right button of the mouse on the picture, the laptop computer can display a function list 602. Among them, the function list 602 includes functions such as sending pictures to mobile phones, saving pictures as, copying pictures, full-screen viewing, object recognition, shopping, translation and word retrieval. Among them, the functions of sending pictures to mobile phones, saving pictures as, copying pictures and full-screen viewing are functions of the laptop computer, and the functions of recognizing objects, shopping, translation and word retrieval are functions of the mobile phone. When the laptop computer detects that the user selects the operation of the object recognition function 603, it displays the following Figure 6 The GUI shown in (c) in FIG.

[0531] It should be understood that the process of displaying the object recognition, shopping, translation and word retrieval functions from the mobile phone on the laptop can refer to Figure 5 For the sake of brevity, the description in the embodiments will not be repeated here.

[0532] See also Figure 6 In the GUI shown in (c), in response to detecting that the user has selected the object recognition function 603, the laptop sends the picture and request information to the mobile phone, and the request information is used to request the mobile phone to recognize the content of the picture. After receiving the picture and the request information, the mobile phone can recognize the content on the picture. When the mobile phone completes the recognition of the content on the picture, the mobile phone can send the object recognition result to the laptop. In response to receiving the object recognition result of the mobile phone for the picture, the laptop can display a prompt box 604, wherein the prompt box 604 includes the prompt information "The following similar content is found for you", the source of information (for example, xx website), the name of the object in the picture (for example, football), and multiple shopping links for the object (for example, shopping link 1, shopping link 2 and shopping link 3).

[0533] In the embodiment of the present application, the user does not need to log in to the object recognition software or send the image to the object recognition website for object recognition. The laptop can directly display the object recognition function from the mobile phone on the image display interface, so that the content in the image can be recognized by the mobile phone. This can improve the efficiency of the user in identifying objects in the image, thereby helping to enhance the user experience.

[0534] Figure 7 This is another set of GUIs provided in an embodiment of the present application.

[0535] See also Figure 7 In the GUI shown in (a), the laptop displays picture 701 on the display screen, and the mobile phone displays the desktop of the mobile phone. When the laptop detects that the user clicks the right button of the mouse on the picture 701, it displays the following Figure 7 The GUI shown in (b) in FIG.

[0536] In one embodiment, a wireless connection (eg, Bluetooth, Wi-Fi, or NFC) may be established between the laptop computer and the mobile phone; or, the laptop computer and the mobile phone may be connected via a wired connection.

[0537] In one embodiment, the same account (e.g., Huawei ID) is logged in on the laptop and the mobile phone; or, the Huawei IDs logged in on the laptop and the mobile phone are in the same family group; or, the mobile phone has authorized the laptop to access the mobile phone's capabilities.

[0538] See also Figure 7 In the GUI shown in (b), in response to detecting that the user clicks the right button of the mouse on the picture 701, the laptop computer can display a function list 702. Among them, the function list 702 includes functions such as sending pictures to mobile phones, saving pictures as, copying pictures, full-screen viewing, object recognition, shopping, translation and word retrieval. Among them, the functions of sending pictures to mobile phones, saving pictures as, copying pictures and full-screen viewing are functions of the laptop computer, and the functions of recognizing objects, shopping, translation and word retrieval are functions of the mobile phone. When the laptop computer detects that the user selects the word retrieval function 703, it displays the following Figure 7 The GUI shown in (c) in FIG.

[0539] It should be understood that the process of displaying the object recognition, shopping, translation and word retrieval functions from the mobile phone on the laptop can refer to the description in the above embodiment, and for the sake of brevity, it will not be repeated here.

[0540] See also Figure 7 In the GUI shown in (c) of FIG, in response to detecting that the user has selected the word extraction function 703, the laptop computer sends the image and a request message to the mobile phone, requesting the mobile phone to extract the words from the image. After receiving the image and the request message, the mobile phone can recognize the text in the image. For example, the mobile phone can use optical character recognition (OCR) to recognize the text in the image.

[0541] In one embodiment, after recognizing the text in the image, the mobile phone can continue to perform word segmentation processing on the text.

[0542] Mobile phones can segment the recognized text using word segmentation techniques in natural language processing (NLP). Word segmentation is a relatively basic module in NLP. For Latin-based languages ​​like English, words can generally be easily and accurately extracted because they are separated by spaces. However, in languages ​​like Chinese and Japanese, characters are closely connected, lacking clear word boundaries, except for punctuation, making it difficult to extract word segments. Currently, word segmentation can be performed on text content using a number of methods. For example, dictionary-based methods, such as string matching, match a text segment against an existing dictionary. If a match is found, the segment is considered a word segment. Another example is using forward maximum matching, reverse maximum matching, or bidirectional maximum matching methods for word segmentation. For example, for the text content "No hardship or difficulty can stop us from moving forward," the electronic device segmented the text content to obtain 10 words: "any," "hardship," "hardship," "all," "cannot," "block," "us," "forward," "of," and "pace."

[0543] It should be understood that in the embodiments of the present application, the method of performing word segmentation processing on the text content can refer to the word segmentation method of the prior art, and for the sake of brevity, it will not be repeated here.

[0544] After the mobile phone completes the text recognition and word segmentation processing on the image, the mobile phone can send the word extraction result to the laptop. In response to receiving the word extraction result, the laptop can display a prompt box 704, wherein the prompt box 704 includes the word extraction result of the text in the image and the word segmentation result of the recognized text.

[0545] When the notebook computer detects that the user has selected the content of the word retrieval result and clicked the right button of the mouse, the notebook computer can display the following Figure 7 Function list 705 shown in (c) of FIG. 7 includes a copy and a translate function. The copy function 706 is a function of the laptop computer, and the translate function is a function of the mobile phone. When the mobile phone detects that the user has selected the copy function, the mobile phone can copy the word retrieval result.

[0546] In this embodiment of the application, the user does not need to manually input the corresponding text by referring to the content on the image. The laptop can directly display the word retrieval function from the mobile phone on the image display interface, so that the user can use the mobile phone to perform word retrieval and word segmentation operations on the content on the image. This can improve the efficiency of converting the text on the image into a string, thereby helping to improve the user experience.

[0547] Figure 8 This is another set of GUIs provided in an embodiment of the present application.

[0548] See also Figure 8 In the GUI shown in (a), the laptop displays the laptop desktop through the display screen, and the mobile phone displays the mobile phone desktop. The laptop desktop includes document 1. When the laptop detects that the user clicks the right button of the mouse on the document 1, the following is displayed: Figure 8 The GUI shown in (b) in FIG.

[0549] In one embodiment, a wireless connection (eg, Bluetooth, Wi-Fi, or NFC) may be established between the laptop computer and the mobile phone; or, the laptop computer and the mobile phone may be connected via a wired connection.

[0550] In one embodiment, the same account (e.g., Huawei ID) is logged in on the laptop and the mobile phone; or, the Huawei IDs logged in on the laptop and the mobile phone are in the same family group; or, the mobile phone has authorized the laptop to access the mobile phone's capabilities.

[0551] See also Figure 8 In the GUI shown in (b), in response to detecting that the user clicks the right button of the mouse on the document 1, the laptop computer can display a function list 801. The function list 801 includes functions such as open, copy, cut, print, translate and retrieve words. The open, copy, cut and print functions are functions of the laptop computer, and the translate and retrieve words functions are functions of the mobile phone. When the laptop computer detects that the user selects the translation function 802, it displays the following: Figure 8 The GUI shown in (c) in FIG.

[0552] See also Figure 8 In the GUI shown in (c) of FIG, in response to detecting that the user has selected the translation function 802, the laptop computer sends the document 1 and a request message to the mobile phone, requesting the mobile phone to translate the content of the document 1. After receiving the request message and the document 1, the mobile phone can translate the content of the document 1 to obtain the corresponding translation content. The mobile phone can send the translation content to the laptop computer. After receiving the translation content, the laptop computer can display a prompt box 803, wherein the prompt box 803 includes the translation content.

[0553] In one embodiment, in response to detecting that the user has selected the translation function 802, the laptop computer may prompt the user to select a language (e.g., Chinese, Japanese, Korean, Spanish, etc.) to translate the original text into. After the laptop computer detects that the user has selected the operation to translate the original text into Chinese, the laptop computer may send the document 1 and a request message to the mobile phone, wherein the request message is used to request the mobile phone to translate the content of the document 1 into Chinese.

[0554] In this embodiment of the present application, instead of the user opening a document and copying the text into a translation application or website, the laptop can directly display the translation function from the mobile phone after detecting the user's right-click on the document, allowing the user to translate the content of the document using the mobile phone. This can improve the efficiency of the user when translating the original text, avoid excessive user operations during the translation process, and thus enhance the user experience.

[0555] Figure 9 This is another set of GUIs provided in an embodiment of the present application.

[0556] See also Figure 9 In the GUI shown in (a), the laptop displays its desktop on its display, while the mobile phone displays its desktop. The laptop's desktop includes a function list 901, which includes intelligent voice, shopping, translation, word retrieval, and object recognition. The functions in function list 901 are from the mobile phone.

[0557] In one embodiment, after a laptop and a mobile phone establish a wireless connection, the laptop can request the mobile phone's capability information. Upon receiving the request, the mobile phone can send its own capability information (e.g., intelligent voice, shopping, translation, word retrieval, object recognition, etc.) to the laptop. The laptop can then display a function list 901 on the desktop.

[0558] In one embodiment, if the same account (e.g., Huawei ID) is logged in on a mobile phone and a laptop, the laptop can also request the capability information of other devices under the account from the cloud server. After receiving the request, the cloud server can send a request to other devices under the account (e.g., other devices can include mobile phones), requesting the capability information of other devices. After receiving the capability information of other devices, the cloud server can send the capability information of other devices to the laptop. Thus, the laptop can display the function list 901 on the desktop.

[0559] In one embodiment, Figure 9The smart voice, shopping, translation, word retrieval, and object recognition functions shown in the function list 901 in (a) can come from different devices. For example, the laptop computer determines that the capability information of mobile phone A includes the smart voice function and the capability information of mobile phone B includes the shopping, translation, word retrieval, and object recognition functions. Thus, the laptop computer can display the functions from mobile phone A (such as Figure 9 The smart voice function shown in the function list in (a)) and the function from mobile phone B (such as Figure 9 shopping, translation, word retrieval, and object recognition functions shown in the function list in (a).

[0560] See also Figure 9 In the GUI shown in (b) of FIG, a photo 2 is displayed on the laptop. At this time, the user wants to view the shopping link of a product in the photo, so the user can use the shopping function to view it. When the laptop detects that the user clicks the shopping function 902, the laptop can display the following Figure 9 The GUI shown in (c) in FIG.

[0561] See also Figure 9 In the GUI shown in (c), in response to the laptop detecting that the user clicks on the shopping function 902, the laptop may display a window 903. The size of the window 903 may change in response to the user's operation (for example, the user uses a cursor to drag the edge of the window 903 to the left or right), and the position of the window 903 may change in response to the user's operation (for example, the user uses a cursor to drag the window 903 to another display area).

[0562] In one embodiment, when the laptop detects that window 903 remains unchanged for a first preset time period, the laptop can obtain the image information of window 903 and send the image information and a first request message to the mobile phone. The first request message is used to request the mobile phone to identify the object in the image information and request the mobile phone to query the shopping link of the object. In response to receiving the image information and the first request message, the mobile phone identifies the object in the image information (for example, the mobile phone can identify the object in the image information as a smart TV). And the mobile phone queries the shopping link of the identified object through the server (for example, the server of the shopping app). The mobile phone can send the thumbnail of the smart TV and the shopping link queried to the laptop (for example, shopping link 1, shopping link 2, shopping link 3 and shopping link 4).

[0563] See also Figure 9 In the GUI shown in (d) of FIG, in response to receiving the thumbnail image and the shopping link of the object, the laptop computer may display a prompt box 904. The prompt box 904 includes a prompt message "The following similar content is found for you" and the thumbnail image of the object and the shopping link information.

[0564] In one embodiment, the laptop computer can also respond to the user clicking on the shopping link 1 by viewing the website corresponding to the shopping link through the browser application on the laptop computer, thereby enabling the user to browse the goods to be purchased.

[0565] See also Figure 9 In the GUI shown in (e), in response to the user adjusting the size and position of window 903, other objects in photo 2 are displayed in window 903 currently displayed on the laptop. In response to detecting that window 903 remains unchanged for a first preset time period, the laptop can obtain another image information of window 903 and send the other image information and a second request information to the mobile phone. The second request information is used to request the mobile phone to identify the other image information and request the mobile phone to query the shopping link of the object. In response to receiving the other image information and the second request information, the mobile phone identifies the image information (for example, the mobile phone can identify the object in the image information as a smart speaker). And the mobile phone queries the shopping links of the identified objects (for example, shopping link 5, shopping link 6, shopping link 7 and shopping link 8) through the server (for example, the server of the shopping app). The mobile phone can send the thumbnail of the queried object and the shopping link to the laptop.

[0566] See also Figure 9 In the GUI shown in (e) of FIG, in response to receiving the thumbnail image and shopping link of the object, the laptop computer may update the thumbnail image and shopping link information displayed in prompt box 904. Prompt box 904 includes the prompt message "The following similar content is found for you" and the thumbnail image of the smart speaker and shopping link information (e.g., shopping link 5, shopping link 6, shopping link 7, and shopping link 8).

[0567] In the embodiment of the present application, the user does not need to log in to the object recognition software or send the image to the object recognition website for object recognition. The laptop can directly display the object recognition function from the mobile phone on the image display interface, so that the content in the image can be recognized by the mobile phone. This can improve the user's efficiency in identifying objects in the image, thereby helping to enhance the user experience. At the same time, the user only needs to update the position of the window on the laptop to obtain the shopping link corresponding to the object in the window in real time, which helps to enhance the user's shopping experience.

[0568] Figure 10 This is another set of GUIs provided in an embodiment of the present application.

[0569] See also Figure 10In the GUI shown in (a), the laptop displays its desktop on its display, while the mobile phone displays its desktop. The laptop's desktop includes a function list 1001, which includes intelligent voice, shopping, translation, word retrieval, and object recognition. The functions in function list 1001 are from the mobile phone.

[0570] It should be understood that the process of the notebook computer displaying the function list 1001 can refer to the description in the above embodiment, and for the sake of brevity, it will not be repeated here.

[0571] When the notebook computer detects that the user clicks on the smart voice function 1002, the notebook computer can start detecting the voice command input by the user. Figure 10 As shown in (a), in response to receiving the user's voice command "What's the weather like today", the laptop can send the voice command and request information to the mobile phone, and the request information is used to request the mobile phone to recognize the user's intention in the voice command. In response to receiving the voice command and the request information sent by the laptop, the mobile phone can analyze the voice command. The automatic speech recognition (ASR) module of the mobile phone can first forward the voice information into text information, and then analyze the text information. The mobile phone can identify the slot information and user intention in the text information through the natural language understanding (NLU) module.

[0572] For example, Table 1 shows the user intention and slot information determined by the mobile phone.

[0573] Table 1

[0574] Intent "Check the weather" slot Time = "Today"

[0575] It should be understood that the process of analyzing the voice command by the mobile phone can refer to the existing technology, and for the sake of brevity, it will not be repeated here.

[0576] After obtaining the slot information and the user's intent from the text message, the mobile phone can send these information to the mobile phone's intent processing module. The intent processing module can determine that the user's intent is "check the weather" and that the slot information associated with this intent is "today," thereby querying today's weather for the user. After querying today's weather information, the mobile phone can send this weather information to the laptop.

[0577] See also Figure 10 In the GUI shown in (b), in response to receiving the weather information, the laptop computer can prompt the user through voice “It will be cloudy and then sunny today, and the temperature will be between 10°C and 22°C”.

[0578] In one embodiment, after querying and obtaining the weather information, the mobile phone can send text information corresponding to the weather information to the laptop computer. The laptop computer can convert the text information into voice information through the ASR module, thereby prompting the user with the voice information.

[0579] In another embodiment, after obtaining the weather information, the mobile phone can convert the text information corresponding to the weather information into a voice message through the mobile phone's ASR module, and then send the voice message to the laptop. In response to receiving the voice message, the laptop prompts the user with the voice message.

[0580] In an embodiment of the present application, when a user uses the smart voice function from a mobile phone on a laptop, the user does not need to switch to the mobile phone to issue voice commands, but instead issues voice commands to the mobile phone through the laptop, thereby improving the convenience of the user when using smart voice. Since most current laptops also have smart voice capabilities, but may use different voice assistants than mobile phones, for example, the voice assistant of a laptop (for example, a laptop with a Windows system) is Cortana, the voice assistant of a Huawei phone is Xiaoyi, and the voice assistant of Apple is Siri, and so on. In this way, when using a voice assistant, the user does not need to switch wake-up words and usage habits, which helps to improve the user experience. In addition, since mobile phones have more data support than laptops, this can also ensure the accuracy of the data obtained by the user.

[0581] Combination of the above Figures 5 to 8 The invention introduces that the user can right-click a certain position on the display screen to display the capability information from other devices in the pop-up function list of the laptop computer, and Figure 9 and Figure 10 It is introduced that capability information from other devices is displayed by adding a function list 901 and a function list 1001 on the laptop side. In the embodiment of the present application, there is no limitation on the way in which the user uses the capability information of other devices. For example, the user can customize a shortcut key on the laptop to call the capability information of the mobile phone. Alternatively, the user can customize a shortcut key to call up a function list from other devices, so that the user can choose to use a function from other devices in the function list. For example, when the laptop detects that the user has selected a piece of text and clicked the Tab key and the T key on the keyboard, the translation function of the other device can be called, so that the laptop can send the text and request information to the other device, and the request information is used to request translation of the text.

[0582] It should be understood that Figures 5 to 10In the GUI shown, the mobile phone may receive the first content and request information sent by the laptop computer while the mobile phone's desktop is displayed, and the mobile phone processes the first content using the first function based on the request information. The embodiments of the present application are not limited to this, and the mobile phone may receive the first content and request information in other states.

[0583] For example, the mobile phone receives the first content and the request information when the screen is off, and then the mobile phone processes the first content using the first function according to the request information. It should be understood that the mobile phone can use the first function to process the first content when the screen is off.

[0584] For example, when a mobile phone is running an application (e.g., a game app) and receives the first content and request information, the mobile phone processes the first content using the first function based on the request information. It should be understood that the state of the mobile phone (the state of the running application) may not change upon receiving the first content and request information.

[0585] Figure 11 This is another set of GUIs provided in an embodiment of the present application.

[0586] See also Figure 11 In the GUI shown in (a), the smart TV displays photo 1, which includes an English sentence "Today is a sunny...outing!"; at this time, the mobile phone displays the mobile phone's desktop.

[0587] See also Figure 11 In the GUI shown in (b) of Figure 1, when the mobile phone detects a user pressing the screen with two fingers, it can send a command to the smart TV, instructing the smart TV to capture the image information currently displayed on the smart TV. In response to receiving the command sent by the mobile phone, the smart TV sends the image information currently displayed on the display to the mobile phone. In response to receiving the image information sent by the smart TV, the mobile phone can use optical character recognition (OCR) to recognize the text in Photo 1, thereby obtaining the string information "Today is a sunny...outing!"

[0588] See also Figure 11 The GUI shown in (c) is a string information display interface. After the mobile phone recognizes the string information, it can display the string information on the display screen and display a prompt box 1101. The prompt box 1101 includes the result of the mobile phone's word segmentation of the string information and a full-screen translation control. After the mobile phone displays the string information display interface for a preset duration (for example, 3 seconds), it can automatically translate the string information.

[0589] In one embodiment, if the mobile phone determines that the photo 1 only includes text content after identifying the photo 1, the mobile phone can automatically translate the identified character string information.

[0590] For example, if the default language of the mobile phone is Chinese, and the mobile phone determines that the language corresponding to the string information is non-Chinese content (for example, English), the mobile phone can automatically translate the string content into Chinese.

[0591] In one embodiment, after obtaining the character string information, the mobile phone may further display a prompt message to the user, where the prompt message is used to prompt the user which language (eg, Chinese, Japanese, Korean, Spanish, etc.) the character string content is translated into.

[0592] See also Figure 11 The GUI shown in (d) is a translation display interface. When the mobile phone completes the translation of the string information, the corresponding translation content "Today is a sunny Sunday...Autumn outing!" can be displayed on the display screen.

[0593] In one embodiment, the mobile phone can send the translated content to the smart TV while displaying the translated text display interface.

[0594] In one embodiment, when the mobile phone detects that the user presses the screen with both hands, the mobile phone can also directly display the following Figure 11 The GUI shown in (d) in FIG.

[0595] See also Figure 11 In the GUI shown in (e), in response to receiving the translated content sent by the mobile phone, the smart TV can display the translated content.

[0596] In an embodiment of the present application, a user can use the function of another device (e.g., a mobile phone) on a device (e.g., a smart TV), which expands the capability boundary of the device and also enables the device to complete some more difficult tasks conveniently and efficiently. The user does not need to input the text in the photo displayed on the smart TV into the translation software or upload it to the translation website. The preset operation triggers the mobile phone to obtain image information from the smart TV. After obtaining the image information, the mobile phone can identify the string information, and the mobile phone can translate the string information. The smart TV can directly display the translation result of the mobile phone to the original text on the display interface of the original text, which can improve the efficiency of the user in translating the original text, avoid excessive user operations when translating the original text, and thus enhance the user experience.

[0597] Figure 12 This is another set of GUIs provided in an embodiment of the present application.

[0598] See also Figure 12 In the GUI shown in (a), the smart TV displays photo 2, which includes image information of a football; at this time, the mobile phone displays the lock screen interface.

[0599] See also Figure 12 In the GUI shown in (b) of FIG, when the mobile phone detects a user pressing the screen with two fingers, the mobile phone can send a command to the smart TV, instructing the smart TV to capture the image information currently displayed on the smart TV. In response to receiving the command sent by the mobile phone, the smart TV sends the image information currently displayed on the display to the mobile phone. In response to receiving the image information sent by the smart TV, the mobile phone can identify the object in the image information, thereby obtaining an object recognition result for the object.

[0600] In one embodiment, when the mobile phone detects that the user has pressed the screen with two fingers, the mobile phone can collect the user's fingerprint information and match the collected fingerprint information with the fingerprint information preset in the mobile phone. If the match is successful, the mobile phone can be unlocked to enter the non-lock screen interface. When the mobile phone receives the image information sent by the smart TV, it can identify the image information and display it as follows: Figure 12 The object recognition result shown in (c) in the figure.

[0601] It should be understood that if the mobile phone receives the image information and obtains the object recognition result before entering the non-lock screen interface, the mobile phone can directly display the object recognition result after entering the non-lock screen interface; or, if the mobile phone receives the image information after entering the non-lock screen interface, the mobile phone can recognize the object in the image information and display it as follows: Figure 12 The object recognition result shown in (c) in the figure.

[0602] In one embodiment, when the mobile phone detects the user pressing the screen with two fingers, the mobile phone can send the instruction to the smart TV. When the mobile phone receives the image information sent by the smart TV, the mobile phone can prompt the user to unlock the screen before identifying the object in the image information. When the mobile phone detects the user's unlock operation, the mobile phone can enter the non-lock screen interface, thereby identifying the object in the image information and displaying the following information: Figure 12 The object recognition result shown in (c) of FIG. It should be understood that the mobile phone detecting the user's unlocking operation includes but is not limited to: the mobile phone detecting the user entering a password and successfully verifying the password; or the mobile phone detecting the user pressing a finger on the fingerprint collection area and the collected fingerprint information matches the fingerprint information preset in the mobile phone; or the mobile phone turning on the camera to collect the user's facial information and the facial information collected by the camera matches the facial information preset in the mobile phone.

[0603] In one embodiment, when the mobile phone detects the user pressing the screen with two fingers, the mobile phone can send the instruction to the smart TV. When the mobile phone receives the image information sent by the smart TV, the mobile phone can identify the object in the image information to obtain the object recognition result. In response to obtaining the object recognition result, the mobile phone can prompt the user to unlock the phone to view the object recognition result. When the mobile phone detects the user's unlocking operation, the mobile phone can display the following information: Figure 12 It should be understood that the detection of the unlocking operation by the mobile phone by the user can refer to the description in the above embodiment, and for the sake of brevity, it will not be repeated here.

[0604] In one embodiment, if the mobile phone determines that the photo 2 only includes information about an object after identifying the photo 2, the mobile phone can automatically identify the object.

[0605] See also Figure 12 The GUI shown in (c) of FIG. 1 is a display interface for the object recognition results. The mobile phone can display a prompt box 1201 on the display screen, wherein prompt box 1201 includes the prompt message "The following similar content has been found for you", the information source (e.g., "xx website"), the name of the object (e.g., "soccer ball"), a control 1202 for viewing more similar images, and a shopping link 1203.

[0606] In one embodiment, while displaying the object recognition result, the mobile phone can also send the object recognition result to the smart TV, so that the smart TV displays the object recognition result.

[0607] See also Figure 12 In the GUI shown in (d), in response to receiving the object recognition result sent by the mobile phone, the smart TV can display the object recognition result through the display screen.

[0608] In the embodiment of the present application, there is no need for the user to log in to the object recognition software or send the photo to the object recognition website for object recognition. The user's preset operation triggers the mobile phone to send a command to obtain image information to the smart TV. After obtaining the image information, the mobile phone can use the mobile phone's object recognition function to identify the object in the image information. In this way, the smart TV can call on the mobile phone's intelligent object recognition function, which helps improve the user's efficiency in identifying objects in photos, thereby helping to enhance the user experience.

[0609] Figure 13 This is another set of GUIs provided in an embodiment of the present application.

[0610] See also Figure 13 In the GUI shown in (a), the smart TV displays photo 3, which includes a Chinese sentence "a sentence describing autumn...flying around"; at this time, the mobile phone displays the mobile phone's desktop.

[0611] See also Figure 13 In the GUI shown in (b) of Figure 1, when the phone detects a two-finger press on the screen, it can send a command to the smart TV, instructing it to capture the image currently displayed on the smart TV. In response to receiving the command from the phone, the smart TV sends the image currently displayed on the display to the phone. In response to receiving the image information from the smart TV, the phone can use OCR to recognize the text in Photo 3, thereby obtaining the string "Sentences describing autumn...flying around."

[0612] See also Figure 13 The GUI shown in (c) of the figure is a display interface for string information. When the phone detects that the user has selected a portion of the text "Bursts of autumn wind...sneak into my heart," the phone may display a function list 1301, which includes functions such as copy, share, select all, and web search. The user can choose to copy the selected text to the phone (for example, to the phone's memo app).

[0613] In one embodiment, if the mobile phone determines that the photo 3 only includes text content and the text content is in the default language of the mobile phone after identifying the photo 3, the mobile phone can display the character string information obtained by the mobile phone identification.

[0614] For example, if the default language of the mobile phone is Chinese, and the mobile phone determines that the language corresponding to the string information is Chinese content, then the mobile phone can display the string information.

[0615] In one embodiment, after obtaining the character string information, the mobile phone may further display a prompt message to the user, where the prompt message is used to prompt the user which language (eg, Chinese, Japanese, Korean, Spanish, etc.) the character string content is translated into.

[0616] In the embodiment of the present application, the user does not need to refer to the content of the photo on the smart TV and manually enter the corresponding text on the mobile phone. The user's preset operation triggers the mobile phone to send a command to the smart TV to obtain image information. After obtaining the image information, the mobile phone can use the mobile phone's image text to string function to obtain the recognized string information. This helps improve the efficiency of users when converting text in images to strings, thereby improving the user experience.

[0617] The above passed Figures 11 to 13 The GUIs shown in the figure illustrate how a mobile phone uses image information received from a smart TV to determine its content, thereby invoking the corresponding mobile phone capabilities to process the content. The following describes how the mobile phone processes different types of content (e.g., character strings, object images, etc.) received from a smart TV.

[0618] Figure 14 This is another set of GUIs provided in an embodiment of the present application.

[0619] See also Figure 14 In the GUI shown in (a), the smart TV displays photo 4, which includes an English sentence "Today is a sunny...outing!" and image information of an object (e.g., a mountain); at this time, the mobile phone displays the mobile phone's desktop.

[0620] See also Figure 14 In the GUI shown in (b) of FIG, when the mobile phone detects that the user has pressed the screen with two fingers, the mobile phone can send a command to the smart TV, which is used to instruct the smart TV to capture the image information currently displayed on the smart TV. In response to receiving the command sent by the mobile phone, the smart TV sends the image information currently displayed on the display to the mobile phone. In response to receiving the image information sent by the smart TV, the mobile phone can recognize the image information in Photo 4, thereby obtaining a string of information (for example, "Today is a sunny...outing!") and the image information of the object.

[0621] See also Figure 14 In the GUI shown in (c) of FIG, when the mobile phone completes the recognition of the image information, the mobile phone can display the recognized string information 1401 and the image information 1402 of the object. When the mobile phone detects the user's double-finger pressing operation on the string information, the mobile phone can display the following Figure 14 The GUI shown in (d) in FIG.

[0622] See also Figure 14 In the GUI shown in (d), in response to the mobile phone detecting the user's double-finger pressing operation on the string information, the mobile phone can translate the string information. The GUI is the translation result of the string information.

[0623] In one embodiment, if the default language of the mobile phone is Chinese and the mobile phone determines that the language corresponding to the string information is not Chinese, then when the mobile phone detects the user's double-finger press operation on the string information, the mobile phone can automatically translate the string information into Chinese.

[0624] In one embodiment, when the mobile phone detects a two-finger press operation by the user on a character string information, the mobile phone may also prompt the user to which language (eg, Chinese, Japanese, Korean, Spanish, etc.) the character string information should be translated.

[0625] In one embodiment, the mobile phone may also translate the character string information when detecting other preset operations (eg, three-finger pressing) performed by the user on the character string information.

[0626] See also Figure 14 In the GUI shown in (e) of FIG, when the mobile phone detects the user's double-finger pressing operation on the image information of the object, the mobile phone can display the following Figure 14 The GUI shown in (f) in FIG.

[0627] See also Figure 14 In the GUI shown in (f) of FIG, in response to the phone detecting a user pressing two fingers on an image of an object, the phone can identify the image and display a prompt box 1403 containing the object identification result. The object identification result includes the prompt message "The following similar content has been found for you", the information source (e.g., xx website), the name of the object (e.g., a mountain), a control 1404 for viewing more similar images, and a shopping link 1405.

[0628] In one embodiment, in response to the mobile phone detecting the user's double-finger pressing operation on the image information of an object, the mobile phone may also prompt the user which operation to perform on the image information, such as identifying the object, searching for shopping links, etc.

[0629] In one embodiment, the mobile phone can also recognize objects in the image information when detecting other preset operations (for example, air gestures) performed by the user on the image information.

[0630] Figure 15 is another set of GUIs provided by the embodiment of the present application. Figure 14 The difference from the GUI shown is that the mobile phone can prompt the user to select a processing method for the image information before displaying the processing result of the image information sent by the smart TV.

[0631] See also Figure 15 In the GUI shown in (a) of FIG, when the mobile phone detects that the user presses the screen with two fingers, the mobile phone can send a command to the smart TV, which is used to instruct the smart TV to capture the image information currently displayed on the smart TV. In response to receiving the command sent by the mobile phone, the smart TV sends the image information currently displayed on the display to the mobile phone. In response to receiving the image information sent by the smart TV, the mobile phone can recognize the image information in Photo 4, thereby obtaining string information (for example, "Today is a sunny...outing!") and image information of the object.

[0632] See also Figure 15In the GUI shown in (b) of FIG, in response to the mobile phone obtaining the string information and the image information of the object, the mobile phone can display a prompt box 1501, wherein the prompt box 1501 includes the prompt message "It is detected that the image information obtained from the smart TV includes text and objects. Please determine which function to use" and a function list (including translation, object recognition, string conversion, and shopping). When the mobile phone detects that the user selects the translation function and clicks the control 1502, the mobile phone can display the following Figure 15 The GUI shown in (c) in FIG.

[0633] See also Figure 15 In the GUI shown in (c), in response to the mobile phone detecting that the user selects the translation function and clicks the control 1502, the mobile phone can translate the string information. The GUI is the translation result of the string information.

[0634] In one embodiment, if the default language of the mobile phone is Chinese and the mobile phone determines that the language corresponding to the string information is not Chinese, then when the mobile phone detects that the user selects the translation function and clicks the control 1502, the mobile phone can automatically translate the string information into Chinese.

[0635] In one embodiment, when the mobile phone detects that the user clicks on the control 1502, it can also prompt the user to translate the string information into which language (for example, Chinese, Japanese, Korean, Spanish, etc.). When the mobile phone detects that the user chooses to translate into Chinese, it can translate the string information into Chinese.

[0636] See also Figure 15 In the GUI described in (d), when the mobile phone detects that the user selects the object recognition function and clicks the control 1502, the mobile phone can display the following Figure 15 The GUI shown in (e) in FIG.

[0637] See also Figure 15 In the GUI shown in (e) of FIG, in response to the mobile phone detecting that the user has selected the object recognition function and clicked control 1502, the mobile phone can recognize the image information of the object. This displays a prompt box 1503 containing the object recognition results. The recognition results include the prompt message "The following similar content has been found for you," the information source (e.g., xx website), the name of the object (e.g., a mountain), a control 1504 for viewing more similar images, and a shopping link 1505.

[0638] Combination of the above Figure 14 and Figure 15 This article introduces how a mobile phone processes different types of content (e.g., character string information, object image information, etc.) when it identifies image information obtained from a smart TV. Figure 16This section describes the process by which a mobile phone determines whether the user is processing content displayed on the mobile phone or on the smart TV.

[0639] Figure 16 This is another set of GUIs provided in an embodiment of the present application.

[0640] See also Figure 16 In the GUI shown in (a), the smart TV displays photo 1, which includes an English sentence "Today is a sunny...outing!"; at this time, the mobile phone displays the display interface of the mobile phone's short message application.

[0641] See also Figure 16 GUI shown in (b) in FIG, when the mobile phone detects the user's two-finger pressing operation on the display interface of the short message application, the mobile phone can display the following Figure 16 The GUI shown in (c) in FIG.

[0642] See also Figure 16 In the GUI shown in (c), in response to the mobile phone detecting the user's two-finger pressing operation on the display interface of the short message application, the mobile phone can display a prompt box 1601, wherein the prompt box 1601 includes the prompt information "The mobile phone is detected to be connected to the smart TV. Please confirm whether to perform smart screen recognition on the smart TV". When the mobile phone detects the user clicking the control 1602, the mobile phone can send an instruction to the smart TV, which is used to instruct the smart TV to intercept the image information currently displayed on the smart TV. In response to receiving the instruction sent by the mobile phone, the smart TV sends the image information currently displayed on the display screen to the mobile phone. In response to receiving the image information sent by the smart TV, the mobile phone can recognize the image information in photo 1, thereby obtaining character string information (for example, "Today is a sunny...outing!").

[0643] In one embodiment, if a mobile phone has established wireless connections with both a smart TV and a tablet, the mobile phone can also prompt the user to select which device to perform smart screen recognition on. If the mobile phone detects that the user has selected the smart TV for smart screen recognition, the mobile phone can send the instruction to the smart TV.

[0644] See also Figure 16 The GUI shown in (d) of FIG. 1 is a display interface for string information. The display interface also includes a prompt box 1603. Prompt box 1603 includes the result of the mobile phone's word segmentation of the string information and a full-screen translation control. The mobile phone can automatically translate the string information after displaying the string information display interface for a preset duration (e.g., 3 seconds).

[0645] In one embodiment, if the mobile phone determines that the photo 1 only includes text content after identifying the photo 1, the mobile phone can automatically translate the identified character string information.

[0646] For example, if the default language of the mobile phone is Chinese, and the mobile phone determines that the language corresponding to the string information is non-Chinese content (for example, English), the mobile phone can automatically translate the string content into Chinese.

[0647] In one embodiment, after obtaining the character string information, the mobile phone may further display a prompt message to the user, where the prompt message is used to prompt the user which language (eg, Chinese, Japanese, Korean, Spanish, etc.) the character string content is translated into.

[0648] See also Figure 16 The GUI shown in (c) is a translation display interface. When the mobile phone completes the translation of the string information, the corresponding translation content "Today is a sunny Sunday...Autumn outing!" can be displayed on the display screen.

[0649] In one embodiment, the mobile phone can also send the translated content to the smart TV while displaying the translated text display interface. Figure 11 The GUI shown in (e) in FIG.

[0650] In one embodiment, when the mobile phone detects that the user clicks the control 1602, the mobile phone can also directly display the following Figure 16 The GUI shown in (e) in FIG.

[0651] In one embodiment, the mobile phone can determine whether the user wants to perform smart screen recognition on the screen on the mobile phone or on the smart TV based on the content displayed on the current interface. For example, a wireless connection is established between the mobile phone and the smart TV. When the mobile phone displays the mobile phone's desktop or the mobile phone's lock screen interface, and the mobile phone detects the user's preset operation (for example, two-finger press), the mobile phone can determine that the user wants to perform smart screen recognition on the screen on the smart TV; when the mobile phone displays the display interface of an application (for example, a short message application, a memo application, a browser application), and the mobile phone detects the user's preset operation (for example, two-finger press), the mobile phone can determine that the user wants to perform smart screen recognition on the screen on the mobile phone, or the mobile phone can prompt the user to select which device's screen to perform smart screen recognition on.

[0652] In one embodiment, the mobile phone can also determine whether the user wants to perform smart screen recognition on the screen on the mobile phone or on the smart TV based on the user's preset gesture. For example, when the mobile phone detects the user's double-finger pressing operation, the mobile phone can determine that the screen on the mobile phone is to be smartly recognized; for example, when the mobile phone detects the user's double-finger pressing and the distance the two fingers move on the screen is greater than or equal to the preset distance, the mobile phone can determine that the screen on the smart TV is to be smartly recognized. For example, if the mobile phone has established a wireless connection with the smart TV and the tablet computer, when the mobile phone detects the user's double-finger pressing and the distance the two fingers move on the screen is greater than or equal to the preset distance, the mobile phone can prompt the user to choose to perform smart screen recognition on the smart TV or tablet computer.

[0653] Combination of the above Figures 11 to 16 , describes that when a mobile phone detects a preset operation (for example, two-finger press), it can send a command to the smart TV, which is used to instruct the smart TV to capture the image information currently displayed on the smart TV. In the embodiment of the present application, considering that there is a certain time interval between the user seeing the image on the smart TV and picking up the mobile phone to perform smart screen recognition on the smart TV, the command sent by the mobile phone to the smart TV can also be used to instruct the smart TV to capture video cache resources within a certain time period, and the video cache resources may include multiple frames of images.

[0654] Figure 17 This is another set of GUIs provided in an embodiment of the present application.

[0655] See also Figure 17 In the GUI shown in (a), the smart TV is currently playing a video, and the mobile phone displays the mobile phone desktop.

[0656] Referring to the GUI shown in (b) of FIG17 , when the mobile phone detects the user's two-finger pressing operation, the mobile phone can display the following Figure 17 The GUI shown in (c) in FIG.

[0657] See also Figure 17 In the GUI shown in (c) of FIG, in response to the mobile phone detecting a user's two-finger press on the display interface of the short message application, the mobile phone may display a prompt box 1701, wherein prompt box 1701 includes the prompt message "Please confirm how long ago the smart TV screen was smartly recognized." When the mobile phone detects that the user selects to smartly recognize the screen for a screen from 5 seconds ago and clicks control 1702, the mobile phone may send a command to the smart TV, which is used to instruct the smart TV to capture the video cache resource from 5 seconds ago. In response to receiving the command sent by the mobile phone, the smart TV sends the video cache resource from 5 seconds ago to the mobile phone.

[0658] In one embodiment, when a mobile phone detects a user's two-finger press, it can record the timestamp T1 of that moment. Because there is a certain time interval T2 between the user seeing the relevant screen on the smart TV and the user performing the two-finger press on the phone (for example, the user selected smart screen recognition for the screen 5 seconds ago), the instruction can include the timestamp T1 and the time interval T2. The smart TV can intercept N seconds (for example, N is 2 seconds) of video cache resources at the time point T1-T2 and send it to the mobile phone.

[0659] For example, if the timestamp T1 is 8:00:15 a.m. and the user selects smart screen recognition for the image 5 seconds ago, the smart TV can intercept the video cache resources around 8:00:10. For example, the smart TV can intercept the video cache resources from 8:00:09 to 8:00:11.

[0660] After receiving the video cache resource sent by the smart TV, the mobile phone can convert the video cache resource into image information. The specific conversion process can be referred to in the following description and will not be repeated here. The mobile phone can recognize the converted image information. For example, the mobile phone can recognize the image information to obtain string information.

[0661] See also Figure 17 The GUI shown in (d) is a string information display interface. After the mobile phone recognizes the string information, it can display the string information on the display screen and display a prompt box 1703. The prompt box 1703 includes the result of the mobile phone's word segmentation of the string information and a full-screen translation control. After the mobile phone displays the string information display interface for a preset duration (for example, 3 seconds), it can automatically translate the string information.

[0662] In one embodiment, if the mobile phone recognizes the converted image information and determines that the image information only includes text content, the mobile phone can automatically translate the recognized character string information.

[0663] For example, if the default language of the mobile phone is Chinese, and the mobile phone determines that the language corresponding to the string information is non-Chinese content (for example, English), the mobile phone can automatically translate the string content into Chinese.

[0664] In one embodiment, after obtaining the character string information, the mobile phone may further display a prompt message to the user, where the prompt message is used to prompt the user which language (eg, Chinese, Japanese, Korean, Spanish, etc.) the character string content is translated into.

[0665] See also Figure 17The GUI shown in (e) is a translation display interface. When the mobile phone completes the translation of the string information, the corresponding translation content "Today is a sunny Sunday...Autumn outing!" can be displayed on the display screen.

[0666] In one embodiment, the mobile phone can send the translated content to the smart TV while displaying the translated text display interface.

[0667] In one embodiment, when the mobile phone detects that the user presses the screen with two fingers, the mobile phone can also directly display the following Figure 17 The GUI shown in (e) in FIG.

[0668] Figure 18 This is another set of GUIs provided in an embodiment of the present application.

[0669] See also Figure 18 In the GUI shown in (a), the smart TV displays the login interface of the video app, and the mobile phone displays the mobile phone desktop.

[0670] When the smart TV detects that the user has entered a mobile phone number in the mobile phone number input box and clicked the control 1801 for obtaining a verification code, the smart TV may request the server to send a verification code to the device corresponding to the mobile phone number.

[0671] See also Figure 18 The GUI shown in (b) of the figure is the interface displayed when the mobile phone receives the verification code. When the mobile phone detects a two-finger press on this display interface, it can extract the verification code information (for example, the digital verification code "900912") in the short message. When the mobile phone determines that a wireless connection has been established with the smart TV, it can send the verification code information to the smart TV.

[0672] See also Figure 18 The GUI shown in (c) in the figure can automatically fill in the verification code information in the verification code input box in response to receiving the verification code information sent by the mobile phone.

[0673] In the embodiment of the present application, upon receiving the verification code information sent by the server and detecting the user's preset operation, the mobile phone can send the verification code information to the smart TV. This saves the user from checking the phone and actively memorizing the verification code, provides convenience to the user, improves the efficiency of obtaining the verification code, and thus improves the user experience.

[0674] Figure 19 This is another set of GUIs provided in an embodiment of the present application.

[0675] See also Figure 19As shown in (a) of FIG. 1 , the laptop displays a display interface 1901 of the App1 website, wherein the display interface 1901 is the web page login interface of App1. The mobile phone displays the mobile phone desktop, wherein the mobile phone desktop includes an icon of App2.

[0676] See also Figure 19 As shown in (b) in the figure, the laptop detects the operation of the user logging in through a third-party account (App2's account). In response to detecting the operation of the user logging in through App2's account, the laptop can send a query request to the surrounding devices, and the query request is used to query the surrounding devices with App2 installed. If the mobile phone receives the query request and the mobile phone has App2 installed, the mobile phone can send a response (ACK) to the laptop. In response to receiving the response sent by the mobile phone, the laptop can send an authorization request (authorization request) to the mobile phone, and the authorization request is used to request App2 on the mobile phone to authorize the login of App1. In response to receiving the authorization request, the mobile phone can display a prompt box 1902, wherein the prompt box 1902 includes the prompt information "The laptop requests App2 authorization".

[0677] In one embodiment, in response to detecting that a user has logged in through an account of App2, the laptop computer may send the query request to devices under the same account (for example, the devices under the same account include mobile phones) or mobile phones under the same family group (for example, the family group includes account 1 and account 2, the devices under account 1 include the laptop computer, and the devices under account 2 include mobile phones).

[0678] It should be understood that in the embodiments of the present application, a user can invite the accounts of other family members (for example, Huawei ID2) by using an account logged in on a certain device (for example, Huawei ID1), thereby forming a family group with the user's account and the accounts of other family members. After forming a family group, the user's account and the accounts of other family members can share information. For example, the user's account can obtain information such as the device name, device type, and address from the accounts of other family members; for example, if the user purchases a membership for an application, other family members can obtain the user's membership; for example, members of the same family group can share storage space on a cloud server.

[0679] In one embodiment, after receiving the authorization request, the mobile phone can determine whether the laptop is a trusted device. For example, if the mobile phone determines that the mobile phone and the laptop are devices under the same account, then the mobile phone can determine that the laptop is a trusted device; or, if the mobile phone determines that the mobile phone and the laptop are devices under the same family group, then the mobile phone can determine that the laptop is a trusted device; or, if the mobile phone determines that the user has set the laptop as a trusted device on the mobile phone, then the mobile phone can determine that the laptop is a trusted device. After the mobile phone determines that the laptop is a trusted device, the mobile phone can display prompt box 1902. If the mobile phone determines that the laptop is an untrusted device, then the mobile phone can prompt the user in prompt box 1902 that the laptop is an untrusted device.

[0680] See also Figure 19 As shown in (c) in FIG, when the mobile phone detects that the user clicks the control 1903, the mobile phone can start App2 and display the authorized login information of App1 on the display interface of App2. Figure 19 In (c), App2's display interface includes the prompt "App1 requests access to your account information." Upon detecting the user's click on control 1904, the phone may request login authorization information (e.g., an access token) from App2's server. In response to receiving the login authorization information from App2's server, the phone may send the login authorization information to the laptop.

[0681] In one embodiment, the mobile phone may also prompt the user on the display interface of App2 to select the content of the account information that App1 is authorized to apply for use. For example, the user may choose to allow App1 to use the nickname and profile picture information of the App2 account, but choose not to allow App1 to use the region and gender information of the App2 account.

[0682] See also Figure 19 As shown in (d) in the figure, in response to receiving the information for authorized login from the mobile phone, the laptop computer can use the information for authorized login to request App2's account information from App2's server. In response to receiving the corresponding account information from App2's server, the laptop computer can use the account information to log in to the App1 website. After logging in, the laptop computer can display the display interface of App1, wherein the account information logged in by App1 can be displayed in the upper right corner of the display interface, wherein the avatar of the account logged in by App1 is the same as the avatar of the App2 account. The mobile phone can display the chat history display interface of App2, wherein the most recent chat history is a login operation notification "Your App2 account has performed a website login operation."

[0683] In this embodiment of the present application, a laptop computer can use a mobile phone with a third-party application App2 installed to quickly and easily log into the application. This simplifies the interactive steps for application login authorization, avoids the user's tedious input or active memorization process, improves the user's application login efficiency, and also ensures security when logging into the application.

[0684] Figure 20 This is another set of GUIs provided in an embodiment of the present application.

[0685] See also Figure 20 As shown in (a) in the figure, the mobile phone displays the lock screen interface. The laptop displays the display interface 2001 of the App1 website, wherein the display interface 2001 is the web login interface of App1. The laptop detects the user's login operation through a third-party account (App2's account). In response to detecting the user's login operation through App2's account, the laptop can send a query request to surrounding devices, and the query request is used to query the surrounding devices that have App2 installed. If the mobile phone and tablet receive the query request and both the mobile phone and tablet have App2 installed, then the mobile phone and tablet can send a response (ACK) to the laptop.

[0686] See also Figure 20 As shown in (b) of FIG, in response to receiving responses from the mobile phone and tablet, the laptop may display a prompt box 2002, wherein prompt box 2002 includes the prompt message "We have detected multiple devices nearby with App2 installed. Please select one." In response to detecting that the user has selected a mobile phone and clicked control 2003, the laptop sends an authorization request to the mobile phone, requesting App2 on the mobile phone to authorize the login of App1. In response to receiving the authorization request, the mobile phone may display a prompt box 2005, wherein prompt box 2005 includes the prompt message "The laptop requests authorization from App2."

[0687] In one embodiment, in response to detecting a user logging in through an account of App2, the laptop can send the query request to devices under the same account (for example, devices under the same account include a mobile phone and a tablet). If both the mobile phone and the tablet have App2 installed, the mobile phone and the tablet can send a response (ACK) to the laptop.

[0688] Alternatively, the laptop can send the query request to other devices in the same family group (for example, the family group includes Account 1 and Account 2, where Account 1 includes the laptop and mobile phone, and Account 2 includes the tablet). If both the mobile phone and the tablet have App 2 installed, the mobile phone and the tablet can send a response (ACK) to the laptop.

[0689] See also Figure 20 As shown in (c) in FIG, when the mobile phone detects that the user clicks the control 2006, the mobile phone can start App2 and display the authorized login information of App1 on the display interface of App2. Figure 20 In (c), App2's display interface includes the prompt "App1 requests access to your account information." Upon detecting the user's click on control 2007, the phone may request login authorization information (e.g., an access token) from App2's server. Upon receiving the login authorization information from App2's server, the phone may send the login authorization information to the laptop.

[0690] See also Figure 20 As shown in (d) in the figure, in response to receiving the information for authorized login from the mobile phone, the laptop computer can use the information for authorized login to request App2's account information from App2's server. In response to receiving the corresponding user information from App2's server, the laptop computer can use the account information to log in to the App1 website. After logging in, the laptop computer can display the display interface of App1, wherein the account information logged in by App1 can be displayed in the upper right corner of the display interface, wherein the avatar of the account logged in by App1 is the same as the avatar of the App2 account. The mobile phone can display the chat history display interface of App2, wherein the most recent chat history is a login operation notification "Your App2 account has performed a website login operation."

[0691] In this embodiment of the present application, a laptop computer can quickly and easily log into an application using nearby devices that have the third-party application App2 installed. When multiple available devices are available, the laptop computer can prompt the user to select an appropriate device for login. This simplifies the interactive steps for application login authorization, eliminating the need for users to input or remember information, improving user login efficiency while also ensuring security during application login.

[0692] Figure 21 This is another set of GUIs provided in an embodiment of the present application.

[0693] See also Figure 21 As shown in (a) of FIG, the mobile phone displays the lock screen interface. The laptop displays the display interface of the App1 website, wherein the display interface is the web login interface 2101 of App1. The laptop detects that the user clicks the control 2102 for logging in using another device.

[0694] See also Figure 21As shown in (b) of FIG, in response to detecting a user clicking control 2102, the laptop computer may send a query request to surrounding devices, which is used to query surrounding devices that have App 1 installed. If the mobile phone receives the query request and has App 1 installed on it, the mobile phone may send a response (ACK) to the laptop computer.

[0695] See also Figure 21 As shown in (b) of FIG, in response to receiving the response sent by the mobile phone, the laptop computer may send an authorization request to the mobile phone, requesting App1 on the mobile phone to authorize login to App1 on the laptop computer. In response to receiving the authorization request, the mobile phone may display a prompt box 2103, wherein prompt box 2103 includes the prompt message "Laptop computer requests authorization from App1."

[0696] In one embodiment, in response to receiving a response from the mobile phone, the laptop may also prompt the user, "App 1 has been detected installed on the mobile phone. Do you want to use the mobile phone for authorization?" When the laptop detects that the user has decided to use the mobile phone for authorization, the laptop may send an authorization request to the mobile phone.

[0697] In one embodiment, when the laptop receives responses from the mobile phone and tablet computer, the laptop may prompt the user, "App 1 has been detected installed on both the mobile phone and tablet computer. Please determine which device to use for authorization." When the laptop detects that the user has determined to use the mobile phone for authorization, the laptop may send an authorization request to the mobile phone.

[0698] In one embodiment, after receiving the authorization request, the mobile phone can determine whether the laptop is a trusted device. For example, if the mobile phone determines that the mobile phone and the laptop are devices under the same account, then the mobile phone can determine that the laptop is a trusted device; or, if the mobile phone determines that the mobile phone and the laptop are devices under the same family group, then the mobile phone can determine that the laptop is a trusted device; or, if the mobile phone determines that the user has set the laptop as a trusted device on the mobile phone, then the mobile phone can determine that the laptop is a trusted device. After the mobile phone determines that the laptop is a trusted device, the mobile phone can display prompt box 2103. If the mobile phone determines that the laptop is an untrusted device, then the mobile phone can prompt the user in prompt box 2103 that the laptop is an untrusted device.

[0699] See also Figure 21As shown in (c) of FIG, in response to the mobile phone detecting the user clicking control 2104, the mobile phone may display App1 and display the authorization login interface of App1, which includes information prompting the user to confirm the login. When the mobile phone detects the user clicking control 2105, it may request information for authorization login (e.g., an access token) from App1's server. In response to receiving the authorization login information from App1's server, the mobile phone may send the authorization login information to the laptop computer.

[0700] See also Figure 21 As shown in (d) in the figure, in response to receiving the login authorization information from the mobile phone, the laptop computer can use the login authorization information to request the App1 server for the account information used to log in to App1 on the mobile phone. In response to receiving the account information from the App1 server, the laptop computer can use the account information to log in to the App1 website. After logging in, the laptop computer can display the App1 interface, where the upper right corner of the interface can display the profile picture information of the account logged in to App1 on the mobile phone. This allows the same account to be logged in to both the mobile phone and the laptop computer.

[0701] In this embodiment of the present application, a laptop computer can use a mobile phone with a third-party application App1 installed to quickly and easily log in to the application. This simplifies the interactive steps for application login authorization, avoids the user's tedious input or active memorization process, improves the user's application login efficiency, and also ensures security when logging in to the application.

[0702] Figure 22 This is another set of GUIs provided in an embodiment of the present application.

[0703] See also Figure 22 As shown in (a) of FIG. 1 , the laptop displays the display interface of the App1 website, wherein the display interface is the web registration interface 2201 of App1. The mobile phone displays the desktop of the mobile phone, wherein the desktop of the mobile phone includes the icon of App2.

[0704] See also Figure 22As shown in (b) in the figure, the laptop detects the operation of the user registering and logging in through a third-party account (App2's account). In response to detecting the operation of the user registe...

Claims

1. A system, characterized in that: The system includes a first electronic device and a second electronic device. The first electronic device is used to request capability information of the second electronic device; The second electronic device is used to send the capability information to the first electronic device, where the capability information includes one or more functions, and the one or more functions include the first function; The first electronic device is further configured to, when detecting an operation of a user selecting a first content, display a function list according to a type of the first content, wherein the function list includes the first function; In response to detecting a first operation, sending first content and first request information to the second electronic device, wherein the first request information is used to request the second electronic device to process the first content using the first function, wherein the first operation is an operation of a user selecting the first function; The second electronic device is further configured to process the first content using the first function according to the first request information and send a processing result of the first content to the first electronic device; The first electronic device is further used to prompt the user with the processing result.

2. The system according to claim 1, characterized in that The first electronic device is specifically used for: In response to receiving the capability information, displaying a function list, the function list including the one or more functions; In response to detecting an operation of a user selecting the first function from the one or more functions, detecting an operation of a user selecting the first content and sending the first content and the first request information to the second electronic device.

3. The system according to claim 2, characterized in that The first electronic device is specifically used for: In response to detecting that the user selects the first content and not detecting that the user selects other content within a preset time period after the user selects the first content, the first content and the first request information are sent to the second electronic device.

4. The system according to claim 2 or 3, characterized in that: The first electronic device is further used to: in response to detecting a user selecting a second content, send the second content and second request information to the second electronic device, wherein the second request information is used to request the second electronic device to process the second content using the first function.

5. The system according to claim 1, characterized in that The first electronic device is specifically used for: In response to a user selecting the first content and clicking a first button, the first content and the first request information are sent to the second electronic device, wherein the first button is associated with the first function.

6. The system according to any one of claims 1 to 3, characterized in that The first function is a text editing function, and the first electronic device is specifically used for: When the first operation is detected, acquiring audio content; Displaying a first text content corresponding to the audio content and sending the first text content and the first request information to the second electronic device, where the first request information is used to request the second electronic device to edit the first text content; The second electronic device is specifically used for: In response to receiving the first text content and the first request information, displaying the first text content; In response to detecting an editing operation of the user on the first text content, displaying second text content, where the second text content is text content after editing the first text content; Sending the second text content to the first electronic device; The first electronic device is specifically used for: The first text content is replaced with the second text content.

7. The system according to claim 6, characterized in that The editing operation includes a format modification operation on the first text content, wherein: The second electronic device is further used to send format information of the second text content to the first electronic device.

8. The system according to claim 7, characterized in that The format information of the second text content includes one or more of the font color, font size, font background color, font italicization, font underline and the carriage return operation in the second text content.

9. The system according to any one of claims 1 to 3, characterized in that The first content includes text content, the first function is a translation function, and the first electronic device is specifically used for: When the first operation is detected, sending the text content and the first request information to the second electronic device, where the first request information is used to request the second electronic device to translate the text content using a translation function; The second electronic device is specifically used to: use a translation function to translate the text content and send the translation result to the first electronic device; The first electronic device is further configured to prompt the user with the translation result.

10. The system according to any one of claims 1 to 3, characterized in that The first content includes image information, the first function is an object recognition function, and the first electronic device is specifically used for: When the first operation is detected, the image information and the first request information are sent to the second electronic device, where the first request information is used to request the second electronic device to use an object recognition function to recognize the object in the image information; The second electronic device is specifically configured to: use an object recognition function to recognize the object in the image information and send the recognition result to the first electronic device; The first electronic device is also used to prompt the user with the object recognition result.

11. The system according to any one of claims 1 to 3, characterized in that The first content includes first image information, the first function is a photo editing function, and the first electronic device is specifically used for: When the first operation is detected, displaying one or more image parameters, the one or more image parameters including a first image parameter; detecting an operation of a user adjusting the first image parameter to a first value, sending the first image information and the first request information to the second electronic device, where the first request information is used to request the second electronic device to use the image editing function to adjust the first image parameter of the first image information to the first value; The second electronic device is specifically configured to: use the image editing function to adjust the first image parameter of the first image information to the first value to obtain second image information; sending the second image information to the first electronic device; The first electronic device is further configured to replace the first image information with the second image information.

12. A method for invoking the capabilities of other devices, the method being applied to a first electronic device, characterized in that: The method comprises: The first electronic device requests capability information of the second electronic device; The first electronic device receives the capability information sent by the second electronic device, where the capability information includes one or more functions, and the one or more functions include a first function; When the first electronic device detects a user selecting a first content, the first electronic device displays a function list according to the type of the first content, wherein the function list includes the first function; In response to detecting that a user selects the first function, sending first content and first request information to the second electronic device, where the first request information is used to request the second electronic device to process the first content using the first function; The first electronic device receives and prompts a user with a result of processing the first content by the second electronic device.

13. The method according to claim 12, characterized in that When the first electronic device detects a first operation of the user, sending the first content and the first request information to the second electronic device includes: In response to receiving the capability information, the first electronic device displays a function list including the one or more functions; In response to detecting an operation of a user selecting the first function from the one or more functions, detecting that the user has selected the first content and sending the first content and the first request information to the second electronic device.

14. The method according to claim 13, characterized in that In response to detecting an operation of a user selecting the first content, the first electronic device sending the first content and the first request information to the second electronic device includes: In response to detecting that the user selects the first content and not detecting that the user selects other content within a preset time period since the user selects the first content, the first electronic device sends the first content and the first request information to the second electronic device.

15. The method according to claim 13 or 14, characterized in that The method further comprises: In response to detecting a user selection operation of second content, the first electronic device sends the second content and second request information to the second electronic device, where the second request information is used to request the second electronic device to process the second content using the first function.

16. The method according to claim 12, characterized in that When the first electronic device detects a first operation of the user, sending the first content and the first request information to the second electronic device includes: In response to a user selecting the first content and clicking a first button, the first electronic device sends the first content and the first request information to the second electronic device, wherein the first button is associated with the first function.

17. The method according to any one of claims 12 to 14, characterized in that The first function is a text editing function, and when the first electronic device detects a first operation of the user, the first electronic device sends first content and first request information to the second electronic device, including: When the first electronic device detects the first operation, acquiring audio content; The first electronic device displays first text content corresponding to the audio content and sends the first text content and the first request information to the second electronic device, where the first request information is used to request the second electronic device to edit the first text content; The first electronic device receives and prompts a user with a result of processing the first content by the second electronic device, including: The first electronic device receives second text content sent by the second electronic device and replaces the first text content with the second text content, where the second text content is text content detected by the second electronic device after the user edits the first text content.

18. The method according to claim 17, characterized in that The processing result also includes format information of the second text content.

19. The method according to claim 18, characterized in that The format information of the second text content includes one or more of the font color, font size, font background color, font italicization, font underline and the carriage return operation in the second text content.

20. The method according to any one of claims 12 to 14, characterized in that The first content includes text content, the first function is a translation function, and when the first electronic device detects a first operation of the user, the first electronic device sends the first content and first request information to the second electronic device, including: When the first operation is detected, the first electronic device sends the text content and the first request information to the second electronic device, where the first request information is used to request the second electronic device to translate the text content using a translation function; The first electronic device receives and prompts a user with a result of processing the first content by the second electronic device, including: The first electronic device receives and prompts a user with a translation result of the text content by the second electronic device.

21. The method according to any one of claims 12 to 14, characterized in that The first content includes image information, the first function is an object recognition function, and when the first electronic device detects a first operation of the user, the first content and first request information are sent to the second electronic device, including: When the first operation is detected, the first electronic device sends the image information and the first request information to the second electronic device, where the first request information is used to request the second electronic device to use an object recognition function to recognize the object in the image information; The first electronic device receives and prompts a user with a result of processing the first content by the second electronic device, including: The first electronic device receives and prompts a user with the result of the second electronic device identifying the object.

22. The method according to any one of claims 12 to 14, characterized in that The first content includes first image information, the first function is a photo editing function, and when the first electronic device detects a first operation of the user, the first electronic device sends the first content and first request information to the second electronic device, including: When the first operation is detected, displaying one or more image parameters, the one or more image parameters including a first image parameter; detecting an operation of a user adjusting the first image parameter to a first value, sending the first image information and the first request information to the second electronic device, where the first request information is used to request the second electronic device to use the image editing function to adjust the first image parameter of the first image information to the first value; The first electronic device receives and prompts the user of the second electronic device pair, including: The first electronic device receives second image information sent by the second electronic device, where the second image information is image information obtained by adjusting the first image parameter of the first image information to the first value; The first electronic device replaces the first image information with the second image information.

23. A method for invoking the capabilities of another device, the method being applied to a second electronic device, characterized in that: The method comprises: The second electronic device receives first request information sent by the first electronic device, where the first request information is used to request capability information of the second electronic device; The second electronic device sends the capability information to the first electronic device, where the capability information includes one or more functions, and the one or more functions include the first function; The second electronic device receives the first content and the second request information sent by the first electronic device, wherein the second request information is used for the second electronic device to process the first content using the first function, wherein the first function is included in a function list, and the function list is displayed by the first electronic device according to the type of the first content when the first electronic device detects a user selecting the first content; The second electronic device processes the first content using the first function according to the second request information and sends the processing result of the first content to the first electronic device. The first content and the second request information are sent when it is detected that a user selects the first function in a function list displayed according to the type of the first content.

24. The method according to claim 23, characterized in that The second electronic device receives the first content and the second request information sent by the first electronic device, including: The second electronic device receives the first text content and the second request information sent by the first electronic device, where the second request information is used to request the second electronic device to edit the first text content; The second electronic device processes the first content using the first function according to the second request information and sends a processing result of the first content to the first electronic device, including: In response to receiving the first text content and the second request information, the second electronic device displays the first text content; In response to detecting the user's editing operation on the first text content, the second electronic device displays second text content, where the second text content is text content after editing the first text content; The second electronic device sends the second text content to the first electronic device.

25. The method according to claim 24, characterized in that The editing operation includes a format modification operation on the first text content, and the method further includes: The second electronic device sends format information of the second text content to the first electronic device.

26. The method according to claim 25, characterized in that The format information of the second text content includes one or more of the font color, font size, font background color, font italicization, font underline and the carriage return operation in the second text content.

27. The method according to claim 23, characterized in that The second electronic device receives the first content and the second request information sent by the first electronic device, including: The second electronic device receives the text content and the second request information sent by the first electronic device, where the second request information is used to request the second electronic device to translate the text content using a translation function; The second electronic device processes the first content using the first function according to the second request information and sends a processing result of the first content to the first electronic device, including: The second electronic device translates the text content using a translation function and sends the translation result to the first electronic device.

28. The method according to claim 23, characterized in that The second electronic device receives the first content and the second request information sent by the first electronic device, including: The second electronic device receives the image information and the second request information sent by the first electronic device, where the second request information is used to request the second electronic device to use an object recognition function to recognize an object in the image information; The second electronic device processes the first content using the first function according to the second request information and sends a processing result of the first content to the first electronic device, including: The second electronic device recognizes the object in the image information using an object recognition function and sends the recognition result to the first electronic device.

29. The method according to claim 23, characterized in that The second electronic device receives the first content and the second request information sent by the first electronic device, including: The second electronic device receives the first image information and the second request information sent by the first electronic device, where the second request information is used to request the second electronic device to adjust the first image parameter of the first image information to a first value using a photo editing function; The second electronic device processes the first content using the first function according to the second request information and sends a processing result of the first content to the first electronic device, including: The second electronic device uses the image editing function to adjust the first image parameter of the first image information to the first value to obtain second image information; The second electronic device sends the second image information to the first electronic device.

30. An electronic device, characterized in that: The electronic device comprises: one or more processors; one or more memories; The one or more memories store one or more computer programs, and the one or more computer programs include instructions, which, when executed by the one or more processors, enable the electronic device to perform the method as claimed in any one of claims 12 to 22.

31. An electronic device, characterized in that: The electronic device comprises: one or more processors; one or more memories; The one or more memories store one or more computer programs, and the one or more computer programs include instructions, which, when executed by the one or more processors, enable the electronic device to perform the method as claimed in any one of claims 23 to 29.

32. A computer-readable storage medium, characterized in that: comprising computer instructions, which, when executed on an electronic device, cause the electronic device to execute the method as claimed in any one of claims 12 to 22; or, When the computer instructions are executed on an electronic device, the electronic device is caused to execute the method as claimed in any one of claims 23 to 29.

Images