Control method applied to electronic device, and electronic device

Abstract

To provide a target file sharing method.SOLUTION: An electronic device determines a target device based on user operation. When the user operation is that a user pushes the electronic device in a direction close to the target device, the electronic device sends content displayed in the electronic device to the target device. When the user operation is that the user pulls the electronic device in a direction away from the target device, the electronic device sends a request to the target device. After receiving the request, the target device sends, to the electronic device, related information of a task currently being executed by the target device or a control instruction of the task being executed. Accordingly, the user operation allows the electronic device and the target device to exchange data.SELECTED DRAWING: Figure 3f

Description

[Technical Field]

[0001] This application claims priority to Chinese Patent Application No. 202010780353.3, filed on August 5, 2020, with the State Intellectual Property Office of the People's Republic of China, entitled "CONTROL METHOD APPLIED TO ELECTRONIC DEVICE AND ELECTRONIC DEVICE," and to Chinese Patent Application No. 202010779662.9, filed on August 5, 2020, with the State Intellectual Property Office of the People's Republic of China, entitled "TARGET FILE SHARING METHOD, ELECTRONIC DEVICE, AND COMPUTER-READABLE STORAGE MEDIUM," and to Chinese Patent Application No. 202010779662.9, filed on August 5, 2020, with the State Intellectual Property Office of the People's Republic of China, entitled "DIRECTIONAL SEARCH INTERACTION METHOD AND ELECTRONIC Priority is claimed to Chinese Patent Application No. 202010780257.9, entitled "CONTROL METHOD FOR SMART HOME DEVICE AND ELECTRONIC DEVICE," filed with the State Intellectual Property Office of the People's Republic of China on August 5, 2020, which claims priority to Chinese Patent Application No. 202010779814.5, entitled "CONTROL METHOD FOR SMART HOME DEVICE AND ELECTRONIC DEVICE," filed with the State Intellectual Property Office of the People's Republic of China on May 27, 2020, which claims priority to Chinese Patent Application No. 202010458414.4, entitled "BUTTON INTERACTION METHOD AND TERMINAL," filed with the State Intellectual Property Office of the People's Republic of China on October 29, 2020, which claims priority to Chinese Patent Application No. 202010458414.4, entitled "CONTROL METHOD APPLIED TO ELECTRONIC DEVICE AND ELECTRONIC This application claims priority to Chinese Patent Application No. 202011174741.3 entitled "A METHOD FOR IMPROVING A HIGH-SPEED PHOTOVOLTAIC DEVICE," which is incorporated herein by reference in its entirety.

[0002] This application relates to the field of electronic technology, and in particular to methods applied to electronic devices and electronic devices. [Background technology]

[0003] With the continuous development of Internet technology, more and more electronic devices may interact with other electronic devices (e.g., data transmission, control, and projection). For example, content on a mobile phone can be projected on a smart television. Audio on a mobile phone can be transmitted to a smart speaker for playback. A file on a mobile phone can be transferred to another electronic device, such as another mobile phone, a tablet computer, or a computer. Typically, when electronic device A and electronic device B interact with each other, a user needs to perform an action on electronic device A to establish a connection between electronic device A and electronic device B. Then, the user finds data to be transmitted on electronic device A and transmits the data to electronic device B. This process requires complex user actions.

[0004] Therefore, how to make the interaction between electronic devices more convenient is an urgent problem to be solved. Summary of the Invention

[0005] An embodiment of the present application provides a control method applicable to an electronic device. According to the method, a user can control the electronic device to send first content to a target device based on an action of pushing the electronic device toward the target. Alternatively, the user can obtain first information and / or first control commands for a task being performed by the target device based on an action of pulling the electronic device away from the target device. In this way, the electronic device and the target device can conveniently interact with each other based on a simple user action.

[0006] According to a first aspect, there is provided a control method applicable to an electronic device, the method may include, by the electronic device, displaying first content, detecting a first motion of a user, acquiring a direction of the first motion and a first attitude of the electronic device in response to the first motion, determining a target device based on the direction of the first motion and / or the first attitude, and transmitting the first content to the target device when the electronic device and the target device detect that the electronic device and the target device are logged into the same account.

[0007] The first content may include any one of a picture, a video, an audio, a text, a food cooking parameter, and an exercise parameter.

[0008] The first motion is moving the electronic device in a direction closer to the target device in a first attitude, where the top of the electronic device is facing upward and the display of the electronic device is facing the target device, and the direction of the first motion is a direction in which the center of gravity of the electronic device moves during the first motion or a direction in which a user gesture moves during the first motion.

[0009] According to the method provided in this embodiment of the present application, a user can control an electronic device to transmit data to a target device based on a first action. For example, a user can transmit a video played on a mobile phone to a television based on an action of pushing the mobile phone toward a television. In this way, the user can watch the video through the television. Therefore, the user action is simple and the user experience can be improved.

[0010] Referring to the first aspect, in a possible implementation, after determining the target device based on the direction of the first movement and / or the first posture, the method further includes, when the electronic device detects that the electronic device and the target device are not logged in to the same account, sending a first request to the target device, the first request being used to request the target device to receive first content, receiving a first response being used to indicate to the electronic device to send the first content, and sending the first content to the target device. When the electronic device and the target device are not logged in to the same account, the electronic device needs to first send the request to the target device, which can avoid affecting the execution of normal tasks of the target device.

[0011] Referring to the first aspect, in a possible implementation, determining the target device based on the direction of the first movement and / or the first attitude specifically includes transmitting a second request to one or more intelligent devices, the second request being used to instruct the one or more intelligent devices to transmit location information to the electronic device, and determining a first intelligent device as the target device based on the location information transmitted by the one or more intelligent devices, the location of the first intelligent device being in the direction of the first movement, the first intelligent device including one or more intelligent devices among the one or more intelligent devices. In this way, the electronic device may obtain the intelligent devices in the direction of the first movement through calculation based on the location information of the multiple intelligent devices and determine the target device with which the user expects the electronic device to exchange data.

[0012] Optionally, determining the target device based on the direction of the first movement and / or the first attitude specifically includes transmitting a third request to a positioning server, the third request being used to instruct the positioning server to transmit position information of one or more intelligent devices, the positioning server being configured to store the position information of the one or more intelligent devices; and determining a first intelligent device as the target device based on the position information of the one or more intelligent devices, the position of the first intelligent device being in the direction of the first movement, the first intelligent device including one or more intelligent devices of the one or more intelligent devices. In this way, the electronic device can also obtain the position information of the intelligent device when the intelligent device does not have a positioning function. Additionally, the electronic device may obtain the intelligent device in the direction of the first movement through calculation based on the position information of multiple intelligent devices to determine the target device with which the user expects the electronic device to exchange data.

[0013] Referring to the first aspect, in a possible implementation, determining a first intelligent device as a target device based on location information transmitted by one or more intelligent devices specifically includes, when the first intelligent device includes a plurality of intelligent devices, displaying a first list in a first user interface, the first list being used to display icons of the plurality of intelligent devices, and determining, in response to a second response from the user, as the target device an intelligent device in the first intelligent device whose icon is selected from the first list based on a second action. In this way, the electronic device may determine the target device based on a user action.

[0014] Optionally, determining the first intelligent device as the target device based on the location information transmitted by the one or more intelligent devices specifically includes, when the first intelligent device includes a plurality of intelligent devices, the electronic device uses the intelligent device that is in the first intelligent device and closest to the electronic device as the target device.

[0015] Referring to the first aspect, in a possible implementation, the order of arrangement of icons displayed in the first list is determined based on a distance between the electronic device and the plurality of intelligent devices, and the icons are of a plurality of intelligent devices.

[0016] Referring to the first aspect, in a possible implementation, after determining the intelligent device in the first intelligent device and whose icon is selected from the first list based on the second operation as the target device, the method further includes performing a first preset action, the first preset action including one or more of vibration, ringing, or displaying a prompt box in a user interface. In this way, the user can learn that the electronic device has determined the target device by using the prompt.

[0017] According to a second aspect, there is provided a control method applicable to an electronic device, the method including: detecting a fifth motion; acquiring a direction of the fifth motion and a third attitude of the electronic device in response to the fifth motion; determining a target device based on the direction of the fifth motion and / or the third attitude; transmitting a fourth request to the target device, the fourth request being used to request the target device to transmit second content; and displaying the second content transmitted by the target device when the electronic device and the target device detect that they are logged into the same account.

[0018] The fifth action is to move the electronic device in the third attitude in a direction away from the target device, and the direction of the fifth action is a direction away from the target device.

[0019] According to the method provided in this embodiment of the present application, a user can control an electronic device to retrieve second content data from a target device based on a fifth action. For example, a user may pull a mobile phone away from a television. Then, in response to the user action, the mobile phone detects that the mobile phone and the television are logged into the same account. In this manner, the mobile phone can retrieve second content transmitted from the television. When the television is playing a television program, the second content may include the name, cast list, and download address of the television series being played by the television, as well as instructions for controlling the television series to stop playback, pause playback, start playback, adjust the volume, etc. In this manner, user actions are simplified and the user experience may be improved.

[0020] Referring to the second aspect, in a possible implementation, after sending the fourth request to the target device, the method further includes, when the electronic device detects that the electronic device and the target device are not logged into the same account, displaying third content sent by the target device, where the third content is different from the second content.

[0021] The second content includes first information of a first task currently being executed by the target device and / or a first control command for the first task, and the third content is used to indicate a current working state of the target device.

[0022] In this way, when the electronic device and the target device are not logged into the same account, the user can only obtain the operational status of the target device, which is, for example, busy or idle.

[0023] Referring to the second aspect, in a possible implementation, when the first task plays the first audio, the first information includes one or more of the name of the first audio, singer information, a download link, and lyrics, and the first control command includes one or more of a pause command, a stop command, a play command, and a next command.

[0024] Optionally, when the first task is to cook a first food, the first information includes one or more of a cooking process, cooking time, cooking temperature, and cooking humidity of the first food, and the first control instruction includes one or more of a pause instruction, a stop instruction, a start instruction, a cooking time adjustment instruction, a cooking temperature adjustment instruction, and a cooking humidity adjustment instruction.

[0025] Optionally, when the first task plays the first video, the first information includes one or more of a name, cast information, a download link, and an episode number of the first video, and the first control command includes one or more of a pause command, a stop command, a play command, and a next episode command.

[0026] Referring to the second aspect, in a possible implementation, determining the target device based on the fifth direction of movement and / or the third attitude specifically includes transmitting a fifth request to one or more intelligent devices, the fifth request being used to indicate to the one or more intelligent devices to transmit location information to the electronic device, and determining a first intelligent device as the target device based on the location information transmitted by the one or more intelligent devices, the location of the first intelligent device being in the fifth direction of movement, the first intelligent device including one or more intelligent devices of the one or more intelligent devices. In this way, the electronic device may obtain the intelligent devices in the first direction of movement through calculation based on the location information of the multiple intelligent devices and determine the target device with which the user expects the electronic device to exchange data.

[0027] Referring to the second aspect, in a possible implementation, determining the target device based on the fifth direction of movement and / or the third attitude specifically includes transmitting a sixth request to a positioning server, the sixth request being used to instruct the positioning server to transmit location information of one or more intelligent devices, the positioning server being configured to store the location information of the one or more intelligent devices; and determining a first intelligent device as the target device based on the location information of the one or more intelligent devices, the location of the first intelligent device being in the fifth direction of movement, the first intelligent device including one or more intelligent devices of the one or more intelligent devices. In this way, the electronic device can also obtain location information of the intelligent device even when the intelligent device does not have a positioning function. Additionally, the electronic device may obtain the intelligent device in the first direction of movement through calculation based on the location information of multiple intelligent devices to determine the target device with which the user expects the electronic device to exchange data.

[0028] Referring to the second aspect, in a possible implementation, determining a first intelligent device as a target device based on location information transmitted by one or more intelligent devices specifically includes: when the first intelligent device includes multiple intelligent devices, displaying a first list in a first user interface, the first list being used to display icons of the multiple intelligent devices; and, in response to a sixth user action, determining as the target device an intelligent device in the first intelligent device whose icon is selected from the first list based on the sixth user action. In this way, the electronic device may determine a target device based on a user action.

[0029] Optionally, determining the first intelligent device as the target device based on the location information transmitted by the one or more intelligent devices specifically includes, when the first intelligent device includes a plurality of intelligent devices, the electronic device uses the intelligent device that is in the first intelligent device and closest to the electronic device as the target device.

[0030] Referring to the second aspect, in a possible implementation, the order of arrangement of the icons displayed in the first list is determined based on the distance between the electronic device and the plurality of intelligent devices, and the icons are of the plurality of intelligent devices.

[0031] Referring to the second aspect, in a possible implementation, after determining as the target device an intelligent device in the first intelligent device and whose icon is selected from the first list based on the sixth operation, the method includes performing a first preset action, the first preset action including one or more of vibrating, ringing, or displaying a prompt box in a user interface.

[0032] According to a third aspect, an electronic device is provided, including a memory and one or more processors. The memory is configured to store computer instructions that, when executed by the one or more processors, enable the electronic device to: display first content; detect a first motion of a user; acquire a direction of the first motion and a first attitude of the electronic device in response to the first motion; determine a target device based on the direction of the first motion and / or the first attitude; and transmit the first content to the target device when the electronic device and the target device detect that they are logged into the same account.

[0033] Referring to the third aspect, in a possible implementation, after determining the target device based on the direction of the first movement and / or the first posture, when the electronic device detects that the electronic device and the target device are not logged into the same account, the electronic device further performs the following steps: sending a first request to the target device, where the first request is used to request the target device to receive first content; receiving a first response, where the first response is used to indicate to the electronic device to send the first content; and sending the first content to the target device.

[0034] Referring to the third aspect, in a possible implementation, the direction of the first movement is a direction in which the center of gravity of the electronic device moves during the first movement, or a direction in which a user gesture moves during the first movement.

[0035] Referring to the third aspect, in a possible implementation, in determining the target device based on the direction of the first movement and / or the first attitude, the electronic device specifically: sends a second request to one or more intelligent devices, the second request being used to indicate to the one or more intelligent devices to send location information to the electronic device; and determines a first intelligent device as the target device based on the location information sent by the one or more intelligent devices, where the location of the first intelligent device is in the direction of the first movement, and the first intelligent device includes one or more intelligent devices among the one or more intelligent devices.

[0036] Referring to the third aspect, in a possible implementation, in determining a target device based on the direction of the first movement and / or the first attitude, the electronic device specifically transmits a third request to a positioning server, the third request being used to indicate to the positioning server to transmit location information of one or more intelligent devices, the positioning server being configured to store the location information of the one or more intelligent devices; and determining a first intelligent device as the target device based on the location information of the one or more intelligent devices, wherein the location of the first intelligent device is in the direction of the first movement, and the first intelligent device includes one or more intelligent devices among the one or more intelligent devices.

[0037] Referring to the third aspect, in a possible implementation, in determining a first intelligent device as a target device based on location information transmitted by one or more intelligent devices, the electronic device specifically: when the first intelligent device includes a plurality of intelligent devices, display a first list in a first user interface, the first list being used to display icons of the plurality of intelligent devices; and, in response to a second response of the user, determine as the target device an intelligent device in the first intelligent device whose icon is selected from the first list based on the second action.

[0038] Referring to the third aspect, in a possible implementation, the order of arrangement of the icons displayed in the first list is determined based on the distance between the electronic device and the plurality of intelligent devices, and the icons are of the plurality of intelligent devices.

[0039] Referring to the third aspect, in a possible implementation, after determining the intelligent device, which is in the first intelligent device and whose icon is selected from the first list based on the second operation, as the target device, the electronic device further performs a first preset action, the first preset action including one or more of vibrating, ringing, or displaying a prompt box in a user interface.

[0040] Referring to a third aspect, in a possible implementation, the first action is moving the electronic device in a direction closer to the target device in a first attitude, the first attitude being such that the top of the electronic device is facing upward and the display of the electronic device is facing the target device.

[0041] Referring to the third aspect, in a possible implementation, the first action includes a third action and a fourth action, wherein in detecting the first action of the user, the electronic device specifically detects the third action of the user; in response to the first action, acquiring a direction of the first action and a first attitude of the electronic device; in response to the third action, the electronic device specifically acquires the direction of the third action and the first attitude of the electronic device; in determining the target device based on the direction of the first action and / or the first attitude, the electronic device specifically determines the target device based on the direction of the third action and / or the first attitude; and in transmitting the first content to the target device when detecting that the electronic device and the target device are logged in to the same account, the electronic device specifically acquires a fourth action, the fourth action being changing the electronic device from the first attitude to a second attitude; and in response to the fourth action, transmitting the first content to the target device when detecting that the electronic device and the target device are logged in to the same account.

[0042] Referring to the third aspect, in a possible implementation, the third action is moving the electronic device in a first attitude in a direction closer to the target device, the first attitude being such that the top of the electronic device is facing the target device, and the fourth action is changing the first attitude of the electronic device to a second attitude, the second attitude being such that the top of the electronic device is facing upward and the display of the electronic device is facing the target device.

[0043] The beneficial effects of the third embodiment are the same as those described in the first embodiment, and the details will not be described again here.

[0044] According to a fourth aspect, an electronic device is provided, including a memory and one or more processors. The memory is configured to store computer instructions that, when executed by the one or more processors, cause the electronic device to: detect a fifth motion; acquire a direction of the fifth motion and a third attitude of the electronic device in response to the fifth motion; determine a target device based on the direction of the fifth motion and / or the third attitude; send a fourth request to the target device, the fourth request being used to request the target device to send second content; and display the second content sent by the target device when the electronic device and the target device detect that they are logged into the same account.

[0045] Referring to the fourth aspect, in a possible implementation, after sending the fourth request to the target device, the electronic device may further display third content sent by the target device when it detects that the electronic device and the target device are not logged into the same account, the third content being different from the second content.

[0046] Referring to the fourth aspect, in a possible implementation, the second content includes first information of a first task currently being executed by the target device and / or first control instructions for the first task, and the third content is used to indicate a current working state of the target device.

[0047] Regarding the fourth aspect, in a possible implementation, when the first task is to play a first audio, the first information includes one or more of the name, singer information, download link, and lyrics of the first audio, and the first control instructions include one or more of a pause instruction, a stop instruction, a play instruction, and a next instruction; or when the first task is to cook a first food, the first information includes one or more of a cooking process, cooking time, cooking temperature, and cooking humidity of the first food, and the first control instructions include one or more of a pause instruction, a stop instruction, a start instruction, a cooking time adjustment instruction, a cooking temperature adjustment instruction, and a cooking humidity adjustment instruction.

[0048] Referring to the fourth aspect, in a possible implementation, the fifth action is moving the electronic device in the third attitude in a direction away from the target device, and the direction of the fifth action is a direction away from the target device.

[0049] Referring to the fourth aspect, in a possible implementation, in determining the target device based on the fifth movement direction and / or the third attitude, the electronic device specifically: sends a fifth request to one or more intelligent devices, the fifth request being used to indicate to the one or more intelligent devices to send location information to the electronic device; and determines a first intelligent device as the target device based on the location information sent by the one or more intelligent devices, where the location of the first intelligent device is in the fifth movement direction, and the first intelligent device includes one or more intelligent devices among the one or more intelligent devices.

[0050] Referring to the fourth aspect, in a possible implementation, in determining the target device based on the fifth direction of movement and / or the third attitude, the electronic device specifically transmits a sixth request to a positioning server, the sixth request being used to indicate to the positioning server to transmit location information of one or more intelligent devices, the positioning server being configured to store the location information of the one or more intelligent devices; and determining a first intelligent device as the target device based on the location information of the one or more intelligent devices, the location of the first intelligent device being in the fifth direction of movement, the first intelligent device including one or more intelligent devices of the one or more intelligent devices.

[0051] Referring to the fourth aspect, in a possible implementation, in determining a first intelligent device as a target device based on location information transmitted by one or more intelligent devices, the electronic device specifically: when the first intelligent device includes a plurality of intelligent devices, display a first list in a first user interface, the first list being used to display icons of the plurality of intelligent devices; and, in response to a sixth action of the user, determine as the target device an intelligent device in the first intelligent device, the icon of which is selected from the first list based on the sixth action.

[0052] Referring to the fourth aspect, in a possible implementation, the order of arrangement of icons displayed in the first list is determined based on a distance between the electronic device and the plurality of intelligent devices, and the icons are of a plurality of intelligent devices.

[0053] Referring to the fourth aspect, in a possible implementation, after determining the intelligent device in the first intelligent device and whose icon is selected from the first list based on the sixth operation as the target device, the electronic device further performs a first preset action, the first preset action including one or more of vibration, ringing, or displaying a prompt box in a user interface.

[0054] The beneficial effects of the fourth embodiment are the same as those described in the second embodiment, and the details will not be described again here.

[0055] According to a fifth aspect, there is provided a computer-readable storage medium comprising instructions that, when run on an electronic device, enable the electronic device to perform a method according to any possible implementation of the first aspect and a method according to any possible implementation of the second aspect.

[0056] According to a sixth aspect, there is provided a computer program product which, when run on a computer, enables the computer to perform a method according to any possible implementation of the first aspect and a method according to any possible implementation of the second aspect.

[0057] According to a seventh aspect, an embodiment of the present invention provides a target file sharing method, the method including: detecting a first action on a selected target file; and, when the first action is determined to match a specific trigger condition, locating at least one sharable device toward which a head of an electronic device is pointing; displaying a sharing interface for the target file, the sharing interface including an icon of the at least one sharable device toward which the head of the electronic device is pointing; detecting a second action; selecting at least one target device from the at least one sharable device; and sharing the target file with the at least one target device based on the determined target type. In a possible implementation, the first action includes a first sliding action and a first pressing action, and the trigger condition includes a first trigger condition corresponding to the first sliding action and a second trigger condition corresponding to the first pressing action.

[0058] The first trigger condition includes that a slide is performed in a specific display area, and the slide direction includes a first specific direction.

[0059] The second trigger condition includes the press time being equal to or greater than a first specified duration.

[0060] In a possible implementation, the first action includes a second sliding action, and the trigger condition includes a third trigger condition corresponding to the second sliding action.

[0061] The third trigger condition includes that the sliding occurs within a specific display area, that the sliding direction includes a second specific direction, and that the sliding distance is equal to or greater than a specific distance.

[0062] In a possible implementation, the first action includes a second pressing action, and the trigger condition includes a fourth trigger condition corresponding to the second pressing action.

[0063] The fourth trigger condition includes a multi-finger press action being performed and the press duration being equal to or greater than a second specified time.

[0064] In a possible implementation, when detecting a first action on a selected target file and determining that the first action meets a particular trigger condition, before locating at least one shareable device toward which the head of the electronic device is pointing, the method includes detecting a selection action and selecting the target file, the selection action including tapping on the target file.

[0065] In a possible implementation, the second action includes dragging the target file onto an icon of the target device.

[0066] In a possible implementation, the second action includes dragging the target file toward where the target device icon is located and releasing the target file, causing the target file to be moved to the target device icon.

[0067] In a possible implementation, the second action includes releasing the first action and tapping an icon of one or more shareable devices.

[0068] In a possible implementation, the second action includes dragging the target file in a direction where the icon of the target device is located, then releasing the target file and tapping the device name and / or icon of at least one shareable device from the device names and / or icons of the multiple shareable devices.

[0069] Detecting the second action and selecting at least one target device from the at least one sharable device includes: when multiple sharable devices are present, detecting an action of dragging the target file in a direction where an icon of the target device is located and then releasing the target file, and displaying a first pop-up window, wherein the first pop-up window includes device names and / or icons of the multiple sharable devices; and detecting an action of tapping the device name and / or icon of at least one sharable device from the device names of the multiple sharable devices, and determining at least one sharable device identified by the tapped device name and / or tapped icon of the at least one sharable device as the at least one target device.

[0070] In a possible implementation, the second action includes releasing the first action and tapping an icon of one or more shareable devices.

[0071] Detecting a second action and selecting at least one target device from the at least one shareable device includes detecting a release action of the first action and displaying an icon of the shareable device toward which the head of the electronic device is pointing; and detecting a tapping action on the icon of one or more shareable devices and determining the shareable device identified by the tapped icon of the shareable device as the target device.

[0072] In a possible implementation, before sharing the target file with at least one target device based on the determined target type, the method further includes: determining whether the target device has the capability to display the application to which the target file belongs; and if it is determined that the target device has the capability to display the application to which the target file belongs, displaying a second pop-up window, the second pop-up window including multiple share types; detecting a tapping action on a share type; and determining the tapped share type as the target type.

[0073] In a possible implementation, the multiple share types include an application type and a file type.

[0074] In a possible implementation, the method further includes determining the file type as the target type if it is determined that the target device does not have the capability to display the application to which the target file belongs.

[0075] In a possible implementation, the icon of the shareable device has a different shape, the icon of the shareable device includes multiple sub-icons, each sub-icon corresponds to one sharing type, and different sub-icons have different patterns, and different patterns represent different sharing types.

[0076] In possible implementations, the target file may include a picture, video, audio, web page, text, or file.

[0077] According to an eighth aspect, an embodiment of the present application provides an electronic device. The device includes a display, one or more processors, a memory, a plurality of applications, and one or more computer programs, the one or more computer programs being stored in the memory, the one or more computer programs including instructions, which, when executed by the device, cause the device to: detect a first action on a selected target file; and, when the first action is determined to match a specific trigger condition, locate at least one sharable device toward which the head of the electronic device is pointing; display a sharing interface for the target file, the sharing interface including an icon of the at least one sharable device toward which the head of the electronic device is pointing; detect a second action; select at least one target device from the at least one sharable device; and share the target file with the at least one target device based on the determined target type. In an optional implementation, when the instructions are executed by the device, the device specifically causes the device to detect a selection action and select the target file, the selection action including tapping on the target file.

[0078] In an optional implementation, the second operation includes dragging the target file toward an icon of the target device, then releasing the target file, and tapping a device name and / or icon of at least one sharable device from the device names and / or icons of the multiple sharable devices. When the instructions are executed by the device, the device is specifically enabled to: detect the operation of dragging the target file toward an icon of the target device and then releasing the target file when multiple sharable devices are present, and display a first pop-up window, where the first pop-up window includes the device names and / or icons of the multiple sharable devices; and detect the operation of tapping the device name and / or icon of at least one sharable device from the device names of the multiple sharable devices, and determine at least one sharable device identified by the tapped device name and / or tapped icon of the at least one sharable device as the at least one target device.

[0079] In an optional implementation, the second action includes releasing the first action and tapping an icon of one or more shareable devices. When the instructions are executed by the device, the device is specifically capable of detecting the release of the first action and displaying an icon of the shareable device toward which the head of the electronic device is pointing, detecting the tapping of the icon of the one or more shareable devices, and determining, as the target device, a shareable device identified by the tapped icon of the shareable device.

[0080] In an optional implementation, when the instructions are executed by the device, the device is specifically capable of: determining whether the target device has the capability to display the application to which the target file belongs; if it is determined that the target device has the capability to display the application to which the target file belongs, displaying a second pop-up window, the second pop-up window including multiple share types; and detecting a tapping action on a share type and determining the tapped share type as the target type.

[0081] In an optional implementation, the plurality of share types includes an application type and a file type. When the instructions are executed by the device, the device specifically:

[0082] When the instructions are executed by the device, the device is enabled to determine the file type as the target type, specifically if it is determined that the target device does not have the capability to display the application to which the target file belongs.

[0083] According to a ninth aspect, an embodiment of the present application provides a computer-readable storage medium storing program code for execution by a device, the program code including instructions for performing a method according to the seventh aspect or any one of the possible implementations of the seventh aspect.

[0084] According to a tenth aspect, there is provided a smart home device control method. The method is applied to a portable device, and includes the portable device determining a first smart home device, where the first smart home device is a smart home device for which a user has an operation intention. The portable device sets a control target of a button on the portable device as the first smart home device. The portable device controls the first smart home device to perform a first response in response to a first operation performed on the button of the portable device by the user.

[0085] According to the method provided in the first aspect, when the portable device determines the user's operation intention, i.e., when it determines the smart home device expected to be controlled by the user, it may switch the control target of the buttons on the portable device to the smart home device and directly control the smart home device based on the operation on the buttons on the portable device. This method can solve the problem of poor user experience caused by the complex and time-consuming control process of smart home devices in conventional technologies.

[0086] In a possible implementation, determining the first smart home device by the portable device includes determining that the smart home device pointed to by the portable device is the first smart home device when the portable device detects that the movement track of the portable device matches a preset movement track and / or that the portable device has moved to a preset spatial orientation, where the portable device is between the smart home device and one or more smart home devices and based on the relative position detected by the portable device. This solution supports detecting the movement track and / or spatial orientation of the portable device to determine whether a user intends to control the smart home device.

[0087] In a possible implementation, the smart home device pointed to by the portable device is the smart home device through which a perpendicular line of the plane on which the portable device is located passes, or the smart home device pointed to by the portable device is the smart home device through which an extension of the long side of the portable device passes. The smart home device through which the perpendicular line of the plane on which the portable device is located passes, or the smart home device through which an extension of the long side of the portable device passes, is detected to determine the smart home device that the user intends to operate.

[0088] In a possible implementation, the portable device detects the relative position between the smart home device and one or more smart home devices surrounding the portable device by using a Bluetooth module or an ultra-wideband (UWB) module.

[0089] In a possible implementation, the portable device measures motion data by using one or more motion sensors, and the portable device obtains a movement track or spatial orientation of the portable device.

[0090] In a possible implementation, determining the first smart home device by the portable device includes determining the first smart home device based on a user selecting a virtual “card” for the smart home device in the smart home application interface. This solution supports detecting the user's selection in the smart home application interface to determine whether the user intends to control the smart home device.

[0091] In a possible implementation, the buttons on the portable device include physical buttons and / or virtual buttons, and the physical buttons include one or more of a power button, a volume up button, a volume down button, and a fingerprint button. This solution supports the use of the physical or virtual buttons on the portable device to directly control the smart home device.

[0092] In a possible implementation, the first action is a press by a user on a power button when the first smart home device is in an on state and the first response is to power off, or the first action is a press by a user on a power button when the first smart home device is in an off state and the first response is to power on.

[0093] In a possible implementation, the first action is a press by a user on a volume up button when the first smart home device is in an on state, and the first response is one of increasing wind speed, increasing volume, increasing brightness, increasing temperature, increasing rotation speed, increasing intensity, raising, or opening, or the first action is a press by a user on a volume down button when the first smart home device is in an on state, and the first response is one of decreasing wind speed, decreasing volume, decreasing brightness, decreasing temperature, decreasing rotation speed, decreasing intensity, lowering, or closing.

[0094] In a possible implementation, the first action is a press action made by a user on a fingerprint button when the first smart home device is in an on state, and the first response is to verify the fingerprint information entered by the user by using the fingerprint button.

[0095] According to an eleventh aspect, there is provided a portable device including: a processing unit configured to determine a first smart home device and set a control target of a button of the portable device as the first smart home device, the first smart home device being a smart home device for which a user has an operation intention; and a control unit configured to control the first smart home device to perform a first response in response to a first operation performed by the user on the button of the portable device.

[0096] According to the antenna provided in the eleventh aspect, when the portable device determines the user's operation intention, i.e., when it determines the smart home device expected to be controlled by the user, it may switch the control target of the buttons on the portable device to the smart home device and directly control the smart home device based on the operation on the buttons on the portable device. This solution can solve the problem of poor user experience caused by the complex and time-consuming control process of smart home devices in conventional technologies.

[0097] In a possible implementation, the processing unit's determining the first smart home device specifically includes, when detecting that the movement track of the portable device matches a preset movement track and / or that the portable device has moved to a preset spatial orientation, determining that the smart home device pointed to by the portable device is the first smart home device based on the detected relative positions between the smart home device and one or more smart home devices. This solution supports detecting the movement track and / or spatial orientation of the portable device to determine whether a user intends to control the smart home device.

[0098] In a possible implementation, the portable device further includes a sensor unit configured to measure motion data of the portable device to obtain a movement track or spatial orientation of the portable device, the sensor unit including one or more motion sensors.

[0099] In a possible implementation, the transceiver unit is further configured to detect signals from one or more smart home devices in a vicinity of the portable device to obtain a relative position between the smart home device and the one or more smart home devices.

[0100] In a possible implementation, the transceiver unit includes a Bluetooth module and / or an Ultra Wideband (UWB) module.

[0101] In a possible implementation, the portable device further includes a sensor unit configured to receive a user's touch action, the sensor unit including a touch sensor. The processing unit's determining the first smart home device specifically includes the processing unit determining the first smart home device based on the action received by the sensor unit and a user selecting a virtual "card" for the smart home device in the smart home application interface. This solution supports detecting a selection action performed by the user in the smart home application interface to determine whether the user intends to control the smart home device.

[0102] In possible implementations, the buttons on the portable device include physical buttons and / or virtual buttons, and the physical buttons include one or more of a power button, a volume up button, a volume down button, and a fingerprint button.

[0103] According to a twelfth aspect, there is provided a portable device, the portable device including: a memory configured to store computer program code, the computer program code including instructions; a radio frequency circuit configured to transmit and receive radio signals; and a processor configured to execute the instructions, causing the portable device to determine a first smart home device; set a control target of a button of the portable device as the first smart home device; and control the first smart home device to make a first response in response to a first operation performed by a user on the button of the portable device, the first smart home device being a smart home device that the user has an operation intention to control.

[0104] According to the method provided in the twelfth aspect, when the portable device determines the user's operation intention, i.e., when it determines the smart home device expected to be controlled by the user, it may switch the control target of the buttons on the portable device to the smart home device and directly control the smart home device based on the operation on the buttons on the portable device. This solution can solve the problem of poor user experience caused by the complex and time-consuming control process of smart home devices in conventional technologies.

[0105] In a possible implementation, the processor determining the first smart home device specifically includes the processor executing instructions such that, when it detects that the movement track of the portable device matches a preset movement track and / or that the portable device has moved to a preset spatial orientation, the portable device determines that the smart home device pointed to by the portable device is the first smart home device based on the detected relative positions between the smart home device and one or more smart home devices. This solution supports detecting the movement track and / or spatial orientation of the portable device to determine whether a user intends to control the smart home device.

[0106] In a possible implementation, the portable device further includes one or more motion sensors configured to measure motion data of the portable device to obtain a movement track or spatial orientation of the portable device.

[0107] In a possible implementation, the radio frequency circuitry is further configured to detect signals from one or more smart home devices in a vicinity of the portable device to obtain a relative position between the smart home device and the one or more smart home devices.

[0108] In a possible implementation, the radio frequency circuitry includes a Bluetooth module and / or an Ultra Wideband (UWB) module.

[0109] In a possible implementation, the portable device further includes a touch sensor configured to receive a user's touch action. The processor's determining the first smart home device specifically includes the processor executing instructions to cause the portable device to determine the first smart home device based on the action received by the sensor unit and a user selecting a virtual "card" for the smart home device in the smart home application interface. This solution supports detecting a selection action performed by the user in the smart home application interface to determine whether the user intends to control the smart home device.

[0110] In possible implementations, the buttons on the portable device include physical buttons and / or virtual buttons, and the physical buttons include one or more of a power button, a volume up button, a volume down button, and a fingerprint button.

[0111] According to a thirteenth aspect, there is provided a computer-readable storage medium storing computer-executable instructions that, when executed by a processor, implement a method according to any possible implementation of the tenth aspect.

[0112] According to a fourteenth aspect, there is provided a chip system. The chip system includes a processor and a memory, and the memory stores instructions. When the instructions are executed by the processor, a method is implemented according to any possible implementation of the tenth aspect. The chip system may include a chip, or may include a chip and another individual component.

[0113] According to a fifteenth aspect, there is provided a computer program product which, when run on a computer, implements a method according to any possible implementation of the tenth aspect.

[0114] According to a sixteenth aspect, a directional search interaction method is provided. The method is applicable to an electronic device, and includes the electronic device detecting a first user action on a first interface. In response to the first action, the electronic device displays a first search interface, the first search interface including a search box and first content, the first content related to content stored locally on the electronic device. In response to a second user action, the electronic device displays the first interface. The electronic device detects a third user action on the first interface. In response to the third action, the electronic device detects that the direction pointed by the electronic device includes a target electronic device and obtains a state of the target device. The electronic device displays a second search interface based on the state of the target device, the second search interface including a search box and second content, the second content related to the state of the target device.

[0115] According to this embodiment of the present application, when the electronic device determines that the device in the direction of the electronic device is another electronic device, the electronic device displays a search interface in response to the user's action of inputting search content, and the search results in the search interface are related to the status of the other electronic device. For example, when a user points the electronic device toward a smart television to search, the search results expected by the user may be videos. Therefore, this technical solution allows the user to obtain the search results expected by the user, improving the user experience.

[0116] Referring to the sixteenth aspect, in some implementations of the sixteenth aspect, the third action is inputting a keyword, and when the electronic device determines that the state of another electronic device is playing a first task content corresponding to the keyword, the second content includes a plurality of task content cards related to the first task content and having a priority, and the plurality of task content cards are related to the capabilities of the target electronic device.

[0117] According to this embodiment of the application, when another electronic device is playing task content for a keyword entered by a user, the search interface may include multiple task content cards related to the keyword content, and the multiple task content cards may have a priority to facilitate user selection.

[0118] Referring to the sixteenth aspect, in some implementations of the sixteenth aspect, a first task content card in the plurality of task content cards is used to display a first task content.

[0119] According to this implementation of the present application, the first displayed result in the search results is the task content currently being played by another electronic device, which helps the user understand detailed information about the currently playing task content and perform episode selection playback, etc.

[0120]

[0023] Referring to the sixteenth aspect, in some implementations of the sixteenth aspect, when the electronic device determines that the state of the target electronic device is an off state, the second content includes a control card of the target electronic device. After detecting a user tapping an on control on the control card, the electronic device further includes displaying a third search interface, the third search interface including a search box and a plurality of task content cards, the plurality of task content cards being related to capabilities of the target electronic device.

[0121] According to this embodiment of the application, a user controls another electronic device in the current display interface of the electronic device, improving the user's cross-device control experience.

[0122] Referring to the sixteenth aspect, in some implementations of the sixteenth aspect, when the electronic device determines that the state of the target electronic device is in an on state and task content is not being played, the second content includes a plurality of task content cards, and the plurality of task content cards are related to the capabilities of the target electronic device.

[0123] Referring to the sixteenth aspect, in some implementations of the sixteenth aspect, when the target electronic device is a smart television, the plurality of task content cards are video content cards, or when the target electronic device is a smart speaker, the plurality of task content cards are audio content cards.

[0124] Referring to the sixteenth aspect, in some implementations of the sixteenth aspect, the method further includes, when the electronic device detects that the user taps one of the plurality of task content cards, popping up a prompt box that can be selected by the user for playback on the particular electronic device.

[0125] According to this embodiment of the present application, the user can choose to play the task content on the electronic device or another electronic device based on their will.

[0126] According to a seventeenth aspect, a direction-finding interaction method is provided. The method is applied to an electronic device, and includes the electronic device detecting a first user action on a first interface. The electronic device displays a second interface in response to the first action, the second interface being an interface displayed after the first interface is refreshed. The electronic device detects a second user action on the second interface. In response to the second action, the electronic device identifies another nearby electronic device. The electronic device displays a third interface, the third interface including a location tag of the other electronic device.

[0127] According to this embodiment of the application, in response to a user action, the electronic device can identify multiple other surrounding electronic devices and display location tags of the multiple other electronic devices in the mobile phone interface, allowing the user to control the multiple electronic devices by using the location tags.

[0128] With reference to the seventeenth aspect, in some implementations of the seventeenth aspect, the second action is for the user to pick up the electronic device and hold the electronic device in a vertical state, and the electronic device displaying the third interface includes the electronic device calling a camera to obtain the third interface displayed in the camera's field of view.

[0129] According to this embodiment of the application, when a user picks up an electronic device and holds the electronic device in a vertical position, the electronic device will open the camera and acquire the positioning tags of other electronic devices that are within the camera's viewing angle, allowing the user to control multiple electronic devices by using the positioning tags.

[0130] Referring to the seventeenth aspect, in some implementations of the seventeenth aspect, the method further includes displaying a fourth interface after the electronic device detects a user tapping action on the location tag in the third interface, the fourth interface including a display interface card of the electronic device corresponding to the location tag, the content of the display interface card matching the content of a display of the electronic device corresponding to the location tag, or the display interface card being used to control the electronic device corresponding to the location tag.

[0131] According to this embodiment of the application, a user taps a location tag, and a display interface card of the electronic device corresponding to the location tag can be displayed on the screen of the electronic device, improving the user experience.

[0132] Referring to the seventeenth aspect, in some implementations of the seventeenth aspect, the method further includes, after the electronic device detects a user tapping action on the location tag in the third interface, displaying a fourth interface, the fourth interface including a control card of the electronic device corresponding to the location tag. After the electronic device detects a user tapping action on the control card, the electronic device displays a fifth interface, the fifth interface including a display interface card of the electronic device corresponding to the location tag, the content of the display interface card matches the content of a display of the electronic device corresponding to the location tag, or the display interface card is used to control the electronic device corresponding to the location tag.

[0133] According to this embodiment of the application, a user can control another electronic device on the display interface of an electronic device, improving the user's cross-device control experience.

[0134] Referring to the seventeenth aspect, in some implementations of the seventeenth aspect, a method includes the electronic device detecting an operation of a preset gesture in a third interface. In response to the operation of the preset gesture, the electronic device determines that a device in a pointing direction of the electronic device is a target electronic device. The electronic device displays a fourth interface, the fourth interface including a display interface card of the target electronic device, and content of the display interface card matches content of a display of the target electronic device, or the display interface card is used to control the target electronic device.

[0135] According to this implementation of the present application, a user performs a preset gesture to enable the display interface card of another electronic device in the direction pointed by the electronic device to be displayed on the electronic device, thereby helping the electronic device and another intelligent device to interact with each other easily and quickly, improving the user experience.

[0136] According to an eighteenth aspect, a direction-finding interaction method is provided. The method includes an electronic device detecting a first user action on a first interface. The electronic device displays a second interface in response to the first action, the second interface being an interface displayed after the first interface is refreshed. The electronic device detects the user's second action on the second interface. When the electronic device determines that a device in the direction pointed by the electronic device is a target electronic device, the electronic device displays a third interface in response to the second action, the third interface including a display interface card of the target electronic device.

[0137] According to this embodiment of the application, the user performs a preset gesture on the second interface, and a control card or display interface card of the intelligent device in the direction pointed by the electronic device is displayed on the interface of the electronic device to help the user control the intelligent device.

[0138] According to a nineteenth aspect, an electronic device is provided, including one or more processors and one or more memories, wherein the one or more memories store one or more computer programs, the one or more computer programs including instructions, which, when executed by the one or more processors, enable the electronic device to: detect a first user gesture on a first interface; in response to the first gesture, display a first search interface, the first search interface including a search box and first content, the first content related to content stored locally on the electronic device; in response to a second user gesture, display the first interface; detect a third user gesture on the first interface; in response to the third gesture, detect that a pointing direction of the electronic device includes a target electronic device, obtain a state of the target device, and, based on the state of the target device, display a second search interface, the second search interface including the search box and second content, the second content related to the state of the target device.

[0139] Referring to the 19th aspect, in some implementations of the 19th aspect, the third action is inputting a keyword, and when the electronic device determines that the state of another electronic device is playing a first task content corresponding to the keyword, the second content includes a plurality of task content cards related to the first task content and having a priority, and the plurality of task content cards are related to the capabilities of the target electronic device.

[0140] Referring to the nineteenth aspect, in some implementations of the nineteenth aspect, a first task content card in the plurality of task content cards is used to display a first task content.

[0141] Referring to the 19th aspect, in some implementations of the 19th aspect, when the electronic device determines that the state of the target electronic device is an off state, the second content includes a control card of the target electronic device. When the instructions are executed by the one or more processors, the electronic device is specifically configured to display a third search interface after the electronic device detects a user tapping an on control on the control card, the third search interface including a search box and a plurality of task content cards, and the plurality of task content cards are capable of being displayed related to capabilities of the target electronic device.

[0142] Referring to the 19th aspect, in some implementations of the 19th aspect, when the electronic device determines that the state of the target electronic device is in an on state and task content is not being played, the second content includes a plurality of task content cards, and the plurality of task content cards are related to the capabilities of the target electronic device.

[0143] Referring to the 19th aspect, in some implementations of the 19th aspect, when the target electronic device is a smart television, the plurality of task content cards are video content cards, or when the target electronic device is a smart speaker, the plurality of task content cards are audio content cards.

[0144] Referring to the 19th aspect, in some implementations of the 19th aspect, the instructions, when executed by the one or more processors, enable the electronic device to pop up a prompt box that can be selected by the user for playback on the particular electronic device when the electronic device detects that the user taps one of the plurality of task content cards.

[0145] According to a twentieth aspect, there is provided an electronic device including one or more processors and one or more memories, wherein the one or more memories store one or more computer programs, the one or more computer programs including instructions, which when executed by the one or more processors, cause the electronic device to: detect a first user gesture in a first interface, and in response to the first gesture, display a second interface, the second interface being an interface displayed after the first interface is refreshed; detect a second user gesture in the second interface, and in response to the second gesture, identify another nearby electronic device; and display a third interface, the third interface including a location tag of the other electronic device.

[0146] Referring to the twentieth aspect, in some implementations of the twentieth aspect, the second action is a user picking up the electronic device and holding the electronic device in a vertical position, and the electronic device is configured to specifically call a camera to obtain a third interface displayed in a viewing angle of the camera.

[0147] Referring to the twentieth aspect, in some implementations of the twentieth aspect, when the instructions are executed by one or more processors, the electronic device is capable of displaying a fourth interface after the electronic device detects a user tapping action on a location tag in the third interface, the fourth interface including a display interface card of the electronic device corresponding to the location tag, the content of the display interface card matching the content of a display of the electronic device corresponding to the location tag, or the display interface card being used to control the electronic device corresponding to the location tag.

[0148] Referring to the twentieth aspect, in some implementations of the twentieth aspect, when the instructions are executed by one or more processors, the electronic device is capable of: displaying a fourth interface after the electronic device detects a user tapping on a location tag in the third interface, the fourth interface including a control card of the electronic device corresponding to the location tag; and displaying a fifth interface after the electronic device detects a user tapping on an on control on the control card, the fifth interface including a display interface of the electronic device corresponding to the location tag, wherein the content of the display interface card matches the content of a display of the electronic device corresponding to the location tag or the display interface card is used to control the electronic device corresponding to the location tag.

[0149] With respect to the twentieth aspect, in some implementations of the twentieth aspect, when the instructions are executed by one or more processors, the electronic device is capable of: detecting, by the electronic device, an operation of a preset gesture in the third interface; determining, by the electronic device, in response to the operation of the preset gesture, that a device in the pointing direction of the electronic device is a target electronic device; and displaying, by the electronic device, a fourth interface, the fourth interface including a display interface card of the target electronic device, wherein content of the display interface card matches content of a display of the target electronic device or the display interface card is used to control the target electronic device.

[0150] According to a twenty-first aspect, there is provided a computer storage medium comprising computer instructions which, when run on an electronic device, enable the electronic device to perform a direction-finding interaction method according to any one of the sixteenth to eighteenth aspects.

[0151] According to a twenty-second aspect, there is provided a computer program comprising computer instructions which, when run on an electronic device, enable the electronic device to perform a direction-finding interaction method according to any one of the sixteenth to eighteenth aspects.

[0152] According to a 23rd aspect, there is provided an electronic device, comprising one or more processors and one or more memories, wherein the one or more memories store one or more computer programs, the one or more computer programs comprising instructions, which, when executed by the one or more processors, enable the electronic device to perform a method according to any one of the first, second, seventh, ninth, and sixteenth to eighteenth aspects.

[0153] According to a 24th aspect, there is provided a computer-readable storage medium comprising instructions which, when run on an electronic device, enable the electronic device to perform a method according to any one of the first, second, seventh, ninth, and sixteenth to eighteenth aspects.

[0154] According to a 25th aspect, there is provided a computer program product, comprising computer instructions which, when run on an electronic device, enable the electronic device to perform a method according to any one of the first, second, seventh, ninth, and sixteenth to eighteenth aspects. [Brief explanation of the drawings]

[0155] [Figure 1a] FIG. 1 is a schematic diagram of a multi-device scenario according to one embodiment of the present application. [Figure 1b] FIG. 1 is a schematic diagram of a multi-device scenario according to one embodiment of the present application.

[0156] [Figure 2a] 1 is a schematic diagram of a user interface in a data transmission process between a group of multiple devices according to an embodiment of the present application. [Figure 2b] 1 is a schematic diagram of a user interface in a data transmission process between a group of multiple devices according to an embodiment of the present application. [Figure 2c] 1 is a schematic diagram of a user interface in a data transmission process between a group of multiple devices according to an embodiment of the present application. [Figure 2d] 1 is a schematic diagram of a user interface in a data transmission process between a group of multiple devices according to an embodiment of the present application. [Figure 2e] 1 is a schematic diagram of a user interface in a data transmission process between a group of multiple devices according to an embodiment of the present application. [Figure 2f]1 is a schematic diagram of a user interface in a data transmission process between a group of multiple devices according to an embodiment of the present application. [Figure 2g] 1 is a schematic diagram of a user interface in a data transmission process between a group of multiple devices according to an embodiment of the present application. [Figure 2h] 1 is a schematic diagram of a user interface in a data transmission process between a group of multiple devices according to an embodiment of the present application. [Figure 2i] 1 is a schematic diagram of a user interface in a data transmission process between a group of multiple devices according to an embodiment of the present application.

[0157] [Figure 3a] 1 is a schematic diagram of a set of user interfaces of a mobile phone 111 according to an embodiment of the present application. [Figure 3b] 1 is a schematic diagram of a set of user interfaces of a mobile phone 111 according to an embodiment of the present application. [Figure 3c] 1 is a schematic diagram of a set of user interfaces of a mobile phone 111 according to an embodiment of the present application.

[0158] [Figure 3d] FIG. 2 is a schematic diagram of selecting a target device in a multi-device scenario according to an embodiment of the present application.

[0159] [Figure 3e] FIG. 2 is a schematic diagram of a user action according to an embodiment of the present application.

[0160] [Figure 3f] FIG. 10 is a schematic diagram of another user action according to an embodiment of the present application.

[0161] [Figure 3g] FIG. 10 is a schematic diagram of another user action according to an embodiment of the present application.

[0162] [Figure 3h] FIG. 10 is a schematic diagram of another user action according to an embodiment of the present application.

[0163] [Figure 3i] FIG. 2 is a schematic diagram of selecting a target device in a multi-device scenario according to an embodiment of the present application.

[0164] [Figure 3j] 1 is a schematic diagram of a user interface of a mobile phone 111 according to an embodiment of the present application.

[0165] [Figure 3k] FIG. 10 is another schematic diagram of selecting a target device in a multi-device scenario according to an embodiment of the present application.

[0166] [Figure 3l] 1 is a schematic diagram of a set of user interfaces of a mobile phone 111 according to one embodiment of the present application. [Figure 3m] 1 is a schematic diagram of a set of user interfaces of a mobile phone 111 according to one embodiment of the present application.

[0167] [Figure 4a] 1 is a schematic diagram of a set of user interfaces of a mobile phone 111 according to one embodiment of the present application. [Figure 4b] 1 is a schematic diagram of a set of user interfaces of a mobile phone 111 according to one embodiment of the present application. [Figure 4c] 1 is a schematic diagram of a set of user interfaces of a mobile phone 111 according to one embodiment of the present application.

[0168] [Figure 4d] FIG. 2 is a schematic diagram of selecting a target device in a multi-device scenario according to an embodiment of the present application.

[0169] [Figure 4e]1 is a schematic diagram of a set of user interfaces of a mobile phone 111 according to one embodiment of the present application. [Figure 4f] 1 is a schematic diagram of a set of user interfaces of a mobile phone 111 according to one embodiment of the present application.

[0170] [Figure 4g] FIG. 2 is a schematic diagram of selecting a target device in a multi-device scenario according to an embodiment of the present application.

[0171] [Figure 4h] 11A-11C are schematic diagrams of a group of user interfaces of the television 113 according to one embodiment of the present application. [Figure 4i] 11A-11C are schematic diagrams of a group of user interfaces of the television 113 according to one embodiment of the present application. [Figure 4j] 11A-11C are schematic diagrams of a group of user interfaces of the television 113 according to one embodiment of the present application. [Figure 4k] 11A-11C are schematic diagrams of a group of user interfaces of the television 113 according to one embodiment of the present application.

[0172] [Figure 4l] 1 is a schematic diagram of a user interface of a mobile phone 111 according to an embodiment of the present application.

[0173] [Figure 5a] FIG. 2 is a schematic diagram of selecting a target device in a multi-device scenario according to an embodiment of the present application.

[0174] [Figure 5b] 1 is a schematic diagram of a set of user interfaces of a mobile phone 111 according to an embodiment of the present application. [Figure 5c] 1 is a schematic diagram of a set of user interfaces of a mobile phone 111 according to an embodiment of the present application. [Figure 5d]1 is a schematic diagram of a set of user interfaces of a mobile phone 111 according to an embodiment of the present application.

[0175] [Figure 5e] 1 is a schematic diagram of a video telephony interface of a mobile phone 111 according to an embodiment of the present application.

[0176] [Figure 5f] FIG. 1 is a schematic diagram of a video telephony interface of a tablet computer 116 according to one embodiment of the present application.

[0177] [Figure 6] 1 is a schematic diagram of an interface of a user's electronic device, according to one embodiment of the present invention.

[0178] [Figure 7] FIG. 2 is another schematic diagram of an interface of a user's electronic device according to an embodiment of the present application.

[0179] [Figure 8] FIG. 2 is another schematic diagram of an interface of a user's electronic device, according to one embodiment of the present invention.

[0180] [Figure 9] 3 is a schematic diagram of a target file sharing operation to a target device according to one embodiment of the present invention.

[0181] [Figure 10] FIG. 10 is another schematic diagram of the operation of sharing a target file to a target device according to an embodiment of the present invention.

[0182] [Figure 11] FIG. 10 is another schematic diagram of the operation of sharing a target file to a target device according to an embodiment of the present invention.

[0183] [Figure 12] FIG. 10 is another schematic diagram of the operation of sharing a target file to a target device according to an embodiment of the present invention.

[0184] [Figure 13] FIG. 10 is another schematic diagram of the operation of sharing a target file to a target device according to an embodiment of the present invention.

[0185] [Figure 14] FIG. 10 is another schematic diagram of the operation of sharing a target file to a target device according to an embodiment of the present invention.

[0186] [Figure 15] FIG. 10 is another schematic diagram of the operation of sharing a target file to a target device according to an embodiment of the present invention.

[0187] [Figure 16] FIG. 10 is another schematic diagram of the operation of sharing a target file to a target device according to an embodiment of the present invention.

[0188] [Figure 17] FIG. 10 is another schematic diagram of the operation of sharing a target file to a target device according to an embodiment of the present invention.

[0189] [Figure 18] FIG. 2 is a schematic diagram of a first pop-up window interface according to one embodiment of the present invention.

[0190] [Figure 19] FIG. 10 is a schematic diagram of a second pop-up window interface according to one embodiment of the present invention.

[0191] [Figure 20] FIG. 2 is a schematic diagram of a shareable device icon according to one embodiment of the present invention.

[0192] [Figure 21] FIG. 10 is a schematic diagram of an interface for selecting a sharing type, according to one embodiment of the present invention.

[0193] [Figure 22a] FIG. 1 is a schematic diagram of locating a shareable device by an electronic device according to one embodiment of the present invention.

[0194] [Figure 22b] FIG. 1 is a schematic diagram of an interface for locating a shareable device toward which the head of an electronic device is pointing, according to one embodiment of the present invention.

[0195] [Figure 23a] FIG. 2 is a schematic diagram of selecting a target device in a multi-device scenario according to an embodiment of the present application.

[0196] [Figure 23b] 1 is a schematic diagram of a user interface of a mobile phone 111 according to an embodiment of the present application.

[0197] [Figure 23c] FIG. 2 is a schematic diagram of a user action according to an embodiment of the present application.

[0198] [Figure 23d] FIG. 10 is a schematic diagram of another user action according to an embodiment of the present application.

[0199] [Figure 23e] FIG. 10 is a schematic diagram of another user action according to an embodiment of the present application.

[0200] [Figure 23f] FIG. 10 is a schematic diagram of another user action according to an embodiment of the present application.

[0201] [Figure 23g]FIG. 1 is a schematic diagram of a user interface of a television 113 according to one embodiment of the present application.

[0202] [Figure 23h] 1 is a schematic diagram of a set of user interfaces of a mobile phone 111 according to one embodiment of the present application.

[0203] [Figure 23i] 1 is a schematic diagram of a set of user interfaces of a mobile phone 111 according to one embodiment of the present application. [Figure 23j] FIG. 1 is a schematic diagram of a user interface of a television 113 according to one embodiment of the present application.

[0204] [Figure 23k] 1 is a schematic diagram of a set of user interfaces of a mobile phone 111 according to one embodiment of the present application. [Figure 23l] 1 is a schematic diagram of a set of user interfaces of a mobile phone 111 according to one embodiment of the present application.

[0205] [Figure 24a] 1 is a schematic diagram of a set of user interfaces of a mobile phone 111 according to one embodiment of the present application. [Figure 24b] 1 is a schematic diagram of a set of user interfaces of a mobile phone 111 according to one embodiment of the present application.

[0206] [Figure 25a] 1 is a schematic diagram of a set of user interfaces of a mobile phone 111 according to one embodiment of the present application. [Figure 25b] 1 is a schematic diagram of a set of user interfaces of a mobile phone 111 according to one embodiment of the present application.

[0207] [Figure 26a] 1 is a schematic diagram of a set of user interfaces of a mobile phone 111 according to one embodiment of the present application. [Figure 26b] 1 is a schematic diagram of a set of user interfaces of a mobile phone 111 according to one embodiment of the present application.

[0208] [Figure 27] 1 is a schematic diagram of the structure of a smart home system according to one embodiment of this application;

[0209] [Figure 28A] 1 is a schematic diagram of an operation process in which a portable device controls a smart home device. [Figure 28B] 1 is a schematic diagram of an operation process in which a portable device controls a smart home device. [Figure 28C] 1 is a schematic diagram of an operation process in which a portable device controls a smart home device.

[0210] [Figure 29] 1 is a diagram of an example of control parameters corresponding to physical buttons on a portable device according to one embodiment of the present application.

[0211] [Figure 30] FIG. 10 is a diagram of an example where two portable devices are matched to a preset moving track, according to one embodiment of the present application.

[0212] [Figure 31] 10A-10C are diagrams illustrating an example of a portable device moving to a preset spatial orientation according to an embodiment of the present application.

[0213] [Figure 32a] 1 is a schematic diagram of a preset coordinate system of a portable device according to an embodiment of the present application.

[0214] [Figure 32b] 1 is a schematic diagram of a method for determining a spatial orientation of a portable device according to an embodiment of the present application;

[0215] [Figure 33] 1 is a schematic diagram of a method for determining the orientation and distance of a smart home device relative to a portable device according to an embodiment of the present application.

[0216] [Figure 34] FIG. 1 is a diagram of an example of a smartphone controlling a television according to an embodiment of the present application.

[0217] [Figure 35] FIG. 1 is a diagram of an example of a smartphone controlling an air conditioner according to an embodiment of the present application.

[0218] [Figure 36(a)] 1 is a schematic diagram of a group of GUIs according to an embodiment of the present application. [Figure 36(b)] 1 is a schematic diagram of a group of GUIs according to an embodiment of the present application. [Figure 36(c)] 1 is a schematic diagram of a group of GUIs according to an embodiment of the present application. [Figure 36(d)] 1 is a schematic diagram of a group of GUIs according to an embodiment of the present application.

[0219] [Figure 37(a)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 37(b)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 37(c)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 37(d)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application.

[0220] [Figure 38(a)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 38(b)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 38(c)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 38(d)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 38(e)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application.

[0221] [Figure 39(a)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 39(b)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 39(c)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 39(d)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application.

[0222] [Figure 40(a)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 40(b)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 40(c)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 40(d)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 40(e)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 40(f)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 40(g)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 40(h)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application.

[0223] [Figure 41(a)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 41(b)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 41(c)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 41(d)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 41(e)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 41(f)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 41(g)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application.

[0224] [Figure 42(a)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 42(b)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 42(c)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 42(d)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 42(e)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 42(f)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 42(g)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application.

[0225] [Figure 43(a)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 43(b)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 43(c)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 43(d)]FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 43(e)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 43(f)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application.

[0226] [Figure 44(a)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 44(b)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 44(c)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application.

[0227] [Figure 45(a)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 45(b)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 45(c)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application.

[0228] [Figure 46(a)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 46(b)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 46(c)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application.

[0229] [Figure 47(a)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 47(b)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 47(c)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 47(d)]FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application.

[0230] [Figure 48(a)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 48(b)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 48(c)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application.

[0231] [Figure 49(a)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 49(b)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 49(c)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 49(d)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application.

[0232] [Figure 50(a)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 50(b)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 50(c)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application.

[0233] [Figure 51(a)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 51(b)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 51(c)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application.

[0234] [Figure 52(a)]FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 52(b)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 52(c)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application.

[0235] [Figure 53(a)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application. [Figure 53(b)] FIG. 10 is a schematic diagram of another set of GUIs according to an embodiment of the present application.

[0236] [Figure 54a] 1 is a schematic flowchart of a control method applied to an electronic device according to an embodiment of the present application.

[0237] [Figure 54b] 1 is a schematic flowchart of a control method applied to an electronic device according to an embodiment of the present application.

[0238] [Figure 54c] 1 is a flowchart of a target file sharing method according to one embodiment of the present invention.

[0239] [Figure 54d] 4 is a flowchart of another target file sharing method according to an embodiment of the present invention.

[0240] [Figure 54e] 1 is a schematic flowchart of a direction-finding interaction method according to an embodiment of the present application;

[0241] [Figure 54f] 1 is a schematic flowchart of another direction search interaction method according to an embodiment of the present application;

[0242] [Figure 55]1 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present application;

[0243] [Figure 56] 1 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present application;

[0244] [Figure 57] 1 is a block diagram of the structure of a portable device according to one embodiment of the present application.

[0245] [Figure 58] FIG. 10 is a block diagram of the structure of another portable device according to an embodiment of the present application.

[0246] [Figure 59] 1 is a schematic diagram of the structure of a portable device according to one embodiment of the present application.

[0247] [Figure 60] 1 is a schematic diagram of the software structure of a portable device according to one embodiment of the present application.

[0248] [Figure 61] 1 is a schematic diagram of a control process in which a portable device controls a smart home device according to an embodiment of the present application.

[0249] [Figure 62] FIG. 10 is a schematic diagram of another control process in which a portable device controls a smart home device according to an embodiment of the present application.

[0250] [Figure 63] 1 is a schematic flowchart of a framework of a direction-finding interaction method according to an embodiment of the present application;

[0251] [Figure 64]1 is a schematic diagram of identifying orientation and distance with a UWB or Bluetooth component according to one embodiment of the present application; DETAILED DESCRIPTION OF THE INVENTION

[0252] Hereinafter, the technical solutions in one embodiment of this application will be clearly described with reference to the accompanying drawings. In the description of the embodiments of this application, unless otherwise specified, " / " indicates "or." For example, A / B may indicate A or B. The term "and / or" in this specification describes an association relationship for describing associated objects, and indicates that three relationships may exist. For example, A and / or B may represent three cases: only A exists, both A and B exist, and only B exists. Additionally, in the description of the embodiments of this application, "plurality" means two or more.

[0253] In the following description, the terms "first" and "second" are intended for descriptive purposes only and shall not be understood as an implicit indication of the number, relative importance, or other characteristics of the technical features depicted. Therefore, a feature qualified by "first" or "second" may explicitly or implicitly include one or more features. In the description of the implementation of this application, unless otherwise specified, "plurality" means two or more.

[0254] In an embodiment of this application, the electronic device and the target device each have a positioning module. The electronic device may use the positioning module to perform a directional interaction with another device. Specifically, when the electronic device points to the target device, the electronic device may send a file (also called a shared file) to the target device. When the electronic device points to the target device, the electronic device may further obtain information about the task being performed by the target device. For example, when the target device is a television, the electronic device may obtain information about the video being played by the television (such as the video name, the video episode number, and the video cast list). Alternatively, the electronic device may control the target device, not only through the user interface of the electronic device (e.g., turning the target device on or off or adjusting the volume of the target device), but also by using physical buttons on the electronic device.

[0255] In the implementation of this application, the electronic device may be referred to as a portable device. Both the smart home device and the shareable device may be referred to as target devices in the implementation of this application. The first content may be referred to as a target file. The positioning module may be referred to as a positioning chip, which may be a UWB chip or a Bluetooth chip. The electronic device may calculate the distance between the electronic device and the shareable device and the location of the shareable device by using the positioning chip.

[0256] First, one embodiment of this application describes a control method applied to an electronic device with reference to the accompanying drawings. According to the method, when the electronic device points at a target device, or when the electronic device points at the target device and moves toward the target device, the electronic device may transmit first content to the target device. The first content may include pictures, videos, audio, documents, food cooking parameters, motion parameters, etc. In this way, a user only needs to perform a simple action, allowing the electronic device to determine the target device and exchange data. The electronic device does not need to identify the user action multiple times, thereby improving the efficiency of data exchange with the target device. Therefore, the user action is simple, and the user experience is improved.

[0257] 1a illustrates a multi-device scenario. As illustrated in FIG. 1a, the multi-device scenario 100A may include a mobile phone 111, a speaker 112, a television 113, a soy milk maker 114, and a treadmill 115. The mobile phone 111 may perform data transmission with other devices (e.g., the speaker 112, the television 113, the soy milk maker, and the treadmill 115) in the multi-device scenario 100A. Alternatively, a user may control other devices in the multi-device scenario 100A by using the mobile phone 111.

[0258] It will be understood that the multi-device scenario 100A may include more or fewer electronic devices, and the number of electronic devices in the multi-device scenario is not limited in this embodiment of the application.

[0259] Optionally, the multi-device scenario may further include electronic devices such as a tablet computer, a computer, a projector, and the like.

[0260] FIG. 1B illustrates another multi-device scenario 100B according to an embodiment of the present application. As illustrated in FIG. 1B, the multi-device scenario 100B may include electronic devices such as a mobile phone 111, a speaker 112, a television 113, a soy milk maker 114, a treadmill 115, a tablet computer 116, a computer 117, a speaker 118, and a projector 119. A user may control other devices in the multi-device scenario 100B by using an electronic device (e.g., the mobile phone 111 or the tablet computer 116). Alternatively, a user may transmit data in an electronic device to another electronic device. For example, a user may project video in an electronic device onto a television 113. A user may transmit audio in an electronic device to a speaker 112 for playback.

[0261] 2a-2i are schematic diagrams of selecting an electronic device in a multi-device scenario 100B to receive data transmitted by an electronic device in the prior art. In the multi-device scenario 100B, an example in which a user selects a target device on a mobile phone 111 to send a picture is used to explain the prior art.

[0262] 2a shows user interface 200 of mobile phone 111. User interface 200 may include several application icons, such as a gallery icon 201, a music icon 202, a video icon 203, a sports icon 204, and a recipe icon 205. A user may tap gallery icon 201, and mobile phone 111 may display user interface 30A in response to the user action.

[0263] 2b shows a user interface 30A of the mobile phone 111. The user interface 30A may include a picture 301 and a picture 302. The user interface 30A may further display the time at which the mobile phone 111 stored the picture 301 and the picture 302. For example, the time at which the mobile phone 111 stored the picture 301 may be "today."

[0264] As shown in FIG. 2c, a user may press and hold picture 301 in user interface 30A, and mobile phone 111 may display user interface 30B in response to the user action.

[0265] 2d shows a user interface 30B of the mobile phone 111. The user interface 30B may include a picture 301 and a menu 303. The menu 303 may include a control 304. The control device 304 is used to select a manner of sharing the picture 301. The menu 303 may display attributes (not shown), size (not shown), etc. of the picture 301.

[0266] As shown in FIG. 2e, the user may tap control 304 in user interface 30B, and mobile phone 111 may display user interface 30C in response to the user action.

[0267] 2f shows user interface 30C of mobile phone 111. User interface 30C may include picture 301, picture 302, and option box 310. Option box 310 may include control 311 and control 312. Control 311 is used to select a target device to share picture 301 with. Control 312 is used to close option box 310.

[0268] As shown in FIG. 2g, a user may tap control 311 in user interface 30c, and mobile phone 111 may display user interface 400 in response to the user action.

[0269] FIG. 2h illustrates a user interface 400 for the mobile phone 111. The user interface 400 may display icons for multiple devices with which sharing may be performed, such as an icon 401 for the speaker 112, an icon 402 for the tablet 116, an icon 403 for the television 113, an icon 404 for the treadmill 115, an icon 405 for the computer 117, an icon 406 for the soy milk maker 114, an icon 407 for the speaker 118, and an icon 408 for the projector 119. The display sequence of the icons 401-408 in the user interface 400 may be determined based on the signal strength with which the corresponding electronic device receives a Wi-Fi network, a 4G network, or a 5G network. A stronger signal strength indicates a higher display position of the icon corresponding to the electronic device in the user interface 400. After the signal strength changes, the position of the icon corresponding to the electronic device in the user interface 400, such as the icon 402 for the tablet 116 shown in the user interface 400, also changes. When the signal strength with which the tablet 116 receives the Wi-Fi network, the 4G network, or the 5G network weakens, the position of the icon 402 of the tablet 116 in the user interface 400 changes.

[0270] If the position of the tablet 116 icon changes when the user taps the tablet 116 icon 402 in the mobile phone 111 user interface 400, the user may select the wrong electronic device with which the picture is being shared.

[0271] As shown in FIG. 2i, the user originally expects to select tablet 116 with which to share picture 301. However, when the user taps, the position of tablet 116 icon 402 in user interface 400 changes. As a result, the user taps television 113 icon 403, and picture 301 is shared with television 113.

[0272] In the above-described method for controlling an electronic device to select a device for interaction in the prior art, the operation process is very complicated when a user expects to select an electronic device to share a picture 301 with on the mobile phone 111. Additionally, if the signal strength at which the electronic device receives a Wi-Fi network, a 4G network, or a 5G network changes, or if the location between the electronic device and the mobile phone 111 changes, the position of the icon corresponding to the electronic device and displayed on the user interface of the mobile phone 111 changes. As a result, the user may select the wrong electronic device where sharing is expected to be performed. The user may send a picture or other content to electronic device B that is expected to be shared with electronic device A. This results in a poor user experience.

[0273] To solve the problems in the prior art, an embodiment of this application provides a control method applicable to an electronic device. In the method, the electronic device (e.g., a mobile phone or tablet computer) may detect a first user motion. In response to the first motion, the electronic device acquires the direction of the first motion and a first posture of the electronic device. The electronic device determines a target device (e.g., a mobile phone, tablet computer, computer, television, soy milk maker, or treadmill) based on the direction of the first motion and / or the first posture. When the electronic device detects that the electronic device and the target device are logged into the same account, the electronic device sends first content to the target device. The first content may include pictures, videos, audio, documents, food cooking parameters, exercise parameters, etc. In this way, the user only needs to perform a simple motion, allowing the electronic device to determine the target device and exchange data. The electronic device does not need to identify the user motion multiple times, improving the efficiency of data exchange with the target device. Therefore, the user motion is simple, and the user experience is improved.

[0274] In this embodiment of the present application, the direction of the first motion may be the movement direction of the first motion or the direction in which the top of the electronic device is pointing when the user performs the first motion. The electronic device may determine an electronic device in the movement direction of the first motion as the target device. Alternatively, the electronic device may determine an electronic device in the direction in which the top of the electronic device is pointing as the target device.

[0275] In this embodiment of the application, the user interface of the electronic device has a default display orientation. In this implementation of the application, the top frame of the user interface in the default display orientation of the electronic device is referred to as the top of the electronic device, and the bottom frame of the user interface in the default display orientation is referred to as the bottom of the electronic device. As shown in FIG. 2a, the display orientation of the user interface 200 is the default display orientation. The top frame of the user interface 200 is referred to as the top of the mobile phone 111, and the bottom frame of the user interface 200 is referred to as the bottom of the mobile phone 111.

[0276] Hereinafter, a control method applied to an electronic device according to an embodiment of the present application will be described in detail with reference to the accompanying drawings. The method provided in the embodiment of the present application may be applied to a multi-device scenario 100A shown in Figure 1a and a multi-device scenario 100B shown in Figure 1b.

[0277] First, referring to Figures 3a-3m, the mobile phone 111 will be described below in a multi-device scenario 100B determining the target device as the tablet computer 116 and sending a picture to the tablet computer 116. In the embodiment shown in Figures 3a-3l, there are multiple electronic devices in the direction of the user's first directional movement.

[0278] In an embodiment of the present application, the first movement may include a first directional movement.

[0279] 3a shows user interface 200 of mobile phone 111. User interface 300 may include several application icons, such as a gallery icon 201, a music icon 202, a video icon 203, a sports icon 204, and a recipe icon 205. A user may tap gallery icon 201, and mobile phone 111 may display user interface 30A in response to the user action.

[0280] 3b shows user interface 30A of mobile phone 111. User interface 30A may include picture 301 and picture 302. For details herein, see the above description of FIG. 2b. The details will not be described again here. A user may tap picture 301, and mobile phone 111 may display user interface 500 in response to the user action.

[0281] 3c shows a user interface 500 of the mobile phone 111. A picture 301 may be displayed on the user interface 500. The user may determine a target device based on a first directional motion in the multi-device scenario 100B. The mobile phone 111 may send the picture 301 to the target device.

[0282] Figure 3d illustrates a multi-device scenario 100B. As shown in Figure 3d, the user performs a first directional action on the mobile phone 111, i.e., points the mobile phone towards the target device to which the picture 301 is expected to be sent.

[0283] In a possible implementation, the first directional action may be a user moving mobile phone 111 toward the location of a target device (e.g., tablet computer 116). For example, as shown in FIG. 3e, the user pushes mobile phone 111 forward toward the location of the target device. When the user moves mobile phone 111 toward the location of the target device, mobile phone 111 may detect the user action.

[0284] Optionally, the first directional action may be a user pushing the electronic device toward the target device when the top of the electronic device is facing up and the display is facing the target device. As shown in FIG. 3f, the top of mobile phone 111 is facing up and the display is facing television 113, and the user pushes mobile phone 111 toward television 113.

[0285] Furthermore, the mobile phone 111 may detect a first directional movement of the user based on the acceleration collected by the acceleration sensor. For example, when the acceleration collected by the acceleration sensor of the mobile phone 111 is equal to or greater than a first threshold, the mobile phone 111 determines that the user is performing a first directional movement. The first threshold may be set by the system of the mobile phone 111.

[0286] Optionally, the mobile phone 111 may detect a first directional movement of the user based on the acceleration collected by the acceleration sensor and the angular velocity collected by the gyro sensor. For example, when the acceleration collected by the acceleration sensor of the mobile phone 111 is equal to or greater than a first threshold and the angular velocity collected by the gyro sensor is equal to a second threshold, the mobile phone 111 determines that the user is performing a first directional movement. The second threshold may be set by a system of the mobile phone 111.

[0287] Optionally, the mobile phone 111 may detect a first directional motion of the user based on the acceleration sensor and the touch sensor. For example, when the acceleration collected by the acceleration sensor of the mobile phone 111 is equal to or greater than a first threshold and the touch sensor does not detect a touch motion of the user within a preset time period, the mobile phone 111 determines that the user is performing a first directional motion. The preset time period may be set by a system of the mobile phone 111.

[0288] Optionally, the acceleration collected by the acceleration sensor of the mobile phone 111 during the first duration is a first threshold. Then, during a second duration after the first duration, the acceleration collected by the acceleration sensor of the mobile phone 111 is 0, i.e., the mobile phone is not moving. In this way, the mobile phone 111 determines that the user is performing a first directional movement. The specific manner in which the electronic device detects the user's first directional movement is not limited in this embodiment of this application.

[0289] In a possible implementation, the first directional action may be a user moving their hand in the air in a first direction over the display of the mobile phone 111 when placing the top of the mobile phone 111 in a direction close to the target device (e.g., tablet computer 116). For example, as shown in FIG. 3g, the user places the top of the mobile phone 111 in a direction close to the target device and slides their hand in the air over the display of the mobile phone 111 from the bottom to the top of the mobile phone 111. The mobile phone 111 may detect the orientation of the top of the mobile phone 111 by using an acceleration sensor and a gyro sensor. The mobile phone 111 may detect that the user is sliding their hand in the air over the display of the mobile phone 111 from the bottom to the top of the mobile phone 111 by using a camera.

[0290] In a possible implementation, the first directional action may be the user's hand sliding in a first direction across the display of the mobile phone 111 when the user places the top of the mobile phone 111 in a direction close to the target device (e.g., tablet computer 116). For example, as shown in FIG. 3h, the user places the mobile phone 111 in a direction close to the target device, and the user's hand slides from bottom to top across the display of the mobile phone 111. The mobile phone 111 may detect the orientation of the top of the mobile phone 111 by using an acceleration sensor and a gyro sensor. The mobile phone 111 may detect that the user's hand is sliding from bottom to top across the display of the mobile phone 111 by using a touch sensor.

[0291] When the mobile phone 111 detects a first directional movement of the user, in the multi-device scenario 100B, the mobile phone 111 may obtain position information (e.g., three-dimensional coordinates of the positions of the electronic devices) of other electronic devices (e.g., tablet computer 116, television 113, soy milk maker 114, speaker 112, computer 117, speaker 118, projector 119, or treadmill 115) and determine the electronic devices that are in the direction of the first directional movement.

[0292] In a possible implementation, all electronic devices in the multi-device scenario 100B have a positioning function. When the mobile phone 111 detects a first directional movement of the user, the mobile phone 111 may send a location request to the other devices. After receiving the location request sent by the mobile phone 111, the other electronic devices send location information of the other electronic devices to the mobile phone 111. After receiving the location information, the mobile phone 111 determines the electronic devices in the direction of the first directional movement.

[0293] Optionally, multi-device scenario 100B may include a positioning system including three or more positioning sensors. The positioning system may determine the locations of all electronic devices in multi-device scenario 100B and store the locations of all electronic devices in a positioning server corresponding to the positioning system. Mobile phone 111 may send a location request to the positioning server upon detecting a first directional movement of the user. In response to the request from mobile phone 111, the positioning server may send location information of another electronic device in multi-device scenario 100B to mobile phone 111.

[0294] Optionally, in a possible implementation, the mobile phone 111 may only obtain location information of electronic devices within a preset distance. Specifically, the mobile phone may only search for electronic devices within the preset distance, and send requests to the electronic devices within the preset distance to obtain location information of the electronic devices within the preset distance.

[0295] Furthermore, the mobile phone 111 may determine, as the target device, an electronic device that exists on a straight line where the first point of the mobile phone 111 is located in the direction of the first directional movement. As shown in Fig. 3i, the mobile phone 111 may determine, as the target device, an electronic device that exists on a straight line where the center of gravity of the mobile phone 111 is located in the direction of the first directional movement (e.g., the tablet computer 116, the television 113, and the soy milk maker 114 shown in Fig. 3i).

[0296] Furthermore, when there are multiple target devices, the mobile phone 111 may determine the target device that is closest to the mobile phone 111 as the target device to which the picture will ultimately be sent. For example, in Figure 3h, the mobile phone 111 may determine the tablet computer 116 that is closest to the mobile phone 111 as the target device to which the picture will ultimately be sent.

[0297] Optionally, when multiple target devices exist, the mobile phone 111 may display icons (e.g., names and device IDs) corresponding to the multiple target devices in a user interface of the mobile phone 111, such as user interface 600 of the mobile phone 111 shown in FIG. 3j. User interface 60A may include text 601 and controls 602 through 605. Text 601 is used to prompt that the number of target devices determined by the mobile phone 111 is three. Control 602 is used to return to a higher-level interface. Controls 603 through 605 are used by the user to select the final target device. For example, the user may tap control device 603, and the mobile phone 111, in response to the user's action, determines the tablet computer 116 as the final target device.

[0298] In another possible implementation, the mobile phone 111 may determine, as target devices, electronic devices within a preset range of a first point of the mobile phone 111 in the direction of the first directional movement. For example, as shown in FIG. 3k, the mobile phone 111 determines, as target devices, electronic devices within a preset range of a center of gravity point of the mobile phone 111 in the direction of the first directional movement. The target devices determined by the mobile phone 111 may include a tablet computer 116, a speaker 112, a television 113, a soy milk maker 114, and a computer 117.

[0299] As shown in FIG. 3l, icons of five target devices that may be determined by the mobile phone 111 are displayed in the user interface 60B. The user interface 60B may include text 601 and controls 602 through 607. The text 601 is used to prompt the user that the number of target devices determined by the mobile phone 111 is five. The control 602 is used to return to a higher-level interface. The controls 603 through 607 are used by the user to select the final target device. For example, the user may tap the control device 603, and the mobile phone 111, in response to the user's action, determines the tablet computer 116 as the final target device.

[0300] In a possible implementation, the arrangement sequence of icons corresponding to multiple target devices and displayed on the user interface of the mobile phone 111 may be determined based on the distance between the mobile phone 111 and the multiple target devices. The shorter the distance between the target devices and the mobile phone 111, the higher the position of the icon corresponding to the target device in the user interface of the mobile phone 111. For example, in the multi-device scenario 100B shown in FIG. 3i, the tablet computer 116, the television 113, and the soy milk maker 114 are all in the direction of the first directional movement. The tablet computer 116 is closest to the mobile phone 111. In this case, the icon corresponding to the tablet computer is positioned at the top of the list of icons displayed on the user interface of the mobile phone 111, such as the user interface 60A shown in FIG. 3j.

[0301] Optionally, the user interface 60B of the mobile phone 111 displays only the icon of the target device at a preset distance in a particular encompassing angular range of the first directional movement.

[0302] Optionally, when the mobile phone 111 determines that there are multiple target devices within a preset distance and a specific inclusive angle range of the first directional movement, the mobile phone 111 is one of the multiple target devices, and the arrangement order of the icons displayed on the mobile phone 111 is determined based on the distance between the mobile phone 111 and the multiple target devices and the direction of the first directional movement. For example, in the multi-device scenario 100B shown in FIG. 3k, among the multiple target devices determined by the mobile phone 111, the tablet computer 116, the television 113, and the soy milk maker 114 are in the direction of the first directional movement and on the center line of the mobile phone 111, the tablet computer 116 is closest to the mobile phone 111, and the speaker 112 and the computer 117 are within a preset range of the center line of the mobile phone 111. In this way, in a list of icons displayed on a mobile phone 111 that are of multiple target devices, for example, in the user interface 60B shown in FIG. 3l, the icon of the tablet computer is placed at the top, followed by the icon of the television 111, the icon of the soy milk maker 114, the icon of the speaker 112, and the icon of the computer 117.

[0303] Optionally, when two target devices are in the same position from the mobile phone, in the list of icons that belong to the target devices and are displayed on the mobile phone 111, the icon of the target device on the left side of the mobile phone 111 may be placed before the icon of the target device on the right side of the mobile phone 111.

[0304] Optionally, the icons of target devices that are in the direction of the first directional movement on the centerline of the mobile phone 111 may be larger than the icons of other target devices. For example, in the multi-device scenario 100B shown in FIG. 3j, the icons corresponding to the tablet computer 116, the television 113, and the soy milk maker 114 are larger than the icons corresponding to the speaker 112 and the computer 117.

[0305] In a possible implementation, the mobile phone 111 may select a target device based on the type of data transmitted. For example, when the type of data transmitted by the mobile phone is a picture, the mobile phone 111 may learn whether another device supports pictures. The mobile phone 111 uses an electronic device that can support pictures as a target device. For example, in the user interface 60B shown in FIG. 3l, if the speaker 112 and the soy milk maker 114 do not support pictures, the icons corresponding to the speaker 112 and the soy milk maker 114 may not be displayed on the user interface of the mobile phone 111.

[0306] In a possible implementation, when the mobile phone 111 determines the final target device, the mobile phone 111 prompts the user, for example, the mobile phone 111 vibrates or rings to prompt the user, or the display is turned on multiple times to prompt the user that the final target device has been determined.

[0307] After the mobile phone 111 determines that the final target device is the tablet computer 116 , the mobile phone 111 sends the picture 301 to the tablet computer 116 .

[0308] In a possible implementation, the mobile phone 111 sends the picture 301 to the tablet computer 116 when the mobile phone 111 determines that the mobile phone 111 and the tablet computer 116 are logged into the same account.

[0309] Optionally, when the mobile phone 111 determines that the mobile phone 111 and the tablet computer 116 are not logged into the same account, the mobile phone 111 sends a first request to the tablet computer 116, where the first request is used to request the tablet computer 116 to receive the picture 301. The mobile phone 111 receives a first response sent by the tablet computer 116. In response to the first response, the mobile phone 111 sends the picture 301 to the tablet computer 116.

[0310] Specifically, when the mobile phone 111 and the tablet computer 116 are logged in to the same account, the mobile phone 111 may send the picture 301 directly to the tablet computer 116. When the mobile phone 111 and the tablet computer 116 are not logged in to the same account, the mobile phone 111 must first send a request to the tablet computer 116. If the tablet computer 116 accepts the request, the mobile phone 111 may send the picture 301 to the tablet computer 116. If the tablet computer 116 rejects the request, the mobile phone 111 does not send the picture 301 to the tablet computer 116.

[0311] After receiving the picture, the tablet computer 116 may store the picture directly in an album of the tablet computer 116. For example, FIG. 3M shows a user interface 700 of the tablet computer 116. The user interface 700 may include a prompt box 701. The prompt box 701 is used to prompt the user of the tablet computer 116 that a picture has been received from the mobile phone 111 and stored in an album.

[0312] In this way, the user can send pictures to the tablet device with fewer operations, which simplifies the operation and improves the user experience.

[0313] 4a-4l, it will be described below that the mobile phone 111 determines the target device as the tablet computer 116 in the multi-device scenario 100A and sends a picture to the tablet computer 116. In the embodiment shown in FIGS. 4a-4l, there are multiple electronic devices in the direction of the user's first directional movement.

[0314] Figures 4a, 4b and 4c show a specific operational process in which a user selects pictures from the gallery of the mobile phone 111 that are expected to be sent to the target device. For Figures 4a to 4c, please refer to the above description of Figures 3a to 3c. The details will not be described again here.

[0315] FIG. 4d illustrates a user performing a first directional action in the multi-device scenario 100A. That is, the user performs the first directional action on the mobile phone 111 in the direction of the television 113. In the scenario illustrated in FIG. 4d, only one electronic device, namely, the television 113, exists in the direction of the user's first directional action. For details about the first directional action, see the descriptions of FIGS. 3e to 3g. Details will not be described again here. In response to the user action, the mobile phone 111 may determine the television 113 as the target device. In this case, the mobile phone 111 may prompt the user that the target device has been determined. For specific prompting methods, see the above description. Details will not be described again here. Optionally, the television 113 may also prompt the user that the television 113 has been determined as the target device. For example, the television 113 may emit an alert sound, such as "Di" or "Dingdong." The specific form of the alert sound is not limited. The television 113 may further prompt the user by changing the brightness of the display or by alternately turning the screen on and off. The manner in which the user is prompted is not limited herein.

[0316] When the mobile phone 111 determines only one target device, after determining the target device, it may directly transmit the content selected by the user (i.e., the picture 301 shown in FIG. 4c) to the target device.

[0317] Optionally, the mobile phone 111 may display an icon of the determined target device on the user interface. In this way, the user can see the icon of the target device on the user interface of the mobile phone 111. Therefore, the user may double-check whether the target device determined by the mobile phone 111 is correct. For example, FIG. 4e shows a user interface 60C of the mobile phone 111. The user interface 60C may include text 601, a control 602, and a control 606. For the user interface 60C, see the description of the user interface 60B. Details will not be described again here.

[0318] Optionally, the user may decide to send the picture in mobile phone 111 to television 113 by tapping control 606 in user interface 60C, for example, as shown in FIG. 4f.

[0319] Optionally, as shown in FIG. 4g, mobile phone 111 determines the target device based on a first directional action. After mobile phone 111 determines the target device, the user flips mobile phone 111, i.e., points the display of mobile phone 111 toward the target device. In response to the user action, mobile phone 111 transmits picture 301 to television 113.

[0320] It will be understood that the first directional action may be a combination of two actions. For example, the user may point the top of the mobile phone 111 toward the target device and move it toward the target device. After the mobile phone 111 determines the target device, the user may point the display of the mobile phone 111 toward the target device (in this case, the top of the mobile phone 111 may be facing the sky). Specifically, the first directional action may be to first move the mobile phone 111 in a direction closer to the target device and then point the display of the mobile phone 111 toward the target device.

[0321] Optionally, the first directional action may alternatively be the user first moving the mobile phone 111 in a direction closer to the target device and then sliding their hand in the air over the display of the mobile phone 111 from the bottom to the top of the mobile phone 111.

[0322] Optionally, the first directional action may alternatively be to first move the mobile phone 111 in a direction closer to the target device and slide from bottom to top on the display of the mobile phone 111.

[0323] 4h shows a user interface 900 for the television 113. The user interface 900 may be a video currently being played by the television 113.

[0324] In a possible implementation, if the login accounts of the mobile phone 111 and the television 113 are the same, the television 113 may display the picture 301 after receiving the picture 301 sent by the mobile phone 111. As shown in Figure 4i, the picture 301 may be displayed on the user interface 1000 of the television 113. Both the television 113 and the mobile phone 111 are logged into User A's account.

[0325] Optionally, if the login accounts of the mobile phone 111 and the television 113 are different, i.e., the mobile phone 111 is logged in to user A's account and the television is logged in to user B's account, the television 113 displays the content sent by the mobile phone 111 only after the user confirms in the user interface of the television 113. For example, FIG. 4j shows a user interface 1100 of the television 113. The user interface 1100 may include an option box 1101. The option box 1101 may include a control 1102 and a control 1103. If the user taps control 1102, the television 113 may receive the picture 301 sent by the mobile phone 111. As shown in FIG. 4k, the television 113 may display the picture after receiving the picture 301. If the user taps control 1103, the television 113 does not receive the picture 301 sent by the mobile phone 111. The mobile phone 111 may receive an indication that the television 113 will not receive the picture 301 and prompt the user of the fact that the television 113 will not receive the picture in a user interface of the mobile phone 111. As shown in FIG. 4l, after receiving an indication that the television 113 will not receive the picture 301, the mobile phone 111 may display a user interface 800. The user interface 800 may include the picture 301 and a prompt box 801. The prompt box 801 is used to prompt the user of the fact that the television will not receive the picture 301 transmitted by the mobile phone 111. When user B is watching television, user B can select not to receive the picture transmitted by user A's mobile phone 111. In this way, the user's viewing of the video played on the television 113 may not be affected.

[0326] Optionally, in a possible implementation, the mobile phone 111 may determine, as target devices, electronic devices in both the direction of the user's first directional movement and the opposite direction. As shown in FIG. 5a, the user moves the mobile phone 111 toward the treadmill 115. In response to the user movement, the mobile phone 111 may determine, as target devices, the treadmill 115 in the direction of the user's first directional movement and the speaker 112 in the opposite direction of the user's first directional movement.

[0327] Furthermore, the mobile phone 111 may display icons of the determined target devices in a user interface, for example, the user interface 60D shown in FIG. 5b. The user interface 60D may display an icon 607 of the speaker 112 and an icon 608 of the treadmill 115. For the user interface 60D, see the above description of the user interface 60A. Details will not be described again here.

[0328] Optionally, the mobile phone may determine whether the target device supports the content format selected by the user. For example, as shown in FIG. 5c, the user taps icon 607 for speaker 112 to select speaker 112 as the target device to receive the picture sent by mobile phone 111. Mobile phone 111 may determine that speaker 112 does not support the picture format. Mobile phone 111 may display a prompt box to notify the user that the target device does not support the picture format selected by the user. For example, FIG. 5d shows user interface 60E. User interface 60E may include prompt box 609. Prompt box 609 is used to prompt the user that the target device does not support the picture format. Prompt box 609 may include control 610. After the user taps control 610, mobile phone 111 may not display prompt box 609.

[0329] In another possible example, the user may further select to transmit the video in the mobile phone 111 to the television 113. After receiving the video, the television 113 plays the video. For the specific process of the mobile phone 111 transmitting the video to the television 113, please refer to the description of Figures 3a to 3l. The details will not be described again here.

[0330] In another possible implementation, the user may further select to send the video call data in the mobile phone 111 to the tablet computer 116. After receiving the video call data, the tablet computer 116 displays a video call interface. The video call interface of the mobile phone 111 is shown in FIG. 5e. FIG. 5e shows a video call interface 3300. The video call interface 3300 may include a video frame 3301, a video frame 3302, a control 3303, a control 3304, and a control 3305. The video frame 3301 and the video frame 3302 may be video frames captured by two devices conducting the video call, respectively. The display positions of the video frame 3301 and the video frame 3302 may be swapped. The user may tap the control 3303 to end the video call. The user may tap the control 3303 to turn the microphone on or off. A user may tap control 3305 to switch between the front and rear cameras of the mobile phone to capture video frames. When a user taps control 3305, the video frame from mobile phone 111 displayed on video telephone interface 3300 changes. For details regarding video telephone interface 3300, please refer to the description of the prior art. Details will not be described again here. After the tablet computer receives the video telephone data from mobile phone 111, video telephone interface 3400 may be displayed on tablet computer 116. As shown in FIG. 5F, for the video telephone interface 3400 shown in FIG. 5F, please refer to the description of video telephone interface 3300. Details will not be described again here.

[0331] For the specific process of the mobile phone 111 sending a video call to the tablet computer 116, please refer to the description of Figures 3a to 3m, and the details will not be described again here.

[0332] In another possible example, the user may select to transmit audio in the mobile phone 111 to the speaker 112. After receiving the audio, the speaker 112 plays the audio. For example, please refer to the description of Figures 3a to 3l for the specific process of the mobile phone 111 transmitting audio to the speaker 112. The details will not be described again here.

[0333] In another possible example, the user may choose to send the food cooking parameters in the mobile phone 111 to the soy milk maker 114. After receiving the food cooking parameters, the soy milk maker 114 may set an operation mode based on the food cooking parameters. For example, the food cooking parameters may be to heat for 10 minutes and stir for 2 minutes. For the specific process of the mobile phone 111 sending the food cooking parameters to the soy milk maker 114, please refer to the description of Figures 3a to 3l. The details will not be described again here.

[0334] In another possible example, the user may select to transmit exercise parameters in the mobile phone 111 to the treadmill 115. After receiving the exercise parameters, the treadmill 115 may set an exercise mode based on the exercise parameters. The exercise parameters may include exercise duration, exercise speed, treadmill incline, etc. For the specific process by which the mobile phone 111 transmits exercise data to the treadmill 115, see the description of Figures 3a-3l. The details will not be described again here.

[0335] Optionally, when a target device and an associated device are logged in to the same account, a permission for whether the electronic device can interact with the target device may be set on the associated device. For example, when the television 113 and the tablet computer 116 are logged in to the same account (e.g., a Huawei cloud account), the user of the tablet computer 116 may set on the tablet computer 116 whether the mobile phone 111 can exchange data with the television 113. If the tablet computer 116 sets the mobile phone 111 to be prohibited from exchanging data with the television 113, the mobile phone 111 cannot send pictures 301 to the television 113. If the tablet computer 116 sets the mobile phone 111 to be allowed to exchange data with the television 113, the mobile phone 111 may send pictures to the television 113.

[0336] In a control method applied to an electronic device provided in this embodiment of the present application, the electronic device detects a fifth motion. In response to the fifth motion, the electronic device acquires a direction of the fifth motion and a third attitude of the electronic device. The electronic device determines a target device based on the direction of the fifth motion and / or the third attitude. The electronic device sends a fourth request to the target device, the fourth request being used to request the target device to send second content. When the electronic device and the target device are logged in to the same account, the electronic device displays the second content sent by the target device. When the electronic device and the target device are not logged in to the same account, the electronic device displays third content sent by the target device, the third content being different from the second content. The second content may include first information about a first task currently being performed by the target device and / or a first control command for the first task, and the third content is used to indicate the current working status of the target device.

[0337] The following describes another specific implementation process for transmitting (or sharing) a target file in this application. The user interaction process in another method for transmitting a target file may be different from the user interaction process shown in Figures 1a to 5f. For details, please refer to the interaction process for users sharing a target file in an electronic device with a target device shown in Figures 6 to 21.

[0338] In some embodiments, a method for sharing files between an electronic device and a target device includes a user tapping a share function icon on a display of the electronic device, causing the display of the electronic device to display a device list, the device list including device names of multiple devices surrounding the electronic device. The user then queries the device names in the device list, selects the device name of the target device to which sharing will occur, and allows the electronic device to share the file with the target device. The operation steps of the file sharing method are complicated, resulting in low target file sharing efficiency. Figures 6 to 21 provide a target file sharing method according to an embodiment of this application, improving target file sharing efficiency.

[0339] The following describes the target file sharing method by using a specific embodiment with reference to a target file sharing scenario.

[0340] Sharing a picture is used as an example. Assume that the user needs to share a picture in the gallery with Vision and allow Vision to display the picture. The user opens the user's electronic device and causes the display to show the home screen of the electronic device. FIG. 6 is a schematic diagram of the interface of the user's electronic device according to one embodiment of this application. As shown in FIG. 6, the schematic diagram includes a status bar 21, a menu bar 22, and a function bar 23. The status bar 21 includes the operator, the current time, the current geographic location and local weather, the network status, the signal status, and the power battery level. As shown in FIG. 6, the operator is China Mobile, the current time is 08:08 on Friday, February 9, the current geographic location is Beijing, the weather in Beijing is cloudy, the temperature is 6°C, the network status is Wi-Fi, the signal status is full signal strength, indicating that the current signal is strong, and the black portion of the power battery level may indicate the remaining battery level of the electronic device. The menu bar 22 includes at least one application icon, and below each application icon is the name of the corresponding application, such as Gallery, App Store, Weibo, Alipay, WeChat, Cards, Settings, Camera, Photos, Messages, and Contacts. The positions of the application icons and the corresponding application names may be adjusted based on user preferences, but this is not limited to this embodiment of the present application. The function bar 23 includes a back key, a home screen key, and a menu key. The back key is used to return to the previous level, the home screen key is used to return to the home screen, and the menu key is used to display multiple background applications.

[0341] It should be noted that the schematic diagram of the interface of the electronic device shown in FIG. 6 is an example for the display in this embodiment of the present application. Alternatively, the schematic diagram of the interface of the electronic device may be in another style, which is not limited in this embodiment of the present application.

[0342] As shown in FIG. 6, a user may tap Gallery on the menu bar 22, causing the display of the user's electronic device to display a Gallery interface. FIG. 7 is another schematic diagram of an interface of a user's electronic device according to one embodiment of the present application. As shown in FIG. 7, the interface schematic diagram includes a photo search bar 31, at least one album 32, and a classification bar 33. The photo search bar 31 is used to conduct searches based on keywords entered by the user. Types of keywords include places, people, or times. For example, if the keyword is "Tianjin," the display of the electronic device may display all pictures taken in Tianjin. The at least one album 32 may include, but is not limited to, any or any combination of "All Photos," "Photos," and "Recently Deleted." Furthermore, the interface schematic diagram includes a "New Album" key. A new album may also be customized by tapping the "New Album" key on the display. The classification bar 33 includes a photo bar, an album bar, a moment bar, and a discovery bar. For example, when a user taps the photo bar, the display of the electronic device displays all pictures on the electronic device; when a user taps the album bar as shown in FIG. 7, the display of the electronic device displays the "all photos" album on the electronic device; when a user taps the moment bar, the display of the electronic device displays pictures acquired by time sharing; and when a user taps the discovery bar, the display of the electronic device displays pictures acquired after automatic classification, the automatic classification including, but not limited to, one or any combination of landscapes, people, and food.

[0343] It should be noted that the schematic diagram of the interface of the electronic device shown in FIG. 7 is an example for the display in this embodiment of the present application. Alternatively, the schematic diagram of the interface of the electronic device may be in another style, which is not limited in this embodiment of the present application.

[0344] As shown in Fig. 7, a user taps the "All Photos" album, and the display of the user's electronic device displays a schematic view of the interface of the "All Photos" album. Fig. 8 is another schematic view of the interface of the user's electronic device according to an embodiment of this application. As shown in Fig. 8, the schematic view of the interface includes a back key 41, an "All Photos" album name 42, and at least one picture 43. The back key 41 is used to return to the previous layer interface, i.e., the gallery interface.

[0345] It should be noted that the schematic diagram of the interface of the electronic device shown in FIG. 8 is an example for the display in this embodiment of the present application. Alternatively, the schematic diagram of the interface of the electronic device may be in a different style. Alternatively, the user may tap another album to select pictures to be shared. This is not limited in this embodiment of the present application.

[0346] A user may select a target file by performing a selection action. As shown in FIG. 8, the target file is a picture to be shared. For example, the selection action is tapping on a picture. Specifically, the touch screen driver detects the selection action and sends the selection action to the input manager, and the input manager selects the target file based on the selection action. The selection action of tapping on a picture shown in FIG. 8 is merely an exemplary action for selecting a target file, and the target file may be selected in another manner. The manner for selecting a target file is not limited in this embodiment of the present application.

[0347] A user may trigger the display of the electronic device to display a sharing interface by performing a first action, the interface including at least one shareable device icon, the shareable device icon being used to indicate shareable devices positioned around the electronic device. The first action may include a first sliding action and a first pressing action. Sharing a picture is used as an example. FIGS. 9a-9d are schematic diagrams of a sharing interface according to an embodiment of this application. As shown in FIG. 9a, a user selects a picture and then drags the picture with a finger to slide upward from the bottom area of ​​the display of the electronic device. Optionally, the size of the picture may be gradually reduced to a specific size as the finger slides upward. A schematic diagram obtained after the slide is shown in FIG. 9b. After dragging the picture with a finger to slide upward, the user presses the picture, and a schematic diagram of pressing the picture is shown in FIG. 9c. The pressing time is maintained for a first specific duration or longer, for example, the first pressing time is 700 ms. Optionally, after the press duration is equal to or greater than the first specific duration, the size of the picture is reduced a second time, and the reduced picture continues to move with the movement of the finger. The display of the electronic device displays a sharing interface. The sharing interface may include icons of all shareable devices around the electronic device, or may include only the icon of the shareable device toward which the head of the electronic device is pointing. A positioning driver of the electronic device may locate the shareable device toward which the head of the electronic device is pointing. When the sharing interface includes only the icon of the shareable device toward which the head of the electronic device is pointing, it may be convenient for the user to more accurately select the target device, and the shareable device toward which the head of the electronic device is pointing may also be intuitively displayed. The sharing interface shown in FIG. 9d includes an icon of one shareable device, namely, the icon of Vision.As shown in FIG. 9d, the interface surrounds the second-reduced picture and the Vision icon with a boundary of a specific shape, and a display graphic is set between the second-reduced picture and the Vision icon to indicate the direction of the user's next action. For example, the boundary of the specific shape is a closed dashed line of an ellipse, and the display graphic is an arrow. If the sharing interface includes icons of multiple sharable devices, the interface surrounds the second-reduced picture and the icons of the multiple sharable devices with a boundary of a specific shape, and a display graphic is set between the second-reduced picture and each of the sharable device icons. Alternatively, the interface surrounds the second-reduced picture and the icons of the multiple sharable devices with multiple boundaries of a specific shape, each of which surrounds the second-reduced picture and one of the sharable device icons with a display graphic set between the second-reduced picture and each of the sharable device icons. Optionally, the sharing interface may alternatively display the icons of the sharable devices in the form of a radar chart. FIG. 15d is a schematic diagram illustrating an example of displaying icons of sharable devices in the form of a radar chart according to an embodiment of the present application. As shown in FIG. 15d, the Vision icon is displayed in the sharing interface in the form of a radar chart, and the second zoomed-out picture is at the center of the radar chart. When the positioned Vision is at the 12 o'clock direction of the electronic device and 3 m away from the electronic device, the Vision icon is at the 12 o'clock direction of the second zoomed-out picture on the radar chart, and there is a specific distance between the icon and the second zoomed-out picture. For example, the specific distance is 3 cm. Furthermore, the sharing interface illustrated in FIG. 15d includes an exit button icon used to exit the current sharing interface. The exit button icon may be located in a specific position. For example, as shown in FIG. 15d, the exit button icon is located in the upper left corner of the display of the electronic device. Note that the location of the exit button icon is not limited in this embodiment of the present application.The second reduced picture and the icon of the shareable device may alternatively be in other representational forms such as a radar chart, which is not limited to this embodiment of the present application.

[0348] 13a to 13d (i.e., 13a, 13b, 13c, and 13d) are the same as FIGS. 9a to 9d (i.e., 9a, 9b, 9c, and 9d). Details will not be described again here. 15a to 15c (i.e., 15a, 15b, and 15c) are the same as FIGS. 9a to 9c (i.e., 9a, 9b, and 9c). Details will not be described again here.

[0349] It should be noted that the description of the first sliding action and the first pressing action in this embodiment of the present application is merely an example for the purpose of explanation. The first sliding action and the first pressing action may alternatively be expressed in other forms. This is not limited in this embodiment of the present application.

[0350] In another optional solution, the first action may include a second sliding action. Sharing a picture is used as an example. FIGS. 10a-10c are another schematic diagrams of a sharing interface according to an embodiment of this application. As shown in FIG. 10a, after a user selects a picture, the user drags the picture with a finger, sliding upward from the bottom region of the display of the electronic device. Optionally, the size of the picture may be gradually reduced to a specific size as the finger slides upward. The schematic diagram obtained after the slide is shown in FIG. 10b. Optionally, after the sliding distance is equal to or longer than a specific duration, the size of the picture is reduced a second time, and the reduced picture continues to move with the movement of the finger. The display of the electronic device displays a sharing interface. Optionally, the specific distance is 3 cm. The sharing interface may include icons of all sharable devices around the electronic device, or may include only icons of sharable devices toward which the head of the electronic device is pointing. A location driver of the electronic device may locate the sharable device toward which the head of the electronic device is pointing. When the sharing interface includes only the icon of the shareable device toward which the electronic device is pointing, it may be convenient for the user to select the target device more accurately, and the shareable device toward which the electronic device is pointing may also be displayed intuitively. The sharing interface shown in FIG. 10c includes an icon of one shareable device, namely, the Vision icon. As shown in FIG. 10c, the interface surrounds the second-reduced picture and the Vision icon with a boundary of a specific shape, and a display graphic is set between the second-reduced picture and the Vision icon to indicate the direction of the user's next action. For example, the boundary of the specific shape is a closed dashed ellipse, and the display graphic is an arrow.If the sharing interface includes icons of multiple sharable devices, the interface may include a boundary of a specific shape surrounding the second-reduced picture and the icons of the multiple sharable devices, and a display graphic may be set between the second-reduced picture and each of the sharable device icons, or the interface may include multiple boundaries of a specific shape surrounding the second-reduced picture and the icons of the multiple sharable devices, and each boundary of a specific shape surrounding the second-reduced picture and one of the sharable device icons, and a display graphic may be set between the second-reduced picture and each of the sharable device icons. Optionally, the sharing interface may alternatively display the icons of the sharable devices in the form of a radar chart.

[0351] Figures 16a and 16b are the same as Figures 10a to 10c. Details will not be described again here. Figures 17a and 17b are the same as Figures 10a and 10b. Details will not be described again here.

[0352] It should be noted that the description of the second sliding action in this embodiment of the present application is merely an example for the purpose of explanation. The second sliding action may alternatively be expressed in another form. This is not limited to this embodiment of the present application.

[0353] In another optional solution, the first action includes a second press action, and the second press action includes a multi-finger press action, where the number of fingers is greater than one and less than or equal to five. In an optional solution, the multi-finger press action includes a three-finger press action. Sharing a picture is used as an example. FIGS. 11a to 11c are another schematic diagrams of a sharing interface according to an embodiment of this application. As shown in FIGS. 11a and 11b, after a user selects a picture, the user presses the picture with three fingers and holds the press duration equal to or greater than a second specific duration. In an optional solution, the second specific duration is 700 ms. When the press duration is equal to or greater than the second specific duration, the display of the electronic device displays the sharing interface. In this case, the picture may be displayed on the display of the electronic device in full-screen mode or at a specific size. The picture displayed in the sharing interface shown in FIG. 11c is displayed on the display of the electronic device in full-screen mode. The sharing interface may include icons of all shareable devices around the electronic device, or may include only the icon of the shareable device toward which the head of the electronic device is pointing. A location driver of the electronic device may locate the shareable device toward which the head of the electronic device is pointing. When the sharing interface includes only the icon of the shareable device toward which the head of the electronic device is pointing, it may be convenient for the user to more accurately select the target device, and the shareable device toward which the head of the electronic device is pointing may also be intuitively displayed. The sharing interface shown in FIG. 11c includes an icon of one shareable device, namely, the Vision icon. As shown in FIG. 11c, the interface displays the shareable device icon in the form of a radar chart. Optionally, in the sharing interface, a border of a specific shape may also surround the reduced picture and the Vision icon, and the shareable device icon may be displayed in the form of a display graphic set between the reduced picture and the Vision icon. For details, see FIG. 12c or FIG. 14c. Details will not be described here.

[0354] Figures 12a and 12b are the same as Figures 11a and 11b. Figures 14a and 14b are the same as Figures 11a and 11b. The details will not be explained again here.

[0355] It should be noted that the description of the second pressing action in this embodiment of this application is merely an example for the purpose of illustration. The second pressing action may alternatively be expressed in another form, which is not limited in this application.

[0356] Furthermore, the sharing interface shown in Fig. 11c includes an exit button icon used to exit the current sharing interface. The exit button icon may be disposed in a specific location. For example, as shown in Fig. 11c, the exit button icon is disposed in the upper left corner of the display of the electronic device. It should be noted that the location of the exit button icon is not limited in this embodiment of the present application.

[0357] 17c is another schematic diagram of an interface displaying icons of shareable devices in the form of a radar chart according to an embodiment of the present application. The difference between FIG. 17c and FIG. 11c is that the picture in FIG. 17c is displayed on the display of the electronic device with a specific size, and the picture in FIG. 11c is implemented on the display of the electronic device in full-screen mode.

[0358] A user may trigger the sharing of the target file to the target device by performing a second action. The second action includes dragging the target file to an icon of the target device. For example, the target file is a picture and the target device is Vision. FIG. 9e is a schematic diagram of an interface for sharing a target file to a target device according to one embodiment of the present application. As shown in FIG. 9e, the sharing interface includes an icon of a sharable device, i.e., a Vision icon. The user may complete the action of sharing the picture with Vision by dragging the reduced picture a second time with a single finger in the direction indicated by the display graphic onto the Vision icon. If the sharing interface includes icons of multiple sharable devices, the user may drag the reduced picture a second time with a single finger in the direction indicated by the display graphic onto the icon of one of the sharable devices, where the icon is used to indicate the target device.

[0359] Figure 10d is the same as Figure 9e, and the details will not be explained again here.

[0360] In this embodiment of the present application, the user may alternatively drag the target file to the target device icon with multiple fingers, where the number of fingers is greater than one and less than or equal to five. In an optional solution, the user may drag the target file to the target device icon with three fingers. For example, the target file is a picture and the target device is Vision. FIG. 12d is another schematic diagram of an interface for sharing a target file to a target device according to an embodiment of the present application. As shown in FIG. 12d, the user drags the reduced picture to the Vision icon with three fingers in the direction indicated by the display graphic to complete the action of sharing the picture with Vision. If the sharing interface includes icons of multiple sharable devices, the user may drag the reduced picture to the icon of one of the sharable devices with multiple fingers in the direction indicated by the display graphic, where the icon is used to indicate the target device.

[0361] Furthermore, during the process of sharing the target file with the target device, a sharing progress bar appears around the icon of the target device. The sharing progress bar is used to indicate the current sharing progress. After the sharing is completed, a sharing completion identifier is displayed on the interface of the target device. Optionally, the sharing completion identifier is located in the upper right corner of the icon of the target device. The style of the sharing completion identifier may be set based on the actual situation. For example, the style of the sharing completion identifier is a checkmark icon. It should be noted that the position of the sharing completion identifier and the style of the sharing completion identifier are not limited in this embodiment of this application.

[0362] In another optional solution, the second action includes dragging the target file toward the target device icon, releasing the target file, and moving the target file to the target device icon. For example, the target file is a picture and the target device is Vision. Figures 13e and 13f are another schematic diagram of an interface for sharing a target file with a target device according to an embodiment of the present application. As shown in Figure 9e, the sharing interface includes an icon of a shareable device, i.e., a Vision icon. The user may drag the reduced picture a second time toward the Vision icon with a single finger in the direction indicated by the display graphic and then release the finger. The interface displayed after the finger is released is shown in Figure 13f. The dashed portion indicates the position of the reduced picture a second time before the finger is released. The picture is moved from the dashed portion to the Vision icon with a specific animation effect. For example, the specific animation effect is a fast movement.

[0363] Figures 16d and 16e are the same as Figures 13e and 13f, and the details will not be explained again here.

[0364] In this embodiment of the present application, when the sharing interface includes a single sharable device icon, the user may alternatively drag the target file with multiple fingers toward the target device icon and then release the target file, causing the target file to be moved to the target device icon. The number of fingers is greater than one and less than or equal to five. In an optional solution, the user may drag the target file with three fingers toward the target device icon and then release the target file. Figures 14d and 14e are another schematic diagram of an interface for sharing a target file with a target device according to an embodiment of the present application. As shown in Figure 14d, the sharing interface includes a sharable device icon, i.e., a Vision icon. The user may drag the reduced picture a second time toward the Vision icon with three fingers in the direction indicated by the display graphic and then release the fingers. The interface displayed after the fingers are released is shown in Figure 14e. The dashed area indicates the location of the reduced picture the second time before the fingers were released. The picture is moved from the dashed line position to the Vision icon with a specific animation effect, for example, a fast movement.

[0365] In this embodiment of the present application, if the sharing interface includes icons of multiple sharable devices, the user drags the reduced picture toward the Vision icon with a single finger or multiple fingers in the direction indicated by the display graphic. When the user then releases the finger, the sharing interface includes two sharable devices, making it impossible to determine the target device. Therefore, the user must select a target device, and the display of the electronic device displays a first pop-up window. Sharing a picture is used as an example. FIG. 18 is a schematic diagram of the interface of the first pop-up window according to an embodiment of the present application. As shown in FIG. 18, the sharing interface includes icons of two sharable devices, Vision and MateBook. When the user releases the finger, the display of the electronic device displays a first pop-up window. The question in the first pop-up window is "Please select a target device." The first pop-up window options include "Vision" and "MateBook." In this embodiment of the present application, the first pop-up window options are set to multiple options. Specifically, the user may select at least one shareable device from the plurality of shareable devices, determine the at least one selected shareable device as a target device, and share the target file with the at least one target device.

[0366] It should be noted that the first pop-up window option shown in FIG. 18 includes device names of multiple sharable devices, and the first pop-up window shown in FIG. 18 is merely an example of a first pop-up window provided in this embodiment of the application. In another optional solution, the first pop-up window option of the first pop-up window may further include icons of the multiple sharable devices. In another optional solution, the first pop-up window option of the first pop-up window may further include device names and icons of the multiple sharable devices. This is not limited in this embodiment of the application.

[0367] In this embodiment of the present application, in the process of sharing a target file with at least one target device, it is necessary to determine whether the target device has the ability to display the application to which the target file belongs. If the target device does not have the ability to display the application to which the target file belongs, the target file is shared with the target device. If the target device has the ability to display the application to which the target file belongs, the electronic device displays a second pop-up window for the user to select a sharing type for the target file. For example, the determining condition for determining whether the target device has the ability to display the application to which the target file belongs is whether the target device has a display. Specifically, if it is determined that the target device has a display, it indicates that the target device has the ability to display the application to which the target file belongs. If it is determined that the target device does not have a display, it indicates that the target device does not have the ability to display the application to which the target file belongs. Sharing a picture is used as an example. Figure 19 is a schematic diagram of an interface of the second pop-up window according to an embodiment of the present application. As shown in FIG. 19, after the reduced picture is moved to the icon of the target device, it is determined that Vision has a display, and the electronic device displays a second pop-up window. The second pop-up window includes a second pop-up window question and second pop-up window options. The second pop-up window question is "Select a sharing type." The second pop-up window options include "Share a picture on the page" and "Share a gallery." The second pop-up window options are set to one option, indicating that only the current picture will be shared with Vision when the user selects "Share a picture on the page."When the user selects "Share Gallery," the gallery is shared with Vision. Note that the determination criteria for determining whether the target device has the capability to display the application to which the target file belongs described in this embodiment of the present application are merely illustrative examples. In some embodiments, the capability of the target device may be further determined based on other determination criteria, which is not limited in this embodiment of the present application.

[0368] In another optional solution, the second action may include releasing the first action and tapping one or more icons of sharable devices. For example, the target file is a picture and the target device is Vision. Figures 15d and 15e are schematic diagrams of an interface for sharing a target file with a target device according to an embodiment of the present application. A schematic diagram of a user releasing the first action is shown in Figure 15d. The user releases their finger, i.e., releases the first action. After the user releases the first action, the display of the electronic device displays a sharing interface, which includes an icon of the sharable device toward which the head of the electronic device is pointing, and a positioning driver of the electronic device may locate the sharable device toward which the head of the electronic device is pointing. As shown in Figure 15e, the sharing interface includes an icon of the sharable device toward which the head of the electronic device is pointing, i.e., the Vision icon, and the sharable device icon is displayed in the sharing interface in the form of a radar chart. The user may tap the Vision icon with their finger to determine Vision as the target device and share a picture with Vision. When the sharing interface includes icons of multiple sharable devices toward which the head of the electronic device is pointing, the user may tap one or more icons of one or more sharable devices with a finger, which icons indicate the sharable devices, to determine one or more sharable devices indicated by the one or more tapped icons of the one or more sharable devices as one or more target devices, and use them to share the target file with at least one target device. The interface schematics shown in Figures 15d and 15e each further include an exit button icon used to exit the current sharing interface.In this case, when the user wants to end sharing the target file, the user may tap the exit button icon to return to the interface shown in FIG. 15a, or may tap the target file to return to the interface shown in FIG. 15a. Alternatively, the user may end sharing the target file in another manner, which is not limited to this embodiment of the present application.

[0369] Fig. 17d is the same as Fig. 15e. The details will not be described again here. The difference between Fig. 11d and Fig. 15e is that the picture in Fig. 15e is displayed on the display of the electronic device at a certain size, and the picture in Fig. 11d is implemented on the display of the electronic device in full-screen mode.

[0370] It should be noted that the tapping method of selecting a target device shown in FIG. 15e is merely an illustrative example. The target device may alternatively be selected in a different manner, which is not limited to this embodiment of the present application.

[0371] In this embodiment of the present application, the terms "first operation" and "second operation" are used to describe specific operations, but these operations should not be limited to these terms. These terms are used merely to distinguish between operations. For example, without departing from the scope of the embodiment of the present application, a first operation may also be referred to as a second operation. Similarly, a second operation may also be referred to as a first operation. In this embodiment of the present application, the capabilities supported by the shareable devices differ. Therefore, the sharing types for sharing the target file differ. The sharing types include application types and file types. The application type includes a type in which the electronic device shares the application to which the target file belongs with the target device. After sharing, if the user performs an operation on the application on the electronic device and generates a result, the result is displayed on the display of the target device. The file type includes a type in which the target file is shared with the target device.

[0372] Sharing a music file is used as an example. FIG. 20 is a schematic diagram of a shareable device icon according to an embodiment of this application. As shown in FIG. 20, the icon schematic diagram includes icons of multiple shareable devices, which are displayed on the display of an electronic device in the form of a radar chart. The multiple shareable device icons include user a's MateBook, user b's Vision, and user c's speaker. The shareable device icons may have different shapes and may include multiple sub-icons, each corresponding to a different sharing type. Different sub-icons may have different patterns, and different patterns may represent different sharing types. For example, the icon of user a's MateBook is an oval icon, which is divided into left and right sub-icons. The left sub-icon has a blank pattern, and the right sub-icon has a dot pattern. The blank pattern indicates that a music file is being shared with the MateBook, and the waveform point pattern indicates that the application to which the music file belongs is being shared with the MateBook. The speaker icon for user c is a circular icon, and the pattern of the circular icon is a blank pattern, indicating that the target file is being shared with the speaker. The user may use their finger to drag a music file to the sub-icon of the target device. FIG. 21 is a schematic diagram of an interface for selecting a sharing type according to one embodiment of this application. As shown in FIG. 21, when a user drags a music file to the left sub-icon of user a's MateBook, the music file approaches the left sub-icon of user a's MateBook, and a display graphic is displayed in the current interface, which is used to indicate the sharing type. As shown in FIG. 21, the display graphic is an arrow, which indicates that the sharing type of the music file is a file type.

[0373] Furthermore, if the target device does not support sharing of the target file, the icon of the target file may not be displayed, or the icon of the target device may be displayed in a specific manner. Sharing a picture is used as an example. If the shareable devices positioned around the electronic device include a speaker, but the speaker does not support sharing of pictures, the speaker icon may not be displayed in the sharing interface, or a gray icon of the speaker may be displayed in the sharing interface.

[0374] In an embodiment of this application, when a target file approaches a sub-icon of a target device, the selected sharing type is indicated by using a display graphic, which more clearly indicates the user's current selection direction, reduces the possibility of the user selecting the wrong sharing type due to manual error, and allows the user to make an accurate selection based on the user's intention.

[0375] It should be noted that the icon of the shareable device may alternatively have another shape, for example, a triangle, a rectangle, or a diamond. This is not limited in this embodiment of the application. The sub-icons may alternatively have another pattern, for example, a horizontal stripe pattern, a vertical stripe pattern, or a wave pattern. This is not limited in this embodiment of the application. In this embodiment of the application, the description of different sharing types represented by different patterns is used only as an example for explanation. The different patterns may alternatively represent other sharing types. This is not limited in this embodiment of the application.

[0376] The following describes a process for locating a shareable device around an electronic device. For example, assume there is one shareable device. FIG. 22a is a schematic diagram of locating a shareable device by an electronic device according to one embodiment of the present application. As shown in FIG. 22a, the schematic diagram includes an electronic device 51 and a shareable device 52. The electronic device 51 includes a first transmitter 511, a first receiver 512, a first antenna 512, and a positioning driver 513. The shareable device 52 includes a second transmitter 521, a second receiver 521, and a second antenna 522. Below, a positioning process in which the positioning driver includes a UWB driver and a positioning process in which the positioning driver includes a Bluetooth driver will be described separately.

[0377] When the positioning driver 513 includes a UWB driver, the UWB driver includes a UWB chip. The UWB chip controls the first transmitter 511 to transmit a measurement pulse signal to a second receiver 521 of the shareable device 52 via a single first antenna 512. The second transmitter 521 reflects a reflected signal to the first receiver 512 of the electronic device based on the measurement pulse signal via multiple second antennas 522. The first receiver 512 transmits the reflected signal to the UWB chip. The UWB chip records a first timestamp when the measurement pulse signal is transmitted and a second timestamp when the reflected signal is received, and calculates the distance between the electronic device and the shareable device by using a Time of Flight (ToF) ranging method based on the time period between the first timestamp and the second timestamp. The UWB chip calculates the location of the shareable device based on the distance between the electronic device and the shareable device by using a spherical intersection method. The time-of-flight ranging method specifically includes multiplying the time period between the first timestamp and the second timestamp by the propagation velocity of the measurement pulse signal in the air to obtain the distance of one round trip of the pulse signal, and then dividing the distance by 2 to obtain the distance between the electronic device and the shareable device. The propagation velocity of the measurement pulse signal in the air is a fixed value, i.e., v=300,000 km / s.

[0378] If the positioning driver 513 includes a Bluetooth driver, the Bluetooth driver includes a Bluetooth chip. The positioning process of the Bluetooth driver is the same as that of the UWB driver. The details will not be described again here.

[0379] The process of determining the location of the shareable device to which the head of the electronic device is pointing is described below.

[0380] A gyro sensor may be disposed in the electronic device, and the gyro sensor may detect the orientation of the head of the electronic device. The positioning driver 513 includes a positioning chip, which may be a UWB chip or a Bluetooth chip. As described above, the positioning chip may calculate the distance between the electronic device and the shareable device and the location of the shareable device. For example, Vision is located at 12 o'clock from the electronic device and 3 m away from the electronic device. The gyro sensor may transmit the detected orientation of the head of the electronic device to the positioning chip. The positioning chip locates the shareable device toward which the head of the electronic device is facing based on the orientation of the head of the electronic device, the distance between the electronic device and the shareable device, and the location of the shareable device. Figure 22b is a schematic diagram of an interface for locating the shareable device toward which the head of the electronic device is facing, based on an embodiment of this application. As shown in Figure 22b, the positioning driver of the electronic device locates two shareable devices located around the electronic device. The two shareable devices are Vision and MateBook, respectively. The Vision is located at the position pointed by the head of the electronic device, and the MateBook is located to the left of the electronic device. The sharing interface displays only the icon of the shareable device toward which the head of the electronic device is pointing. That is, the interface displays only the icon of the Vision, but not the icon of the MateBook. The border of the Vision icon is represented by a solid line, indicating that the sharing interface displays the Vision icon. The border of the MateBook icon is represented by a dashed line, indicating that the sharing interface does not display the MateBook icon. In the interface, the picture and the Vision icon are surrounded by a border of a specific shape, and a display graphic is set between the picture and the Vision icon to indicate the direction of movement of the user's next action. For example, the border of the specific shape is a closed dashed line of an ellipse, and the display graphic is an arrow. It should be noted that the borders of the icons of the shareable devices that are not displayed may alternatively have another representation form.This is not limited to this embodiment of this application.

[0381] In this embodiment of the present application, the electronic device may not only transmit the target file to the target device in the direction of the pointing, but may also display the task being performed by the target device (e.g., the first information described below) on the electronic device, and may further control the target device in a user interface of the electronic device, such as powering off, powering on, pausing, or starting.

[0382] Referring to the accompanying drawings, the following illustrates an example of a specific process in which an electronic device obtains first information or control commands for a target device in the direction of a first directional movement of a user.

[0383] 23a to 23l show an example of a process in which the mobile phone 111 obtains the first information or control command of the television 113. FIG.

[0384] FIG. 23a shows a multi-device scenario 100A. For the multi-device scenario 100A, see the above description of FIG. 1a. The details will not be described again here. In the multi-device scenario 100A, the user may perform a second directional action on the mobile phone. When the user performs the second directional action on the mobile phone 111, the mobile phone 111 may display a home screen.

[0385] In this embodiment of the application, the fifth motion may include a second directional motion.

[0386] Figure 23b shows a user interface 200 of the mobile phone 111. The user interface 200 is the home screen of the mobile phone 111. For details of the user interface 200, see the above description of Figure 2a. The details will not be described again here.

[0387] Optionally, when the user performs a second directional motion on mobile phone 111, mobile phone 111 may display another user interface, such as a video playback interface or a lock screen interface, without being limited thereto herein.

[0388] The second directional action performed by the user with respect to the mobile phone 111 may be the user pointing the top of the mobile phone 113 toward the television 113 and moving the mobile phone in a direction away from the television 113 as shown in FIG. 23a. In the moving process, the top of the mobile phone 111 may always point toward the television 113. The mobile phone 111 may detect the user's action by using an acceleration sensor and an angular velocity sensor. For example, when the acceleration detected by the acceleration sensor is equal to or greater than a third threshold and the angular velocity detected by the gyro sensor is equal to a fourth threshold, the mobile phone 111 may determine that the user is performing the second directional action with respect to the mobile phone 111. The third threshold and the fourth threshold may be set by the system.

[0389] Optionally, the mobile phone 111 may detect a second directional motion of the user by using an acceleration sensor and a touch sensor. For example, when the acceleration detected by the acceleration sensor is equal to or greater than a third threshold and the touch sensor does not detect a touch motion of the user within a third duration, the mobile phone 111 determines that the user is performing a second directional motion with respect to the mobile phone 111. The third duration may be set by the system. The mobile phone 111 may determine a target device based on the second directional motion and determine that the user expects the mobile phone 111 to obtain first information or control commands for the target device.

[0390] Optionally, the second directional action may be a combination of two user actions. For example, as shown in FIG. 23c, the user may first move the mobile phone 111 in a direction closer to the television, and then move the mobile phone 111 in a direction away from the television 113. In this manner, the mobile phone 111 may first determine the target device based on the user's action of moving the mobile phone 111 in a direction closer to the television. Then, the mobile phone 111 may determine that the user expects the mobile phone 111 to obtain first information or control commands for the target device based on the user's action of moving the mobile phone 111 in a direction away from the television 113.

[0391] Optionally, the second directional action may be the user moving the electronic device away from the target device when the top of the electronic device is pointing at the target device. As shown in Figure 23d, the top of mobile phone 111 is pointing at television 113 and the user moves mobile phone 111 away from television 113.

[0392] Optionally, the second direction action may alternatively be the user moving their hand in the air over the display of the mobile phone 111 in the second direction when placing the top of the mobile phone 111 in a direction closer to the target device (e.g., television 113). For example, as shown in FIG. 23e, the user places the top of the mobile phone 111 in a direction closer to the target device and slides their hand in the air over the mobile phone 111 from the top to the bottom of the mobile phone. The mobile phone 111 may detect the orientation of the top of the mobile phone 111 by using an acceleration sensor and a gyro sensor. The mobile phone 111 may detect that the user is sliding their hand in the air over the display of the mobile phone 111 from the top to the bottom of the mobile phone 111 by using a camera.

[0393] Optionally, the second directional action may be a combination of two user actions. For example, the user first moves the mobile phone 111 closer to the television. Then, the user's hand slides in a second direction across the display of the mobile phone 111.

[0394] Optionally, the second direction action may be the user's hand sliding in a second direction on the display of the mobile phone 111 when the user places the top of the mobile phone 111 in a direction close to the target device (e.g., television 113). For example, as shown in FIG. 23f, the user places the mobile phone 111 in a direction close to the target device, and the user's hand slides from top to bottom on the display of the mobile phone 111. The mobile phone 111 may detect the orientation of the top of the mobile phone 111 by using an acceleration sensor and a gyro sensor. The mobile phone 111 may detect that the user's hand is sliding from top to bottom on the display of the mobile phone 111 by using a touch sensor.

[0395] Optionally, the second directional action may be the user first moving the mobile phone 111 in a direction closer to the television and then sliding in a second direction on the display of the mobile phone 111 .

[0396] When the mobile phone 111 detects the user's second directional motion, the mobile phone 111 may obtain location information (e.g., three-dimensional position coordinates) of another electronic device (e.g., the television 113, the soy milk maker 114, the speaker 112, or the treadmill 115) in the multi-device scenario 100A and determine the electronic device in the direction of the directional motion. For details in this specification, please refer to the above description of how the mobile phone 111 obtains location information of another device. The details will not be described again here.

[0397] When mobile phone 111 detects the user's second directional motion, mobile phone 111 may determine that the target device is television 113. In this case, mobile phone 111 may display an icon for television 113 in a user interface, such as user interface 60C shown in FIG. 4e. Alternatively, mobile phone 111 may directly send a request to television 113 to obtain the first information or control command for television 113 without displaying a television icon in the user interface.

[0398] When the television 113 receives the request sent by the mobile phone 111, the user interface of the television 113 may be shown in FIG. 23g. FIG. 23g shows a user interface 1300 of the television 113. The user interface 1300 may include controls 1301 through 1309. A user may tap control 1301 to view account login information for the television 113. A user may tap control 1302 to search for content related to text entered by the user. A user may tap control 1303 to return to the home page of the television 113. A user may tap control 1304 to view a geographic search program. A user may tap control 1305 to view the television program "XXX." A user may tap control 1307 to view a history of television programs played on the television 113. A user may tap control 1308 to view signal sources for the television 113. The user may tap control 1309 to view the menu of the television 113. The television 113 may send control commands to the mobile phone 111. The control commands are used by the mobile phone 111 to control the television 113.

[0399] The mobile phone 113 may receive the control command sent by the television 113. As shown in FIG. 23h, the mobile phone 111 may display a user interface 1400 after receiving the control command. The user interface 1400 may include controls 1401 through 1410. After the user taps control 1401, the television 113 may display a settings interface. The user may tap control 1402 to turn the television 113 off or on. The user may tap control 1403 to select a program on the television 113 for playback. The user may tap control 1404 to switch to the next or previous channel on the television 113. The user may tap control 1405 to increase or decrease the volume of the television 113. The user may tap control 1407 to scroll up the program list in the television 113. The user may tap control 1410 to scroll down the program listings in the television 113. The user may tap control 1408 to rewind a program being played on the television 113. The user may tap control 1409 to fast forward a program being played on the television 113. The user may tap control 1406 to return to the previous level of the interface on the mobile phone 111.

[0400] Optionally, if the login accounts of the mobile phone 111 and the television 113 are different and the mobile phone 111 does not obtain permission from the television 113, the mobile phone 111 cannot obtain the first information or control command from the television 113. Alternatively, if the television 113 is busy (e.g., if another user is controlling the television 113 or if the television 113 is exchanging data with another electronic device), the mobile phone 111 cannot obtain the first information or control command from the television 113. As shown in FIG. 23i, the mobile phone 111 displays a prompt box 206 in the user interface 200. The prompt box 206 is used to prompt the user that the television 113 is not responding. Optionally, the prompt box 206 may further include a control 207 and a control 208. The user may tap the control 207 to send a request to the television 113 again. The request is used to request the television 113 to send the first information and control command. The user may tap control 208 to cancel the task that is in the mobile phone 111 and that requires obtaining the first information and control instructions for the television 113 .

[0401] Optionally, when the television 113 receives the request sent by the mobile phone 111, a user interface of the television 113 may be shown in FIG. 23j. The television 113 may display a user interface 900. The user interface 900 displays the video being played. The user interface 900 may include text 901. The text 901 is used to display information about the played video, such as the video name. In response to the request from the mobile phone 111, the television 113 may transmit first information of the television 113 to the mobile phone 111, or transmit the first information and a control command.

[0402] The mobile phone 111 may receive the first information and control command transmitted by the television 113. As shown in FIG. 23k, the mobile phone 111 may display a user interface 1500 after receiving the first information and control command transmitted by the television 113. The user interface 1500 may include a control 1501, text information 1502, a control 1503, a control 1504, a control 1505, a control 1506, a control 1507, and a control 1508. The user may tap control 1501, and the mobile phone 111 may play the video currently playing on the television 113 in response to the user action. The text information 1502 is used to display information about the video currently playing on the television 113, such as the video name, the number of plays (e.g., "played X times"), the video type (e.g., documentary), the website, and the cast list. The user may tap control 1503 to control the television 113 to play the previous episode of the video. The user may tap control 1504 to control rewinding of the video played on the television 113. The user may tap control 1505 to control pausing or playing of the video played on the television. The user may tap control 1506 to control fast forwarding of the video played on the television 113. The user may tap control 1507 to control the television 113 to play the next episode of the video. The user may tap control 1508 to return to the previous level interface of the mobile phone 111.

[0403] Optionally, as shown in FIG. 23l, mobile phone 111 may display user interface 1600 after receiving the first information and control command transmitted by television 113. User interface 1600 may include text information 1601 and control 1602. Text information 1601 is used to display information about the video currently playing on television 113, such as the video name, the number of plays (e.g., "played X times"), the video type (e.g., documentary), the website, and the cast list. The user may tap control 1602 to return to the previous level interface of mobile phone 111.

[0404] In this way, the user may obtain first information and control commands for the television 113 on the mobile phone 111 by performing a simple action. Thus, the user may view information about the video currently being played on the television 113 on the mobile phone 111, and may control the television 113 based on a directional action. In this way, the user action is simple, and the user experience may be improved.

[0405] In a possible example, the mobile phone 111 may further acquire first information and a control command for the speaker 112 based on the directional motion. For a specific operation process in which the mobile phone 111 acquires the first information and a control command for the speaker 112 based on the directional motion, please refer to the description of FIGS. 23a to 23e. The details will not be described again here. As shown in FIG. 24a, after the mobile phone 111 receives the first information and a control command for the speaker 112, the mobile phone 111 may display a user interface 4000. The user interface 4000 may include text 4001, a song progression bar 4002, and controls 4003 to 4010. The text 4001 may be information about the song being played by the speaker 112 (e.g., the song title and the singer). The user may adjust the playback progress of the song on the speaker 112 by using the song progression bar 4002. The user may tap the control 4003 to adjust the playback volume of the song on the speaker 112. The user may tap control 4004 to allow the mobile phone 111 to make a Bluetooth connection to the speaker 112. The user may tap control 4005 to allow the speaker 112 to play the previous song. The user may tap control 4006 to control the speaker 112 to pause or start playing a song. The user may tap control 4007 to allow the speaker 112 to play the next song. The user may tap control 4008 to view the music playlist on the speaker 112. The user may tap control 4009, and after the user taps control 4009, the mobile phone 111 may play the song currently playing on the speaker 112.

[0406] Optionally, if the mobile phone 111 does not have permission to control the speaker 112, the mobile phone may only obtain the first information of the speaker 112. As shown in FIG. 24b, after the mobile phone 111 receives the first information of the speaker 112, the mobile phone 111 may display a user interface 4100. The user interface 4100 may display information such as the name, singer, and lyrics of the song currently being played on the speaker 112.

[0407] In a possible example, the mobile phone 111 may further acquire first information and control commands for the soy milk maker 114 based on the directional movement. For a specific operation process in which the mobile phone 111 acquires the first information and control commands for the soy milk maker 114 based on the directional movement, please refer to the description of Figures 23a to 23e. The details will not be described again here. As shown in Figure 25a, after the mobile phone 111 receives the first information and control commands for the soy milk maker 114, the mobile phone 111 may display a user interface 4200. The user interface 4200 may include controls 4201 to 4207. A user may tap control 4201 to view detailed cooking instructions for the food being cooked in the soy milk maker 114. Control 4202 is used to display the current status of the soy milk maker 114 (e.g., idle or busy). Control 4203 is used to display the remaining time for the soy milk maker 114 to complete food cooking (e.g., "00:03:10"). The user may tap control 4204 to pause the soy milk maker 114. The user may tap control 4205 to start the soy milk maker 114. The user may tap control 4206 to cancel the current task in the soy milk maker 114. The user may tap control 4207 to return to the previous level interface of the mobile phone 111.

[0408] Optionally, if the mobile phone 111 does not have permission to control the soy milk maker 114, the mobile phone may only obtain the first information of the soy milk maker 114. As shown in FIG. 25b, after the mobile phone 111 receives the first information of the soy milk maker 114, the mobile phone 111 may display a user interface 4300. The user interface 4300 may include controls 4301 to 4304. A user may tap control 4301 to view detailed cooking instructions for the food being cooked in the soy milk maker 114. Control 4302 is used to display the current status of the soy milk maker 114 (e.g., idle or busy). Control 4303 is used to display the remaining time for the soy milk maker 114 to complete food cooking (e.g., "00:03:10"). A user may tap control 4304 to return to the previous level interface of the mobile phone 111.

[0409] In a possible example, the mobile phone 111 may further acquire first information and control commands for the treadmill 115 based on the directional movement. For a specific operational process in which the mobile phone 111 acquires the first information and control commands for the treadmill 115 based on the directional movement, see the description of FIGS. 23a to 23e. Details will not be described again here. As shown in FIG. 26a, after the mobile phone 111 receives the first information and control commands for the treadmill 115, the mobile phone 111 may display a user interface 4400. The user interface 4400 may include controls 4402 to 4409. The user may tap control 4401 to view details of the ongoing course on the treadmill 115. Control 4402 is used to display the current status of the treadmill 115 (e.g., idle or busy). Control 4403 is used to display the remaining time for the treadmill 115 to complete the ongoing exercise (e.g., "00:03:10"). A user may tap control 4404 to adjust the speed of the treadmill 115. A user may tap control 4405 to adjust the incline of the treadmill. A user may tap control 4406 to pause the treadmill 115. A user may tap control 4407 to start the treadmill 115. A user may tap control 4408 to cancel an exercise task on the treadmill 115.

[0410] Optionally, if the mobile phone 111 does not have permission to control the treadmill 115, the mobile phone may only obtain the first information of the treadmill 115. As shown in FIG. 26b, after the mobile phone 111 receives the first information of the treadmill 115, the mobile phone 111 may display a user interface 4500. The user interface 4500 may include a control 4501. The control 4501 is used to display the current status of the treadmill 115 (e.g., idle or busy).

[0411] Furthermore, the mobile phone 111 may obtain first information and control commands for electronic devices such as the tablet computer 116 and the computer 117 based on the second directional movement. For details, see the description of the mobile phone 111 obtaining first information and control commands for the television 113 based on the second directional movement. The details will not be described again here.

[0412] In some embodiments, more and more users choose to integrate smart home devices, such as security protection, lighting, health, kitchen appliances, home improvement, and cleaning, to build efficient smart home systems for residential facilities and family schedules by using intelligent technology to improve home security, convenience, comfort, and the like. In a smart home system, a portable device (such as a smartphone) is typically used to implement management and control of various smart home devices. For example, a smart home application may be installed on the smartphone, and the application includes virtual "cards" that correspond to multiple smart home devices and are added by the user. The user can manage and control different smart home devices through different virtual "cards." However, with the increasing number of smart home devices, when a user needs to control, for example, smart home device A, the user needs to enter the control interface of smart home device A by using the virtual "card" and control smart home device A by performing an action in the control interface. For example, the user taps a virtual power button to control smart home device A to be turned on or off. When a user needs to control multiple smart home devices, the user needs to perform the corresponding control operations one by one in the control interfaces corresponding to the multiple virtual "cards." The above process of controlling smart home devices is complicated and time-consuming, thus resulting in a poor user experience.

[0413]

[0013] The present invention provides a method for controlling a smart home device, which simplifies the process of controlling the smart home device and improves the user experience.

[0014] Hereinafter, with reference to the accompanying drawings in the embodiments of the present invention, a detailed description will be given of an implementation process for controlling a target device (hereinafter, also referred to as a smart home device) by using an electronic device (hereinafter, also referred to as a portable device) provided in the embodiments of the present invention.

[0414] One embodiment of this application provides a smart home device control method, which is applied to a process of controlling smart home devices by using a portable device in a smart home system, which includes, but is not limited to, one or more portable devices, one or more routers, and one or more smart home devices.

[0415] Smart home devices are various home devices that can be controlled using wireless communication technology in a smart home system, such as home devices used for security protection, lighting, environment, health, kitchen appliances, entertainment, home improvement, or cleaning. For example, FIG. 27 is a schematic diagram of the structure of a smart home system according to one embodiment of this application. As shown in FIG. 27 , smart home devices in the smart home system may include devices such as alarm devices and smart locks used for security protection, devices such as smart desk lamps and smart light bulbs used for lighting, devices such as fresh air systems, air purifiers, and air quality sensors used for health, devices such as dishwashers and sterilizing cabinets used for kitchen appliances, devices such as televisions and speakers used for entertainment, devices such as electric curtains and smart doors used for home improvement, or devices such as vacuum cleaner robots used for cleaning.

[0416] The router in the smart home system shown in Figure 27 may also be called a smart host or home gateway. A router is a hardware device that connects two or more networks and acts as a gateway between them. The router is a dedicated intelligent network device that reads the address in each data packet and determines how to transmit the data packet. In a smart home system, the router is wirelessly connected to the host, allowing users to conveniently manage and control different smart home devices by using portable devices. Typically, the router may provide a wireless fidelity (Wi-Fi) hotspot, and smart home devices and portable devices may access the Wi-Fi network by accessing the Wi-Fi hotspot provided by the router.

[0417] In this application, the portable device is configured to assist a user in selecting and controlling devices such as smart home devices and routers in a smart home system. For example, the portable device may be a smartphone.

[0418] Note that Figure 27 in this application is merely used as an example of a smart home system, and the specific structure of the smart home system is not limited in this application. For example, the smart home system may alternatively not include a router, and the portable device in the smart home system may directly control the smart home devices (e.g., directly control the smart home devices via Wi-Fi Direct). In another example, the smart home system may further include other devices, such as smart home devices with other functions.

[0419] Additionally, in addition to smartphones, the portable device in this application may be a netbook, tablet computer, smartwatch, smart band, phone watch, smart camera, palmtop computer, personal digital assistant (PDA), portable multimedia player (PMP), augmented reality (AR) device, virtual reality (VR) device, etc. Alternatively, the portable device may be another type or structure of electronic device, which is not limited in this application.

[0420] As a smart home device control method, FIGS. 28A, 28B, and 28C are schematic diagrams of an operation process in which a portable device controls smart home devices. As shown in FIG. 28B, when a user intends to control a smart home device, the smartphone displays a smart home application interface 2802 in response to the operation of opening a smart home application on the smartphone (operation 2801 shown in FIG. 28A). Virtual "cards" corresponding to all smart home devices and added by the user are displayed in the smart home application interface 2802. For example, virtual "cards" correspond to the smart desk lamp, air conditioner, speaker, vacuum cleaner, air purifier, dishwasher, and electric curtain shown in FIG. 28. In this case, assuming that the user needs to control the air conditioner, speaker, and vacuum cleaner, the user needs to tap the virtual "cards" corresponding to the air conditioner, speaker, and vacuum cleaner one by one to enter the corresponding control interface to perform the operation. For example, in response to a user's action of opening an air conditioner control interface (operation 2803 of the user tapping the virtual "card" corresponding to the air conditioner shown in FIG. 28B), the smartphone displays air conditioner control interface 2804, as shown in FIG. 28C. Air conditioner control interface 2804 includes a power button, a temperature increase button ("+"), a temperature decrease button ("-"), etc. The smartphone may control the air conditioner in response to an action taken by the user on air conditioner control interface 2804. For example, in response to operation 2805 of the user tapping the power button on air conditioner control interface 2804, the smartphone controls the air conditioner to turn on. Then, in response to operation 2806 of the user tapping the temperature increase button (+) on air conditioner control interface 2804, the smartphone controls the air conditioner to increase the cooling temperature.

[0421] When multiple smart home devices operate in a control interface, the smart home devices need to be operated one by one, i.e., enter the control interface of the first smart home device → operate the first smart home device → return → enter the control interface of the second smart home device → operate the second smart home device → return →... The above process of controlling smart home devices is complicated and time-consuming, thus resulting in a poor user experience.

[0422] To solve the above-mentioned problems, an embodiment of the present application provides a smart home device control method. The method may provide a solution for directly controlling a smart home device based on a button on a portable device. The basic principle of the method is that when a user's action intention is determined, i.e., when a smart home device expected to be controlled by the user is determined, the control target of the button on the portable device is switched to the smart home device, and the smart home device is directly controlled based on the operation on the button on the portable device.

[0423] In some embodiments, the buttons of the portable device may include physical buttons, such as a power button, a volume up button ("+"), a volume down button ("-"), or a fingerprint button. In this application, an action on a physical button of a portable device may include, but is not limited to, an action on a single physical button and multiple actions on multiple physical buttons. An action on a single physical button is, for example, pressing the power button. A multiple action on multiple physical buttons is, for example, pressing the power button and the volume up button ("+") simultaneously. The specific form of the action is not limited in this application and is specifically determined based on the function settings of the physical buttons. For example, when a smartphone determines that a user expects to control a desk lamp, the smartphone may control the desk lamp to be turned on or off by using the smartphone's power button, control the desk lamp to be brighter by using the smartphone's volume up button ("+"), and control the desk lamp to be brighter by using the smartphone's volume down button ("-"). For example, a smartphone, when it determines that the user expects to control a speaker, may control the speaker to be turned on or off by using the smartphone's power button, control the speaker to be turned up by using the smartphone's volume up button ("+"), and control the speaker to be turned down by using the smartphone's volume down button ("-").For example, when a smartphone determines that a user expects to control a television, it may control the television to be turned on or off by using the smartphone's power button, verify the user's identity to use the television service by using the smartphone's fingerprint button, control the television to turn up the volume by using the smartphone's volume up button ("+"), and control the television to turn down the volume by using the smartphone's volume down button ("-").

[0424] FIG. 29 illustrates control parameters corresponding to physical buttons on a portable device, using the power button, volume up button (+), and volume down button (-) of the portable device as examples. As shown in FIG. 29, the power button on the portable device may correspond to "on" or "off" of any smart home device. The volume up button ("+") on the portable device may correspond to increasing the wind speed, increasing the volume, increasing the brightness, increasing the temperature, increasing the rotation speed, increasing the intensity, raising, opening, etc. The volume down button ("-") on the portable device may correspond to decreasing the wind speed, decreasing the volume, decreasing the brightness, decreasing the temperature, decreasing the rotation speed, decreasing the intensity, lowering, closing, etc. The specific control parameters corresponding to the volume buttons on the portable device are determined based on the functionality of the smart home device. For example, when the smart home device is a fan or an air conditioner, the volume button on the portable device may correspond to the air speed or rotation speed of the fan or air conditioner; when the smart home device is a television or a speaker, the volume button on the portable device may correspond to the volume of the television or speaker; when the smart home device is a desk lamp, the volume button on the portable device may correspond to the brightness or intensity of the desk lamp; when the smart home device is an air conditioner, the volume button on the portable device may correspond to the temperature of the air conditioner; when the smart home device is a fan, the volume button on the portable device may correspond to the rotation speed of the fan; when the smart home device is a clothes hanger, the volume button on the portable device may correspond to raising / lowering the desk lamp; or when the smart home device is a smart lock, the volume button on the portable device may correspond to opening / closing the smart lock.

[0425] Please note that Figure 29 in this application is used only as an example of the correspondence between the physical buttons of the portable device and the control parameters. The control parameters that the physical buttons of the portable device may correspond to are not limited to the control parameters shown in Figure 29. For more information, see Smart Home Device Features and Adjustable Parameters.

[0426] Additionally, the specific form of the buttons on the portable device is not limited in this application. In some other embodiments, the buttons on the portable device may include virtual buttons. For example, the buttons on the portable device may be virtual buttons in an application interface and installed on the portable device for remote control. Alternatively, the buttons on the portable device may be virtual actions in another user interface (UI) of the portable device. This is not limited in this application.

[0427] In some other embodiments, the portable device may determine a smart home device (i.e., a smart home device pointed to by the portable device) that is expected to be controlled by the user (e.g., a first smart home device) when it detects that the portable device's movement track matches a preset movement track and / or that the portable device has moved to a preset spatial pose.

[0428] For example, the preset movement track may include, but is not limited to, a track away from the user's body. In some embodiments, the preset movement track may be a movement of the mobile phone from position A to position B, and may be a track shown in FIG. 30(a) or FIG. 30(b). The movement to the preset spatial orientation may include, but is not limited to, a movement to a spatial orientation at an included angle of 90° (or close to an included angle of 90°) with respect to the horizontal plane, or a movement to a spatial orientation at an included angle α (0≦α<90°) with respect to the horizontal plane. In some embodiments, the movement to the preset spatial orientation is the movement of the mobile phone from position A to position B to a spatial orientation at an included angle of 90° and shown in FIG. 31(a). In some embodiments, the movement to the preset spatial orientation is the movement of the mobile phone from position A to position B to a spatial orientation at an included angle α and shown in FIG. 31(b).

number

[0429] It should be noted that the preset movement tracks shown in Figures 30(a) and 30(b) of this application are used only as examples. The specific track thresholds, decision criteria, etc. of the preset movement tracks are not limited in this application. Additionally, the spatial orientation of the mobile phone at position B shown in Figures 31(a) and 31(b) are used only as two examples. The specific settings, decision criteria, etc. of the preset spatial orientation are not limited in this application.

[0430] In a possible embodiment of this application, the portable device may determine the movement track and / or spatial orientation of the portable device based on motion data of the portable device and collected by a sensor driver.

[0431] For example, the portable device may collect the moving direction and moving speed of the portable device in real time by using an acceleration sensor, plot the moving track of the portable device, and further determine whether the moving track of the portable device meets the preset moving track.

[0432] In another example, the portable device may determine the spatial orientation of the portable device by using a nine-axis fusion algorithm based on motion data collected in real time by the gyro sensor, acceleration sensor, and magnetic sensor of the portable device, and further determine whether the spatial orientation of the portable device satisfies a preset spatial orientation. In this application, the spatial orientation of the portable device may be represented by Euler angles of the preset coordinate system of the portable device relative to the ground coordinate system. The Euler angles include a pitch angle θ, a yaw angle Φ, and a roll angle φ.

[0433] A smartphone is used as an example. See Figure 32(a) for the preset coordinate system of the portable device. As shown in Figure 32(a), A x, with coordinate origin A axis, y A axis and z A The axes form a right-handed rectangular coordinate system. A The smartphone may have four sides: a long side 01, a short side 02, another long side parallel to the long side 01 and having the same length, and another short side parallel to the short side 02 and having the same length. A The axis is parallel to the short side 02 of the smartphone. x A The axis is parallel to the long side of the smartphone and points upward. A The axis is y A perpendicular to the x axis A It is perpendicular to the axis.

[0434] The ground coordinate system may be shown in Figure 32b. As shown in Figure 32b(a) and Figure 32b(b), the X-axis, Y-axis, and Z-axis with O as the coordinate origin form a right-handed rectangular coordinate system. The coordinate origin O shown in Figure 32b(a) and Figure 32b(b) may be any point in space. The X-axis points in any direction within a horizontal plane. The Z-axis is perpendicular to the plane in which the X-axis lies and points to the center of the Earth. The Y-axis is perpendicular to the X-axis and perpendicular to the Z-axis.

[0435] Based on the preset coordinate system of the portable device shown in FIG. 32a and the ground coordinate system shown in FIG. 32b, the pitch angle θ of the preset coordinate system of the portable device relative to the ground coordinate system may be the included angle between the x-axis of the preset coordinate system of the portable device and the plane (i.e., horizontal plane) on which the XOY of the ground coordinate system is located. The pitch angle θ of the preset coordinate system of the smartwatch relative to the ground coordinate system may be the x-axis of the preset coordinate system of the portable device and the plane (i.e., horizontal plane) on which the XOY of the ground coordinate system is located. A The yaw angle Φ of the preset coordinate system of the portable device relative to the ground coordinate system is the horizontal included angle between the x-axis of the preset coordinate system of the portable device and the X-axis of the ground coordinate system, i.e., Ox A '(i.e., O A x A The roll angle φ of the preset coordinate system of the portable device relative to the ground coordinate system is the included angle between the z axis of the preset coordinate system of the portable device. A axis and x A A vertical plane passing through the axis (i.e., x A The included angle between the plane in which OZ is located.

[0436] Note that in FIG. 32a, only a smartphone is used as an example to explain the preset coordinate system of the portable device. The preset coordinate system of the portable device may be further defined according to another rule. For example, the coordinate origin may alternatively be any other point on the portable device or any point outside the portable device. The directions of the three axes of the preset coordinate system are the xA axis, yB axis, and yC axis shown in FIG. 32a. A axis and z A The settings of the coordinate origin position and coordinate axis directions of the preset coordinate system of the portable device are not limited in this embodiment of the present application.

[0437] In some examples, if the portable device detects that the portable device matches a preset movement track and / or that the portable device has moved to a preset spatial orientation, the portable device may specifically determine the smart home device that is expected to be controlled by the user (i.e., the smart home device that the portable device is pointing to) (e.g., the first smart home device) in steps 1 and 2.

[0438] Step 1: The portable device detects and identifies surrounding smart home devices.

[0439] For example, a portable device may trigger a UWB driver or a Bluetooth driver to detect and identify surrounding smart home devices.

[0440] It should be understood that after accessing a network (e.g., Wi-Fi), the smart home device and the portable device may obtain their access information. For example, the access information may include a network access method, a communication address (e.g., an IP address), a received signal strength indication (RSSI) parameter, etc. As shown in FIG. 33, since signal strength gradually attenuates with propagation distance, a UWB or Bluetooth sensor may receive signals transmitted by multiple transmitting devices (e.g., smart home devices) via multiple antennas. The transmission time difference between different received signals is calculated based on the strength of the different received signals to calculate the azimuth angles and distances of the different transmitting devices (e.g., smart home devices) relative to the receiving device (e.g., portable device), allowing the portable device to identify the smart home device.

[0441] Assume that the first smart home device is a television. As shown in FIG. 34 , when the television is in an off state, the first action is operation 1201 (shown by mark A in FIG. 34 ) of pressing the power button on the smartphone while holding the smartphone and pointing the smartphone toward the television. In this case, as shown by mark B in FIG. 34 , the television is turned on, and interface 1202 is displayed. In some embodiments, if the user presses the fingerprint button on the smartphone in accordance with the fingerprint verification indication in interface 1202 on the television display (operation 1203 shown by mark C in FIG. 34 ), the fingerprint verification on the television is successful, and television program interface 1204 is displayed, as shown by mark D in FIG. 34 . In some other embodiments, if the user presses the volume up button on the smartphone (operation 1205 shown by mark E in FIG. 34 ) in the process of watching a television program, the television displays volume up interface 1206, and the volume of the television is increased, as shown by mark F in FIG. 34 . In some other embodiments, assuming the user presses the power button on the smartphone (action 1207 shown at mark G in FIG. 34), the television is turned off, as shown at mark H in FIG.

[0442] For example, assume that the first smart home device is an air conditioner and the portable device is a smartphone. The voice command on the smartphone may be implemented by long-pressing the volume down button ("-"). As shown in FIG. 35, in response to the voice command "Adjust to 26°C and shut down after 2 hours" transmitted when the user long-presses the volume down button ("-") on the smartphone, the air conditioner adjusts the temperature to 26°C and shuts down after two hours of operation.

[0443] The specific process by which an electronic device controls a target device provided in this embodiment of the present application is not limited to the implementation process shown in FIGS. 27 to 35. A user may implement the electronic device to control a target device (hereinafter also referred to as an intelligent device) based on the operation process shown in FIGS. 36(a) to 36(d) to 53(a) and 53(b). Typically, a user may control multiple intelligent devices by using an electronic device. However, when a user controls multiple intelligent devices by using an electronic device, the user may need to open a dedicated application and tap the corresponding intelligent device in the application to implement control over the intelligent device. As a result, the entire operation process becomes complicated and the user experience becomes poor.

[0444] 36(a) to 36(d) to 53(a) and 53(b) illustrate intelligent device control processes that may be simplified in embodiments of the present application to simplify the process of an electronic device controlling an intelligent device and improve the user experience, as detailed below.

[0445] 36(a)-36(d) are schematic diagrams of a group of GUIs according to one embodiment of this application. 36(b)-36(d) illustrate a process in which a mobile phone interacts with another intelligent device in the home screen state. The intelligent device may be a smart television, a speaker, an air conditioner, a tablet computer, etc. In this embodiment of this application, the intelligent device in the current pointing direction of the mobile phone's head is a smart television.

[0446] See Figure 36(a). The GUI is a display interface 3610 of a smart television. The display interface 3610 may include a preview interface 3614 and functional options such as interface options 3611, video options 3612, and audio options 3613. A user may connect the smart television to a set-top box via interface option 3611, which may be, for example, a high-definition multimedia interface (HDMI). A user may search for videos by using video option 3612, search for music by using audio option 3613, and so on.

[0447] See Figure 36(b). The GUI is a mobile phone home screen 3620. After detecting a user's single finger sliding downward at any position on the home screen 3620, the mobile phone may display the GUI shown in Figure 36(c).

[0448] See Figure 36(c). The GUI is a search interface 3630 of a mobile phone. The search interface 3630 may display some applications (applications, apps) commonly used by users, real-time hotspots, history searches, etc. When the mobile phone detects that the user's finger continues to slide downward, if the sliding distance is greater than a preset value, the mobile phone may display the GUI shown in Figure 36(d).

[0449] 36(d), the interface 3640 may include a display interface card 3641 used to display the smart television in the direction of the mobile phone's pointing. The display interface card 3641 is the interface 3610 currently displayed on the smart television, i.e., the display interface card 3641 may be embedded in the search interface 3630.

[0450] For example, the display interface card 3641 may be in an upper position in the search interface 3630, e.g., above the application suggestions. Above the display interface card 3641, further text may be displayed, such as "My Vision."

[0451] For example, the mobile phone and the smart television may each include a Bluetooth component or an ultra-wideband (UWB) component. In this case, the mobile phone may determine the orientation and distance between the mobile phone and the smart television by using the Bluetooth component or the UWB component. For example, when the mobile phone determines that the device pointed by the mobile phone's head is a smart television, in response to a user's sliding motion, the mobile phone displays an interface on the mobile phone's screen that is displayed on the smart television. Solutions in which the Bluetooth component or the UWB component determines the orientation and distance will be described below in connection with specific embodiments. Details will not be described here.

[0452] Optionally, the display interface card 3641 may further include some functional controls that can be used to control the television, such as turning the volume up or down or changing channels. The display interface card 3641 may further include a control used to close the display interface card 3641, etc.

[0453] Optionally, when the smart television is not turned on, the display interface card 3641 may be a control interface for controlling the television to be turned on / off. A user may control the smart television to be turned on with a mobile phone and display the interface of the smart television.

[0454] It should be understood that in the processes of Figures 36(b) to 36(d), the user's finger must not leave the home screen, i.e., the user's finger slide in Figure 36(b) and the user's finger slide in Figure 36(c) are continuous. Alternatively, the user's finger may leave the home screen, i.e., the user's finger slide in Figure 36(b) and the user's finger slide in Figure 36(c) are discontinuous. Specifically, if the mobile phone detects that the user's single finger slides downward on the home screen 3620, the mobile phone displays a search interface 3630; if the mobile phone detects that the user's single finger slides downward on the search interface beyond a preset distance, the mobile phone draws the display interface of the intelligent device in the direction pointed by the mobile phone to the search interface.

[0455] Optionally, in the search interface 3630, the mobile phone may also display a display interface card 3641 of an intelligent device in the direction of the head of the mobile phone when detecting that the user vibrates the mobile phone, which is not limited to this embodiment of the present application.

[0456] In this embodiment of the application, when using an electronic device (e.g., a mobile phone) to control another intelligent device, the user may point the head of the electronic device toward the intelligent device and perform a slide-down gesture or a vibration gesture on the screen of the electronic device to display a display interface of the intelligent device on the screen of the electronic device, which helps the user reduce redundant operations of using the electronic device to control or interact with another intelligent device, making the interaction between the electronic device and another intelligent device easier and faster, and improving the user's experience.

[0457] 37(a)-37(d) are schematic diagrams of another group of GUIs according to an embodiment of the present application. 37(b)-37(d) show the process of a mobile phone interacting with a smart television in a lock screen interface state. In the embodiment of the present application, the intelligent device that the mobile phone's head is currently pointing at is the smart television.

[0458] For Figure 37(a), see the related explanation for Figure 36(a).

[0459] See Figure 37(b). The GUI is the mobile phone's lock screen interface 3720. Icons and prompt text used to prompt the user to unlock the screen may be displayed at the top of the lock screen interface 3720. The mobile phone may display the GUI shown in Figure 37(c) after detecting the user's single finger sliding downward on the lock screen interface 3720.

[0460] See Figure 37(c). GUI display interface 3730 may include a loading area 3731 used for user prompts. Loading area 3731 may be located at an upper position of the lock screen interface, such as the position originally used to display the unlock prompt. When the mobile phone detects that the user's finger continues to slide downward, if the sliding distance is greater than a preset value, the mobile phone may display the GUI shown in Figure 37(d).

[0461] For example, if the intelligent device currently pointed at by the head of the mobile phone is a smart television, the loading area 3731 may be used to display "television" to prompt the user. For example, if the intelligent device currently pointed at by the head of the mobile phone is a smart television, the loading area 3731 may display "speaker." In this way, it can be verified whether the device displayed in the loading area is the intelligent device currently pointed at by the mobile phone.

[0462] It should be understood that in the processes of Figures 37(b) and 37(c), the user's finger slide may be continuous or the user's finger slide may be paused, but the user's finger must remain on the mobile phone's home screen when the slide is paused.

[0463] See Figure 37(d). Lock screen interface 3740 may display a display interface card 3741 of the smart television where the head of the mobile phone is currently pointing. Display interface card 3741 is the smart television's display interface 3610. Icons, etc. used to prompt the user that the screen has been unlocked may also be displayed at the top of lock screen interface 3740.

[0464] The display interface card 3741 may be stacked on the lock screen interface, or the display interface card 3741 may be embedded within the lock screen interface. The display interface card 3741 may be displayed in a middle position on the mobile phone screen, a position above the middle position, a position below the middle position, etc. Alternatively, the user may freely drag the display interface card 3741 based on requirements.

[0465] Optionally, when the smart television is not turned on, the display interface card 3741 may be a control interface for controlling the television to be turned on / off. A user may control the smart television to be turned on and display the interface of the smart television on a mobile phone.

[0466] In this embodiment of the application, when using an electronic device (e.g., a mobile phone) to control another intelligent device, the user may point the head of the electronic device toward the intelligent device and perform a slide-down gesture on the screen of the electronic device to display a display interface card of the intelligent device on the screen of the electronic device, which helps the user reduce redundant operations of using the electronic device to control or interact with another intelligent device, making the interaction between the electronic device and another intelligent device easier and faster, and improving the user's experience.

[0467] Figures 38(a)-38(e) are schematic diagrams of another set of GUIs according to one embodiment of the present application. Figures 38(b)-38(d) show the process of a mobile phone interacting with an air conditioner. In this embodiment of the present application, the intelligent device currently pointed in the direction of the mobile phone's head is the air conditioner.

[0468] Referring to Figure 38(a), the air conditioner 3800 may be in an off state.

[0469] For Figures 38(b) and 38(c), please refer to the relevant explanations for Figures 36(b) and 36(c), and the details will not be repeated here.

[0470] See Figure 38(d). Display interface 3840 may display an air conditioner control card 3842. Control card 3842 may include a control 3841 used to prompt the user to turn on the air conditioner. After detecting a tap on control 3841 by the user, the mobile phone may display the GUI shown in Figure 38(e).

[0471] It should be understood that after the user taps on control 3841, the air conditioner changes from an off state to an on state.

[0472] For example, the control card 3842 is in a top position, e.g., above the app suggestions, in the search interface 3840. Above the control card 3842, further text may be displayed, such as "My Vision."

[0473] See FIG. 38(e). Display interface 3850 may include an air conditioner control card 3851. Control card 3851 may include an area used to display the brand of the air conditioner and function controls that may be used to control wind speed, wind direction, wind sweep, power 3852, increase or decrease the temperature, etc. A user may control the air conditioner by tapping the function controls. For example, control card 3842 is located in an upper position in search interface 3840, e.g., above the app suggestions. Text such as "My Vision" may also be displayed above control card 3842.

[0474] Optionally, the user may perform the same actions as described above in the lock screen interface, which is not limited in this embodiment of this application.

[0475] In this embodiment of the application, when the device pointed by the head of the mobile phone is an air conditioner, the user may slide his finger downward on the screen of the mobile phone to display the control interface of the air conditioner on the screen of the mobile phone. This technical solution allows the user to control the air conditioner easily and quickly, helping to improve the user experience.

[0476] Figures 39(a)-39(d) are schematic diagrams of another set of GUIs according to one embodiment of the present application, showing the process of a mobile phone interacting with a tablet computer.

[0477] FIG. 39( a ) shows an interface 3910 where playback is performed by a tablet computer 3900 .

[0478] For Figures 39(b) to 39(c), please refer to the related explanations for Figures 36(b) to 36(c).

[0479] In this embodiment of the application, when the device in the direction of the mobile phone's head is pointing is a tablet computer, the user may slide his finger downward on the screen of the mobile phone to display the current display interface of the tablet computer on the screen of the mobile phone. This technical solution allows the user to control the tablet computer easily and quickly, helping to improve the user experience.

[0480] Figures 40(a)-40(h) are schematic diagrams of another set of GUIs according to one embodiment of the present application, showing the process of a mobile phone interacting with a smart television.

[0481] See Figure 40(a). The smart television is in the off state.

[0482] For Figures 40(b) and 40(c), please refer to the relevant explanations for Figures 37(b) and 37(c), and the details will not be described again here.

[0483] See FIG. 40(d). The lock screen interface 4040d includes a smart television display interface card 4041d, which is a control card for the smart television, and the display interface card 4041d includes a control 4042d used to prompt the user to turn on the air conditioner. Text such as "My Vision" may also be displayed on the display interface card 4041d. An icon or the like used to prompt the user that the screen is unlocked may also be displayed at the top of the lock screen interface 4040d. After the mobile phone detects the user tapping on the control 4042d, the smart television may display the GUI shown in FIG. 40(e), and the mobile phone may display the GUI shown in FIG. 40(f) or FIG. 40(g).

[0484] Optionally, the display interface card 4041d may be embedded in the lock screen interface or stacked on the lock screen interface 4040d, and may be displayed in a middle position, above the middle position, below the middle position, etc. on the screen of the mobile phone.

[0485] See Figure 40(e). In response to the user tapping control 4042d, the smart television changes from an off state to an on state, and the GUI is the smart television's current display interface 4011e.

[0486] See FIG. 40(f). Lock screen interface 4050f includes smart television's current display interface card 4051f, which is smart television's current display interface 4011e. Text such as "My Vision" may be further displayed above display interface card 4051f. Icons, such as those used to prompt the user that the screen has been unlocked, may also be displayed at the top of lock screen interface 4050f.

[0487] In an optional embodiment, see FIG. 40(g). Lock screen interface 4060g includes a smart television display interface card 4061g and two related service content cards 4062g and 4063g. Related service content card 4062g may be a purchase link to a book related to the content currently being played on the smart television, and related service content card 4063g may be a brief introduction to a person or article related to the content currently being played on the smart television. Related service content cards 4062g and 4063g may be stacked sequentially below display interface card 4061g. After detecting a user tapping 4061g, 4062g, or 4063g, the mobile phone may display the GUI shown in FIG. 40(e).

[0488] It should be understood that in this embodiment of the present application, only the example of the lock screen interface displaying two related service content cards is used for illustration purposes, and the number of related service content cards is not limited in this embodiment of the present application.

[0489] See Figure 40(h). The mobile phone may display a display interface card 4071h and related service content cards 4072h and 4073h in a lock screen interface 4070h in a list format. The user may tap the related links to jump to other applications or web pages.

[0490] For example, after a user taps the related service content card 4072h, the mobile phone may jump to an interface for purchasing a book.

[0491] In this embodiment of the present application, when the device pointed by the mobile phone head is a smart television, the user slides his finger downward on the mobile phone screen to display the television display interface on the mobile phone screen, and the mobile phone screen may further display service content cards related to the content in the television display interface, so that multiple related links can be provided to the user. Thus, the user can perform related operations in the interface without having to open another app for searching, improving the user experience.

[0492] Figures 41(a)-41(g) are schematic diagrams of another set of GUIs according to one embodiment of the present application, showing the process of a mobile phone interacting with a smart television.

[0493] See Figure 41(a). The GUI is a display interface 4110 of a smart television.

[0494] For Figures 41(b) and 41(c), please refer to the associated description of Figures 36(b) and 36(c), and for the sake of brevity, the details will not be described again here.

[0495] See FIG. 41(d). The search interface 4130 may be divided into upper and lower sections. Area 4131 is used to display the smart television display interface card, and area 4132 is a partial display area of ​​the original search interface 4130. When the user's finger slides downward, area 4131 may display icon 4133, which is used to prompt the user that the smart television display interface card is loaded. The mobile phone may display the GUI shown in FIG. 41(e) when it detects that the user's finger slides beyond a preset distance.

[0496] See Figure 41(e). The display interface 4140 includes a smart television's current display interface card 4141, which is the smart television's current display interface 4110. The top of the display interface card 4141 may further include text such as "My Vision." The bottom of the display interface 4140 may further include a search box for a search interface. The mobile phone may display the GUI shown in Figure 41(f) after detecting a user's single finger sliding upward on the display interface 4140.

[0497] Optionally, display interface 4140 further includes a plurality of related service content cards (not shown), which may be displayed in a list format below display interface card 4141 or stacked sequentially below display interface card 4141.

[0498] In this embodiment of the application, sliding upward by a user on the display interface 4140 may be understood as sliding upward a particular distance.

[0499] See Figure 41(f). The interface is a mobile phone search interface 4130. The mobile phone may display the GUI shown in Figure 41(g) after detecting that the user's single finger slides downward a certain distance on the search interface 4130.

[0500] See Figure 41(g). The GUI is actually the interface shown in Figure 41(e).

[0501] In this embodiment, the interface displayed on the mobile phone and the smart television display interface card and the mobile phone search interface are divided into two interfaces, and the interface display switching can be implemented based on the user's slide-up and slide-down actions on the screen. Therefore, the smart television display interface card does not affect the layout and function of the original search interface of the mobile phone.

[0502] Figures 42(a)-42(g) are schematic diagrams of another set of GUIs according to one embodiment of the present application. Figures 42(b)-42(g) illustrate a process in which a mobile phone interacts with a smart speaker. In this embodiment of the present application, the intelligent device currently in the pointing direction of the mobile phone's head is the smart speaker.

[0503] FIG. 42( a ) shows a smart speaker 4210 .

[0504] For Figures 42(b) and 42(c), please refer to the related explanations for Figures 36(b) and 36(c).

[0505] See FIG. 42(d). Display interface 4240 includes a speaker control card 4241. Control card 4241 may be located at an upper position in interface 4240, for example, above app suggestions. Text such as "My Vision" may further be displayed above display interface card 4241. When the speaker is in an off state, card 4241 may display a control device 4242 for the user to control the speaker to be turned on. The mobile phone may display the GUI shown in FIG. 42(e) after detecting a tapping action on control 4242 by the user. Optionally, if the speaker is currently in a playback state, the speaker may jump directly from the interface shown in FIG. 42(c) to the GUI shown in FIG. 42(e).

[0506] See FIG. 42(e). Display interface 4250 may include a speaker display interface card 4251, which may display lyrics and the playback progress of the currently playing music, display function controls such as music playback mode under the playback progress, music switching, pause, and playlist. A user may tap some controls on the card to control the speaker to perform actions such as music playback, switching, and playback mode setting.

[0507] In an optional embodiment, see Fig. 42(f). Display interface 4250 may further include a service content card 4252 related to music, for example, a music video (MV), and service content card 4252 may be stacked below display interface card 4251. After detecting a user tapping action on display interface card 4251 or service content card 4252, the mobile phone may display a GUI shown in Fig. 42(g).

[0508] 42(g), the display interface 4260 may include a display interface card 4253 and a service content card 4254 arranged in a list format. That is, the display interface card 4251 is a playback interface used to display the current music, and the service content card 4254 is an MV interface used to display the current music, and the MV interface may display the MV name, picture, lyrics, etc.

[0509] In this embodiment of the present application, when the device pointed by the mobile phone head is a smart speaker, the user may slide his finger downward on the mobile phone screen to display the speaker's control interface on the mobile phone screen, and further display a service content card on the mobile phone screen, for example, a music video related to the content in the speaker's control interface. Therefore, when the user plays music by using the speaker, the music video can be synchronously displayed on the mobile phone, providing the user with both visual and auditory sensations and improving the user experience.

[0510] 43(a)-43(f) are schematic diagrams of another set of GUIs according to an embodiment of the present application. 43(a)-43(f) illustrate a process in which a mobile phone interacts with a smart television. In the embodiment of the present application, the intelligent device that the mobile phone's head is currently pointing at is the smart television.

[0511] See Figure 43(a). The GUI is a display interface 4320 in an application. For example, the display interface 4320 is an interface for a news information application, and the interface may display multiple pieces of news information, such as text and video. The mobile phone may display the GUI shown in Figure 43(b) after detecting a downward sliding action of a single finger of the user at any position on the interface.

[0512] It should be understood that the display interface 4320 may be any interface in the application, which is not limited in this embodiment of this application.

[0513] See Figure 43(b). The GUI is the interface that is present when display interface 4320 is being refreshed, and the top of display interface 4330 includes icon 4321 that is used to prompt the user that the interface is being refreshed. Display interface 4330 may display the refreshed interface after the user slides a single finger downwards.

[0514] Optionally, the top of the display interface 4330 includes a guide used to prompt the user to perform a refresh, for example, "Refresh" or "Pull down to refresh" display text, as well as display text and a down arrow.

[0515] FIG. 43(c) shows the current display interface 4310 of the television.

[0516] See Figure 43(d). The GUI is a display interface 4320 in the application. The mobile phone may display the GUI shown in Figure 43(e) when it detects that the user's fingers are sliding downward anywhere on the interface, for example, two fingers are sliding downward or three fingers are sliding downward.

[0517] It should be understood that the display interface 4320 may be any interface of a mobile phone, which is not limited in this embodiment of this application.

[0518] See Figure 43(e). The top of display interface 4340 includes a loading area 4322. Loading area 4322 is used to display a "television" prompt to the user. The interface in which loading area 4322 is located is stacked on display interface 4320 and displays a color different from the color of display interface 4322, for example, gray. The mobile phone may display the GUI shown in Figure 43(f) after detecting that the user's multiple fingers continue to slide downward and the sliding distance exceeds a preset distance.

[0519] See Figure 43(f). The GUI is of a smart television and includes a display interface card 4323 stacked on the display interface 4320, i.e., the current display interface 4310 of the smart television.

[0520] For example, the display interface card 4323 may be displayed at a middle position on the screen of the mobile phone, a position above the middle position, a position below the middle position, etc. Alternatively, the user may freely drag the display interface card 4323 based on requirements.

[0521] Optionally, in addition to the current display interface 4310 of the smart television, the display interface card may further include some function controls that can be used to control the television, for example, turning the volume up or down or changing channels.

[0522] Optionally, if the smart television is not turned on, the display interface card 4323 may be a control interface for controlling the television to be turned on / off. A user may control the smart television to be turned on and display the interface of the smart television on the mobile phone.

[0523] In one example, a user is browsing current news in an application and the television is off. In this case, if the user wants to turn on the television, the user may point the head of the mobile phone toward the television and slide multiple fingers downward anywhere in the interface to display the television control interface on the screen of the user's mobile phone. In this case, the user may turn on the television through the interface.

[0524] In another example, a user may be browsing current news in an application and the television is in a playback state. However, if the user wishes to switch to another program, the user may point the head of the mobile phone toward the television and slide multiple fingers downward anywhere in the interface to display the television display interface on the user's mobile phone screen. In this case, the user may control the function controls on the display interface card to switch programs.

[0525] In an optional embodiment, multiple service content cards related to content in the television display interface are further stacked below the display interface card 4323, for example, a brief introduction to a web page for a person or item or a link to purchase a book.

[0526] According to this embodiment of the present application, in the interface of the application, a user can slide downward with a single finger to refresh the interface, and slide downward with multiple fingers to stack the display interface card of the intelligent device pointed to by the mobile phone head on top of the original interface of the application, so that the original layout format of the page is not affected.

[0527] According to this embodiment of the application, when a user slides multiple fingers downward on any interface, the control card or display interface card of the intelligent device in the direction pointed by the mobile phone may be displayed on the interface of the mobile phone to help the user control the intelligent device.

[0528] Figures 44(a)-44(c) are schematic diagrams of another set of GUIs according to one embodiment of the present application, which illustrate the process by which a mobile phone interacts with other intelligent devices.

[0529] See Figure 44(a). The GUI is a display interface 4420 in the application. The mobile phone may display the GUI shown in Figure 44(b) when it detects a user's action of pressing and holding multiple fingers at any position within the interface, for example, a two-finger action of pressing and holding at any position, or a three-finger action of pressing and holding at any position.

[0530] It should be understood that in this embodiment of the application, sliding downwards with a single user finger still has the function of refreshing the interface.

[0531] It should be understood that the display interface 4420 may be any interface of a mobile phone.

[0532] See Figure 44(b). The GUI is a radar distribution interface 4430 of intelligent devices that can be identified around the mobile phone and is stacked on the display interface 4420. For example, the radar distribution interface displays a smart television tag, a smart speaker tag, an air conditioner tag, and a tablet computer tag. After the mobile phone detects a tap on the smart television tag 4423 by the user, the mobile phone may display the GUI shown in Figure 44(e).

[0533] Referring to Figure 44(c), the GUI is an interface 4430 stacked on a display interface 4420, which includes a display interface card 4424 of the smart television, which is the current display interface of the smart television.

[0534] Optionally, the display interface card 3641 further includes some functional controls that can be used to control the television, for example, turning the volume up or down or changing channels. The display interface card may further include a control used to close the display interface card.

[0535] Optionally, after a user taps a speaker tag, a control interface or a playback interface for the speaker may be displayed on the mobile phone, and after a user taps an air conditioner tag, a control interface for the air conditioner may be displayed on the mobile phone.

[0536] Optionally, the position of the display interface card 4424 in the interface 4430 is not specifically limited. The user may freely drag the display interface card 4424 based on requirements.

[0537] According to this embodiment of the present application, in the interface of the application, a user may slide downward with a single finger to refresh the interface, and press and hold with multiple fingers to stack a radar distribution map of tags of all identifiable intelligent devices around the mobile phone on the original interface of the application, so that the original layout format of the page is not affected, and the display interface cards or control interfaces of the intelligent devices are displayed on the interface, allowing multiple intelligent devices to be easily and conveniently controlled.

[0538] According to this embodiment of the application, when a user long presses any interface with multiple fingers, a radar distribution map of tags of all identifiable intelligent devices around the mobile phone may be displayed on the mobile phone interface to help the user control the intelligent devices.

[0539] Figures 45(a)-45(c) are schematic diagrams of another set of GUIs according to one embodiment of the present application, illustrating a process for a mobile phone to interact with another intelligent device.

[0540] For Figure 45(a), please refer to the related explanation for Figure 44(a), and the details will not be explained again here.

[0541] See Figure 45(b). The GUI is a radar distribution interface 4530 of intelligent devices that can be identified around the mobile phone and is stacked on display interface 4520. For example, the radar distribution interface displays a smart television tag, a smart speaker tag, an air conditioner tag, and a tablet computer tag. The mobile phone may display the GUI shown in Figure 45(c) when it detects that the user's fingers slide downward on interface 4530 beyond a preset distance.

[0542] In this embodiment of the application, when a user long presses the interface of the application with multiple fingers to display the interface of the radar distribution tag of the smart television, the user's fingers do not leave the screen of the mobile phone but slide directly downward to display the GUI shown in Figure 45(c). Alternatively, when a user long presses the interface of the application with multiple fingers to display the interface of the radar distribution tag of the smart television, the user's fingers leave the screen, and then the user performs a downward sliding action of multiple fingers on the screen to display the GUI shown in Figure 45(c).

[0543] For Figure 45(c), see the associated description of Figure 44(c). For the sake of brevity, the details will not be described again here.

[0544] 46(a)-46(c) are schematic diagrams of another set of GUIs according to an embodiment of the present application, in which the intelligent device currently in the direction of the mobile phone's head is pointing is a smart television.

[0545] See Figure 46(a). The GUI is an existing search result display interface 4610 obtained when a user enters a keyword into a search interface for a search. After the user enters a keyword into a search box 4611 in the interface and taps "Search," the interface may present all found content related to the keyword.

[0546] For example, the interface may present video 4612, audio 4613, and web page information 4614 and 4615 related to the keyword, purchase links 4613, and files stored on the mobile phone, such as messages 4616. The interface may also prioritize content stored on the mobile phone, such as information related to the keyword and stored in messages or notes.

[0547] A file stored in a mobile phone, for example an SMS or a memo, may be understood as a file stored in the memory of the mobile phone.

[0548] See Figure 46(b). The GUI is a search result display interface 4620 obtained when a user inputs a keyword into a search interface for a search when the intelligent device in the direction of the mobile phone head is a smart television according to this embodiment of the present application. The display interface 4620 may include multiple function cards related to the keyword video. In other words, the function cards displayed in the display interface 4620 are related to the capabilities of the smart television, and the multiple function cards are located below the search box.

[0549] In one example, the television is currently playing a television series. When the intelligent device in the direction of the mobile phone's head is a smart television and the keyword entered by the user in the search box of the search interface is the name of a television series, function card 4621 may be preferentially displayed on display interface 4620. Function card 4621 is a playback control interface for the television series, and may include a brief introduction to the television series, the number of times the television series has been played, information about the actors in the television series, the release year of the television series, playback controls for each episode of the television series, etc. The source of function card 4621 may be displayed above function card 4621, for example, Huawei Video. Display interface 4620 may further include multiple video content cards 4622, 4623, 4624, etc. related to the television series. Multiple video content cards may be presented below function card 4621 in a list format or a stack format. A user may slide their finger to flip display interface 4620 to view multiple video content cards.

[0550] In another example, the television is on but not playing any programs. When a user enters the name of a television series in a search box, feature card 4621 may alternatively be preferentially displayed in display interface 4620. Display interface 4620 may further include multiple video content cards 4622, 4623, 4624, etc., related to the television series.

[0551] The user may choose to play the video based on the user's will. After detecting the user tapping on control 4625, the mobile phone may display the GUI shown in Figure 46(c), and the smart television may also display the episode being played and selected by the user.

[0552] See Figure 46(c). The feature card 4621 includes a smart television display interface card 4651, which is used to display the story being played and selected by the user. The display interface card 4651 may be located in a story selection area within the feature card 4621, and a story selection control 4652 may further be included on the display interface card 4651. The user may tap the story selection control to select the story expected to be played.

[0553] For example, if the control device 4625 is a playback control for episode 1 of a television series, the display interface card 4651 may display a playback interface for episode 1.

[0554] According to an embodiment of this application, when the head of a mobile phone is pointed at another intelligent device and a user inputs a keyword into the search interface for a search, the search results in the search interface are related to the capabilities of the intelligent device. For example, if the intelligent device is a smart television, videos will be displayed in the search results, or if the intelligent device is a smart speaker, audio will be displayed in the search results. When a user points the mobile phone toward a smart television, the user may expect to obtain videos through the search. Therefore, this embodiment of this application makes it convenient for users to search for related videos.

[0555] 47(a)-47(d) are schematic diagrams of another set of GUIs according to an embodiment of the present application.

[0556] For Figures 47(a) and 47(b), please refer to the related explanations in Figures 46(a) and 46(b).

[0557] See Figure 47(c). In response to a user tapping a control on a selected story, a "Play on Television" prompt box 4603 and a "Play on Mobile Phone" prompt box 4604 are displayed in function card 4621 to allow the user to select to play the selected story on a particular device. Prompt boxes 4603 and 4604 may be located in a story selection area within function card 4621.

[0558] For example, the mobile phone may display the GUI shown in FIG. 47(d) after detecting a user tapping on the “Play on TV” prompt box 4603, and the selected story will be played on the smart television display interface 4602.

[0559] See Figure 47(d). A prompt box 4603a used to prompt the currently playing story selected by the user may be displayed in interface 4621. For example, prompt box 4603a may display "Episode 1 is playing on television." Interface 4621 may further include a prompt box 4603b used by the user to select a story. For example, story selection prompt box 4603b may display "Select a story."

[0560] Optionally, the selected story may be played in interface 4621 after the user taps on the "Play on Mobile" prompt box 4604.

[0561] In this embodiment of the application, after finding a related video in the search interface, the user may flexibly choose to play the video on their mobile phone or television.

[0562] 48(a)-48(c) are schematic diagrams of another set of GUIs according to an embodiment of the present application, in which the intelligent device to which the mobile phone head is currently pointing is a smart television.

[0563] For Figure 48(a), see the related explanation for Figure 47(a).

[0564] See Figure 48(b). The GUI is a search result display interface 4640 obtained when a user inputs a keyword into a search interface for a search when the intelligent device pointed by the head of the mobile phone is a smart speaker according to this embodiment of the present application. The display interface 4640 may include multiple function cards related to the keyword audio. In other words, the function cards displayed in the display interface 4640 are related to the capabilities of the smart speaker, and the multiple function cards are located below the search box.

[0565] For example, when a user expects to listen to music related to a television series, the user may enter the name of the television series into the search interface. That is, the keyword is the name of the television series. In this case, multiple audio content cards 4641, 4642, 4643, 4644, 4645, 4646, 4647, 4648, etc. related to the keyword may be displayed in display interface 4640. The audio content cards may include music or pure music whose name is the keyword, theme songs, opening songs, and ending songs of the television series whose name is the keyword, etc. The multiple audio content cards may be presented in a list format or a stack format in the display interface. The source of the multiple audio content cards may be further displayed above the multiple audio content cards, such as Huawei Music.

[0566] In another example, if a user enters the name of a piece of music into a search interface, multiple different versions of the music may be displayed in display interface 4640 for user selection.

[0567] In another example, when a smart speaker is playing music, a control interface for the music currently being played on the smart speaker may be displayed preferentially within display interface 4640. The control interface may display lyrics and playback progress of the currently playing music, and display function controls such as music playback style, music switching, pause, and playlists below the playback progress. A user may tap some controls in the cards to control the smart speaker to perform actions such as music playback, switching, and playback style setting. Display interface 4640 may also display multiple audio content cards related to music.

[0568] The user may choose to play music based on the user's will. When the mobile phone detects that the user taps a card, such as audio content card 4643, the mobile phone may display the GUI shown in Figure 48(c), and the smart speaker will start playing the music selected by the user.

[0569] See Figure 48(c). Display interface 4660 includes a playback display interface 4661 for the selected audio content card 4643. Playback display interface 4661 includes music lyrics, playback time, etc., and may further include several controls, allowing the user to control play / pause, switch to previous song, switch to next song, playback mode, playlist, etc. Audio content card 4662 may display an icon and "Now Playing" to prompt the user that music is being played and to prompt the user to know the music currently being played.

[0570] According to an embodiment of this application, when the head of the mobile phone is pointed at another intelligent device and the user inputs a keyword into the search interface for a search, the search results in the search interface are related to the capabilities of the intelligent device. When the user points the mobile phone toward a smart speaker, the user may expect to obtain audio through the search. Therefore, this embodiment of this application makes it convenient for the user to search for related audio.

[0571] According to this embodiment of the application, when the smart speaker is playing music, the user may enter the name of the music being played into a search interface, in which case a control interface for the currently playing music is presented preferentially in the search results to help the user control the music being played on the smart speaker.

[0572] 49(a)-49(d) are schematic diagrams of another set of GUIs according to an embodiment of the present application, in which the intelligent device that the mobile phone head is currently pointing at is a smart television.

[0573] For Figure 49(a), see the related description of Figure 47(a). For Figure 49(b), see the related description of Figure 48(b).

[0574] See Figure 49(c). In response to a user tapping on audio content card 4643, the mobile phone pops up prompt card 4650. Prompt card 4650 may be stacked above the search results interface. Prompt card 4650 may include a "play on speaker" prompt box 4605 and a "play on mobile phone" prompt box 4606, allowing the user to select whether to play the selected music on a particular device.

[0575] It should be understood that the user may freely drag the cards 4650 based on their requirements.

[0576] For example, after detecting a tap on the "Play on Speaker" prompt box 4605, the mobile phone may display the GUI shown in FIG. 49(d), and the smart speaker will begin playing the selected music.

[0577] See Figure 49(d). Card 4605a displays "Now Playing on Speaker" to prompt the user with the music that is currently being played.

[0578] Optionally, after the user taps on the "Play on Mobile" prompt box 4606, "Play on Mobile" may be displayed on card 4605a.

[0579] In this embodiment of the application, after finding related audio in the search interface, the user may flexibly choose to play the audio on their mobile phone or speaker.

[0580] 50(a)-50(c) are schematic diagrams of another set of GUIs according to an embodiment of the present application, in which the intelligent device that the mobile phone head is currently pointing at is a smart speaker.

[0581] For Figure 50(a), see the related explanation for Figure 47(a).

[0582] See FIG. 50(b). The GUI is a search result display interface 4670 obtained when a user inputs a keyword into a search interface for a search when the intelligent device pointed by the head of the mobile phone is a smart speaker according to this embodiment of the present application. The display interface 4670 may include multiple function cards related to the keyword audio. In other words, the function cards displayed in the display interface 4670 are related to the capabilities of the smart speaker. The function cards are audio content cards, and the multiple audio content cards are located below the search box.

[0583] For example, in addition to information such as the name and author of the music, audio content card 4671 further includes prompt boxes selected by the user for playback on a particular device, such as "play on speakers" prompt box 4607 and "play on mobile phone" prompt box 4608.

[0584] The user may choose to play music and may select a particular device for playback based on the user's wishes. For example, when detecting that the user taps a prompt box within the card and used to play on a particular device, e.g., when detecting that the user taps on "Play on Speaker" prompt box 4607 within audio content card 4671, the mobile phone may display the GUI shown in Figure 50(c), and the smart speaker will begin playing the music selected by the user.

[0585] See Figure 50(c). Audio content card 4609 may display "Play on Speaker" to prompt the user with the music that is currently playing.

[0586] Optionally, after the user taps on the "Play on Mobile" prompt box 4608, "Play on Mobile" may be displayed in card 4609.

[0587] In this embodiment of the application, after finding related audio in the search interface, the user may flexibly choose to play the audio on their mobile phone or speaker.

[0588] 51(a)-51(c) are schematic diagrams of another set of GUIs according to one embodiment of the present application.

[0589] See Figure 51(a). When the mobile phone detects that the mobile phone 4821 has been picked up and is being held in a vertical position, the mobile phone may display the GUI shown in Figure 51(e).

[0590] It should be appreciated that components within the mobile phone, such as gravity sensors and gyros, may determine whether the mobile phone is in an upright position.

[0591] See Figure 51(b). The GUI is a display interface 4710 in the application and a radar distribution interface stacked on the interface 4710. The radar distribution interface represents the distribution of all identifiable intelligent devices around the mobile phone 4821 and displays the tags of the intelligent devices, for example, a smart television tag 4711, a smart speaker tag, an air conditioner tag, and a tablet computer (mate pad) tag. When the mobile phone detects that the user taps a tag, for example, the smart television tag 4711, the GUI shown in Figure 51(c) may be displayed.

[0592] Referring to Figure 51(c), the interface on which the smart television's display interface card 4712 is located is stacked on the display interface 4710, and the display interface card 4712 is the current display interface of the smart television.

[0593] It should be understood that the user may freely drag the cards 4712 based on their requirements.

[0594] According to this embodiment of the present application, in the interface of the application, the user picks up the mobile phone and holds the mobile phone vertically to stack the radar distribution map of tags of all identifiable intelligent devices around the mobile phone on the original interface of the application, so that the original layout format of the page is not affected, and the display interface card or control interface of the intelligent device is displayed on the interface, allowing multiple intelligent devices to be easily and conveniently controlled.

[0595] 52(a)-52(c) are schematic diagrams of another set of GUIs according to one embodiment of the present application.

[0596] See Figure 52(a). In a mobile phone search interface, when the mobile phone detects that the user has picked up the mobile phone and is holding it upright, it may open the camera and display the interface shown in Figure 52(b).

[0597] See Figure 52(b). The interface is a three-dimensional display interface 4810 in the viewing angle of the camera. When the mobile phone opens the camera, an intelligent device in the viewing angle of the camera may display a tag of the intelligent device, such as a Huawei television tag 4811 or a Huawei speaker tag 4812. The user may tap the tag of the intelligent device. When the mobile phone detects that the user taps a tag, such as a Huawei television tag 4811, the mobile phone may display the interface shown in Figure 52(c).

[0598] It is understood that in this embodiment of the application, the mobile phone may automatically identify the intelligent device by using artificial intelligence (AI) object recognition techniques, and may also generate a location tag for the intelligent device by using UWB or Bluetooth components within the mobile phone.

[0599] Referring to Figure 52(c), the interface on which the smart television's display interface card 4813 is located is stacked on the display interface 4810, and the display interface card 4813 is the current display interface of the smart television.

[0600] It should be understood that the user may freely drag the cards 4813 based on their requirements.

[0601] Optionally, when a user taps the Huawei speaker tag 4812, a playback control interface for the speaker may be displayed and stacked on the display interface 4810.

[0602] According to this embodiment of the present application, in the search interface of the mobile phone, a user picks up the mobile phone, holds the mobile phone vertically, and opens the camera to identify multiple intelligent devices around the mobile phone. The tags of the multiple intelligent devices are displayed in the camera interface. The user taps the tag to display the display interface card or control interface of the intelligent device in the interface, allowing the multiple intelligent devices to be easily and conveniently controlled.

[0603] Figures 53(a) and 53(b) are schematic diagrams of a set of GUIs according to one embodiment of the present application, showing the process by which a mobile phone interacts with a tablet computer.

[0604] See FIG. 53(a). The GUI is a search interface 4920 of a mobile phone. The search interface 4920 may include a search box, app suggestions, real-time hotspots, history search, etc. Additionally, the search interface may further include multiple function areas. The multiple function areas may be coupled to a keyboard and located above the keyboard. For example, the function areas may include a "Submit Barrage Comment" function area 4921, a "Video Search" function area 4922, and an "Audio Search" function area 4923.

[0605] For example, when a user watches a television series on the tablet computer 4900, in order to improve the experience of watching the television series, the user expects to send barrage comments to communicate with other users watching the series. Typically, when sending barrage comments, the user needs to invoke a keyboard to input comments. Because the keyboard occupies part of the display space of the screen, the user's screen viewing experience is affected to some extent.

[0606] In this embodiment of the application, the mobile phone may display the GUI shown in FIG. 53(b) after detecting the user's tapping action on the "Send Barrage Comments" function area 4921.

[0607] See Figure 53(b). Search interface 4930 may include a function card 4931 for sending barrage comments, and function card 4931 may include a barrage comment text display box 4932, a control 4933 that can be used to close function card 4931, a barrage comment send key 4934, etc.

[0608] When sending a barrage comment, the user only needs to point the head of the mobile phone towards the tablet computer 4900, and the barrage comment 4912 sent by the user will be displayed in the display area 4910 of the tablet computer 4900.

[0609] For example, when a user taps video search 4922, a keyword may be entered into a pop-up input box, and after OK is tapped, multiple video-related results may be displayed on the tablet computer's display. For example, when a user taps audio search 4923, a keyword may be entered into a pop-up input box, and after OK is tapped, multiple audio-related results may be displayed on the tablet computer's display.

[0610] In an embodiment of this application, in the search interface of a mobile phone, text input, video search, audio search, etc. can be implemented on the device in the direction pointed by the head of the mobile phone to improve the user's cross-device input experience.

[0611] 54a and 54b are schematic flowcharts of a control method applied to an electronic device according to an embodiment of the present application. As shown in Fig. 54a, the control method applied to the electronic device may specifically include the following steps:

[0612] Steps S100 to S104 are steps in which the electronic device transmits the first content to the target device.

[0613] S100: The electronic device displays a first content.

[0614] Alternatively, the electronic device may be a tablet computer, a smart watch, a smart band, etc. This is not limited herein. The first content displayed by the electronic device may include pictures, videos, audio, food cooking parameters, exercise parameters, etc.

[0615] S101: When the electronic device displays a first content, the electronic device detects a first action of a user.

[0616] The first motion may be the first directional motion described above. For details about the first directional motion, see the descriptions of Figures 3d to 3f. The details will not be described again here. The electronic device may detect the user's first directional motion. For details about how the electronic device detects the first directional motion, see the descriptions of Figures 3e to 3g. The details will not be described again here. The electronic device may be the mobile phone 111 in the multi-device scenario 100 shown in Figure 1a.

[0617] S102: In response to a first movement, the electronic device acquires a direction of the first movement and a first attitude of the electronic device.

[0618] When the electronic device detects a first motion, the electronic device acquires a direction of the first motion. The direction of the first motion is the direction in which the center of gravity of the electronic device moves during the first motion or the direction in which a user gesture moves during the first motion. As shown in Figures 3e and 3f, the direction of the first motion is the direction in which the user moves the mobile phone 111 toward the television 113. As shown in Figures 3g and 3h, the direction of the first motion is the direction in which the gesture moves when the user performs the first motion.

[0619] The electronic device may determine the orientation of the electronic device by using an acceleration sensor and a gyro sensor. A first orientation of the electronic device may be one in which the top of the electronic device is facing up and the display of the electronic device is facing toward the target device. As shown in FIG. 3g, the mobile phone shown in FIG. 3g is facing up and the display of the mobile phone is facing toward the target device and away from the user.

[0620] Optionally, the electronic device may determine that the electronic device is in the first position when the electronic device detects that the top of the electronic device is facing upwards and the camera cannot detect a face.

[0621] S103: The electronic device determines a target device based on the direction of the fifth movement and / or the first attitude.

[0622] The electronic device may send a second request to one or more electronic devices, where the second request is used to obtain location information of the one or more electronic devices.

[0623] In a possible implementation, determining the target device based on the direction of the first movement and / or the first attitude specifically includes: sending a second request to one or more intelligent devices, the second request being used to indicate to the one or more intelligent devices to send location information to the electronic device; and determining a first intelligent device as the target device based on the location information sent by the one or more intelligent devices, the location of the first intelligent device being in the direction of the first movement, the first intelligent device including one or more intelligent devices of the one or more intelligent devices. In this way, the electronic device may obtain the intelligent devices in the direction of the first movement through calculation based on the location information of the multiple intelligent devices and determine the target device with which the user expects the electronic device to exchange data.

[0624] The electronic device and one or more electronic devices may be connected to the same Wi-Fi network. Alternatively, the login account of the electronic device may be the same as one or more login accounts of the one or more electronic devices. The electronic device and one or more electronic devices may all access the Internet. For example, the electronic device and one or more electronic devices may access the Internet via a Wi-Fi network, a 4G network, or a 5G network. The one or more electronic devices may be a television, a speaker, a treadmill, a refrigerator, a tablet computer, etc. The electronic device may send a request for location information to one or more devices. The one or more electronic devices may have a location determination module. The one or more electronic devices may obtain three-dimensional location information by using the location determination module.

[0625] Optionally, determining the target device based on the direction of the first movement and / or the first attitude specifically includes transmitting a third request to a positioning server, the third request being used to instruct the positioning server to transmit position information of one or more intelligent devices, the positioning server being configured to store the position information of the one or more intelligent devices; and determining a first intelligent device as the target device based on the position information of the one or more intelligent devices, the position of the first intelligent device being in the direction of the first movement, the first intelligent device including one or more intelligent devices of the one or more intelligent devices. In this way, the electronic device can also obtain the position information of the intelligent device when the intelligent device does not have a positioning function. Additionally, the electronic device may obtain the intelligent device in the direction of the first movement through calculation based on the position information of multiple intelligent devices to determine the target device with which the user expects the electronic device to exchange data.

[0626] Optionally, the electronic device sends a request to a position determination system to obtain position information of the one or more electronic devices. The one or more electronic devices do not have a position determination module. The one or more electronic devices may be located by using a position determination system including multiple sensors. The position determination system may determine one or more positions of the one or more electronic devices. It will be understood that when one or more positions of the one or more electronic devices change, it is necessary to perform position determination again using the position determination system.

[0627] The one or more electronic devices may have a position determination module. The one or more electronic devices may obtain three-dimensional position information by using the position determination module. The one or more electronic devices then transmit the three-dimensional position determination information to the electronic device.

[0628] Optionally, the position determination system may transmit position information of one or more electronic devices to the electronic devices.

[0629] For step S103, see the explanation of how the mobile phone 111 acquires the location information of the television 113 in Fig. 31. The details will not be explained again here.

[0630] The electronic device may use an electronic device in the direction of the first directional movement as the target device. For example, in the multi-...

Claims

[Claim 1] A control method applied to an electronic device, comprising: Displaying a first content; Detecting a first action of a user; obtaining a direction of the first movement and a first attitude of the electronic device in response to the first movement; determining a target device based on the direction of the first motion and / or the first pose; and transmitting the first content to the target device upon detecting that the electronic device and the target device are logged into the same account.

Images