Interaction method and electronic device

Abstract

The present application relates to the technical field of terminals, and provides an interaction method and an electronic device. On the basis of pointing intentions of users on display screens, the present application can flexibly control corresponding smart devices to execute operations, thereby improving the interaction experience of the users. The method comprises: a first electronic device displays a first interface, a plurality of device identifiers being displayed on the first interface, the plurality of device identifiers respectively corresponding to a plurality of smart devices, and the first electronic device and the plurality of smart devices forming a smart control system; the first electronic device acquires a first pointing intention of a second electronic device on a display screen of the first electronic device; and, after determining that the first pointing intention comprises selecting N device identifiers among the plurality of device identifiers, the first electronic device instructs N smart devices respectively corresponding to the N device identifiers to execute corresponding operations, N being a positive integer greater than or equal to 2.

Description

Interaction method and electronic device

[0001] The present application claims priority to the Chinese patent application No. 202411397131.8, filed on September 30, 2024, and entitled "Interaction method and electronic device", the content of which is incorporated herein by reference in its entirety. TECHNICAL FIELD

[0002] The present application relates to the technical field of terminal, and in particular, to an interaction method and an electronic device. BACKGROUND

[0003] A home theater is generally formed by a smart screen and multiple smart speaker devices networking, and provides a good audio-visual experience for users through the collaborative work between the multiple devices.

[0004] For example, after the devices are networked, the user can control the multiple smart speakers to play audio through the smart screen, thereby obtaining a surround stereo audio playing experience. However, since the user cannot flexibly select which smart speakers in the network to control, the user's interaction experience is affected. SUMMARY

[0005] To solve the above technical problems, the present application provides an interaction method and an electronic device. The technical solution provided by the present application can flexibly control the corresponding smart devices to perform operations according to the pointing intention of the user on the display screen, thereby improving the user's interaction experience.

[0006] To achieve the above technical purposes, the present application provides the following technical solutions:

[0007] In a first aspect, an interaction method is provided, applied to a first electronic device, the first electronic device and multiple smart devices forming a smart control system, the method comprising: displaying a first interface, the first interface displaying multiple device identifiers, the multiple device identifiers respectively corresponding to the multiple smart devices; obtaining a first pointing intention of a second electronic device on a display screen of the first electronic device; and after determining that the first pointing intention includes selecting N device identifiers in the multiple device identifiers, instructing N smart devices corresponding to the N device identifiers to perform corresponding operations, N being a positive integer greater than or equal to 2.

[0008] In this way, the first electronic device can meet the user's control demand for the smart devices by obtaining the pointing intention of the second electronic device on the display screen, thereby enhancing the user's interaction experience. Moreover, the problem that the user cannot flexibly control certain smart devices in the use process of the smart control system is solved.

[0009] In addition, the first electronic device triggers the plurality of smart devices to perform corresponding operations after determining the plurality of smart devices selected by the pointing intention of the user, thereby realizing orderly control of the plurality of smart devices.

[0010] According to the first aspect, indicating the N devices to perform corresponding operations on the N smart devices respectively includes: indicating the N smart devices to perform corresponding operations synchronously; or indicating the N smart devices to perform corresponding operations in sequence according to the order in which the N devices are determined. Optionally, synchronous performance means, for example, that the plurality of smart devices perform together. For example, the N smart devices are audio playing devices, and synchronous performance includes synchronous playing, such as playing of the audio to be played, such as audio track cooperation, playing time cooperation, and the like.

[0011] In this way, the first pointing intention obtained by the first electronic device can also be used to control the plurality of smart devices, thereby realizing flexible control of the plurality of smart devices.

[0012] According to the first aspect, or any one of the implementation manners of the first aspect, the first pointing intention is determined by sequentially obtaining the order in which the N devices are pointed to by the second electronic device on the display screen of the first electronic device.

[0013] For example, the user points to the plurality of device icons by means of the second electronic device sending an indication signal corresponding to the connection line of the pointing position on the display screen of the first electronic device. Then, the first electronic device can obtain the plurality of device icons selected by the user by connection, and the connection order of the plurality of device icons, thereby obtaining the first pointing intention of the user.

[0014] According to the first aspect, or any one of the implementation manners of the first aspect, the method further includes: indicating the N smart devices to perform corresponding operations in sequence according to the order in which the devices are sequentially obtained.

[0015] In this way, the first electronic device can obtain the devices selected by the user in sequence according to the pointing intention of the user, thereby realizing subsequent sequence control of the plurality of smart devices.

[0016] According to the first aspect, or any one of the implementation manners of the first aspect, the time interval at which the second electronic device points to the N devices in sequence is related to the time interval at which the N smart devices perform corresponding operations in sequence.

[0017] In this way, the first electronic device can flexibly adjust the rhythm of the sound test according to the connection speed of the user through the second electronic device, thereby improving the interactive experience of the user.

[0018] According to the first aspect, or any one of the implementation manners of the first aspect, the smart devices identified by the N devices are not the same, or partially the same.

[0019] In this way, the first electronic device can continuously trigger the smart devices selected by the user to perform corresponding operations according to the user's intention, so as to avoid the case that all smart devices are triggered to perform operations or the case that smart devices are triggered to perform operations in a fixed order. In addition, whether the smart devices need to be repeatedly triggered to perform operations can be selected according to the user's demand.

[0020] According to the first aspect, or any one of the implementations of the first aspect, the method further includes: obtaining a second pointing intention of the second electronic device on the display screen of the first electronic device during the process in which the N smart devices perform corresponding operations. When it is determined that the second pointing intention includes selecting M device identifiers in the plurality of device identifiers, the M smart devices corresponding to the M device identifiers are instructed to perform corresponding operations, where M is a positive integer greater than or equal to 1, and the smart devices identified by the M device identifiers are different from, or partially the same as, the smart devices identified by the N device identifiers.

[0021] In some examples, during the implementation of the first pointing intention, the first electronic device can further receive a second pointing intention of the user.

[0022] In this way, a more flexible sound testing experience is provided for the user.

[0023] According to the first aspect, or any one of the implementations of the first aspect, obtaining the first pointing intention of the second electronic device on the display screen of the first electronic device includes: obtaining a pointing style of the second electronic device. According to the pointing style being a first pointing style, it is determined that the first pointing intention includes instructing the N smart devices to synchronously perform corresponding operations. And / or, according to the pointing style being a second pointing style, it is determined that the first pointing intention includes instructing the N smart devices to perform corresponding operations in sequence.

[0024] According to the first aspect, or any one of the implementations of the first aspect, the first pointing style is a circle or an approximate circle, and the display positions of the N device identifiers on the first interface are located in an area within the circle or the approximate circle; and the second pointing style is a line, and the line is used to connect the N device identifiers.

[0025] In this way, the first electronic device can flexibly control different smart devices according to the pointing style of the obtained first pointing intention, so as to enrich the user's interactive experience.

[0026] According to the first aspect, or any one of the implementations of the first aspect, the method further includes: obtaining a first pointing direction of the second electronic device. When a third pointing intention determined according to the first pointing direction includes selecting N smart devices in the plurality of smart devices, the N smart devices are instructed to perform corresponding operations.

[0027] In this way, the user can point to the device identifier displayed on the first electronic device by the second electronic device, or directly point to the actual position of the smart device in the space, and the first electronic device can trigger the corresponding smart device to perform an operation, thereby effectively improving the interaction experience of the user.

[0028] According to the first aspect or any one of the implementations of the first aspect, the method further includes: obtaining first information respectively sent by N smart devices in the plurality of smart devices, the first information being determined by the N smart devices according to a fourth pointing intention of the second electronic device pointing to the N smart devices. According to the first information, the N smart devices are instructed to perform corresponding operations.

[0029] In some examples, the smart device can also be installed with a positioning module. Then, when the second electronic device sends an indication signal to the smart speaker in the space, the corresponding smart device can also receive the indication signal and locate the second electronic device. Then, the smart device can send first information to the first electronic device, the first information being used to indicate that the second electronic device currently indicates that the first electronic device performs a triggering operation. Correspondingly, after receiving the first information, the first electronic device can obtain the fourth pointing intention of the user indicating the smart device to perform an operation, and then the first electronic device can send an execution instruction to the smart device to trigger the smart device to perform a corresponding operation.

[0030] In this way, the smart device can also trigger itself to perform a corresponding operation through the first electronic device according to the pointing operation of the second electronic device, thereby meeting the needs of the user to flexibly control in different interaction scenarios.

[0031] According to the first aspect or any one of the implementations of the first aspect, the first smart device exists near the N smart devices, and the method further includes: in the case where the N smart devices are instructed to perform corresponding operations, the first smart device is also instructed to perform corresponding operations. In this way, through the linkage of multiple devices, the interaction experience of the user is enriched.

[0032] According to the first aspect or any one of the implementations of the first aspect, the method further includes: displaying a second interface, and the second interface displays screen saver content. The fifth pointing intention of the second electronic device on the display screen of the first electronic device is obtained. In the case where the fifth pointing intention is used to move first screen saver content in the screen saver content, the first screen saver content is controlled to move on the second interface.

[0033] In this way, the first electronic device can also realize flexible interaction with the user in the process of displaying the screen saver interface.

[0034] According to the first aspect or any one of the implementations of the first aspect, the method further includes: following the change of the moving track of the first screen saver content, controlling the corresponding smart device in the plurality of smart devices to perform an operation.

[0035] In this way, the playability of the screen saver interface is increased, and the user's interactive experience is improved.

[0036] According to a first aspect, or any one of the implementations of the first aspect, the plurality of smart devices are audio playing devices and / or light devices.

[0037] According to the first aspect, or any one of the implementations of the first aspect, the first electronic device is a smart screen, and / or the second electronic device is a remote control device.

[0038] According to a second aspect, there is provided an interaction method applied to a first electronic device, the first electronic device and a plurality of smart devices forming a smart control system, the method comprising: obtaining a first pointing direction of a second electronic device; and after determining that a first pointing intention according to the first pointing direction comprises selecting N smart devices from the plurality of smart devices, instructing the N smart devices to perform corresponding operations, N being a positive integer greater than or equal to 2.

[0039] In this way, the first electronic device can obtain the pointing intention of the user through the pointing direction of the second electronic device in space, implement flexible control of the smart devices, and enhance the user's interactive experience. In this way, the problem that the user cannot flexibly control the smart devices in the use process of the smart control system is solved.

[0040] According to the second aspect, instructing the N smart devices to perform corresponding operations comprises: instructing the N smart devices to synchronously perform corresponding operations; or instructing the N smart devices to perform corresponding operations in sequence according to a sequence of the N smart devices.

[0041] According to the second aspect, or any one of the implementations of the second aspect, the first pointing intention is determined through a sequence of the N smart devices pointed by the first pointing direction in sequence.

[0042] According to the second aspect, or any one of the implementations of the second aspect, the method further comprises: instructing the N smart devices to perform corresponding operations in sequence according to a sequence of directions in which the smart devices are pointed in sequence.

[0043] According to the second aspect, or any one of the implementations of the second aspect, the first electronic device determines a time interval at which the second electronic device points the N smart devices in sequence, and the time interval at which the N smart devices perform corresponding operations in sequence.

[0044] According to the second aspect, or any one of the implementations of the second aspect, the N smart devices are not the same, or partially the same.

[0045] According to a second aspect, or any possible implementation mode of the second aspect, the method further includes: obtaining a second pointing direction of the second electronic device in a process that the N smart devices perform the corresponding operation. When the second pointing intention determined according to the second pointing direction includes selecting M smart devices from the plurality of smart devices, the M smart devices perform the corresponding operation, M is a positive integer greater than or equal to 1, and the M smart devices are different from or partially the same as the N smart devices.

[0046] According to the second aspect, or any possible implementation mode of the second aspect, the first smart device is present in the vicinity of the N smart devices, and the method further includes: instructing the first smart device to perform the corresponding operation in a case that the N smart devices perform the corresponding operation.

[0047] According to the second aspect, or any possible implementation mode of the second aspect, the method further includes: obtaining first information respectively sent by the N smart devices from the plurality of smart devices, the first information being determined by the N smart devices according to a third pointing intention of the second electronic device pointing at the N smart devices. The N smart devices perform the corresponding operation according to the first information.

[0048] According to the second aspect, or any possible implementation mode of the second aspect, the method further includes: displaying a first interface, the first interface displaying a plurality of device identifiers, the plurality of device identifiers respectively corresponding to the plurality of smart devices. Obtaining a fourth pointing intention of the second electronic device on the display screen of the first electronic device. When it is determined that the fourth pointing intention includes selecting N device identifiers from the plurality of device identifiers, instructing the N smart devices respectively corresponding to the N device identifiers to perform the corresponding operation.

[0049] In this way, the user can trigger the corresponding smart device to perform the operation through the first electronic device by directly pointing at the actual position of the smart device in the space or by pointing at the device identifier displayed on the first electronic device through the second electronic device, thereby effectively improving the interactive experience of the user.

[0050] According to the second aspect, or any possible implementation mode of the second aspect, the method further includes: displaying a second interface, the second interface displaying a screen saver content. Obtaining a fifth pointing intention of the second electronic device on the display screen of the first electronic device. In a case that the fifth pointing intention is used to move a first screen saver content in the screen saver content, controlling the first screen saver content to move on the second interface.

[0051] According to the second aspect, or any possible implementation mode of the second aspect, the method further includes: following the change of the moving track of the first screen saver content, controlling the corresponding smart device from the plurality of smart devices to perform the operation.

[0052] According to a second aspect, or any possible implementation mode of the second aspect, the plurality of smart devices are audio playing devices and / or light devices.

[0053] According to the second aspect, or any possible implementation mode of the second aspect, the first electronic device is a smart screen, and / or the second electronic device is a remote control device.

[0054] According to a third aspect, there is provided an interaction method applied to a first electronic device, the first electronic device and a plurality of smart devices forming a smart control system, the method comprising: obtaining first information respectively sent by N smart devices in the plurality of smart devices, the first information being determined by the N smart devices according to a first pointing intention of a second electronic device pointing at the N smart devices; and instructing the N smart devices to perform corresponding operations according to the first information, N being a positive integer greater than or equal to 2.

[0055] In this way, when the smart devices can detect the indication signal sent by the second device, the first electronic device can obtain the pointing intention of the user through the information sent by the smart devices, implement flexible control on the smart devices, and enhance the user's interaction experience. In this way, the problem that the user cannot control a certain smart device alone in the use of the smart control system is also solved.

[0056] According to the third aspect, or any possible implementation mode of the third aspect, instructing the N smart devices to perform corresponding operations comprises: instructing the N smart devices to synchronously perform corresponding operations; or instructing the N smart devices to perform corresponding operations in sequence according to the order of the N device identifiers determined.

[0057] According to the third aspect, or any possible implementation mode of the third aspect, the method further comprises: instructing the N smart devices to perform corresponding operations in sequence according to the receiving order of each first information.

[0058] According to the third aspect, or any possible implementation mode of the third aspect, the first electronic device determines that the time interval at which the second electronic device points at the N smart devices in sequence is related to the time interval at which the N smart devices perform corresponding operations in sequence.

[0059] According to the third aspect, or any possible implementation mode of the third aspect, the method further comprises: obtaining second information respectively sent by M smart devices in the plurality of smart devices in a process in which the N smart devices perform corresponding operations, the second information being determined by the M smart devices according to a third pointing intention of the second electronic device pointing at the M smart devices, M being a positive integer greater than or equal to 1, and the M smart devices being different from or partially the same as the N smart devices; and instructing the M smart devices to perform corresponding operations according to the third information.

[0060] According to a third aspect, or any possible implementation mode of the third aspect, the first smart device is present in the vicinity of the N smart devices, and the method further comprises: instructing the first smart device to perform the corresponding operation in the case that the N smart devices are instructed to perform the corresponding operation.

[0061] According to the third aspect, or any possible implementation mode of the third aspect, the method comprises: obtaining a first pointing direction of the second electronic device. After determining that a fourth pointing intention according to the first pointing direction comprises selecting N smart devices from the plurality of smart devices, the N smart devices are instructed to perform the corresponding operation.

[0062] According to the third aspect, or any possible implementation mode of the third aspect, the method further comprises: displaying a first interface, and the first interface displays a plurality of device identifiers, and the plurality of device identifiers correspond to the plurality of smart devices respectively. A fifth pointing intention of the second electronic device on the display screen of the first electronic device is obtained. After determining that the fifth pointing intention comprises selecting N device identifiers from the plurality of device identifiers, the N smart devices corresponding to the N device identifiers are instructed to perform the corresponding operation.

[0063] In this way, the user can trigger the corresponding smart device to perform the operation through the first electronic device by directly pointing to the actual position of the smart device in the space or by pointing to the device identifier displayed on the first electronic device through the second electronic device, thereby effectively improving the user's interactive experience.

[0064] According to the third aspect, or any possible implementation mode of the third aspect, the method further comprises: displaying a second interface, and the second interface displays a screen saver content. A sixth pointing intention of the second electronic device on the display screen of the first electronic device is obtained. In the case that the sixth pointing intention is used to move a first screen saver content in the screen saver content, the first screen saver content is controlled to move on the second interface.

[0065] According to the third aspect, or any possible implementation mode of the third aspect, the method further comprises: following the change of the moving track of the first screen saver content, controlling the corresponding smart device from the plurality of smart devices to perform the operation.

[0066] According to the third aspect, or any possible implementation mode of the third aspect, the plurality of smart devices are audio playing devices and / or light devices.

[0067] According to the third aspect, or any possible implementation mode of the third aspect, the first electronic device is a smart screen, and / or the second electronic device is a remote control device.

[0068] In a fourth aspect, a first electronic device is provided. The first electronic device includes a processor, a memory, and a display screen. The memory and the display screen are coupled to the processor. The memory is configured to store computer program codes including computer instructions. When the processor reads the computer instructions from the memory, the first electronic device is caused to perform the following operations: display a first interface, the first interface displaying a plurality of device identifiers, the plurality of device identifiers respectively corresponding to a plurality of smart devices; obtain a first pointing intention of a second electronic device on the display screen of the first electronic device; and after determining that the first pointing intention includes selecting N device identifiers in the plurality of device identifiers, instruct N smart devices corresponding to the N device identifiers to perform corresponding operations, N being a positive integer greater than or equal to 2. The first electronic device and the plurality of smart devices form a smart control system.

[0069] According to the fourth aspect, instructing the N smart devices to perform the corresponding operations includes: instructing the N smart devices to synchronously perform the corresponding operations; or instructing the N smart devices to sequentially perform the corresponding operations according to a determined order of the N device identifiers.

[0070] According to the fourth aspect or any one of the implementations of the fourth aspect, the first pointing intention is determined by sequentially obtaining an order of the N device identifiers pointed by the second electronic device on the display screen of the first electronic device.

[0071] According to the fourth aspect or any one of the implementations of the fourth aspect, when the processor reads the computer instructions from the memory, the first electronic device is further caused to perform the following operation: according to the order of the sequentially obtained device identifiers, instruct the N smart devices to sequentially perform the corresponding operations.

[0072] According to the fourth aspect or any one of the implementations of the fourth aspect, a time interval at which the second electronic device sequentially points to the N device identifiers is related to a time interval at which the N smart devices sequentially perform the corresponding operations.

[0073] According to the fourth aspect or any one of the implementations of the fourth aspect, the smart devices identified by the N device identifiers are not the same or partially the same.

[0074] According to a fourth aspect, or any possible implementation mode of the fourth aspect, when the processor reads the computer instructions from the memory, the first electronic device further performs: obtaining a second pointing intention of the second electronic device on the display screen of the first electronic device in a process in which the N smart devices perform the corresponding operation. After determining that the second pointing intention comprises selecting M device identifiers from the plurality of device identifiers, instructing the M smart devices corresponding to the M device identifiers to perform the corresponding operation, M being a positive integer greater than or equal to 1, the smart devices identified by the M device identifiers being different from the smart devices identified by the N device identifiers, or partially the same.

[0075] According to the fourth aspect, or any possible implementation mode of the fourth aspect, obtaining the first pointing intention of the second electronic device on the display screen of the first electronic device comprises: obtaining a pointing style of the second electronic device. According to the pointing style being a first pointing style, it is determined that the first pointing intention comprises instructing the N smart devices to synchronously perform the corresponding operation. And / or, according to the pointing style being a second pointing style, it is determined that the first pointing intention comprises instructing the N smart devices to sequentially perform the corresponding operation.

[0076] According to the fourth aspect, or any possible implementation mode of the fourth aspect, the first pointing style is a circle or an approximate circle, and the display positions of the N device identifiers on the first interface are located in an area within the circle or the approximate circle; the second pointing style is a connecting line, and the connecting line is used to connect the N device identifiers.

[0077] According to the fourth aspect, or any possible implementation mode of the fourth aspect, when the processor reads the computer instructions from the memory, the first electronic device further performs: obtaining a first pointing direction of the second electronic device. After determining that a third pointing intention according to the first pointing direction comprises selecting N smart devices from the plurality of smart devices, instructing the N smart devices to perform the corresponding operation.

[0078] According to the fourth aspect, or any possible implementation mode of the fourth aspect, when the processor reads the computer instructions from the memory, the first electronic device further performs: obtaining first information respectively sent by the N smart devices from the plurality of smart devices, the first information being determined by the N smart devices according to a fourth pointing intention of the second electronic device pointing at the N smart devices. According to the first information, instructing the N smart devices to perform the corresponding operation.

[0079] According to the fourth aspect, or any possible implementation mode of the fourth aspect, there is a first smart device near the N smart devices, and when the processor reads the computer instructions from the memory, the first electronic device further performs: in a case where the N smart devices are instructed to perform the corresponding operation, instructing the first smart device to perform the corresponding operation.

[0080] According to a fourth aspect, or any possible implementation mode of the fourth aspect, when the processor reads the computer instructions from the memory, the first electronic device further performs: displaying a second interface, and the second interface displays the screen saver content. The first electronic device further performs: acquiring a fifth pointing intention of the second electronic device on the display screen of the first electronic device. In a case where the fifth pointing intention is used to move a first screen saver content in the screen saver content, the first electronic device further performs: controlling the first screen saver content to move on the second interface.

[0081] According to the fourth aspect, or any possible implementation mode of the fourth aspect, when the processor reads the computer instructions from the memory, the first electronic device further performs: following the change of the moving track of the first screen saver content, controlling the corresponding smart device in the plurality of smart devices to perform an operation.

[0082] According to the fourth aspect, or any possible implementation mode of the fourth aspect, the plurality of smart devices are audio playing devices and / or light devices.

[0083] According to the fourth aspect, or any possible implementation mode of the fourth aspect, the first electronic device is a smart screen, and / or the second electronic device is a remote control device.

[0084] A fifth aspect provides a first electronic device. The first electronic device comprises a processor, a memory and a display screen. The memory and the display screen are coupled to the processor. The memory is configured to store computer program codes, and the computer program codes comprise computer instructions. When the processor reads the computer instructions from the memory, the first electronic device performs: acquiring a first pointing direction of a second electronic device. After determining that a first pointing intention according to the first pointing direction comprises selecting N smart devices in a plurality of smart devices, the first electronic device instructs the N smart devices to perform corresponding operations, where N is a positive integer greater than or equal to 2. The first electronic device and the plurality of smart devices form a smart control system.

[0085] According to the fifth aspect, instructing the N smart devices to perform corresponding operations comprises: instructing the N smart devices to synchronously perform corresponding operations; or instructing the N smart devices to perform corresponding operations in sequence according to a sequence of determining the N smart devices.

[0086] According to the fifth aspect, or any possible implementation mode of the fifth aspect, the first pointing intention is determined by a sequence of the N smart devices pointed by the first pointing direction in sequence.

[0087] According to the fifth aspect, or any possible implementation mode of the fifth aspect, when the processor reads the computer instructions from the memory, the first electronic device further performs: according to a sequence of directions of the smart devices pointed by the first pointing direction in sequence, instructing the N smart devices to perform corresponding operations in sequence.

[0088] According to the fifth aspect, or any implementation of the fifth aspect above, the time interval for the first electronic device to sequentially point to the N smart devices is related to the time interval for the N smart devices to sequentially perform corresponding operations.

[0089] According to the fifth aspect, or any of the above implementations of the fifth aspect, the N smart devices are either different or partially the same.

[0090] According to the fifth aspect, or any implementation of the fifth aspect above, when the processor reads computer instructions from memory, it also causes the first electronic device to perform: during the execution of corresponding operations by N intelligent devices, obtaining a second pointing direction of the second electronic device. When the second pointing intention determined according to the second pointing direction includes selecting M intelligent devices from a plurality of intelligent devices, the M intelligent devices are instructed to perform corresponding operations, where M is a positive integer greater than or equal to 1, and the M intelligent devices are not the same as, or partially the same as, the N intelligent devices.

[0091] According to the fifth aspect, or any implementation of the fifth aspect above, a first intelligent device exists near N intelligent devices. When the processor reads computer instructions from memory, it also causes the first electronic device to perform: instructing the first intelligent device to perform the corresponding operation when instructing the N intelligent devices to perform the corresponding operation.

[0092] According to the fifth aspect, or any implementation thereof, when the processor reads computer instructions from memory, it further causes the first electronic device to perform the following: acquire first information sent by N intelligent devices from a plurality of intelligent devices, wherein the first information is determined by the N intelligent devices based on a third pointing intention of the second electronic device to the N intelligent devices. Based on the first information, instruct the N intelligent devices to perform corresponding operations.

[0093] According to the fifth aspect, or any implementation thereof, when the processor reads computer instructions from memory, it further causes the first electronic device to perform the following: displaying a first interface showing multiple device identifiers, each corresponding to a multiple smart device; acquiring a fourth pointing intention from the second electronic device's display screen on the first electronic device; and, after determining that the fourth pointing intention includes selecting N device identifiers from the multiple device identifiers, instructing the N smart devices corresponding to the N device identifiers to perform corresponding operations.

[0094] According to a fifth aspect, or any possible implementation mode of the fifth aspect, when the processor reads the computer instructions from the memory, the first electronic device further performs: displaying a second interface, and the second interface displays the screen saver content. The first electronic device acquires a fifth pointing intention of the second electronic device on the display screen of the first electronic device. In a case where the fifth pointing intention is used to move a first screen saver content in the screen saver content, the first electronic device controls the first screen saver content to move on the second interface.

[0095] According to the fifth aspect, or any possible implementation mode of the fifth aspect, when the processor reads the computer instructions from the memory, the first electronic device further performs: following the change of the moving track of the first screen saver content, the first electronic device controls the corresponding smart device in the plurality of smart devices to perform the operation.

[0096] According to the fifth aspect, or any possible implementation mode of the fifth aspect, the plurality of smart devices are audio playing devices and / or light devices.

[0097] According to the fifth aspect, or any possible implementation mode of the fifth aspect, the first electronic device is a smart screen, and / or the second electronic device is a remote control device.

[0098] According to a sixth aspect, a first electronic device is provided. The first electronic device comprises a processor, a memory and a display screen. The memory and the display screen are coupled to the processor. The memory is configured to store computer program codes, and the computer program codes comprise computer instructions. When the processor reads the computer instructions from the memory, the first electronic device performs: acquiring first information respectively sent by N smart devices in a plurality of smart devices, the first information being determined by the N smart devices according to a first pointing intention of a second electronic device pointing to the N smart devices. According to the first information, the first electronic device instructs the N smart devices to perform corresponding operations, where N is a positive integer greater than or equal to 2. The first electronic device and the plurality of smart devices form a smart control system.

[0099] According to the sixth aspect, instructing the N smart devices to perform the corresponding operations comprises: instructing the N smart devices to synchronously perform the corresponding operations; or instructing the N smart devices to perform the corresponding operations in sequence according to the order of the N device identifiers.

[0100] According to the sixth aspect, or any possible implementation mode of the sixth aspect, when the processor reads the computer instructions from the memory, the first electronic device further performs: the first electronic device instructs the N smart devices to perform the corresponding operations in sequence according to the receiving order of the respective first information.

[0101] According to a sixth aspect, or any possible implementation mode of the sixth aspect, the first electronic device determines a time interval at which the second electronic device points to the N smart devices in turn, in relation to a time interval at which the N smart devices sequentially perform the corresponding operations.

[0102] According to the sixth aspect, or any possible implementation mode of the sixth aspect, when the processor reads the computer instructions from the memory, the first electronic device further performs: in the process of the N smart devices performing the corresponding operations, obtaining second information respectively sent by M smart devices of the plurality of smart devices, the second information being determined by the M smart devices according to a third pointing intention of the second electronic device pointing to the M smart devices. According to the third information, the M smart devices are instructed to perform the corresponding operations, M being a positive integer greater than or equal to 1, and the M smart devices being different from or partially the same as the N smart devices.

[0103] According to the sixth aspect, or any possible implementation mode of the sixth aspect, when the processor reads the computer instructions from the memory, the first electronic device further performs: in the case of instructing the N smart devices to perform the corresponding operations, instructing a first smart device in the vicinity of the N smart devices to perform the corresponding operations.

[0104] According to the sixth aspect, or any possible implementation mode of the sixth aspect, when the processor reads the computer instructions from the memory, the first electronic device further performs: obtaining a first pointing direction of the second electronic device. After determining that a fourth pointing intention according to the first pointing direction includes selecting the N smart devices of the plurality of smart devices, the N smart devices are instructed to perform the corresponding operations.

[0105] According to the sixth aspect, or any possible implementation mode of the sixth aspect, when the processor reads the computer instructions from the memory, the first electronic device further performs: displaying a first interface, the first interface displaying a plurality of device identifiers, the plurality of device identifiers respectively corresponding to the plurality of smart devices. Obtaining a fifth pointing intention of the second electronic device on the display screen of the first electronic device. After determining that the fifth pointing intention includes selecting N device identifiers of the plurality of device identifiers, the N device identifiers respectively corresponding to the N smart devices are instructed to perform the corresponding operations.

[0106] According to the sixth aspect, or any possible implementation mode of the sixth aspect, when the processor reads the computer instructions from the memory, the first electronic device further performs: displaying a second interface, the second interface displaying a screen saver content. Obtaining a sixth pointing intention of the second electronic device on the display screen of the first electronic device. In the case that the sixth pointing intention is used to move a first screen saver content in the screen saver content, the first screen saver content is controlled to move on the second interface.

[0107] According to a sixth aspect, or any possible implementation mode of the sixth aspect, when the processor reads the computer instructions from the memory, the first electronic device is further caused to perform: controlling the corresponding smart device in the plurality of smart devices to perform an operation following the change of the moving track of the first screen saver content.

[0108] According to a sixth aspect, or any possible implementation mode of the sixth aspect, the plurality of smart devices are audio playing devices and / or light devices.

[0109] According to a sixth aspect, or any possible implementation mode of the sixth aspect, the first electronic device is a smart screen, and / or the second electronic device is a remote control device.

[0110] According to a seventh aspect, there is provided an electronic device having the function of implementing the method according to the first aspect and any possible implementation mode of the first aspect; or having the function of implementing the method according to the second aspect and any possible implementation mode of the second aspect; or having the function of implementing the method according to the third aspect and any possible implementation mode of the third aspect. The function can be implemented by hardware, or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions.

[0111] According to an eighth aspect, there is provided a computer-readable storage medium. The computer-readable storage medium stores a computer program (also referred to as instructions or code), which, when executed by an electronic device, causes the electronic device to perform the method of the first aspect or any implementation mode of the first aspect; or causes the electronic device to perform the method of the second aspect or any implementation mode of the second aspect; or causes the electronic device to perform the method of the third aspect or any implementation mode of the third aspect.

[0112] According to a ninth aspect, there is provided a computer program product, which, when running on an electronic device, causes the electronic device to perform the method of the first aspect or any implementation mode of the first aspect; or causes the electronic device to perform the method of the second aspect or any implementation mode of the second aspect; or causes the electronic device to perform the method of the third aspect or any implementation mode of the third aspect.

[0113] According to a tenth aspect, there is provided a circuitry, which includes a processing circuitry configured to perform the method of the first aspect or any implementation mode of the first aspect; or configured to perform the method of the second aspect or any implementation mode of the second aspect; or configured to perform the method of the third aspect or any implementation mode of the third aspect.

[0114] In an eleventh aspect, a chip system is provided, including at least one processor and at least one interface circuit, the at least one interface circuit being configured to perform a transceiving function and send an instruction to the at least one processor, when the at least one processor executes the instruction, the at least one processor executes the method of the first aspect or any one of the implementations of the first aspect; or, when the at least one processor executes the instruction, the at least one processor executes the method of the second aspect or any one of the implementations of the second aspect; or, when the at least one processor executes the instruction, the at least one processor executes the method of the third aspect or any one of the implementations of the third aspect.

[0115] The technical effects of the foregoing aspects can be referred to each other, and will not be repeated here. BRIEF DESCRIPTION OF DRAWINGS

[0116] FIG. 1 is a schematic diagram of an interface according to an embodiment of the present application;

[0117] FIG. 2 is a schematic diagram of an interface according to an embodiment of the present application;

[0118] FIG. 3 is a schematic diagram of a communication system to which an interaction method is applied according to an embodiment of the present application;

[0119] FIG. 4 is a schematic diagram of a hardware structure of a first electronic device according to an embodiment of the present application;

[0120] FIG. 5 is a schematic diagram of an interface according to an embodiment of the present application;

[0121] FIG. 6 is a schematic diagram of a scenario of individually selecting one smart speaker according to an embodiment of the present application;

[0122] FIG. 7 is a schematic diagram of a scenario of selecting a smart speaker by circling according to an embodiment of the present application;

[0123] FIG. 8 is a schematic diagram of a scenario of selecting a smart speaker by connecting according to an embodiment of the present application;

[0124] FIG. 9 is a schematic diagram of an interaction scenario of a screensaver interface according to an embodiment of the present application;

[0125] FIG. 10 is a schematic diagram of an interaction method flow according to an embodiment of the present application;

[0126] FIG. 11 is a schematic diagram of an interaction method flow according to an embodiment of the present application;

[0127] FIG. 12 is a schematic diagram of an interaction method flow according to an embodiment of the present application;

[0128] FIG. 13 is a schematic diagram of a structure of a first electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0129] The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application. In the description of the embodiments of the present application, the terms used in the following embodiments are only for the purpose of describing the specific embodiments and are not intended to be limiting on the present application. As used in the specification and the appended claims of the present application, the singular forms “a,” “an,” and “the” are intended to include the plural forms, e.g., “one or more,” unless the context clearly indicates otherwise. It will also be understood that “at least one” and “one or more” refer to one or two or more (including two) in the following embodiments of the present application.

[0130] In the present specification, the phrase “one embodiment” or “some embodiments” etc. means that a particular feature, structure or characteristic described in connection with the embodiment is included in one or more embodiments of the present application. Thus, the phrases “in one embodiment,” “in some embodiments,” “in other some embodiments,” “in yet some embodiments,” etc. appearing in various places in the specification are not necessarily all referring to the same embodiment, but mean “one or more but not all embodiments” unless otherwise specifically stated. The terms “comprising,” “including,” “having” and their conjugates mean “including but not limited to,” unless otherwise specifically stated. The term “connected” includes both direct and indirect connections unless otherwise specifically stated. “First,” “second,” etc. are used only for descriptive purposes and cannot be construed as indicating or implying relative importance or an indicated number of technical features.

[0131] In the embodiments of the present application, the words “exemplary” or “for example” are used to mean serving as an example, instance, or illustration. Any embodiment or design presented as “exemplary” or “for example” in the embodiments of the present application is not necessarily to be construed as preferred or advantageous over other embodiments or designs. Rather, use of the words “exemplary” or “for example” is intended to present concepts in a concrete manner.

[0132] In some embodiments, the devices in the smart home system need to be configured and commissioned by the installation and maintenance engineers before being delivered to the users for use, which is the pre-installation process of the smart home system. In the pre-installation process, the installation and maintenance engineers log in to the configuration application (such as the “Smart Home App”) through an electronic device (such as a mobile phone), and then complete the configuration and commissioning of the smart home devices in the smart home system through the configuration application in the electronic device. Optionally, the configuration and commissioning process of the smart home devices includes networking the smart home devices and configuring the networked smart home devices.

[0133] ​Optionally, the networking mode includes, for example, wireless fidelity (Wi-Fi) networking, power line communication (PLC), etc.

[0134] For example, the plurality of smart sound boxes in the smart home system can be networked to form a home theater. It should be understood that the smart screen can also be included in the home theater. For example, the smart screen can play audio through the plurality of ceiling sound boxes networked with the smart screen, thereby providing a sky sound playing effect for the user.

[0135] In some examples, during the front-end installation of the smart home devices in the home theater, the installation and maintenance engineer can add the smart home devices in the home theater through the electronic device, and configure, debug, etc. the smart home devices, so as to facilitate subsequent use by the user. For example, the installation and maintenance engineer can configure the names, positions, etc. of the plurality of smart sound boxes, and can also test the sound of the plurality of smart sound boxes to determine that the smart sound boxes are connected normally and can play audio. The application adds the smart home devices in the home theater, and configures, debugs, etc. the smart home devices, so as to facilitate subsequent use by the user. For example, the installation and maintenance engineer can configure the names, positions, etc. of the plurality of smart sound boxes, and can also test the sound of the plurality of smart sound boxes to determine that the smart sound boxes are connected normally and can play audio.

[0136] For example, as shown in (a) of FIG. 1, the electronic device displays an application interface for configuring the music host. The application interface is used for configuring the music host. The electronic device can add the four ceiling sound boxes in the living room as the music host according to the user operation. In the current interface, the installation and maintenance engineer can test the sound of each ceiling sound box individually. For example, the interface displays four device cards corresponding to the four ceiling sound boxes respectively. The electronic device detects the operation of the installation and maintenance engineer on the play control 11 on the device card corresponding to the ceiling sound box 2, and sends a sound test instruction to the ceiling sound box 2. Accordingly, the ceiling sound box 2 plays the preset sound test audio after receiving the sound test instruction sent by the electronic device. In this way, the installation and maintenance engineer can determine the installation of the ceiling sound box 2 according to the sound test effect. For example, as shown in (b) of FIG. 1, the electronic device displays a home theater sound box position setting interface in the application. In the interface, the electronic device can set the position information of the four ceiling sound boxes added according to the user operation. The position information is the same as the actual position of the ceiling sound box in the living room. In this way, the installation and maintenance engineer can intuitively test the sound, deploy, etc. of each ceiling sound box. As shown in the prompt information 12 displayed on the interface, the smart sound boxes in the home theater need to be set simultaneously or not to be set. For example, in the current scenario, the four ceiling sound boxes do not play audio during the subsequent use of the home theater by the user. Alternatively, the smart screen triggers the four ceiling sound boxes to play audio simultaneously according to the user operation.

[0137] For example, as shown in (b) of FIG. 1, the electronic device displays a home theater sound box position setting interface in the application. In the interface, the electronic device can set the position information of the four ceiling sound boxes added according to the user operation. The position information is the same as the actual position of the ceiling sound box in the living room. In this way, the installation and maintenance engineer can intuitively test the sound, deploy, etc. of each ceiling sound box. As shown in the prompt information 12 displayed on the interface, the smart sound boxes in the home theater need to be set simultaneously or not to be set. For example, in the current scenario, the four ceiling sound boxes do not play audio during the subsequent use of the home theater by the user. Alternatively, the smart screen triggers the four ceiling sound boxes to play audio simultaneously according to the user operation.

[0138] ​In some embodiments, in the user use stage after the home theater completes the front-end process, the smart screen and the plurality of smart sound boxes (such as the 4 ceiling sound boxes described above) can be automatically connected and establish a networking relationship according to the user operation after being started. For example, the smart screen can display an interface as shown in FIG. 2, which can display prompt information to prompt the user that the whole-house music system of the current living room is connected successfully, the whole-house music system including the aforementioned smart screen and the plurality of smart sound boxes. For example, the home theater includes the whole-house music system.

[0139] Exemplarily, after the whole-house music system is connected successfully, the smart screen can play audio through the plurality of smart sound boxes connected currently in response to the user operation of indicating to play audio.

[0140] For example, in the interface as shown in FIG. 2, the smart screen intelligently provides the user with a simple networking display, such as the user can know the smart home devices included in the whole-house music system. However, in the user use stage, the smart screen triggers the plurality of smart sound boxes to play audio according to the audio playing indication. That is, the user cannot individually instruct a certain sound box or a certain number of sound boxes to play audio. In this way, the user's interaction with the devices in the whole-house music system is poor during the audio playing process. For example, in the scenario of the living room including 4 ceiling sound boxes in the aforementioned example, the user cannot individually select a certain ceiling sound box to play a test sound; and the user cannot select only 2 or 3 ceiling sound boxes to play audio during the audio playing process.

[0141] Therefore, the present application provides an interaction method, which can realize individual control of the controlled devices (such as smart sound boxes) and thus improve the user's interaction experience.

[0142] Optionally, FIG. 3 is a schematic diagram of a communication system to which the interaction method provided by the embodiments of the present application is applied. As shown in FIG. 3, the communication system includes a first electronic device 100, a second electronic device 200 and a third electronic device 300.

[0143] Optionally, the first electronic device 100 can be, for example, a smart screen, a spliced screen device, a tablet computer, a mobile phone, a notebook computer, an ultra-mobile personal computer (UMPC), a personal digital assistant (PDA), an artificial intelligence (AI) device, etc., which are terminal devices with display capability, and the operating system installed in the first electronic device 100 includes but is not limited to or other operating systems. The present application does not limit the specific type of the first electronic device 100 and the operating system installed therein.

[0144] Optionally, the second electronic device 200 can be a terminal device with a pointing remote control function, such as a remote control device (for example, a remote control with a pointing device, a remote control handle, etc.), a wearable device, a mobile phone, an AI device, and the like. The operating system installed on the second electronic device 200 includes, but is not limited to or other operating systems, or the second electronic device 200 can not be installed with an operating system. The specific type of the second electronic device 200, whether or not to install an operating system, and the operating system installed in the case of installing an operating system are not limited in the present application.

[0145] In some embodiments, a wireless communication connection is established between the first electronic device 100 and the second electronic device 200. The wireless communication technology for establishing the wireless communication connection includes, but is not limited to, at least one of the following: ultra wide band (UWB), Bluetooth (BT) (for example, traditional Bluetooth or Bluetooth low energy (BLE)), wireless local area networks (WLAN) (for example, a wireless fidelity (Wi-Fi) network), near field communication (NFC), Zigbee, frequency modulation (FM), infrared (IR), and the like.

[0146] Optionally, the first electronic device 100 and the second electronic device 200 can also establish a communication connection through a third-party device in a local area network, such as a router, a gateway, a smart device controller, a server, and the like.

[0147] In other embodiments, a wired communication connection can also be established between the first electronic device 100 and the second electronic device 200. For example, the first electronic device 100 and the second electronic device 200 are connected through a universal serial bus (USB) interface, and the like.

[0148] Optionally, the third electronic device 300 can be a terminal device, such as a smart speaker, a smart lamp, an artificial intelligence (AI) device, and the like. The specific type of the third electronic device 300 is not limited in the present application.

[0149] In some embodiments, the first electronic device 100 and the plurality of third electronic devices 300 establish a wireless communication connection based on the wireless communication technology described in the above examples. Alternatively, the first electronic device 100 and the plurality of third electronic devices 300 can also establish a wired communication connection, for example, the first electronic device 100 and the plurality of third electronic devices 300 establish a PLC connection.

[0150] In some embodiments, the first electronic device 100 and the plurality of third electronic devices 300 form a home theater. Alternatively, the first electronic device 100 is a display device, and the third electronic device 300 is an audio device, thereby providing a good audio-visual experience for the user. Alternatively, the third electronic device 300 can include an audio device and a light and shadow device (such as a smart lamp), which can also provide a light and shadow experience for the user in cooperation with the audio-visual experience.

[0151] Alternatively, the first electronic device 100, the second electronic device 200, and the third electronic device 300 in the embodiments of the present application can be implemented by different devices, and the different devices can have the same, similar, or certain different hardware structures, such as the hardware structure shown in FIG. 4.

[0152] For example, taking the first electronic device 100 having the hardware structure shown in FIG. 4 as an example, the hardware structure shown in FIG. 4 is described.

[0153] As shown in FIG. 4, the first electronic device 100 can include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a sensor module 180, a key 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, and the like.

[0154] It can be understood that the structure shown in the embodiments of the present application does not constitute a specific limitation on the first electronic device 100. In other embodiments of the present application, the first electronic device 100 can include more or fewer components than shown, or combine certain components, or split certain components, or different component arrangements. The components shown can be implemented in hardware, software, or a combination of software and hardware.

[0155] The processor 110 can include one or more processing units, for example: the processor 110 can include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units can be independent devices or integrated in one or more processors.

[0156] The controller can generate operation control signals according to the instruction operation code and the timing signal, and complete the control of fetching and executing instructions.

[0157] The processor 110 can also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory can save instructions or data that have just been used or are used repeatedly by the processor 110. If the processor 110 needs to use the instructions or data again, it can directly call from the memory. This avoids repeated access and reduces the waiting time of the processor 110, thereby improving the efficiency of the system.

[0158] In some embodiments, the processor 110 can include one or more interfaces. The interfaces can include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0159] The MIPI interface can be used to connect the processor 110 and the display screen 194, the camera 193 and other peripheral devices. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), and the like. In some embodiments, the processor 110 and the camera 193 communicate through the CSI interface to implement the photographing function of the first electronic device 100. The processor 110 and the display screen 194 communicate through the DSI interface to implement the display function of the first electronic device 100.

[0160] The mobile communication module 150 can provide a solution for wireless communication including 2G / 3G / 4G / 5G and the like applied to the first electronic device 100. The mobile communication module 150 can include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), and the like. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and perform filtering, amplification, and the like on the received electromagnetic waves, and transmit the processed signals to the modem processor for demodulation. The mobile communication module 150 can also amplify signals modulated by the modem processor, and radiate the signals as electromagnetic waves through the antenna 1. In some embodiments, at least part of the functional modules of the mobile communication module 150 can be disposed in the processor 110. In some embodiments, at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 can be disposed in the same device.

[0161] The wireless communication module 160 can provide a solution for wireless communication including wireless local area networks (WLAN) (such as a wireless fidelity (Wi-Fi) network), Bluetooth (BT), a global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared technology (IR), and the like, applied to the first electronic device 100. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering processing on the electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 can also receive signals to be transmitted from the processor 110, perform frequency modulation and amplification on the signals, and radiate the signals as electromagnetic waves through the antenna 2.

[0162] The first electronic device 100 implements a display function through a GPU, a display screen 194, and an application processor, etc. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 can include one or more GPUs that execute program instructions to generate or change display information.

[0163] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be manufactured by using a liquid crystal display (LCD), such as an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flex light-emitting diode (FLED), a Mini-led, a Micro-led, a Micro-oled, a quantum dot light emitting diode (QLED), etc. In some embodiments, the first electronic device 100 can include 1 or N display screens 194, and N is a positive integer greater than 1.

[0164] Hereinafter, the first electronic device 100 is taken as a smart screen, the second electronic device 200 is taken as a remote control device, and the third electronic device 300 is taken as a smart speaker and / or a smart lamp, as examples, to describe the interaction method provided by the embodiments of the present application in detail.

[0165] In some embodiments, the whole-house music system includes a smart screen and a plurality of smart speakers. The smart screen is used to display pictures, and the smart speaker is used to play corresponding audio.

[0166] Optionally, in the process of adding the smart screen and the smart speaker to the smart home system (such as the front installation process), the smart screen and the smart speaker can be added to the same group to establish the whole-house music system. Alternatively, the smart home system includes the smart screen and the smart speaker, and subsequently in the process of using the devices, the central control device in the smart home system can create the whole-house music system according to user operations, and add the smart screen and the smart speaker selected by the user to the whole-house music system.

[0167] Optionally, in the process of adding the smart speaker to the smart home system, the user can configure the position information of the smart speaker, and the position information indicates the real spatial position of the smart speaker in the room. Optionally, in the process of configuring the whole-house music system, the smart screen can obtain the position information of the smart speaker.

[0168] In some embodiments, after the whole-house music system is configured, the smart screen and the smart speaker can automatically establish a communication connection in response to a user operation after being started. Optionally, after the smart screen establishes a communication connection with the smart speaker, the smart screen can display a corresponding interface to prompt the user that the whole-house music system is connected successfully, and the interface can also display the smart home devices included in the whole-house music system and the positional relationship of each smart home device through icons and other means.

[0169] For example, as shown in FIG. 5, the whole-house music system is applied to a living room and includes one smart screen and four smart speakers. Optionally, the smart speakers are ceiling speakers installed at four positions on the ceiling of the living room. For example, the smart screen is generally placed at a fixed position in the room, and the positions of the smart speakers can be set based on the position of the smart screen, so as to facilitate the user to understand. For example, based on the position of the smart screen, the four smart speakers are located at the left front, left rear, right front, and right rear positions on the ceiling of the living room. Then, in response to the user starting the operation of the smart screen and the smart speaker, or in response to the user starting the operation of the whole-house music system, the smart screen and the smart speaker establish a communication connection. As shown in FIG. 5, after the connection is successfully established, the smart screen can display a corresponding interface and display prompt information 51 on the interface to prompt the user that the whole-house music system in the current living room is connected successfully. Optionally, as shown in FIG. 5, the interface can also display a smart screen icon 501 corresponding to the smart screen, and smart speaker icons 502, 503, 504, and 505 corresponding to the four smart speakers, respectively. In this way, through the display of icons, the user can intuitively understand which smart home devices are included in the current whole-house music system and the positional relationship of the smart home devices.

[0170] In some embodiments, the smart screen and the remote control device are respectively installed with a wireless positioning module, which can be used to send and / or receive positioning signals to determine the pointing direction of the remote control device. For example, in order to realize that the user controls the smart home device corresponding to the icon displayed by the smart screen through the remote control device, the smart screen needs to determine which icon the remote control device points to. Then, in response to a user operation, the remote control device can send a positioning signal to the smart screen through the wireless positioning module. Correspondingly, the smart screen can receive the positioning signal to determine which position of the display screen the remote control device points to, and thus determine the display content (such as an icon) corresponding to the position.

[0171] Optionally, the positioning signal is, for example, an optical signal. The wireless positioning module in the remote control device can adjust the transmitted optical signal in terms of frequency adjustment, amplitude modulation, etc. In this way, the wireless positioning module in the smart screen can obtain the instruction content of the current optical signal, such as point selection, circle selection, continuous selection, etc., through signal feature analysis after receiving the optical signal.

[0172] In some embodiments, the smart screen receives an indication signal transmitted by the remote control device during the display of the whole-house music system interface, which is, for example, the positioning signal described above. The smart screen can determine the icon pointed to by the remote control device and the instruction content corresponding to the indication signal according to the indication signal.

[0173] In some embodiments, the smart screen determines that the indication signal transmitted by the remote control device points to a certain smart speaker icon currently displayed according to the indication signal continuously received, and the instruction content is point selection of the certain smart speaker icon. Then, the smart screen can trigger the smart speaker corresponding to the smart speaker icon to play audio, thereby realizing the individual control of a single smart speaker in the whole-house music system, such as individual sound testing, etc.

[0174] For example, as shown in FIG. 6, the smart screen receives an indication signal transmitted by the remote control device and determines that the indication signal points to the smart speaker icon 502. Then, the smart screen can determine that the user instructs the smart speaker corresponding to the smart speaker icon 502 to sound test. Then, the smart screen can send an audio playing instruction to the smart speaker, thereby triggering the smart speaker to play audio. Optionally, the audio is, for example, a sound test audio, such as an audio prompting the sound channel corresponding to the smart speaker or a short audio generated by AI, etc.

[0175] In this way, the user can realize the individual control of a certain smart speaker through the remote control device, thereby enhancing the interactive experience of the user. In this way, the problem that the user cannot individually control the sound test of a certain smart speaker in the use process of the whole-house music system is solved.

[0176] For another example, the smart screen can display an identifier corresponding to the pointing of the smart remote control to help the user understand the position of the smart speaker currently selected. Optionally, as shown in FIG. 6, the user holds the remote control device and points to the smart speaker icon 502 corresponding to the smart speaker to be controlled and clicks the corresponding key (or touch area), thereby triggering the remote control device to send an indication signal to the smart screen. Correspondingly, the smart screen displays an identifier 61 on the smart speaker icon 502, thereby facilitating the user to determine the smart speaker currently selected. It should be understood that the user long-presses the key, the remote control device sends continuous indication signals to the smart screen, and the smart screen can display a moving identifier according to the change of the pointing of the remote control device, thereby facilitating the user to determine the smart speaker to be finally controlled.

[0177] In some examples, the smart home system can further include smart lights, and the smart screen can establish a communication connection with the smart lights and trigger the smart lights to turn on or off. Alternatively, the smart screen can instruct the smart lights near the smart speaker to start during the process of triggering the smart speaker to play audio. In this way, not only can the user be provided with an audio experience, but also a corresponding light and shadow experience. Alternatively, the home theater includes a whole-house music system and smart lights.

[0178] For example, four ceiling speakers are installed at the four corners of the living room, and corresponding ceiling lights are also installed near the four ceiling speakers. Then, as shown in the scenario of FIG. 6, the smart screen sends a start instruction to the ceiling light located at the left rear during the process of sending an audio playing instruction to the smart speaker located at the left rear corresponding to the smart speaker icon 502 in response to the received indication signal. Thus, the ceiling light located at the left rear starts during the process of the smart speaker located at the left rear playing audio, and light prompting is achieved.

[0179] In the subsequent embodiments, “left”, “right”, “front”, and “rear” are all with reference to the orientation shown in FIG. 6, and will not be described in detail hereinafter.

[0180] In some embodiments, the smart screen can obtain the actual orientation of the smart speaker in the space. Then, in some example scenarios, the remote control device points to a certain orientation in the space, and the smart screen can receive the indication signal. Then, the smart screen can determine the orientation pointed to by the indication signal. Then, the smart screen can determine at least one smart speaker pointed to by the current remote control device according to the positions of the plurality of smart speakers that have established a communication connection in the space. Subsequently, the smart screen can send an audio playing instruction to the at least one smart speaker to trigger the at least one smart speaker located at the orientation pointed to by the current remote control device to play audio, such as playing a test tone.

[0181] Alternatively, the smart screen can also obtain the position information of the smart light that has established a communication connection. Then, the smart screen can further obtain at least one smart light pointed to by the current remote control device according to the position information of the smart light. Then, the smart screen can further send a start instruction to the at least one smart light to trigger the at least one smart light to start, thereby achieving corresponding light prompting.

[0182] In this way, the user can point to the device icon displayed on the smart screen by the remote control device, or directly point to the actual orientation of the device in the space, and the corresponding device can be triggered by the smart screen to start, thereby effectively improving the user's interactive experience.

[0183] In some examples, a positioning module can also be installed in the smart sound box. Then, when the remote control device sends an indication signal to the smart sound box in the space, the corresponding smart sound box can also receive the indication signal and locate the remote control device. Then, the smart sound box can send information to the smart screen, which is used to indicate that the remote control device is currently pointing to the smart sound box. Correspondingly, after receiving the information, the smart screen can obtain the user's intention to instruct the smart sound box to play audio, and then the smart screen can send an instruction to the smart sound box to trigger the smart sound box to play audio.

[0184] In some embodiments, the smart screen can connect the pointing positions of the indication signals successively received by the remote control device on the display screen as an ellipse (or a circle). Then, the smart screen can determine that the instruction content is to select a plurality of smart sound box icons in the inner circle of the ellipse. Then, the smart screen can trigger the plurality of smart sound boxes corresponding to the plurality of smart sound box icons to play audio, so as to realize the flexible control of different smart sound boxes in the whole-house music system. For example, the whole-house music system includes 4 smart sound boxes, and the smart screen determines that the user selects 2 smart sound boxes through the remote control device. Subsequently, during the audio playing process, the smart screen only plays audio through the 2 smart sound boxes selected by the user, and no longer plays audio through the remaining smart sound boxes not selected by the user.

[0185] For example, the smart screen receives a plurality of indication signals successively sent by the remote control device, and according to the changes of the display positions of the identifiers corresponding to the indication signals on the display screen, the smart screen can obtain the smart sound boxes that need to be selected by the user.

[0186] Optionally, when the remote control device detects that the user performs a long-press operation on the key, the remote control device can successively send indication signals until the user stops pressing the key, and the remote control device can stop sending the indication signals.

[0187] Optionally, the smart screen can be preconfigured with selection rules, and different selection rules can correspond to audio playing instructions. For example, in the point selection scenario of the above example, when the user individually points to a smart sound box icon through the remote control device, the smart screen can trigger the sound test of the smart sound box corresponding to the smart sound box icon pointed to by the user according to the point selection rule in the selection rule. For another example, in the circle selection scenario of the current example, when the user circles at least one smart sound box icon through the remote control device, the smart screen can trigger at least one smart sound box corresponding to the at least one smart sound box icon circled by the user to play audio during the subsequent audio playing process according to the circle selection rule in the selection rule. In this way, the user can realize more flexible control of the smart sound box through different selection methods, and the flexibility of the interaction between the user and the smart screen is also increased.

[0188] Optionally, the smart screen receives an operation of selecting the smart speaker icon by the user through the remote control device. Then, within a preset time A, the smart screen does not receive an operation of selecting the smart speaker icon by the user again, it is determined that the user completes the selection of the smart speaker, and at least one smart speaker corresponding to the smart speaker icon selected by the user is obtained. During this period, the user can select to directly select all the required smart speaker icons through the remote control device, or can select to separately select the required smart speaker icons through the remote control device. For example, in the above example scenario, during the process in which the smart screen displays the smart speaker icons corresponding to the four smart speakers included in the living room, it is detected that the user selects three smart speaker icons through the remote control device within the preset time A after the operation of selecting the three smart speaker icons at a time, and the smart screen does not receive an operation of continuing to select through the remote control device, and three smart speakers corresponding to the three smart speaker icons are obtained. For another example, during the process in which the smart screen displays the smart speaker icons corresponding to the four smart speakers included in the living room, it is detected that the user selects two smart speaker icons through the remote control device, and then it is detected that the user selects a smart speaker icon in the remaining two smart speaker icons through the remote control device within the preset time A. Then, within the preset time A, the smart screen does not receive an operation of continuing to select through the remote control device, and three smart speakers corresponding to the three smart speaker icons are obtained.

[0189] For example, as shown in FIG. 7, after the smart screen receives the continuously transmitted indication signals of the remote control device, the smart screen can display an elliptical mark 71 corresponding to the continuously transmitted indication signals. The elliptical mark 71 is composed of marks corresponding to the received indication signals. It should be understood that the smart screen can also not display the elliptical mark 71. Then, the smart screen can obtain the smart speaker mark 502 and the smart speaker mark 505 located in the elliptical mark 71, and determine that the smart speaker selected by the user includes the left rear smart speaker corresponding to the smart speaker mark 502 and the right rear smart speaker corresponding to the smart speaker mark 505. Then, the smart screen detects an operation of indicating the user to play audio, and sends an audio playing instruction to the left rear smart speaker and the right rear smart speaker to trigger the two smart speakers to play audio, and the other two smart speakers do not play audio. For example, the smart screen plays a video according to the user operation, and triggers the left rear smart speaker and the right rear smart speaker to play audio corresponding to the video during the video playing process.

[0190] Optionally, the smart screen determines the multiple smart speaker marks selected by the user according to the indication signals transmitted by the remote control device, and instructs the multiple smart speakers corresponding to the multiple smart speaker marks to play synchronously. Optionally, the synchronous playing means that the multiple smart speakers play the audio to be played in cooperation, such as audio track cooperation, playing time cooperation, etc.

[0191] Optionally, in the case that there are other smart devices, such as smart lights, near the user-selected smart speaker, the smart screen can also trigger the smart light near the smart speaker to perform corresponding operations, such as starting, in the process of triggering the user-selected smart speaker to perform audio playback.

[0192] In this way, the user's flexible selection of audio playback devices in the whole-house music system is met. In this way, the problem that only all smart speakers can be used for audio playback and the playback mode is single in the use process of the whole-house music system is solved.

[0193] In some embodiments, the smart screen determines that the pointing positions of the indication signals successively received by the remote control device on the display screen change on the plurality of smart speaker icons. For example, the user successively selects a plurality of smart speaker icons through the indication signals sent by the remote control device. Then, the smart screen can determine that the instruction content is the successive selection of the plurality of smart speaker icons. Then, the smart screen can trigger the plurality of smart speakers corresponding to the plurality of smart speaker icons respectively to perform audio playback in the selection order, such as playing a trial sound audio. Optionally, the plurality of smart speaker icons successively selected by the user can be repeated or not repeated.

[0194] Optionally, in the case that the user successively selects a plurality of smart speaker icons through the remote control device, the smart screen can trigger the plurality of smart speakers corresponding to the plurality of smart speaker icons successively selected by the user through the remote control device to play trial sound audios in the selection order according to the successive selection rule in the selection rule.

[0195] Exemplarily, as shown in FIG. 8, in the process that the smart screen displays the smart speaker icons corresponding to the four smart speakers included in the living room respectively, it is detected that the user successively selects the smart speaker icon 502, the smart speaker icon 504, the smart speaker icon 505, and the smart speaker icon 503 through the remote control device in the connection order of 1-2-3-4 shown in the interface. Then, the smart screen can determine that the user completes the connection selection of all smart speakers after not receiving the indication signal again for more than a preset time B, obtain the four smart speakers successively selected by the user and the selection order, and trigger the four smart speakers to play trial sound audios in the selection order.

[0196] Exemplarily, the user selects the smart speaker icons 502, 504, 505, 503 in sequence through the remote control device, and does not stop selecting the smart speaker icons. For example, the smart screen continues to detect the continuous indication signals within the preset time B, and obtains that the user continues to select the smart speaker icon 502. Then, the smart screen determines that the user completes the selection of all the smart speakers after not receiving the indication signals for more than the preset time B, and obtains that the left rear smart speaker corresponding to the smart speaker icon 502, the right front smart speaker corresponding to the smart speaker icon 504, the right rear smart speaker corresponding to the smart speaker icon 505, the left front smart speaker corresponding to the smart speaker icon 503, and the left rear smart speaker corresponding to the smart speaker icon 502 are selected by the user in sequence through the remote control device. Then, the smart screen triggers the smart speakers to play the test sound (such as a prompt sound) in sequence according to the selection order of the user.

[0197] In this way, the smart screen can trigger the smart speakers selected by the user to play the prompt sound in sequence according to the user's intention, and avoid the problem that the prompt sound is always played in a fixed manner or in a fixed order. Compared with the above example in which the user selects a smart speaker for test sound playing, the user can select multiple smart speakers for test sound playing through the remote control device in the current selection scenario, so that the test sound playing process is more smooth.

[0198] In some examples, after obtaining the multiple smart speakers selected by the user in sequence, the smart screen can also obtain the smart lights near the smart speakers. Then, the smart screen can also trigger the smart lights near the smart speakers to start in sequence when triggering the multiple smart speakers to play the prompt sound in sequence.

[0199] In this way, during the test sound playing process, the smart lights near the smart speakers start when the smart speakers play the prompt sound, so that the user can quickly determine the positions of the smart speakers in the actual space according to the prompt sound and the positions of the smart lights, and the user experience is improved.

[0200] In some examples, the smart screen can trigger the smart speakers to play the audio in sequence according to the selection order after the user finishes selecting the plurality of smart speaker icons in succession. Alternatively, the smart screen can trigger the smart speakers to play the audio in sequence according to the selection order of the smart speaker icons that the user has selected during the process of selecting the plurality of smart speaker icons in succession. Alternatively, the smart screen can trigger the smart speakers to play the audio in sequence according to the selection order after the user finishes selecting the plurality of smart speaker icons in succession. During the process of playing the audio by the smart speakers, the smart screen can also display the interfaces corresponding to the four smart speaker icons included in the living room, and receive the indication signal sent by the remote control device to determine the one or more smart speaker icons newly selected by the user, so as to instruct the smart speakers corresponding to the one or more smart speaker icons newly selected by the user to play the audio after the smart speakers selected by the user before play the audio. The smart speakers newly selected by the user and the smart speakers selected by the user before can be the same or different. Alternatively, the smart screen can directly instruct the smart speakers selected by the user before to stop playing the audio, so as to switch to the smart speakers newly selected by the user to play the audio.

[0201] In this way, the user is provided with a more flexible sound test experience.

[0202] In some examples, the user can select the plurality of smart speaker icons through the remote control device at different speeds, such as a fast connection speed or a slow connection speed. Then, the smart screen can adjust the speed of triggering the smart speakers to play the audio according to the connection speed. For example, if the connection speed is fast, the smart screen can shorten the time interval of playing the test audio between different smart speakers selected by the user through the remote control device. For another example, if the connection speed is slow, the smart screen can increase the time interval of playing the test audio between different smart speakers selected by the user through the remote control device.

[0203] Alternatively, the user can also change the connection speed during the process of selecting the plurality of smart speaker icons in succession through the remote control device. Then, the smart screen can also flexibly adjust the test audio time interval of the smart speakers corresponding to the two smart speaker icons according to the connection speed between the two smart speaker icons selected by the user through the remote control device.

[0204] In this way, the smart screen can flexibly adjust the test audio rhythm according to the connection speed of the user through the remote control device, and improve the user's interactive experience.

[0205] In some embodiments, the smart screen can display a screen saver interface when the user does not operate the smart screen for a long time. Alternatively, the smart screen can also switch to display the screen saver interface according to the user's operation.

[0206] Optionally, the smart screen can receive an indication signal sent by the remote control device, the indication signal being directed to the preset display content in the screen saver interface. Then, the smart screen can determine that the user indicates to trigger the operation of the preset display content.

[0207] For example, as shown in FIG. 9, the smart screen receives an indication signal sent by the remote control device in the process of displaying the screen saver interface, and determines that the indication signal is directed to the preset display content 91, and determines that the user indicates to trigger the operation of the preset display content 91. Then, the smart screen continuously receives the indication signal, and the direction of the continuous indication signal moves to the right. Then, the smart screen can move the display of the preset display content 91 to the right according to the direction shown by the dashed arrow 92. In this way, the preset display content 91 can move the display position to the right with the user moving the direction of the remote control device to the right, so as to realize the interaction between the preset display content 91 and the user.

[0208] In this way, the smart screen can also realize flexible interaction with the user in the process of displaying the screen saver interface.

[0209] In some examples, the above interaction process includes, for example, indicating that the preset display content moves arbitrarily on the screen saver interface, and is not limited to the straight line motion of the above examples.

[0210] In some examples, in the interaction process of the preset display content in the screen saver interface, the smart screen can also trigger the corresponding smart speaker to play audio, so as to realize the linkage of picture and sound, and further improve the user experience. Optionally, the audio played by the smart speaker can change with the change of the preset display content, that is, to realize the linkage effect that the audio changes with the change of the display effect. Alternatively, the playing of the smart speaker can be separated from the change of the preset display content, such as being executed in sequence.

[0211] Optionally, the audio played by the smart screen to instruct the smart speaker can also have relevance with the preset display content or the display content near the preset display content. For example, the preset display content is a yellow duck, and then the audio played by the smart screen to instruct the smart speaker can be the sound of the yellow duck. For another example, the screen saver interface includes a yellow duck in a swimming pool. Then, as the user moves the yellow duck in the swimming pool, the smart screen can also instruct the smart speaker to play the sound of the yellow duck and the sound of the water flow. In this way, the user's interaction experience can be improved through flexible audio playing.

[0212] Optionally, in the process of moving the display of the preset display content 91 and the corresponding audio playing of the smart speaker, the smart screen can also control the smart lamp near the smart speaker playing the audio to start and adjust the brightness. In this way, a more immersive interaction experience can be provided for the user.

[0213] Exemplarily, as shown in the scenario of FIG. 9, the smart screen can also adjust the audio playing order and volume size of the left front smart sound box, the left rear smart sound box, the right front smart sound box, and the right rear smart sound box in the process of moving to the right to display the preset display content 91. In this way, the user is provided with an experience of audio playing from left to right and the surround stereo sound changing from large left volume to large right volume in the process of the preset display content 91 moving from left to right.

[0214] In this way, the playability of the screen saver interface is increased, and the user's interactive experience is improved.

[0215] In some embodiments, the above-mentioned interaction method provided by the embodiments of the present application is introduced by taking the example of controlling the smart sound box through the interaction between the remote control device and the smart screen. It should be understood that the interaction method provided by the embodiments of the present application can also be applied to the scenario of controlling other smart devices through the interaction between the remote control device (such as the second electronic device) and the smart screen (such as the first electronic device). For example, the smart device can be a smart lamp. After the multiple smart lamps are networked, the smart screen can obtain the information of the smart lamp, and after the smart screen establishes a connection with the smart lamp, a corresponding interface, such as a whole-house smart control interface, can be displayed. The device identifiers corresponding to each smart lamp can be displayed on the interface. Then, in combination with the method described in each of the above embodiments, the smart screen can instruct the corresponding smart lamp to operate, such as starting, starting according to a preset brightness parameter, and the like, in response to the pointing intention of the user to the device identifier through the remote control device. The implementation process of the above-mentioned scenario in each of the embodiments for different forms of smart devices is not exemplified one by one.

[0216] FIG. 10 is a flowchart of an interaction method provided by an embodiment of the present application. It should be noted that the method is not limited to the specific order described in FIG. 10 and the following. It should be understood that in other embodiments, the order of some steps of the method can be exchanged with each other according to actual needs, or some steps of the method can be omitted or deleted. The method includes the following steps:

[0217] S1001, the first electronic device displays a first interface, and the first interface displays a plurality of device identifiers, and the plurality of device identifiers correspond to a plurality of smart devices.

[0218] In some embodiments, the first electronic device and the plurality of smart devices form a smart control system. The smart control system can include at least one type of device, such as a display device, an audio playing device, a light device, and the like, which establishes a communication connection.

[0219] Optionally, the first electronic device is, for example, a smart screen, and the smart device is, for example, at least one type of device, such as a smart sound box, a smart lamp, a smart screen, and the like.

[0220] In some examples, the first electronic device and the plurality of smart devices can also constitute a multimedia control system. For example, the first electronic device is a smart screen, and the plurality of smart devices include an audio playing device.

[0221] In some examples, after the smart control system is configured, the first electronic device and the plurality of smart devices are started, and the communication connection is automatically established. Then, the first electronic device can display a corresponding first interface to prompt the user that the smart control system is successfully connected, and the first interface can also display the devices included in the smart control system and the positional relationship of the devices by icons and the like.

[0222] For example, as shown in FIG. 5, the smart control system is a whole-house music system in a living room, which includes a smart screen (e.g., the first electronic device) and four smart speakers (e.g., the smart devices). After the connection of the devices in the whole-house music system is successfully established, the smart screen can display a corresponding interface (e.g., the first interface) and display prompt information 51 on the interface to prompt the user that the whole-house music system in the living room is successfully connected. Optionally, as shown in FIG. 5, the interface can also display a smart screen icon 501 corresponding to the smart screen, and smart speaker icons 502, 503, 504, and 505 corresponding to the four smart speakers, respectively. In this way, the user can intuitively understand which smart home devices are included in the current whole-house music system and the positional relationship of the smart home devices by displaying the icons.

[0223] S1002, the first electronic device obtains a first pointing intention of the second electronic device on the display screen of the first electronic device.

[0224] For example, the second electronic device is a remote control device.

[0225] In some embodiments, the first electronic device and the second electronic device are each installed with a positioning module, and the first electronic device can determine the pointing direction of the second electronic device by the positioning signals transmitted between the first electronic device and the second electronic device. For example, the first electronic device can determine the pointing position of the positioning signal of the second electronic device on the display screen of the first electronic device. The signal transmitted from the second electronic device to the first electronic device can also be described as an indication signal, which is used to indicate the icon corresponding to the pointing position.

[0226] In some examples, the first electronic device determines the pointing position of the pointing signal transmitted by the second electronic device on the display screen and determines the device identifier indicated by the pointing position. Then, the first electronic device can obtain the first pointing intention, which is, for example, an indication to control the smart device corresponding to the device identifier. Then, after obtaining the first pointing intention, the first electronic device can determine the intention of the user to control which smart devices.

[0227] S1003、When it is determined that the first pointing intention includes selecting N device identifiers from the plurality of device identifiers, the first electronic device instructs N smart devices corresponding to the N device identifiers to perform corresponding operations respectively.

[0228] Wherein, N is a positive integer greater than or equal to 2.

[0229] In some embodiments, when the N smart devices are audio playing devices (such as smart speakers), the corresponding operations performed by the N smart devices are audio playing operations. Alternatively, when the N smart devices are light devices (such as smart lights), the corresponding operations performed by the N smart devices are starting operations.

[0230] In some embodiments, the first electronic device can obtain the device identifier pointed by the user according to the first pointing intention of the second electronic device. And the first electronic device can determine the smart devices corresponding to each device identifier on the first interface before displaying the first interface. Then, the first electronic device can determine the N smart devices corresponding to the N device identifiers pointed by the user after determining the N device identifiers, so as to determine the instruction for the N smart devices to perform corresponding operations. Optionally, the first electronic device can trigger the N smart devices to perform corresponding operations by sending execution instructions to the N smart devices.

[0231] For example, as shown in FIG. 6, the smart screen (such as the first electronic device) receives the instruction signal sent by the remote control device (such as the second electronic device), and determines that the instruction signal points to the smart speaker icon 502. N can also be equal to 1. Then, the smart screen can obtain that the first pointing intention includes selecting the smart speaker icon 502 from the plurality of smart speaker icons. Then, the smart screen can determine that the user instructs the smart speaker corresponding to the smart speaker icon 502 to sound. Then, the smart screen can send an audio playing instruction to the smart speaker, so as to trigger the smart speaker to play audio. Optionally, the audio is, for example, a sound test audio, such as an audio prompting the sound channel corresponding to the smart speaker, or a short audio generated by AI, etc.

[0232] In this way, the user can realize the individual control of a certain smart device through the second electronic device, and enhance the interactive experience of the user. In this way, the problem that the user cannot individually control a certain smart device to sound in the use process of the smart control system is solved.

[0233] In some embodiments, when the first pointing intention includes selecting a first device identifier and a second device identifier from the plurality of device identifiers, the first electronic device sends a first execution instruction to a first smart device corresponding to the first device identifier, and sends a second execution instruction to a second smart device corresponding to the second device identifier, the second execution instruction being used to instruct the second smart device to perform a second operation.

[0234] For example, N can be equal to 2. In this case, the first electronic device determines that the first pointing intention includes selecting two device identifiers in the plurality of device identifiers, such as a first device identifier and a second device identifier. Then, the first electronic device instructs the two smart devices corresponding to the two device identifiers to perform corresponding operations, respectively. That is, after the first electronic device obtains the pointing intention of the user selecting the plurality of device identifiers through the second electronic device, the first electronic device triggers the corresponding smart devices to perform corresponding operations.

[0235] In this way, the user can control the plurality of smart devices by pointing to the device identifiers displayed on the display screen of the first electronic device through the second electronic device, increase the flexibility of smart device control, and improve the user's interactive experience.

[0236] In some examples, the first electronic device instructing the N smart devices corresponding to the N device identifiers to perform corresponding operations includes: the first electronic device instructing the N smart devices to perform corresponding operations synchronously; or the first electronic device instructing the N smart devices to perform corresponding operations in sequence according to the order in which the N device identifiers are determined.

[0237] For example, as shown in FIG. 7, after the smart screen (such as the first electronic device) receives the continuously transmitted indication signals of the remote control device (such as the second electronic device), the smart screen can display an elliptical identifier 71 corresponding to the continuously transmitted indication signals. The elliptical identifier 71 is composed of identifiers corresponding to the received plurality of indication signals. Then, the smart screen can obtain the smart speaker identifier 502 (such as the first device identifier) and the smart speaker identifier 505 (such as the second device identifier) located in the elliptical identifier 71, and further determine that the smart speaker selected by the user includes the left rear smart speaker (such as the first smart device) corresponding to the smart speaker identifier 502 and the right rear smart speaker (such as the second smart device) corresponding to the smart speaker identifier 505. That is, the first pointing intention obtained by the smart screen includes selecting the smart speaker identifier 502 and the smart speaker identifier 505. Then, after the smart screen detects the operation of the user instructing to play audio, the smart screen can send an audio playing instruction (such as an execution instruction) to the left rear smart speaker and the right rear smart speaker, respectively, to trigger the two smart speakers to play audio, and the other two smart speakers will not play audio. In this case, the left rear smart speaker and the right rear smart speaker can play audio synchronously. Alternatively, synchronous playing means that the left rear smart speaker and the right rear smart speaker cooperate to play the audio to be played, such as audio track cooperation, playing time cooperation, etc.

[0238] As shown in FIG. 8, the smart screen (e.g., the first electronic device) displays the process of the 4 smart speakers (e.g., the plurality of smart devices) included in the living room corresponding to the smart speaker icons (e.g., the plurality of device identifiers). The user selects the smart speaker icon 502, the smart speaker icon 504, the smart speaker icon 505, and the smart speaker icon 503 in the order of 1-2-3-4 shown in the interface by using the remote control device (e.g., the second electronic device). That is, the first pointing intention includes selecting part of the plurality of device identifiers. Then, the smart screen acquires the 4 smart speakers selected by the user in the order and triggers the 4 smart speakers to play the test sound audio in the order. The 4 smart speakers play in the order. Alternatively, the playing in the order can be achieved by the smart screen sending the order of the execution instructions to different smart speakers, or by the information carried in the execution instructions.

[0239] In this way, the first pointing intention acquired by the first electronic device can also be used to control the plurality of smart devices, thereby achieving flexible control of the plurality of smart devices.

[0240] In some embodiments, the first pointing intention is determined by sequentially acquiring the order in which the second electronic device points to the N device identifiers on the display screen of the first electronic device.

[0241] For example, the user selects the plurality of device icons in the order of the corresponding pointing positions on the display screen of the first electronic device by using the second electronic device to send the indication signal. Then, the first electronic device can acquire the plurality of device identifiers selected by the user in the order, thereby acquiring the first pointing intention of the user.

[0242] In some examples, the first electronic device instructs the N smart devices to perform the corresponding operations in the order according to the order of the device identifiers acquired sequentially.

[0243] In this way, the first electronic device can acquire the device identifiers selected by the user in the order according to the pointing intention of the user, thereby achieving the sequential control of the plurality of smart devices.

[0244] In some examples, the first electronic device determines that the time interval at which the second electronic device points to the N smart devices in the order is related to the time interval at which the N smart devices perform the corresponding operations in the order.

[0245] In this way, the first electronic device can flexibly adjust the test sound rhythm according to the connection speed of the user by using the second electronic device, thereby improving the user's interactive experience.

[0246] In some embodiments, the smart devices identified by the N device identifiers are not the same or partially the same.

[0247] In some examples, the device identifiers of the smart devices displayed on the first interface by the first electronic device are related to the device forms of the smart devices. For example, the smart device is a smart speaker, and the device identifier of the smart speaker displayed on the first interface is a smart speaker identifier; the smart device is a light device, and the device identifier of the light device displayed on the first interface is a light device identifier. Optionally, the styles of the device identifiers displayed on the interface can be the same for smart speaker devices or light devices of the same type, and the styles of the device identifiers displayed on the interface can be different for smart speaker devices or light devices of different types, such as the device identifiers of a ceiling lamp and a smart lamp included in the light device.

[0248] In some examples, in the case where the device identifiers are the same, the first electronic device can distinguish the device identifiers according to the positions of the smart devices corresponding to the device identifiers in space. In some examples, the user can also distinguish the smart devices identified by the device identifiers through the positions of the device identifiers displayed on the first interface. In some examples, the first electronic device can also display information indicating the positions of the corresponding smart devices on or near the device identifiers.

[0249] In some examples, the device forms of some of the smart devices included in the smart control system are the same, and the device identifiers of the smart devices are the same, but the smart devices identified by the same device identifiers are different. For example, as shown in the first interface in FIG. 4, the identifiers corresponding to the four smart speakers are the same, but the four smart speaker identifiers are used to indicate four different smart speakers.

[0250] In some examples, the user can select multiple device identifiers on the first interface through the second electronic device, so as to select multiple different smart devices or some same smart devices.

[0251] Exemplarily, the user selects the plurality of device icons, such as the smart speaker icon 502, the smart speaker icon 504, the smart speaker icon 505, and the smart speaker icon 503, in sequence through the remote control device (such as the second electronic device), and does not stop selecting the smart speaker icon. For example, the smart screen (such as the first electronic device) continues to detect the continuous indication signal within the preset time B, and obtains the smart speaker icon 502 selected by the user in sequence. That is, the first electronic device obtains the first pointing intention further including the repeatedly selected device icon. Subsequently, the smart screen can determine that the user completes the selection of the smart speakers in sequence after not receiving the indication signal for more than the preset time B, and obtains the left rear smart speaker corresponding to the smart speaker icon 502, the right front smart speaker corresponding to the smart speaker icon 504, the right rear smart speaker corresponding to the smart speaker icon 505, the left front smart speaker corresponding to the smart speaker icon 503, and the left rear smart speaker corresponding to the smart speaker icon 502, which are selected by the user in sequence through the remote control device. Then, the smart screen can trigger the smart speakers to play the test sound in sequence according to the selection order of the user.

[0252] In this way, the first electronic device can continuously trigger the smart devices selected by the user to perform corresponding operations according to the intention of the user, so as to avoid the case that all the smart devices are always triggered to perform operations or are triggered to perform operations in a fixed order. In addition, whether the smart devices need to be repeatedly triggered to perform operations can be selected according to the demand of the user.

[0253] In some embodiments, during the process in which the N smart devices perform corresponding operations, the first electronic device obtains a second pointing intention of the second electronic device on the display screen of the first electronic device. After it is determined that the second pointing intention includes selecting M device icons in the plurality of device icons, the M smart devices corresponding to the M device icons are instructed to perform corresponding operations. Wherein, M is a positive integer greater than or equal to 1, and the smart devices indicated by the M device icons are different from or partially the same as the smart devices indicated by the N device icons.

[0254] Exemplarily, as shown in the scenario of FIG. 8, in response to the user connecting to select the four smart speaker icons (such as device identifiers), the smart screen (such as the first electronic device) can also display the interfaces corresponding to the four smart speaker icons respectively corresponding to the four smart speakers included in the living room, and receive the indication signal sent by the remote control device (such as the second electronic device) on the interface, to determine the one or more smart speaker icons newly selected by the user, thereby indicating the smart speakers corresponding to the one or more smart speaker icons. That is, in the process of implementing the first pointing intention, the second pointing intention of the user can also be received. After the smart speaker previously selected by the user completes the audio playback, the audio playback is performed through the smart speaker newly selected by the user, where the smart speaker newly selected by the user can be the same as or different from the smart speaker previously selected by the user. Alternatively, the smart screen directly instructs the smart speaker previously selected by the user to stop the audio playback, so as to switch to the smart speaker newly selected by the user to perform the audio playback. Optionally, the smart device newly selected by the user can be different from or partially the same as the smart device currently implementing the first pointing intention.

[0255] In this way, a more flexible sound testing experience is provided for the user.

[0256] In some embodiments, the first electronic device acquires the first pointing intention of the second electronic device on the display screen of the first electronic device, including: the first electronic device acquires the pointing style of the second electronic device. Then, the first electronic device determines that the first pointing intention includes an instruction to N smart devices to synchronously perform corresponding operations according to the pointing style being the first pointing style. And / or, the first electronic device determines that the first pointing intention includes an instruction to N smart devices to sequentially perform corresponding operations according to the pointing style being the second pointing style.

[0257] In some examples, the first pointing style is a circle or an approximate circle, and the display positions of the N device identifiers on the first interface are located in an area within the circle or the approximate circle (such as the elliptical identifier 71 shown in FIG. 7). The second indication style is a connection line, and the connection line is used to connect the N device identifiers.

[0258] It should be understood that the circle can include a completely closed circle or a not completely closed circle. The approximate circle can include a completely closed ellipse or a not completely closed ellipse. Alternatively, the approximate circle can also include a completely closed or not completely closed special-shaped figure.

[0259] In this way, the first electronic device can flexibly control different smart devices according to the acquired pointing style of the first pointing intention, thereby enriching the interactive experience of the user.

[0260] In some embodiments, the first electronic device obtains a first pointing direction of the second electronic device. After determining that a third pointing intention according to the first pointing direction includes selecting N smart devices from the plurality of smart devices, the N smart devices are instructed to perform corresponding operations. It should be understood that the first electronic device can receive a pointing intention of the user selecting a smart device on the first display interface, or can receive a pointing intention of the user pointing to an actual smart device in space. The smart devices selected by the user on the display screen or in space can be different, the same, or partially the same.

[0261] The first pointing direction is, for example, a direction indicated by the user to the actual space through the second electronic device.

[0262] For example, still taking the first electronic device as a smart screen, the second electronic device as a remote control device, and the smart device as a smart speaker, the smart screen can obtain the actual position of the smart speaker in space. Then, in some example scenarios, the remote control device sends an indication signal when pointing to a certain position in space, and the smart screen can receive the indication signal. Then, the smart screen can determine the position pointed to by the indication signal, and further obtain the pointing intention of the user. Then, the smart screen can determine at least one smart speaker pointed to by the current remote control device according to the positions of the plurality of smart speakers in space that have established a communication connection. Then, the smart screen can send an audio playing instruction to the at least one smart speaker to trigger the at least one smart speaker located at the position pointed to by the current remote control device to play audio.

[0263] Alternatively, in combination with the above-mentioned scenario in which the user indicates the smart device to trigger the operation by connecting or selecting the device identifier on the display screen, the user can also select the smart device in the actual space through the second electronic device by means of separate selection, connection selection, or selection, and the first electronic device can obtain the pointing intention of the user to determine one or more smart devices selected by the user.

[0264] In this way, the user can point to the device identifier displayed on the first electronic device through the second electronic device, and / or directly point to the actual position of the smart device in space, and the first electronic device can trigger the corresponding smart device to perform the operation, thereby effectively improving the user's interaction experience.

[0265] That is, the first electronic device can separately implement or combine the implementation of the pointing intention of the user on the display screen and the pointing intention of the user in the actual space, and the embodiments of the present application do not limit this.

[0266] In some embodiments, the first electronic device obtains first information respectively sent by N smart devices in the plurality of smart devices, the first information being determined by the N smart devices according to a fourth pointing intention of the second electronic device pointing to the first smart device. The first electronic device instructs the N smart devices to perform corresponding operations according to the first information.

[0267] In some examples, a positioning module can also be installed in the smart device. Then, when the second electronic device sends an indication signal to the smart device in the space, the corresponding smart device can also receive the indication signal and locate the second electronic device. Then, the smart device can send first information to the first electronic device, the first information being used to indicate that the first electronic device currently exists the fourth pointing intention of the second electronic device indicating the smart device to perform a triggering operation. Correspondingly, the first electronic device can obtain the fourth pointing intention of the user indicating the smart device to perform an operation after receiving the first information, and then the first electronic device can send an execution instruction to the smart device to trigger the smart device to perform a corresponding operation.

[0268] In this way, the smart device can also be triggered by the first electronic device to perform a corresponding operation according to the pointing operation of the second electronic device, so as to meet the needs of the user to flexibly control in different interaction scenarios.

[0269] In some embodiments, there is a first smart device near the first smart device. When the first electronic device instructs the N smart devices to perform corresponding operations, the first electronic device instructs the first smart device to perform a corresponding operation.

[0270] Optionally, the first smart device is, for example, a smart device within a preset distance near the smart device selected by the user according to the pointing intention. The first electronic device can obtain the position information of each smart device in the space, and then the first electronic device can obtain the first smart device near the N smart devices determined according to the pointing intention.

[0271] It should be understood that the corresponding operations performed by smart devices of different forms are not the same.

[0272] For example, the N smart devices are smart sound boxes, and the first smart device is a smart lamp. For example, in a sound testing scene, the smart sound box pointed by the user plays a prompt sound, and the smart lamp near the smart sound box is started, and the user can quickly determine the position of the smart sound box currently testing sound in the actual space according to the prompt sound and the position of the lamp, thereby improving the user experience.

[0273] In this way, the interaction experience of the user is enriched through the linkage of multiple devices.

[0274] In some embodiments, the first electronic device displays a second interface on which screen saver content is displayed. The first electronic device obtains a fifth pointing intention of the second electronic device on the display screen of the first electronic device. In a case where the fifth pointing intention is used to move a first screen saver content in the screen saver content, the first electronic device controls the first screen saver content to move on the second interface.

[0275] Exemplarily, as shown in FIG. 9, the smart screen (e.g., the first electronic device) displays a screen saver interface (e.g., the second interface) and receives an indication signal sent by the remote control device (e.g., the second electronic device), and determines that the indication signal points to a preset display content 91 (e.g., the first screen saver content) and that the user indication triggers the operation of the preset display content 91. Then, the smart screen continuously receives the indication signal, and the pointing direction of the continuous indication signal moves to the right. That is, the first electronic device obtains a fifth pointing intention used to move the first screen saver content in the screen saver content. Then, the smart screen can move the display of the preset display content 91 to the right according to the direction shown by the dashed arrow 92. In this way, the preset display content 91 can move the display position to the right along with the pointing direction of the user operation of the remote control device, so as to realize the interaction of the preset display content 91 with the user.

[0276] In this way, the first electronic device can also realize flexible interaction with the user during the display of the screen saver interface.

[0277] In some examples, the first electronic device controls the corresponding smart device in the plurality of smart devices to perform an operation following the change of the moving track of the first screen saver content. It should be understood that the moving track can be a track generated by the movement of the first screen saver content in any direction and distance on the display interface.

[0278] Exemplarily, as shown in the scenario of FIG. 9, the smart screen (e.g., the first electronic device) moves the display of the preset display content 91 (e.g., the first screen saver content) to the right and also adjusts the audio playing order and volume size of the plurality of smart devices, such as the left front smart sound box, the left rear smart sound box, the right front smart sound box, and the right rear smart sound box. In this way, the user can be provided with an experience of the audio playing from left to right and the surround stereo sound changing from the left side to the right side with the preset display content 91 moving from left to right.

[0279] In this way, the playability of the screen saver interface is increased, and the interaction experience of the user is improved.

[0280] FIG. 11 is a flow diagram of another interaction method provided by an embodiment of the present application. It should be noted that the method is not limited to the specific order of FIG. 11 and the following, and it should be understood that in other embodiments, the order of some steps of the method can be exchanged with each other according to actual needs, or some steps of the method can be omitted or deleted. The method includes the following steps:

[0281] S1101, the first electronic device obtains a first pointing direction of the second electronic device.

[0282] The first pointing direction is, for example, a direction indicated by the user to the actual space through the second electronic device.

[0283] S1102, after determining that the first pointing intention according to the first pointing direction includes selecting N smart devices from the plurality of smart devices, the first electronic device instructs the N smart devices to perform corresponding operations.

[0284] In some embodiments, the first electronic device can obtain a first smart device according to the first pointing direction of the second electronic device in the space, and N can also be 1. The first smart device is located at the first pointing direction. For example, a smart speaker is installed on the left front roof of the living room. In response to the user sending an indication signal to the left front direction through the second electronic device, the first electronic device can obtain the left front direction and the smart speaker located at the left front direction, i.e. the first smart device. Then, the first electronic device can trigger the first smart device to perform corresponding operations. For example, the first smart device is a smart speaker, which can trigger the smart speaker to play audio. Or, the first smart device is a smart lamp, which can trigger the smart lamp to start.

[0285] In this way, the user can trigger the corresponding smart device to operate through the first electronic device by directly pointing to the actual position of the smart device in the space, effectively improving the user's interaction experience.

[0286] In other embodiments, N is a positive integer greater than or equal to 2. After obtaining the pointing intention of the user pointing to the N smart devices actually existing in the space through the second electronic device, the first electronic device can determine the N smart devices selected by the user according to the pointing intention. Then, the first electronic device can instruct the N smart devices to perform corresponding operations.

[0287] In some embodiments, the plurality of smart devices are audio playback devices and / or light devices. In some embodiments, the first electronic device is a smart screen, and / or the second electronic device is a remote control device.

[0288] In some embodiments, the first electronic device instructing the N smart devices to perform corresponding operations includes: the first electronic device instructing the N smart devices to synchronously perform corresponding operations; or instructing the N smart devices to perform corresponding operations in sequence according to the order in which the N smart devices are determined.

[0289] Optionally, the first electronic device can trigger the N smart devices to perform corresponding operations by sending execution instructions to the N smart devices.

[0290] In some embodiments, the first pointing intention is determined by the order of the N smart devices sequentially pointed by the first pointing direction.

[0291] In some embodiments, the first electronic device instructs the N smart devices to perform corresponding operations in order according to the order of the directions sequentially pointed by the N smart devices.

[0292] In some embodiments, the first electronic device determines a time interval at which the second electronic device sequentially points the N smart devices, and the time interval at which the N smart devices sequentially perform corresponding operations.

[0293] In some embodiments, the N smart devices are not the same, or partially the same. That is, the user can select N smart devices that are not repeated in space through the second electronic device, or can select N smart devices that are partially or completely repeated.

[0294] In some embodiments, during the process of the N smart devices performing corresponding operations, the first electronic device obtains a second pointing direction of the second electronic device. When the second pointing intention determined according to the second pointing direction includes selecting M smart devices from the plurality of smart devices, the first electronic device instructs the M smart devices to perform corresponding operations. Wherein, M is a positive integer greater than or equal to 1, and the M smart devices are not the same as the N smart devices, or partially the same.

[0295] In this way, in combination with the scenario described above in FIG. 10, in which the user indicates the smart device to trigger the operation by connecting or selecting the device identifier on the display screen, the user can also select the smart device in the actual space by individually selecting, connecting, or selecting the device identifier, and the first electronic device can obtain the pointing intention of the user and determine one or more smart devices selected by the user.

[0296] In some embodiments, there is a first smart device near the N smart devices. In the case of instructing the N smart devices to perform corresponding operations, the first smart device is also instructed to perform corresponding operations.

[0297] In this way, the first electronic device obtains the pointing intention of the user in the actual space, and can also trigger the linkage execution effect, thereby improving the user experience.

[0298] In some embodiments, the first electronic device obtains first information sent by N smart devices from a plurality of smart devices, and the first information is determined by the N smart devices according to a third pointing intention of the second electronic device pointing the N smart devices. The first electronic device instructs the N smart devices to perform corresponding operations according to the first information.

[0299] In this way, the smart device can also trigger the first electronic device to perform corresponding operations according to the pointing operation of the second electronic device, so as to meet the requirement of flexible control of the user in different interaction scenarios.

[0300] In some embodiments, the first electronic device displays a first interface, and the first interface displays a plurality of device identifiers, and the plurality of device identifiers correspond to a plurality of smart devices respectively. The first electronic device obtains a fourth pointing intention of the second electronic device on the display screen of the first electronic device. After determining that the fourth pointing intention includes selecting N device identifiers in the plurality of device identifiers, the first electronic device instructs N smart devices corresponding to the N device identifiers to perform corresponding operations.

[0301] In this way, the first electronic device can separately or jointly implement the pointing intention of the user on the display screen and the pointing intention of the user in the actual space.

[0302] In some embodiments, the first electronic device displays a second interface, and the second interface displays screen saver content. The first electronic device obtains a fifth pointing intention of the second electronic device on the display screen of the first electronic device. In a case where the fifth pointing intention is used to move first screen saver content in the screen saver content, the first electronic device controls the first screen saver content to move on the second interface.

[0303] In some examples, the first electronic device controls the corresponding smart device in the plurality of smart devices to perform operations following the change of the movement track of the first screen saver content.

[0304] In this way, the first electronic device can also realize flexible interaction with the user in the process of displaying the screen saver interface.

[0305] FIG. 12 is a flow diagram of another interaction method provided by an embodiment of the present application. It should be noted that the method is not limited to the specific order of FIG. 12, and it should be understood that in other embodiments, the order of some steps of the method can be exchanged according to actual needs, or some steps of the method can be omitted or deleted. The method includes the following steps:

[0306] S1201, the first electronic device obtains first information respectively sent by N smart devices in a plurality of smart devices, and the first information is determined by the N smart devices according to a first pointing intention of a second electronic device pointing to the N smart devices.

[0307] Wherein, N is a positive integer greater than or equal to 2.

[0308] In some embodiments, the positioning module can also be installed in the smart device. Then, when the second electronic device sends the indication signal to the smart device in the space, the corresponding smart device can also receive the indication signal and locate the second electronic device. Then, the smart device can send the first information to the first electronic device, so that the first electronic device obtains the first pointing intention of the user pointing to the smart device in the actual space.

[0309] In S1202, the first electronic device instructs the N smart devices to perform corresponding operations according to the first information.

[0310] In some embodiments, the first electronic device can obtain the pointing intention of the user pointing to the first smart device according to the first information, so as to trigger the control of the first smart device to perform operations.

[0311] In this way, the user can trigger the corresponding smart device to perform operations through the first electronic device by directly pointing to the smart device in the space, effectively improving the user's interactive experience.

[0312] In some embodiments, the first electronic device can obtain the pointing intention of the user pointing to the N smart devices according to the first information, so as to trigger the control of the N smart devices to perform operations.

[0313] In this way, in response to the user pointing to multiple smart devices in the space, the first electronic device can achieve the sequential triggering of the multiple smart devices according to the information sent by the multiple smart devices.

[0314] Optionally, part or all of the multiple smart devices in the actual space can be installed with a positioning module. These smart devices can receive the pointing signal sent by the second electronic device and generate corresponding first information, so as to send the first information to the first electronic device. In this way, the first electronic device can receive the first information sent by these smart devices respectively and obtain the pointing intention of the user pointing to these smart devices.

[0315] In some embodiments, the multiple smart devices are audio playing devices and / or light devices. In some embodiments, the first electronic device is a smart screen, and / or the second electronic device is a remote control device.

[0316] In some embodiments, the first electronic device instructing the N smart devices to perform corresponding operations includes: the first electronic device instructing the N smart devices to synchronously perform corresponding operations. Alternatively, the first electronic device instructs the N smart devices to perform corresponding operations in sequence according to the order of the N device identifiers.

[0317] In some embodiments, the first electronic device instructs the N smart devices to perform corresponding operations in sequence according to the receiving order of each first information.

[0318] In some embodiments, the first electronic device determines a time interval at which the second electronic device sequentially points to the N smart devices, and the time interval at which the N smart devices sequentially perform the corresponding operations.

[0319] In some embodiments, during the process in which the N smart devices perform the corresponding operations, the first electronic device acquires second information respectively sent by M smart devices in the plurality of smart devices, the second information being determined by the M smart devices according to a third pointing intention of the second electronic device pointing to the M smart devices. The first electronic device instructs the M smart devices to perform the corresponding operations according to the third information. Wherein, M is a positive integer greater than or equal to 1, and the M smart devices are different from or partially the same as the N smart devices.

[0320] In this way, in the scenario described above with reference to FIG. 10, the user can also select smart devices in the actual space by individually selecting, connecting, or circling the device identifiers on the display screen, and the first electronic device can acquire the pointing intention of the user and determine one or more smart devices selected by the user.

[0321] In some embodiments, there is a first smart device near the N smart devices. In the case of instructing the N smart devices to perform the corresponding operations, the first electronic device also instructs the first smart device to perform the corresponding operations.

[0322] In this way, the first electronic device can acquire the pointing intention of the user in the actual space and also trigger the linkage execution effect, thereby improving the user experience.

[0323] In some embodiments, the first electronic device acquires a first pointing direction of the second electronic device. When the fourth pointing intention determined according to the first pointing direction includes selecting N smart devices in the plurality of smart devices, the first electronic device instructs the N smart devices to perform the corresponding operations.

[0324] In this way, the first electronic device can also trigger the smart devices corresponding to the first pointing direction to perform the corresponding operations when the first pointing direction of the second electronic device in the actual space is acquired, thereby enriching the user experience.

[0325] In some embodiments, the first electronic device displays a first interface, and the first interface displays a plurality of device identifiers, the plurality of device identifiers respectively corresponding to a plurality of smart devices. The first electronic device acquires a fifth pointing intention of the second electronic device on the display screen of the first electronic device. When it is determined that the fifth pointing intention includes selecting N device identifiers in the plurality of device identifiers, the first electronic device instructs N smart devices corresponding to the N device identifiers to perform the corresponding operations.

[0326] In this way, the first electronic device can separately or jointly implement the implementation manners of the pointing intention of the user in the actual space and the pointing intention of the user on the display screen.

[0327] In some embodiments, the first electronic device displays the second interface, and the second interface displays the screen saver content. The first electronic device obtains a sixth pointing intention of the second electronic device on the display screen of the first electronic device. In a case where the sixth pointing intention is used to move the first screen saver content in the screen saver content, the first electronic device controls the first screen saver content to move on the second interface.

[0328] In some examples, the first electronic device controls the corresponding smart device in the plurality of smart devices to perform an operation following the change of the movement track of the first screen saver content.

[0329] In this way, the first electronic device can also realize flexible interaction with the user in the process of displaying the screen saver interface.

[0330] Optionally, in the interaction method flows described in FIG. 10, FIG. 11, and FIG. 12, the first electronic device can also perform the steps and functions performed by the smart screen in the above embodiments, the second electronic device can also perform the steps and functions performed by the remote control device in the above embodiments, and the smart device can also perform the steps and functions performed by the smart speaker or the smart lamp in the above embodiments, so as to realize the interaction method provided in the above embodiments.

[0331] In some schemes, the plurality of embodiments of the present application can be combined, and the combined scheme is implemented. Optionally, some operations in the flow of each method embodiment are optionally combined, and / or the order of some operations is optionally changed. Moreover, the execution order between the steps of each flow is only exemplary, and does not constitute a limitation on the execution order between the steps, and other execution orders between the steps can also be used. The execution order is not intended to indicate the only execution order in which the operations can be performed. A person of ordinary skill in the art can think of various ways to reorder the operations described herein. In addition, it should be pointed out that the process details related to a certain embodiment herein are also applicable in a similar manner to other embodiments, or different embodiments can be combined for use.

[0332] In addition, some steps in the method embodiments can be equivalently replaced by other possible steps. Alternatively, some steps in the method embodiments can be optional and can be deleted in some use scenarios. Alternatively, other possible steps can be added to the method embodiments.

[0333] Moreover, each method embodiment can be implemented individually or in combination.

[0334] The component display method provided by the embodiments of the present application is described in detail above in combination with FIG. 5-FIG. 12. The first electronic device provided by the embodiments of the present application is described in detail below in combination with FIG. 13.

[0335] In a possible design, FIG. 13 is a structural schematic diagram of a first electronic device provided by the embodiments of the present application. As shown in FIG. 13, the first electronic device 1300 can include a transceiver unit 1301, a processing unit 1302, and a display unit 1303. The first electronic device 1300 can be used to implement the functions of the first electronic device (such as a smart screen) involved in the above method embodiments.

[0336] Optionally, the transceiver unit 1301 is configured to support the first electronic device 1300 to perform S1002 and S1003 in FIG. 10; and / or support the first electronic device 1300 to perform S1101 and S1102 in FIG. 11; and / or support the first electronic device 1300 to perform S1201 and S1202 in FIG. 12.

[0337] Optionally, the processing unit 1302 is configured to support the first electronic device 1300 to perform S1002 in FIG. 10; and / or support the first electronic device 1300 to perform S1101 and S1102 in FIG. 11; and / or support the first electronic device 1300 to perform S1202 in FIG. 12.

[0338] Optionally, the display unit 1303 is configured to support the first electronic device 1300 to perform S1001 in FIG. 10.

[0339] The transceiver unit can include a receiving unit and a sending unit, can be implemented by a transceiver or a transceiver related circuit component, and can be a transceiver or a transceiver module. The operations and / or functions of each unit in the first electronic device 1300 are respectively used to implement the corresponding procedures of the component display method described in the above method embodiments. All related contents of each step described in the above method embodiments can be referred to the function description of the corresponding functional unit, and will not be described herein for brevity.

[0340] Optionally, the first electronic device 1300 shown in FIG. 13 can further include a storage unit (not shown in FIG. 13), and the storage unit stores programs or instructions. When the transceiver unit 1301, the processing unit 1302, and the display unit 1303 execute the programs or instructions, the first electronic device 1300 shown in FIG. 13 can perform the component display method described in the above method embodiments.

[0341] The technical effects of the first electronic device 1300 shown in FIG. 13 can refer to the technical effects of the component display method described in the above method embodiments, which will not be described herein for brevity.

[0342] In addition to the form of the first electronic device 1300, the technical solutions provided in the present application can also be a functional unit or a chip in the first electronic device, or a device matched with the first electronic device.

[0343] The embodiments of the present application further provide a chip system, comprising: a processor, and a memory coupled with the processor, the memory being configured to store programs or instructions, when the programs or instructions are executed by the processor, the chip system implements the method in any of the method embodiments.

[0344] Optionally, the processor in the chip system can be one or more. The processor can be implemented by hardware or software. When implemented by hardware, the processor can be a logic circuit, an integrated circuit, etc. When implemented by software, the processor can be a general-purpose processor, which is implemented by reading software codes stored in the memory.

[0345] Optionally, the memory in the chip system can also be one or more. The memory can be integrated with the processor, or can be separately arranged from the processor, and the embodiments of the present application do not make any limitation. For example, the memory can be a non-transient processor, such as a read-only memory (ROM), which can be integrated on the same chip as the processor, or can be separately arranged on different chips, and the embodiments of the present application do not make any limitation on the type of the memory and the arrangement mode of the memory and the processor.

[0346] For example, the chip system can be a field programmable gate array (FPGA), can be an application specific integrated circuit (ASIC), can be a system on chip (SoC), can be a central processor unit (CPU), can be a network processor (NP), can be a digital signal processor (DSP), can be a micro controller unit (MCU), can be a programmable logic device (PLD) or other integrated chip.

[0347] It should be understood that each step in the above method embodiments can be completed by integrated logic circuits of hardware in the processor or instructions in the form of software. The method steps disclosed in combination with the embodiments of the present application can be directly embodied as execution completed by a hardware processor, or executed by a combination of hardware and software modules in the processor.

[0348] The embodiments of the present application further provide a computer readable storage medium, which stores a computer program. When the computer program is run on a computer, the computer is enabled to perform the above-mentioned related steps to implement the interaction method in the above-mentioned embodiments.

[0349] The embodiments of the present application further provide a computer program product. When the computer program product is run on a computer, the computer is enabled to perform the above-mentioned related steps to implement the interaction method in the above-mentioned embodiments.

[0350] In addition, the embodiments of the present application further provide a device. The device can be specifically a component or a module. The device can include one or more processors and memories connected thereto. The memories are used to store computer programs. When the computer programs are executed by the one or more processors, the device is enabled to perform the interaction method in the above-mentioned method embodiments.

[0351] The device, the computer readable storage medium, the computer program product or the chip provided by the embodiments of the present application are used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved are referred to the beneficial effects in the corresponding methods provided above, which will not be described here.

[0352] The steps of the methods or algorithms described in combination with the disclosure of the embodiments of the present application can be implemented in the form of hardware or by a processor executing software instructions. The software instructions can be composed of corresponding software modules, which can be stored in a random access memory (RAM), a flash memory, a read only memory (ROM), an erasable programmable ROM (EPROM), an electrically EPROM (EEPROM), a register, a hard disk, a mobile hard disk, a compact disc read only memory (CD-ROM) or any other form of storage medium well known in the art. An exemplary storage medium is coupled to the processor, so that the processor can read information from the storage medium and write information to the storage medium. Of course, the storage medium can also be an integral part of the processor. The processor and the storage medium can be located in an application specific integrated circuit (ASIC).

[0353] Those skilled in the art can clearly understand the above-mentioned technical solutions from the description of the above-mentioned embodiments. For the convenience and brevity of description, only the division of the above-mentioned functional modules is exemplified. In actual application, the above-mentioned functions can be completed by different functional modules according to needs; that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. The specific working process of the system, device and unit described above can refer to the corresponding process in the foregoing method embodiments, which will not be repeated here.

[0354] In several embodiments provided in the present application, it should be understood that the disclosed method can be implemented by other ways. The above-mentioned device embodiments are only schematic. For example, the division of the modules or units is only a logical function division, and actual implementation can have another division manner; for example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the units shown or discussed can be indirect coupling or communication connection through some interface, module or unit, which can be electrical, mechanical or other forms.

[0355] In addition, each functional unit in each embodiment of the present application can be integrated in one processing unit, or each unit can exist physically, or two or more units can be integrated in one unit. The integrated unit can be realized in the form of hardware or in the form of a software functional unit.

[0356] The computer readable storage medium includes, but is not limited to, any one of the following: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and various media that can store program codes.

[0357] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any change or replacement within the technical scope disclosed in the present application should be covered in the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

An interaction method, characterized in that, The method is applied to a first electronic device, the first electronic device and a plurality of smart devices constitute a smart control system, and the method comprises the following steps: displaying a first interface, a plurality of device identifiers are displayed on the first interface, and the plurality of device identifiers correspond to the plurality of smart devices respectively; obtaining a first pointing intention of a second electronic device on a display screen of the first electronic device; after determining that the first pointing intention includes selecting N device identifiers in the plurality of device identifiers, instructing N smart devices corresponding to the N device identifiers to perform corresponding operations, wherein N is a positive integer greater than or equal to 2. The method of claim 1, wherein The instruction of the N smart devices to perform corresponding operations comprises: instructing the N smart devices to perform corresponding operations synchronously; or instructing the N smart devices to perform corresponding operations in sequence according to the order of determining the N device identifiers. The method according to claim 1 or 2, characterized in that The first pointing intention is determined by sequentially obtaining the order of the N device identifiers pointed by the second electronic device on the display screen of the first electronic device. The method according to claim 3, characterized in that The first electronic device determines that the time interval of the second electronic device pointing the N device identifiers in sequence is related to the time interval of the N smart devices performing corresponding operations in sequence. The method according to any one of claims 1 to 4, characterized in that The smart devices identified by the N device identifiers are not the same or partially the same. The method according to any one of claims 1 to 5, characterized in that The method further comprises: during the process of the N smart devices performing corresponding operations, obtaining a second pointing intention of the second electronic device on the display screen of the first electronic device; after determining that the second pointing intention includes selecting M device identifiers in the plurality of device identifiers, instructing M smart devices corresponding to the M device identifiers to perform corresponding operations, wherein M is a positive integer greater than or equal to 1, and the smart devices identified by the M device identifiers are not the same as or partially the same as the smart devices identified by the N device identifiers. The method according to any one of claims 2-6, characterized in that The method further comprises: obtaining a pointing style of the second electronic device; determining that the first pointing intention includes instructing the N smart devices to perform corresponding operations synchronously according to the first pointing style being a first pointing style; and / or, determining that the first pointing intention includes instructing the N smart devices to perform corresponding operations in sequence according to the pointing style being a second pointing style. The method of claim 7, wherein The first pointing style is a circle or an approximate circle, and the display positions of the N device identifiers on the first interface are located in the area within the circle or the approximate circle; and the second pointing style is a line, and the line is used to connect the N device identifiers. The method according to any one of claims 1 to 8, characterized in that The method further comprises: obtaining a first pointing direction of the second electronic device; after determining that a third pointing intention according to the first pointing direction includes selecting the N smart devices in the plurality of smart devices, instructing the N smart devices to perform corresponding operations. The method according to any one of claims 1 to 9, characterized in that The method further comprises: obtain first information respectively sent by the N smart devices in the plurality of smart devices, the first information being determined by the N smart devices according to a fourth pointing intention of the second electronic device pointing at the N smart devices; indicate the N smart devices to perform corresponding operations according to the first information. The method according to any one of claims 1 to 10, characterized in that The N smart devices are near a first smart device, and the method further comprises: In the case of indicating the N smart devices to perform corresponding operations, indicate the first smart device to perform corresponding operations. The method according to any one of claims 1 to 11, characterized in that The method further comprises: display a second interface, and the second interface displays screen saver content; obtain a fifth pointing intention of the second electronic device on the display screen of the first electronic device; in the case that the fifth pointing intention is used to move a first screen saver content in the screen saver content, control the first screen saver content to move on the second interface. The method of claim 12, wherein The method further comprises: follow the change of the moving track of the first screen saver content, and control the corresponding smart device in the plurality of smart devices to perform an operation. The method according to any one of claims 1 to 13, characterized in that The plurality of smart devices are audio playing devices and / or light devices. The method according to any one of claims 1 to 14, characterized in that The first electronic device is a smart screen, and / or the second electronic device is a remote control device. An interaction method, characterized in that, Applied to a first electronic device, the first electronic device and a plurality of smart devices constitute an intelligent control system, and the method comprises: obtain a first pointing direction of a second electronic device; after determining that a first pointing intention according to the first pointing direction includes selecting N smart devices in the plurality of smart devices, indicate the N smart devices to perform corresponding operations, N being a positive integer greater than or equal to 2. The method of claim 16, wherein The indication of the N smart devices to perform corresponding operations includes: indicating the N smart devices to perform corresponding operations synchronously; or indicating the N smart devices to perform corresponding operations in sequence according to the order of determining the N smart devices. The method according to claim 16 or 17, characterized in that The first pointing intention is determined by the order of the N smart devices pointed by the first pointing direction in turn. The method of claim 18, wherein The first electronic device determines that the time interval of the second electronic device pointing at the N smart devices in turn is related to the time interval of the N smart devices performing corresponding operations in sequence. The method according to any one of claims 16-19, characterized in that The N smart devices are not the same, or partially the same. The method according to any one of claims 16-20, characterized in that The method further comprises: during the process that the N smart devices perform corresponding operations, obtain a second pointing direction of the second electronic device; after determining that a second pointing intention according to the second pointing direction includes selecting M smart devices in the plurality of smart devices, indicate the M smart devices to perform corresponding operations, M being a positive integer greater than or equal to 1, and the M smart devices being different from or partially the same as the N smart devices. The method according to any one of claims 16-21, characterized in that The N smart devices are near a first smart device, and the method further comprises: In the case of indicating the N smart devices to perform corresponding operations, indicate the first smart device to perform corresponding operations. The method according to any one of claims 16 to 22, characterized in that The method further comprises: Obtaining first information respectively sent by the N smart devices in the plurality of smart devices, the first information being determined by the N smart devices according to a third pointing intention of the second electronic device pointing at the N smart devices; According to the first information, instructing the N smart devices to perform corresponding operations. The method according to any one of claims 16 to 23, characterized in that The method further comprises: displaying a first interface, the first interface displaying a plurality of device identifiers, the plurality of device identifiers respectively corresponding to the plurality of smart devices; Obtaining a fourth pointing intention of the second electronic device on the display screen of the first electronic device; After determining that the fourth pointing intention includes selecting N device identifiers in the plurality of device identifiers, instructing N smart devices respectively corresponding to the N device identifiers to perform corresponding operations. The method according to any one of claims 16 to 24, characterized in that The method further comprises: displaying a second interface, the second interface displaying screen saver content; Obtaining a fifth pointing intention of the second electronic device on the display screen of the first electronic device; In the case where the fifth pointing intention is used to move a first screen saver content in the screen saver content, controlling the first screen saver content to move on the second interface. The method of claim 25, wherein The method further comprises: Following the change of the moving track of the first screen saver content, controlling the corresponding smart device in the plurality of smart devices to perform an operation. The method according to any one of claims 16 to 26, characterized in that The plurality of smart devices are audio playing devices and / or light devices. The method according to any one of claims 16 to 27, characterized in that The first electronic device is a smart screen, and / or the second electronic device is a remote control device. An electronic device, characterized by Comprise: a processor, a memory and a display screen, the memory and the display screen being coupled with the processor, the memory being used to store computer program code, the computer program code comprising computer instructions, when the processor reads the computer instructions from the memory, causing the electronic device to perform the method of any one of claims 1-15; or, causing the electronic device to perform the method of any one of claims 16-28. A computer-readable storage medium, characterized by The computer readable storage medium comprises a computer program, when the computer program runs on an electronic device, causing the electronic device to perform the method of any one of claims 1-15; or, causing the electronic device to perform the method of any one of claims 16-28. A computer program product, characterized in that When the computer program product runs on a computer, causing the computer to perform the method of any one of claims 1-15; or, causing the electronic device to perform the method of any one of claims 16-28.

Images