Equipment interaction method, electronic equipment and computer readable storage medium

Abstract

The invention is suitable for the technical field of terminals, and particularly relates to an equipment interaction method, electronic equipment and a computer readable storage medium. In the method, when first electronic equipment needs to perform interaction, the first electronic equipment determines a first interaction function possibly needed by a user according to a current application scene, and determines a second interaction function supported by second electronic equipment from the first interaction function according to equipment information of the first electronic equipment and equipment information of the second electronic equipment; in the embodiment of the invention, the second interaction function is uniformly displayed in the interface of the first electronic equipment, that is, the second interaction function possibly needing to be used by the user is displayed according to the current application scene, so that the user can quickly select the interaction function according to the current application scene, and the equipment interaction efficiency is improved. In addition, the interface of the first electronic equipment is used as a unified entrance for interaction between the first electronic equipment and the second electronic equipment, so that equipment interaction of a user is facilitated, and the user experience is improved.

Description

[0001] This application is a divisional application. The application number of the original application is 202210781200.X, and the original application date is June 30, 2022. The entire contents of the original application are incorporated into this application by reference. Technical Field

[0002] The present application belongs to the field of terminal technology, and in particular, relates to a device interaction method, an electronic device, and a computer-readable storage medium. Background Art

[0003] With the development of IoT technology, more and more devices can interact with each other, such as screen projection, audio projection, multi-screen collaboration, distributed cameras, etc. When a device supports multiple interactive capabilities, the user needs to determine the interactive capability currently required and trigger the interactive capability through the entrance corresponding to the interactive capability. For example, when a tablet supports both multi-screen collaboration and distributed cameras, if the user determines that the mobile phone needs to perform multi-screen collaboration, the user can click the tablet icon in the control center of the mobile phone to perform multi-screen collaboration with the tablet. If the user determines that the mobile phone needs to use a distributed camera, the user needs to open the camera application and click the button corresponding to the distributed camera to call the tablet's camera. That is, the entrances to the existing device interaction functions are scattered, affecting the user experience. Summary of the invention

[0004] The embodiments of the present application provide a device interaction method, an electronic device, and a computer-readable storage medium, which can solve the problem that the entrances to the existing device interaction functions are scattered and affect the user experience.

[0005] In a first aspect, an embodiment of the present application provides a device interaction method, which is applied to a first electronic device, and the method may include:

[0006] Determining a current application scenario of the first electronic device, and determining at least one first interactive function corresponding to the application scenario;

[0007] Determine, according to the first interactive function, device information of the first electronic device and device information of the second electronic device, a second interactive function corresponding to the second electronic device, where the second interactive function is one or more of the first interactive functions, and the second electronic device is associated with the first electronic device;

[0008] displaying a second interactive function corresponding to the second electronic device;

[0009] In response to a first operation on a third interactive function, it is determined to execute the third interactive function with the second electronic device, where the third interactive function is one of the second interactive functions corresponding to the second electronic device.

[0010] In the above-mentioned device interaction method, when the first electronic device needs to interact, the first electronic device can determine the first interactive function that the user may need to execute according to the current application scenario of the first electronic device, and can determine the second interactive function supported by the second electronic device from the first interactive function according to the device information of the first electronic device and the device information of the second electronic device, and uniformly display the second interactive function supported by the second electronic device in the interface of the first electronic device. That is, the second interactive function is an interactive function supported by the second electronic device and corresponding to the current application scenario of the first electronic device. The second interactive function can be all the interactive functions supported by the second electronic device, or it can be a part of all the interactive functions supported by the second electronic device, so as to display the second interactive function that the user may need to use according to the current application scenario, so as to facilitate the user to quickly select the interactive function according to the current application scenario, so as to improve the efficiency of device interaction. In addition, by using the interface of the first electronic device as a unified entrance for the interaction between the first electronic device and the second electronic device, it is convenient for the user to interact between devices and improve the user experience.

[0011] Exemplarily, determining the current application scenario of the first electronic device may include:

[0012] Detect preset operations;

[0013] In response to the preset operation, a current application scenario of the first electronic device is determined.

[0014] In the device interaction method provided by this implementation, the first electronic device can determine whether the first electronic device needs to perform device interaction based on whether a preset operation is detected, so as to accurately identify the user's interaction intention based on the preset operation.

[0015] In one example, the preset operation includes touching a preset area of ​​the first electronic device to a preset area of ​​the second electronic device.

[0016] In another example, the preset operation includes entering the first interface of the first electronic device, or clicking the second control in the first interface, or dragging the second control in the first interface, and releasing the second control when the distance between the second control and the first control is less than a preset threshold, the first interface includes the second control, or the first interface includes the first control and the second control, the first control is a control corresponding to the first electronic device, and the second control is a control corresponding to the second electronic device.

[0017] In a possible implementation manner, the displaying the second interactive function corresponding to the second electronic device may include:

[0018] In response to a second operation on the second control, a second interactive function corresponding to the second electronic device is displayed.

[0019] Optionally, the second operation includes clicking the second control, or dragging the second control, and releasing the second control when the distance between the second control and the first control is less than a preset threshold.

[0020] In the device interaction method provided by this implementation, after the first electronic device determines the second interaction function corresponding to each second electronic device, it can display the second interaction function corresponding to the second electronic device according to a click operation or a drag operation on the second control corresponding to a second electronic device, that is, display the second interaction function corresponding to the second electronic device with which the user wants to interact, so as to facilitate the user to select the second interaction function corresponding to the second electronic device to perform device interaction, thereby improving the convenience of interaction and enhancing the user experience.

[0021] In another possible implementation manner, after determining the second interactive function corresponding to the second electronic device, the method may further include:

[0022] Displaying a function icon corresponding to the second interactive function;

[0023] The displaying of the second interactive function corresponding to the second electronic device may include:

[0024] In response to a click operation on the function icon, a second interactive function corresponding to the second electronic device is displayed.

[0025] In the device interaction method provided by this implementation, after the first electronic device determines the second interactive function corresponding to each second electronic device, it can display the function icon, and when a click operation on the function icon is detected, the second interactive function corresponding to each second electronic device can be displayed, that is, when the user needs to select an interactive function, the second interactive function corresponding to the second electronic device can be displayed.

[0026] In another possible implementation manner, after determining the second interactive function corresponding to the second electronic device, the method may further include:

[0027] In response to a third operation on the second control, displaying a function icon corresponding to the second interactive function;

[0028] The displaying of the second interactive function corresponding to the second electronic device may include:

[0029] In response to a click operation on the function icon, a second interactive function corresponding to the second electronic device is displayed.

[0030] Optionally, the third operation includes clicking the second control, or dragging the second control, and releasing the second control when the distance between the second control and the first control is less than a preset threshold.

[0031] In the device interaction method provided by this implementation, after the first electronic device determines the second interaction function corresponding to each second electronic device, it can display the function icon corresponding to the second electronic device corresponding to the second control according to a click or drag operation on a second control, and display the second interaction function corresponding to the second electronic device when a click or drag operation on the function icon is detected. That is, according to the user's click or drag operation, the second interaction function corresponding to the second electronic device with which the user wants to interact with the device is displayed, so as to facilitate device interaction and improve user experience.

[0032] In one example, determining at least one first interactive function corresponding to the application scenario may include:

[0033] At least one first interactive function corresponding to the application scenario is determined according to a preset corresponding relationship between the application scenario and the interactive function.

[0034] In the device interaction method provided by this implementation, the first electronic device can directly determine the first interaction function corresponding to the application scenario based on the preset correspondence between the application scenario and the interaction function, that is, the first interaction function may include interaction functions supported by the first electronic device, and may also include interaction functions not supported by the first electronic device.

[0035] In another example, determining at least one first interactive function corresponding to the application scenario may include:

[0036] According to the device information of the first electronic device and the preset correspondence between the application scenario and the interactive function, the first interactive function corresponding to the application scenario is determined, and the device information of the first electronic device includes information of the interactive function supported by the first electronic device.

[0037] In the device interaction method provided by this implementation, the first electronic device can determine the first interaction function corresponding to the application scenario based on the device information of the first electronic device and the preset correspondence between the application scenario and the interaction function, that is, the first interaction function only includes the interaction functions supported by the first electronic device, which can effectively reduce the number of first interaction functions and improve the speed of determining the second interaction function.

[0038] Exemplarily, determining the second interactive function corresponding to the second electronic device according to the first interactive function, the device information of the first electronic device, and the device information of the second electronic device may include:

[0039] For each of the first interactive functions, determine a first constraint condition and a second constraint condition corresponding to the first interactive function, where the first constraint condition is a condition that a sending end corresponding to the first interactive function needs to satisfy, and the second constraint condition is a condition that a receiving end corresponding to the first interactive function needs to satisfy;

[0040] According to the first constraint condition and the device information of the first electronic device, and the second constraint condition and the device information of the second electronic device, a second interactive function corresponding to the second electronic device is determined from the first interactive functions.

[0041] In the device interaction method provided by the implementation, after determining the first interactive function corresponding to the application scenario, the first electronic device can determine the first constraint and the second constraint corresponding to each first interactive function. Therefore, the first electronic device can determine the second interactive function corresponding to the second electronic device from the first interactive function according to the first constraint, the second constraint, the device information of the first electronic device and the device information of the second electronic device. That is, the second interactive function is the interactive function corresponding to the application scenario among the interactive functions supported by the second electronic device. The second interactive function can be all the interactive functions supported by the second electronic device, or it can be part of the interactive functions supported by the second electronic device, so as to determine the interactive function that the user is most likely to use among the interactive functions supported by the second electronic device according to the application scenario as the second interactive function and present it to the user, so as to facilitate the user to quickly select the interactive function, improve the efficiency of device interaction, and enhance the user experience.

[0042] In a second aspect, an embodiment of the present application provides a device interaction apparatus, which is applied to a first electronic device, and the apparatus may include:

[0043] an application scenario determination module, configured to determine a current application scenario of the first electronic device and determine at least one first interactive function corresponding to the application scenario;

[0044] an interactive function determination module, configured to determine a second interactive function corresponding to the second electronic device according to the first interactive function, device information of the first electronic device, and device information of the second electronic device, wherein the second interactive function is one or more of the first interactive functions, and the second electronic device is associated with the first electronic device;

[0045] An interactive function display module, used for displaying a second interactive function corresponding to the second electronic device;

[0046] The interaction execution module is used to determine to execute the third interaction function with the second electronic device in response to a first operation on the third interaction function, where the third interaction function is one of the second interaction functions corresponding to the second electronic device.

[0047] Exemplarily, the application scenario determination module is further used to detect a preset operation; and determine a current application scenario of the first electronic device in response to the preset operation.

[0048] In one example, the preset operation includes touching a preset area of ​​the first electronic device to a preset area of ​​the second electronic device.

[0049] In another example, the preset operation includes entering the first interface of the first electronic device, or clicking the second control in the first interface, or dragging the second control in the first interface, and releasing the second control when the distance between the second control and the first control is less than a preset threshold, the first interface includes the second control, or the first interface includes the first control and the second control, the first control is a control corresponding to the first electronic device, and the second control is a control corresponding to the second electronic device.

[0050] In a possible implementation, the interactive function display module is further configured to display a second interactive function corresponding to the second electronic device in response to a second operation on the second control.

[0051] Optionally, the second operation includes clicking the second control, or dragging the second control, and releasing the second control when the distance between the second control and the first control is less than a preset threshold.

[0052] In another possible implementation, the device may further include:

[0053] A first icon display module, used to display a function icon corresponding to the second interactive function;

[0054] The interactive function display module is further used to display a second interactive function corresponding to the second electronic device in response to a click operation on the function icon.

[0055] In another possible implementation, the device may further include:

[0056] A second icon display module, configured to display a function icon corresponding to the second interactive function in response to a third operation on the second control;

[0057] The interactive function display module is further used to display a second interactive function corresponding to the second electronic device in response to a click operation on the function icon.

[0058] Optionally, the third operation includes clicking the second control, or dragging the second control, and releasing the second control when the distance between the second control and the first control is less than a preset threshold.

[0059] In one example, the application scenario determination module is further used to determine at least one first interactive function corresponding to the application scenario according to a preset correspondence relationship between the application scenario and the interactive function.

[0060] In another example, the application scenario determination module is further used to determine a first interactive function corresponding to the application scenario based on device information of the first electronic device and a preset correspondence between the application scenario and the interactive function, wherein the device information of the first electronic device includes information on the interactive functions supported by the first electronic device.

[0061] Exemplarily, the interactive function determination module is specifically used to determine, for each of the first interactive functions, a first constraint condition and a second constraint condition corresponding to the first interactive function, wherein the first constraint condition is a condition that a sending end corresponding to the first interactive function needs to satisfy, and the second constraint condition is a condition that a receiving end corresponding to the first interactive function needs to satisfy; based on the first constraint condition and device information of the first electronic device, as well as the second constraint condition and device information of the second electronic device, determine the second interactive function corresponding to the second electronic device from the first interactive function.

[0062] In a third aspect, an embodiment of the present application provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the electronic device implements the device interaction method described in any one of the first aspects above.

[0063] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a computer, the computer implements the device interaction method described in any one of the first aspects above.

[0064] In a fifth aspect, an embodiment of the present application provides a computer program product, which, when executed on an electronic device, enables the electronic device to execute the device interaction method described in any one of the above-mentioned first aspects.

[0065] It can be understood that the beneficial effects of the second to fifth aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0066] Figure 1 A schematic diagram of the structure of a mobile phone to which the device interaction method provided in an embodiment of the present application is applicable;

[0067] Figure 2 is a schematic diagram of a software architecture to which the device interaction method provided in an embodiment of the present application is applicable;

[0068] Figure 3 It is a flowchart of a device interaction method provided by an embodiment of the present application;

[0069] Figure 4 This is an example of an application scenario provided by an embodiment of the present application. Figure 1 ;

[0070] Figure 5 and Figure 6 This is an example of an application scenario provided by an embodiment of the present application. Figure 2 ;

[0071] Figure 7 It is a flowchart of a device interaction method provided in another embodiment of the present application. DETAILED DESCRIPTION

[0072] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, wholes, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or combinations thereof.

[0073] It should also be understood that the term “and / or” used in the specification and appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0074] As used in the specification and appended claims of this application, the term "if" can be interpreted as "when" or "uponce" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is detected" can be interpreted as meaning "uponce it is determined" or "in response to determining" or "uponce [described condition or event] is detected" or "in response to detecting [described condition or event]", depending on the context.

[0075] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0076] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0077] In addition, the “plurality” mentioned in the embodiments of the present application should be interpreted as two or more.

[0078] The steps involved in the device interaction method provided in the embodiments of the present application are only examples. Not all steps are mandatory steps, or not all information or messages are mandatory. They can be increased or decreased as needed during use. The same step or steps or messages with the same function in the embodiments of the present application can be referenced and learned from each other in different embodiments.

[0079] The business scenarios described in the embodiments of the present application are intended to more clearly illustrate the technical solutions of the embodiments of the present application, and do not constitute a limitation on the technical solutions provided in the embodiments of the present application. A person of ordinary skill in the art will appreciate that, with the evolution of network architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

[0080] With the development of IoT technology, more and more devices can interact with each other, such as screen projection, audio projection, multi-screen collaboration, distributed cameras, etc. When a device supports multiple interactive capabilities, the user needs to determine the interactive capability currently required and trigger the interactive capability through the entrance corresponding to the interactive capability. For example, when a tablet supports both multi-screen collaboration and distributed cameras, if the user determines that the mobile phone needs to perform multi-screen collaboration, the user can click the tablet icon in the control center of the mobile phone to perform multi-screen collaboration with the tablet. If the user determines that the mobile phone needs to use a distributed camera, the user needs to open the camera application and click the button corresponding to the distributed camera to call the tablet's camera. That is, the entrances to the existing device interaction functions are scattered, affecting the user experience.

[0081] To solve the above problems, an embodiment of the present application provides a device interaction method, an electronic device, and a computer-readable storage medium. In the method, when a first electronic device needs to perform device interaction, the first electronic device can determine the current application scenario of the first electronic device and determine at least one first interaction function corresponding to the application scenario. Subsequently, the first electronic device can determine the second interaction function corresponding to the second electronic device based on the first interaction function, the device information of the first electronic device, and the device information of the second electronic device. The second interaction function is one or more of the first interaction functions, and the second electronic device is associated with the first electronic device. Then, the first electronic device can display the second interaction function corresponding to the second electronic device, and can perform the second interaction function with the second electronic device in response to a first operation on a displayed second interaction function (which can be called a third interaction function).

[0082] That is, in the embodiment of the present application, the first electronic device can determine the first interactive function that the user may need to execute according to the current application scenario, and can determine the second interactive function supported by the second electronic device in the first interactive function according to the device information of the first electronic device and the device information of the second electronic device, and uniformly display the second interactive function supported by the second electronic device in the interface of the first electronic device, that is, the second interactive function is an interactive function supported by the second electronic device and corresponding to the current application scenario of the first electronic device, and the second interactive function can be all the interactive functions supported by the second electronic device, or a part of all the interactive functions supported by the second electronic device, so as to display the second interactive function that the user may need to use according to the current application scenario, so as to facilitate the user to quickly select the interactive function according to the current application scenario, and improve the efficiency of device interaction. In addition, the operation entrance for the first electronic device to interact with the second electronic device can be unified in the interface of the first electronic device, so as to facilitate the user to interact between devices and improve the user experience.

[0083] In the embodiment of the present application, the first electronic device may be a mobile phone, a tablet, a smart TV, a vehicle-mounted device, a laptop, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), a desktop computer, a smart TV, a smart large screen, etc. The second electronic device may be a mobile phone, a tablet, a smart TV, a vehicle-mounted device, a laptop, a UMPC, a netbook, a PDA, a desktop computer, a smart TV, a smart large screen, a smart speaker, etc. The embodiment of the present application does not impose any restrictions on the specific types of the first electronic device and the second electronic device.

[0084] The following uses a mobile phone as an example to describe the electronic device (ie, the first electronic device or the second electronic device) involved in the embodiment of the present application. Figure 1 , Figure 1 A schematic diagram of the structure of the mobile phone 100 is shown. It is understandable that other electronic devices, such as tablets, smart TVs, smart large screens, etc., can refer to the schematic diagram of the structure of the mobile phone 100. Of course, other electronic devices may include more or fewer components than the mobile phone 100, or combine some components, or split some components, or arrange the components differently.

[0085] The mobile phone 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, an antenna 1, an antenna 2, a mobile communication module 140, a wireless communication module 150, an audio module 160, a speaker 160A, a receiver 160B, a microphone 160C, an earphone interface 160D, a sensor module 180, a camera 170, and a display screen 190, etc. Among them, the sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a magnetic sensor 180C, an acceleration sensor 180D, a distance sensor 180E, a fingerprint sensor 180F, a touch sensor 180G, etc.

[0086] It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the mobile phone 100. In other embodiments of the present application, the mobile phone 100 may include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0087] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0088] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.

[0089] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0090] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0091] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple groups of I2C buses. The processor 110 may be coupled to the touch sensor 180G, the camera 170, etc. through different I2C bus interfaces. For example: the processor 110 may be coupled to the touch sensor 180G through the I2C interface, so that the processor 110 communicates with the touch sensor 180G through the I2C bus interface, thereby realizing the touch function of the mobile phone 100.

[0092] The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple I2S buses. The processor 110 can be coupled to the audio module 160 via the I2S bus to achieve communication between the processor 110 and the audio module 160. In some embodiments, the audio module 160 can transmit an audio signal to the wireless communication module 150 via the I2S interface to achieve the function of answering a call through a Bluetooth headset.

[0093] The PCM interface can also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 160 and the wireless communication module 150 can be coupled via a PCM bus interface. In some embodiments, the audio module 160 can also transmit audio signals to the wireless communication module 150 via the PCM interface to realize the function of answering calls via a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

[0094] The UART interface is a universal serial data bus for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is generally used to connect the processor 110 and the wireless communication module 150. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 150 through the UART interface to implement the Bluetooth function. In some embodiments, the audio module 160 can transmit an audio signal to the wireless communication module 150 through the UART interface to implement the function of playing music through a Bluetooth headset.

[0095] The MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 190 and the camera 170. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), etc. In some embodiments, the processor 110 and the camera 170 communicate via the CSI interface to implement the shooting function of the mobile phone 100. The processor 110 and the display screen 190 communicate via the DSI interface to implement the display function of the mobile phone 100.

[0096] The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 with the camera 170, the display 190, the wireless communication module 150, the audio module 160, the sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0097] The USB interface 130 is an interface that complies with the USB standard specification, and can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the mobile phone 100, and can also be used to transfer data between the mobile phone 100 and peripheral devices. It can also be used to connect headphones to play audio through the headphones. The interface can also be used to connect other electronic devices, such as AR devices, etc.

[0098] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present application is only a schematic illustration and does not constitute a structural limitation on the mobile phone 100. In other embodiments of the present application, the mobile phone 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0099] The wireless communication function of the mobile phone 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 140, the wireless communication module 150, the modem processor and the baseband processor.

[0100] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in mobile phone 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0101] The mobile communication module 140 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the mobile phone 100. The mobile communication module 140 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 140 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 140 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 140 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 140 can be set in the same device as at least some of the modules of the processor 110.

[0102] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 160A, a receiver 160B, etc.), or displays an image or video through a display screen 190. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 140 or other functional modules.

[0103] The wireless communication module 150 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the mobile phone 100. The wireless communication module 150 can be one or more devices integrating at least one communication processing module. The wireless communication module 150 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 150 can also receive the signal to be sent from the processor 110, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0104] In some embodiments, the antenna 1 of the mobile phone 100 is coupled to the mobile communication module 140, and the antenna 2 is coupled to the wireless communication module 150, so that the mobile phone 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0105] The mobile phone 100 implements the display function through a GPU, a display screen 190, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 190 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or change display information.

[0106] The display screen 190 is used to display images, videos, etc. The display screen 190 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light emitting diode or an active-matrix organic light emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the mobile phone 100 may include 1 or N display screens 190, where N is a positive integer greater than 1.

[0107] The mobile phone 100 can realize the shooting function through the ISP, the camera 170, the video codec, the GPU, the display screen 190 and the application processor.

[0108] The ISP is used to process the data fed back by the camera 170. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye. The ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. The ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, the ISP can be set in the camera 170.

[0109] The camera 170 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the mobile phone 100 may include 1 or N cameras 170, where N is a positive integer greater than 1.

[0110] The digital signal processor is used to process digital signals, and can process not only digital image signals but also other digital signals. For example, when the mobile phone 100 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0111] Video codecs are used to compress or decompress digital videos. Mobile phone 100 may support one or more video codecs. Thus, mobile phone 100 may play or record videos in various coding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0112] NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can also continuously self-learn. Through NPU, the intelligent cognition of the mobile phone 100 can be realized, such as: image recognition, face recognition, voice recognition, text understanding, etc.

[0113] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the mobile phone 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function, such as storing music, video and other files in the external memory card.

[0114] The internal memory 121 can be used to store computer executable program codes, which include instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the mobile phone 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the mobile phone 100 by running instructions stored in the internal memory 121 and / or instructions stored in a memory provided in the processor.

[0115] The mobile phone 100 can implement audio functions such as music playing and recording through the audio module 160, the speaker 160A, the receiver 160B, the microphone 160C, the earphone interface 160D, and the application processor.

[0116] The audio module 160 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 160 can also be used to encode and decode audio signals. In some embodiments, the audio module 160 can be arranged in the processor 110, or some functional modules of the audio module 160 can be arranged in the processor 110.

[0117] The speaker 160A, also called a "speaker", is used to convert an audio electrical signal into a sound signal. The mobile phone 100 can listen to music or listen to a hands-free call through the speaker 160A.

[0118] The receiver 160B, also called a "handset", is used to convert audio electrical signals into sound signals. When the mobile phone 100 receives a call or voice message, the voice can be received by placing the receiver 160B close to the ear.

[0119] Microphone 160C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to the microphone 160C to input the sound signal into the microphone 160C. The mobile phone 100 can be provided with at least one microphone 160C. In other embodiments, the mobile phone 100 can be provided with two microphones 160C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the mobile phone 100 can also be provided with three, four or more microphones 160C to collect sound signals, reduce noise, identify the sound source, realize directional recording function, etc.

[0120] The earphone interface 160D is used to connect a wired earphone and can be a USB interface 130 or a 3.5 mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0121] The pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be set on the display screen 190. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. The capacitive pressure sensor can be a parallel plate including at least two conductive materials. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The mobile phone 100 determines the intensity of the pressure according to the change in capacitance. When a touch operation acts on the display screen 190, the mobile phone 100 detects the touch operation intensity according to the pressure sensor 180A. The mobile phone 100 can also calculate the touch position according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, an instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, an instruction to create a new short message is executed.

[0122] The gyroscope sensor 180B can be used to determine the motion posture of the mobile phone 100. In some embodiments, the angular velocity of the mobile phone 100 around three axes (i.e., x, y, and z axes) can be determined by the gyroscope sensor 180B. The gyroscope sensor 180B can be used for anti-shake shooting. Exemplarily, when the shutter is pressed, the gyroscope sensor 180B detects the angle of the shaking of the mobile phone 100, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to offset the shaking of the mobile phone 100 through reverse movement to achieve anti-shake. The gyroscope sensor 180B can also be used for navigation and somatosensory game scenes.

[0123] The magnetic sensor 180C includes a Hall sensor. The mobile phone 100 can use the magnetic sensor 180C to detect the opening and closing of the flip leather case. In some embodiments, when the mobile phone 100 is a flip phone, the mobile phone 100 can detect the opening and closing of the flip cover according to the magnetic sensor 180C. Then, according to the detected opening and closing state of the leather case or the opening and closing state of the flip cover, the flip cover automatic unlocking and other features are set.

[0124] The acceleration sensor 180D can detect the magnitude of the acceleration of the mobile phone 100 in all directions (generally three axes). When the mobile phone 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the electronic device and is applied to applications such as horizontal and vertical screen switching, pedometers, etc.

[0125] The distance sensor 180E is used to measure the distance. The mobile phone 100 can measure the distance by infrared or laser. In some embodiments, when shooting a scene, the mobile phone 100 can use the distance sensor 180E to measure the distance to achieve fast focusing.

[0126] The fingerprint sensor 180F is used to collect fingerprints. The mobile phone 100 can use the collected fingerprint characteristics to achieve fingerprint unlocking, access application locks, fingerprint photography, fingerprint call answering, etc.

[0127] The touch sensor 180G is also called a "touch control device". The touch sensor 180G can be set on the display screen 190, and the touch sensor 180G and the display screen 190 form a touch screen, also called a "touch control screen". The touch sensor 180G is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 190. In other embodiments, the touch sensor 180G can also be set on the surface of the mobile phone 100, which is different from the position of the display screen 190.

[0128] The software system of the mobile phone 100 may adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. For example, the software system of the mobile phone 100 may adopt an Android operating system (OS), a Harmony OS, or an IOS with a layered architecture. The embodiment of the present application takes the Android system with a layered architecture as an example to illustrate the software structure of the mobile phone 100.

[0129] Figure 2 It is a software structure block diagram of the mobile phone 100 according to an embodiment of the present application.

[0130] The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system library, and the kernel layer.

[0131] The application layer can include a series of application packages.

[0132] like Figure 2 As shown, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc.

[0133] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0134] like Figure 2As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

[0135] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0136] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0137] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.

[0138] The phone manager is used to provide communication functions of the mobile phone 100, such as management of call status (including answering, hanging up, etc.).

[0139] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0140] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.

[0141] Android Runtime includes core libraries and virtual machines. Android runtime is responsible for scheduling and management of the Android system.

[0142] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.

[0143] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0144] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0145] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0146] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0147] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0148] A 2D graphics engine is a drawing engine for 2D drawings.

[0149] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

[0150] The device interaction method provided in the embodiment of the present application will be described in detail below with reference to the accompanying drawings and specific application scenarios.

[0151] See also Figure 3 , Figure 3 The schematic flow chart of the device interaction method provided by an embodiment of the present application is shown. The method can be applied to a first electronic device. The first electronic device can be any electronic device such as a mobile phone, a tablet, a smart TV, a car device, a laptop computer, a smart large screen, etc. Figure 3 As shown, the method may include:

[0152] S301: Determine a current application scenario of a first electronic device, and determine at least one first interactive function corresponding to the application scenario.

[0153] S302: Determine a second interactive function corresponding to the second electronic device according to the first interactive function, device information of the first electronic device, and device information of the second electronic device, where the second interactive function is one or more of the first interactive functions, and the second electronic device is associated with the first electronic device.

[0154] S303: Display a second interactive function corresponding to the second electronic device.

[0155] S304: In response to the first operation on the third interactive function, determine to execute the third interactive function with the second electronic device, where the third interactive function is one of the second interactive functions corresponding to the second electronic device.

[0156] In the embodiment of the present application, when the first electronic device needs to interact, the first electronic device can determine the first interactive function that the user may need to execute according to the current application scenario of the first electronic device, and can determine the second interactive function supported by the second electronic device from the first interactive function according to the device information of the first electronic device and the device information of the second electronic device, and uniformly display the second interactive function supported by the second electronic device in the interface of the first electronic device. That is, the second interactive function is an interactive function supported by the second electronic device and corresponding to the current application scenario of the first electronic device. The second interactive function can be all the interactive functions supported by the second electronic device, or a part of all the interactive functions supported by the second electronic device, so as to display the second interactive function that the user may need to use according to the current application scenario, so as to facilitate the user to quickly select the interactive function according to the current application scenario, so as to improve the efficiency of device interaction. In addition, by using the interface of the first electronic device as a unified entrance for the interaction between the first electronic device and the second electronic device, it is convenient for the user to interact between devices and improve the user experience.

[0157] Exemplarily, the first electronic device can determine whether the first electronic device needs to interact based on whether a preset operation is detected. That is, when a preset operation is detected, the first electronic device determines that device interaction is required. At this time, the first electronic device can determine the current application scenario of the first electronic device and determine the first interactive function corresponding to the application scenario, so as to determine the second interactive function supported by the second electronic device based on the first interactive function.

[0158] In one possible implementation, the preset operation may be an operation in which a preset area of ​​the first electronic device touches a preset area of ​​the second electronic device. For example, the preset area may be an area where an NFC chip is located (hereinafter referred to as the NFC area). That is, when the first electronic device reads the NFC information of the second electronic device through the NFC module of the first electronic device, the first electronic device may determine that device interaction is required. At this time, the first electronic device may determine the current application scenario of the first electronic device and determine the first interaction function corresponding to the application scenario, so as to determine the second interaction function corresponding to the second electronic device according to the first interaction function, thereby displaying the second interaction function in the interface of the first electronic device for the user to select the interaction function.

[0159] See also Figure 4 , Figure 4 The application scenario provided by the embodiment of the present application is shown Figure 1This application scenario is exemplified by taking the first electronic device as a mobile phone 100 and the second electronic device as a laptop computer 400 as an example. The mobile phone 100 is provided with an NFC chip, and the laptop computer 400 is also provided with an NFC chip, and the mobile phone 100 can be connected to the laptop computer 400 through a communication network.

[0160] like Figure 4 As shown in (a), when the mobile phone 100 displays a certain application interface (such as a video playback interface), if the user wants to trigger the mobile phone 100 to interact with the laptop computer 400, the user can touch the NFC area in the mobile phone 100 to the NFC area in the laptop computer 400. When the mobile phone 100 reads the NFC information in the laptop computer 400 through the NFC module of the mobile phone 100, the mobile phone 100 determines that the mobile phone 100 needs to interact with the laptop computer 400. At this time, the mobile phone 100 can obtain the current application scenario of the mobile phone 100 and determine the first interactive function corresponding to the application scenario. Assume that the application scenario is a video scene, and the first interactive function includes multi-screen collaboration, screen projection, audio projection, and application relay. Subsequently, the mobile phone 100 can determine the second interactive function supported by the laptop computer 400 from the first interactive function based on the device information of the mobile phone 100 and the device information of the laptop computer 400. Assume that the second interactive function includes multi-screen collaboration and screen projection. The mobile phone 100 can display the second interactive function corresponding to the laptop computer 400 on the screen of the mobile phone 100. For example, as Figure 4 As shown in (b), the mobile phone 100 can display a prompt window 401, and a multi-screen collaboration button and a projection button can be displayed in the prompt window 401. The user can click the multi-screen collaboration button to perform multi-screen collaboration between the mobile phone 100 and the laptop computer 400, or can click the projection button to project the content displayed in the mobile phone 100 to the laptop computer 400 for display.

[0161] In another possible implementation, the preset operation may be an operation of entering interface A of the first electronic device. Interface A may display controls corresponding to associated devices of the first electronic device, or may display controls corresponding to the first electronic device and controls corresponding to associated devices of the first electronic device. The associated device of the first electronic device may be an electronic device that is located in the same network as the first electronic device (such as a wireless fidelity (Wi-Fi) network), or an electronic device that logs in to the same account as the first electronic device, or an electronic device that logs in to an account belonging to the same group as the first electronic device (such as an account belonging to the same family group), or an electronic device that is connected to the first electronic device via Bluetooth or Wi-Fi Direct. Among them, the controls corresponding to the device may be device icons and / or names, etc. At this time, the second electronic device may include all associated devices of the first electronic device, or may be an associated device of the first electronic device.

[0162] It should be noted that the embodiment of the present application does not impose any restrictions on the layout of the controls in the interface A. For example, the control A corresponding to the first electronic device may be set at a certain position (such as the center) in the interface A, and the controls B corresponding to the associated devices may be equidistantly arranged around the control A. For example, the control A corresponding to the first electronic device may be set at a certain position in the interface A, and the controls corresponding to the associated devices may be arranged according to the distance between the associated devices and the first electronic device, such as when the distance between an associated device and the first electronic device is smaller, the control corresponding to the associated device is closer to the control corresponding to the first electronic device, and when the distance between an associated device and the first electronic device is larger, the control corresponding to the associated device is farther from the control corresponding to the first electronic device.

[0163] Optionally, the user can enter interface A through the control center, or can enter interface A through the negative one screen, notification bar, etc. That is, the embodiment of the present application does not limit the specific method of entering interface A. The following will be exemplified by taking entering interface A through the control center as an example.

[0164] See also Figure 5 and Figure 6 , Figure 5 and Figure 6 The application scenario provided by the embodiment of the present application is shown Figure 2 This application scenario is exemplified by taking the first electronic device as a mobile phone 100 and the control as a device icon as an example.

[0165] like Figure 5As shown in (a), when the mobile phone 100 displays a certain application interface (such as a video playback interface), if the user wants to trigger the mobile phone 100 to interact with a certain electronic device, the user can enter interface A through the control center, for example, by sliding down from the top of the screen. After the mobile phone 100 detects the operation, it can obtain the device information of the associated devices of the mobile phone 100 and display interface A in the mobile phone 100. Assume that the associated devices of the mobile phone 100 include a tablet, a smart screen and a smart speaker. Figure 5 As shown in (b), the interface A may display the device icon 501 of the mobile phone 100, the device icon 502 of the tablet, the device icon 503 of the smart screen, and the device icon 504 of the smart speaker. After entering the interface A, the mobile phone 100 may determine the current application scene of the mobile phone 100, and may determine the first interactive function corresponding to the application scene. Assume that the current application scene of the mobile phone 100 is a video scene, and the first interactive functions corresponding to the video scene include multi-screen collaboration, screen projection, audio projection, and application relay.

[0166] Subsequently, the mobile phone 100 can determine the second interactive function corresponding to the tablet from the first interactive function based on the device information of the mobile phone 100 and the device information of the tablet, assuming that the second interactive function corresponding to the tablet includes multi-screen collaboration and application relay. Similarly, the mobile phone 100 can determine the second interactive function corresponding to the smart large screen from the first interactive function based on the device information of the mobile phone 100 and the device information of the smart large screen, assuming that the second interactive function corresponding to the smart large screen is screen projection. Similarly, the mobile phone 100 can determine the second interactive function corresponding to the smart speaker from the first interactive function based on the device information of the mobile phone 100 and the device information of the smart speaker, assuming that the second interactive function corresponding to the smart speaker is audio projection.

[0167] In one example, after determining the second interactive function corresponding to each associated device, the mobile phone 100 may directly display the second interactive function corresponding to each associated device in the interface A. Exemplarily, the mobile phone 100 may display the second interactive function through a prompt window or a card.

[0168] For example, Figure 5 As shown in (c), the mobile phone 100 can pop up a prompt window 500 in interface A, and can display the second interactive function corresponding to each associated device in the prompt window 500, that is, the second interactive function "multi-screen collaboration" and "application relay" corresponding to the tablet, the second interactive function "screen projection" corresponding to the smart large screen, and the second interactive function "audio projection" corresponding to the smart speaker can be displayed in the prompt window 500.

[0169] For example, Figure 5As shown in (d), the mobile phone 100 can display the cards corresponding to each associated device in the interface A, and can display the second interactive function corresponding to the associated device in the card corresponding to each associated device, that is, the card 5021 corresponding to the tablet, the card 5031 corresponding to the smart large screen and the card 5041 corresponding to the smart speaker can be displayed in the interface A, and the second interactive functions "multi-screen collaboration" and "application relay" corresponding to the tablet can be displayed in the card 5021, the second interactive function "screen projection" corresponding to the smart large screen can be displayed in the card 5031, and the second interactive function "audio projection" corresponding to the smart speaker can be displayed in the card 5041.

[0170] It should be noted that the embodiment of the present application does not impose any restrictions on the display mode and display order of the second interactive function in the prompt window, which can be determined according to actual conditions. Similarly, the embodiment of the present application does not impose any restrictions on the display position of each card, and any card can be displayed at any position of interface A. Among them, in order to improve the user experience, such as Figure 5 As shown in (d) in FIG. 1 , a card corresponding to each associated device may be displayed near the device icon of the associated device.

[0171] In another example, Figure 6 As shown in (a) of FIG. 1 , after determining the second interactive function corresponding to each associated device, the mobile phone 100 can display the function icon 600 in the interface A. When a click operation on the function icon 600 is detected, the mobile phone 100 can display the second interactive function corresponding to each associated device in the interface A. For example, the mobile phone 100 can Figure 5 The prompt window shown in (c) in the figure can be used to display the second interactive function corresponding to each associated device, or the second interactive function corresponding to each associated device can be displayed by Figure 5 The card shown in (d) in the figure is used to display the second interactive function corresponding to each associated device.

[0172] It should be noted that the above-mentioned four-leaf clover as the function icon 600 is only an exemplary explanation and should not be understood as a limitation on the embodiments of the present application. The embodiments of the present application do not impose any limitation on the specific shape of the function icon 600.

[0173] In another example, after determining the second interactive function corresponding to each associated device, the mobile phone 100 may display the second interactive function of the associated device corresponding to the device icon in interface A when detecting operation 1 on a certain device icon. Alternatively, the mobile phone 100 may display the function icon 600 in interface A when detecting operation 1 on a certain device icon. When a click operation on the function icon 600 is detected, the mobile phone 100 may display the second interactive function corresponding to the associated device in interface A. That is, after determining the second interactive function corresponding to each associated device, the mobile phone 100 does not display the second interactive function corresponding to each associated device in interface A, but obtains operation 1 performed by the user to determine a certain associated device selected for interaction by the user according to operation 1, and only displays the second interactive function corresponding to the associated device in interface A, so that the user can select a certain second interactive function to interact with the device.

[0174] Among them, operation 1 can be a click operation, or it can be an operation of dragging the device icon to the vicinity of the device icon of the mobile phone 100. It should be understood that the vicinity means that the distance between the two device icons is less than a preset threshold, and the preset threshold can be specifically determined according to the actual situation. In addition. The embodiment of the present application does not specifically limit the dragging trajectory of the dragging operation, as long as the device icon is finally located near the device icon of the mobile phone 100.

[0175] For example, Figure 6 As shown in (b) of FIG. 1 , after determining the second interactive function corresponding to each associated device, when the mobile phone 100 detects that the device icon 503 of the smart screen is dragged to the vicinity of the device icon 501 of the mobile phone, the mobile phone 100 can display the function icon 600 in the interface A. When a click operation on the function icon 600 is detected, as shown in FIG. Figure 6 As shown in (c) in FIG. 1 , the mobile phone 100 can display the second interactive function corresponding to the smart large screen in the interface A, such as the mobile phone 100 can pop up a card or prompt window 601 ( Figure 6 The prompt window is taken as an example for exemplary explanation), and the second interactive function "screen projection" corresponding to the smart large screen can be displayed in the prompt window 601.

[0176] In summary, the mobile phone 100 can determine all associated devices of the mobile phone 100 as second electronic devices, and determine the current application scenario of the mobile phone 100 according to the preset operation performed by the user, and determine the first interactive function corresponding to the application scenario, so as to determine the second interactive function corresponding to each second electronic device according to the first interactive function. Subsequently, the mobile phone 100 can directly display the second interactive function corresponding to each second electronic device in the interface A, or display the second interactive function corresponding to each second electronic device based on the user's click operation on the function icon. Therefore, the user can select the second interactive function in the interface A to determine the second electronic device that will eventually interact with the mobile phone 100. The mobile phone 100 can perform related device interaction with the determined second electronic device according to the second interactive function selected by the user. Alternatively, the mobile phone 100 can display the second interactive function corresponding to the second electronic device in the interface A based on the user's operation 1 on the device icon of a second electronic device, so that the second interactive function corresponding to the second electronic device can be selected by the user, and the device interaction can be performed with the second electronic device.

[0177] In another possible implementation, the preset operation may also be an operation of clicking a control corresponding to a certain associated device (i.e., the second electronic device) in interface A. Alternatively, it may be an operation of dragging the control corresponding to the second electronic device in interface A to the vicinity of the control corresponding to the first electronic device.

[0178] That is, when the user wants to interact with the first electronic device and the second electronic device, the user can enter the interface A through the control center and click on a certain associated device in the interface A, or drag the device icon of the associated device to the vicinity of the device icon of the first electronic device. When the first electronic device detects the click operation or drag operation on the associated device, it can determine that the associated device is the second electronic device and that the user wants to interact with the first electronic device and the second electronic device. At this time, the first electronic device can determine the current application scenario of the first electronic device and determine the first interaction function corresponding to the application scenario, so as to determine the second interaction function corresponding to the second electronic device according to the first interaction function corresponding to the application scenario.

[0179] After determining the second interactive function corresponding to the second electronic device, the first electronic device may directly display the second interactive function corresponding to the second electronic device in interface A, so that the user can perform device interaction between the first electronic device and the second electronic device by selecting the second interactive function in interface A. Alternatively, the first electronic device may display a function icon in interface A, and when a click operation on the function icon is detected, the second interactive function corresponding to the second electronic device is displayed in interface A.

[0180] The following describes in detail a process of the first electronic device determining the first interactive function and a process of determining the second interactive function according to the first interactive function.

[0181] Exemplarily, the first electronic device can determine the current application scene of the first electronic device according to the running state of the first electronic device. For example, when the first electronic device runs a video application in the foreground, the first electronic device can determine that the current application scene is a video scene. When the first electronic device runs a music application in the foreground and is in a music playing state, the first electronic device can determine that the current application scene is an audio scene. When the first electronic device runs a video call application in the foreground, the first electronic device can determine that the current application scene is a video call scene. When the first electronic device runs a document editing application in the foreground, such as word, wps, etc., the first electronic device can determine that the current application scene is an office scene. When the first electronic device runs a camera application in the foreground, the first electronic device can determine that the current application scene is a shooting scene. When the first electronic device displays the desktop, that is, when no application is running in the foreground of the first electronic device, the first electronic device can determine that the current application scene is a default scene.

[0182] Among them, the first interactive function may include but is not limited to one or more of the interactive functions such as multi-screen collaboration, screen projection, audio projection, application relay and distributed camera. It should be understood that application relay means that one electronic device can relay the application running on another electronic device. The relayed application can be a video application, a music application, a document editing application, and a connected application (such as a video call application). A distributed camera means that an electronic device can call the camera of another electronic device to take pictures.

[0183] In a possible implementation, the first electronic device may determine the first interactive function corresponding to the current application scenario of the first electronic device according to the preset correspondence between the application scenario and the interactive function. The preset correspondence may be stored in the first electronic device, or in other devices that are connected to the first electronic device for communication, such as a cloud server. The preset correspondence may be set by default by the first electronic device, or may be set by a user, and the present application embodiment does not impose any restrictions on this.

[0184] Exemplarily, Table 1 shows an example of a preset correspondence relationship between application scenarios and interactive functions. Therefore, after the first electronic device determines the current application scenario of the first electronic device, it can determine the first interactive function corresponding to the application scenario by looking up Table 1.

[0185] Table 1

[0186]

[0187]

[0188] For example, when the first electronic device determines that the current application scenario is a video scenario, the first electronic device may determine that the first interactive function corresponding to the application scenario includes multi-screen collaboration, screen projection, audio projection, and application relay. For example, when the first electronic device determines that the current application scenario is a shooting scenario, the first electronic device may determine that the first interactive function corresponding to the application scenario is a distributed camera, and so on.

[0189] Optionally, after determining the first interactive function corresponding to the application scenario, the first electronic device may determine the constraint conditions A and constraint conditions B corresponding to each first interactive function, where constraint condition A may be a condition that the sending end corresponding to the first interactive function needs to satisfy, and constraint condition B may be a condition that the receiving end corresponding to the first interactive function needs to satisfy. Therefore, the first electronic device may determine the second interactive function corresponding to the second electronic device from the first interactive function based on constraint condition A, constraint condition B, device information of the first electronic device, and device information of the second electronic device. The second interactive function may be one or more of the first interactive functions.

[0190] It is understandable that the constraint conditions A and constraint conditions B corresponding to each first interactive function can be specifically set by the technical personnel according to the actual situation, and the embodiments of the present application do not impose specific restrictions on this. Among them, the device information mainly includes the basic attributes of the device and the service capabilities it has. For example, the device information may include the device ID, device type, device name, installed applications, whether screen projection is supported, the device type of the receiving end supported by screen projection and / or the device type of the sending end, whether audio projection is supported, the device type of the receiving end supported by audio projection and / or the device type of the sending end, whether multi-screen collaboration is supported, the device type of the receiving end supported by multi-screen collaboration and / or the device type of the sending end, whether application relay is supported, the device type of the receiving end supported by application relay and / or the device type of the sending end, whether distributed cameras are supported, the device type of the receiving end supported by distributed cameras and / or the device type of the sending end, and so on.

[0191] Exemplarily, Table 2 shows an example of constraint conditions A and constraint conditions B corresponding to each first interactive function. Therefore, after the first electronic device determines the first interactive function corresponding to the application scenario, it can obtain device information of the first electronic device and device information of the second electronic device, and can determine the second interactive function corresponding to the second electronic device according to the device information of the first electronic device, the device information of the second electronic device and Table 2.

[0192] Table 2

[0193]

[0194] Optionally, for each first interactive function, the first electronic device may determine whether the first interactive function is an interactive function supported by the second electronic device according to Table 2, the device information of the first electronic device, and the device information of the second electronic device, that is, determine whether the first electronic device satisfies the constraint condition A corresponding to the first interactive function according to the device information of the first electronic device, and determine whether the second electronic device satisfies the constraint condition B corresponding to the first interactive function according to the device information of the second electronic device. When the first electronic device satisfies the constraint condition A corresponding to the first interactive function, and the second electronic device satisfies the constraint condition B corresponding to the first interactive function, the first electronic device may determine that the first interactive function is an interactive function supported by the second electronic device, and at this time, the first electronic device may determine the first interactive function as the second interactive function corresponding to the second electronic device.

[0195] For example, when the first electronic device is a mobile phone and the second electronic device is a tablet, if it is determined that the current application scenario of the mobile phone is a video scene, the mobile phone can determine according to Table 1 that the first interactive function corresponding to the video scene includes multi-screen collaboration, screen projection, audio projection and application relay.

[0196] As for multi-screen collaboration, it can be seen from Table 2 that the sending end of multi-screen collaboration includes a mobile phone and the receiving end includes a tablet. At this time, if the mobile phone determines that the mobile phone supports multi-screen collaboration according to the device information of the mobile phone, and the mobile phone determines that the tablet supports multi-screen collaboration according to the device information of the tablet, the mobile phone can determine that multi-screen collaboration is the second interactive function corresponding to the tablet.

[0197] As for screen projection, it can be seen from Table 2 that the sending end of screen projection includes a mobile phone and the receiving end includes a tablet. At this time, if the mobile phone determines that the mobile phone supports screen projection according to the device information of the mobile phone, and the mobile phone determines that the tablet supports screen projection according to the device information of the tablet, the mobile phone can determine that screen projection is the second interactive function corresponding to the tablet.

[0198] As for audio projection, it can be seen from Table 2 that the sending end of audio projection includes the mobile phone, but the receiving end does not include the tablet. Therefore, the mobile phone can determine that audio projection is not the second interactive function corresponding to the tablet.

[0199] As for application relay, it can be seen from Table 2 that the sending end of application relay includes a mobile phone and the receiving end includes a tablet. At this time, if the mobile phone determines that the mobile phone supports application relay according to the device information of the mobile phone, and the mobile phone determines that the tablet supports application relay according to the device information of the tablet, the mobile phone can determine that application relay is the second interactive function corresponding to the tablet.

[0200] Therefore, in this video scenario, the mobile phone can determine that the second interactive functions corresponding to the tablet include multi-screen collaboration, screen projection and application relay.

[0201] In another possible implementation, the first electronic device may determine the first interactive function corresponding to the current application scenario of the first electronic device based on the device information of the first electronic device and the preset correspondence between the application scenario and the interactive function. Exemplarily, the first electronic device may determine the interactive function supported by the first electronic device based on the device information of the first electronic device, and determine the first interactive function corresponding to the current application scenario of the first electronic device based on the interactive function supported by the first electronic device and the preset correspondence. That is, the first interactive function is an interactive function corresponding to the current application scenario of the first electronic device and supported by the first electronic device.

[0202] Exemplarily, Table 3 shows an example of the first interactive function corresponding to each application scenario when the first electronic device is a mobile phone. Therefore, when the first electronic device is a mobile phone, after the mobile phone determines the current application scenario of the mobile phone, it can determine the first interactive function corresponding to the application scenario by looking up Table 3.

[0203] Table 3

[0204]

[0205] Among them, 011 indicates tablet, 012 indicates laptop, 013 indicates mobile phone, 09C indicates smart large screen, 00A indicates smart speaker, phoneextend indicates multi-screen collaboration, cast indicates screen projection, relay indicates application relay, sound indicates sound projection, and camera indicates distributed camera. That is, 011_phoneextend indicates multi-screen collaboration with tablet as the receiving end, 011_cast indicates screen projection with tablet as the receiving end, 011_relay indicates application relay with tablet as the receiving end, and the other expressions are similar and will not be repeated here.

[0206] Similar to the above, after determining the first interactive function corresponding to the application scenario, the first electronic device can determine the constraint conditions A and constraint conditions B corresponding to each first interactive function. Therefore, the first electronic device can determine the second interactive function corresponding to the second electronic device from the first interactive functions according to the constraint conditions A, the constraint conditions B, the device information of the first electronic device, and the device information of the second electronic device.

[0207] Exemplarily, Table 4 shows an example of constraint conditions A and constraint conditions B corresponding to each first interactive function. Therefore, after the first electronic device determines the first interactive function corresponding to the application scenario, it can obtain device information of the first electronic device and device information of the second electronic device, and can determine the second interactive function corresponding to the second electronic device according to the device information of the first electronic device, the device information of the second electronic device and Table 4.

[0208] Table 4

[0209]

[0210]

[0211] It should be noted that when developers are developing code, each constraint condition A and each constraint condition B can be set as a separate atomic capability module, so that the atomic capability modules can be reused in different application scenarios to improve development efficiency.

[0212] For example, the constraint condition A corresponding to the sending end in 011_phoneextend can be set to the atomic capability module A1, the constraint condition B corresponding to the receiving end can be set to the atomic capability module B1, the constraint condition B corresponding to the receiving end in 012_phoneextend can be set to the atomic capability module B2, and so on.

[0213] When the first electronic device is a mobile phone and the second electronic device is a tablet, the mobile phone can determine whether multi-screen collaboration is the second interactive function corresponding to the tablet according to the atomic capability module A1 and the atomic capability module B1. When the first electronic device is a mobile phone and the second electronic device is a laptop, the mobile phone can determine whether multi-screen collaboration is the second interactive function corresponding to the laptop according to the atomic capability module A1 and the atomic capability module B2, and so on.

[0214] Alternatively, when developers are developing codes, each sub-condition in constraint A and each sub-condition in constraint B can be set as a separate atomic capability module.

[0215] For example, the first item (i.e., the device type of the sending end is a mobile phone) and the second item (i.e., the sending end supports multi-screen collaboration) of the constraint condition A corresponding to the sending end in 011_phoneextend can be set to atomic capability module A1 and atomic capability module A2 respectively, the first item (i.e., the device type of the receiving end is a tablet) and the second item (i.e., the receiving end supports multi-screen collaboration) of the constraint condition B corresponding to the receiving end in 011_phoneextend can be set to atomic capability module B1 and atomic capability module B2 respectively, and the first item (i.e., the device type of the receiving end is a laptop computer) of the constraint condition B corresponding to the receiving end in 012_phoneextend can be set to atomic capability module B3, and so on.

[0216] When the first electronic device is a mobile phone and the second electronic device is a tablet, the mobile phone can determine whether multi-screen collaboration is the second interactive function corresponding to the tablet according to the atomic capability module A1, the atomic capability module A2, and the atomic capability module B1 and the atomic capability module B2. When the first electronic device is a mobile phone and the second electronic device is a laptop, the mobile phone can determine whether multi-screen collaboration is the second interactive function corresponding to the laptop according to the atomic capability module A1, the atomic capability module A2, and the atomic capability module B3 and the atomic capability module B2, and so on.

[0217] See also Figure 7 , Figure 7 A schematic flow chart of a device interaction method provided by another embodiment of the present application is shown. The method can be applied to a first electronic device (e.g., a mobile phone). The method takes the case where it is detected that the mobile phone needs to perform device interaction when entering interface A through the control center. The mobile phone may include a control center, a smart decision module, a device portrait module, and a capability module. Figure 7 As shown, the method may include:

[0218] S701. When it is detected that the control center is pulled down to enter interface A, the control center sends a pull-down instruction to the intelligent decision-making module.

[0219] S702. After receiving the pull-down instruction, the intelligent decision-making module determines the current application scenario of the mobile phone and determines the first interactive function corresponding to the application scenario.

[0220] S703. The intelligent decision-making module obtains device information of the second electronic device from the device portrait module.

[0221] S704. The intelligent decision-making module determines the second interactive function corresponding to the second electronic device according to the device information of the mobile phone, the device information of the second electronic device and the first interactive function, and adds the information of the second interactive function corresponding to the second electronic device to the device information of the second electronic device.

[0222] S705. The intelligent decision-making module sends device information of the second electronic device to the control center, wherein information of the second interactive function is added to the device information.

[0223] S706: After acquiring the device information of the second electronic device, the control center displays the second interactive function corresponding to the second electronic device, or displays the function icon, and when a click operation on the function icon is detected, displays the second interactive function corresponding to the second electronic device.

[0224] S707: When a click operation on a second interactive function is detected, the control center sends an interactive instruction corresponding to the second interactive function to the capability module;

[0225] S708: After receiving the interaction instruction corresponding to the second interaction function, the capability module executes the second interaction function.

[0226] Among them, interface A can be Figure 5 The interface shown in (b) in FIG. The device information can be transmitted in the format of a json string. The device portrait module can store the device information of all associated devices of the mobile phone, or only store the device information of a certain associated device (i.e., the second electronic device). Exemplarily, the device information stored in the device portrait module can be obtained from each associated device, or can be obtained from other storage devices storing each associated device. It should be understood that the embodiment of the present application does not impose specific restrictions on the time when the device portrait module obtains the device information of the associated device. For example, it can be obtained when the mobile phone detects that the pull-down control center enters interface A, or it can be obtained at any other time.

[0227] In one example, when it is determined that a mobile phone needs to perform device interaction, the intelligent decision-making module in the mobile phone can determine the current application scenario of the mobile phone based on the current operating status of the mobile phone, and can determine the first interactive function corresponding to the application scenario based on the aforementioned Table 1.

[0228] Assuming that a music application is running in the foreground of the mobile phone and the music application is in the music playing state, the intelligent decision-making module can determine that the current application scenario of the mobile phone is an audio scenario, and can determine according to Table 1 that the first interactive function corresponding to the audio scenario includes audio projection and application relay.

[0229] Subsequently, for each first interactive function, the intelligent decision-making can determine the constraint conditions A and constraint conditions B corresponding to the first interactive function according to the aforementioned Table 2, and obtain the device information of the mobile phone and the device information of each associated device, so as to determine the second interactive function corresponding to each associated device according to the device information of the mobile phone, the device information of each associated device and the constraint conditions A and constraint conditions B corresponding to the first interactive function, and add the information of the second interactive function corresponding to each associated device to the device information of each associated device.

[0230] Assume that the associated devices of a mobile phone include tablets, smart screens, and smart speakers. The smart decision-making module determines the constraint conditions A corresponding to audio projection based on Table 2, including: (1) the device type of the sending end is a mobile phone or a tablet; (2) the sending end supports audio projection, and the constraint conditions B corresponding to audio projection include: (1) the device type of the receiving end is a smart speaker; (2) the receiving end supports audio projection. Similarly, the mobile phone can determine the constraint conditions A corresponding to application relay based on Table 2, including: (1) the device type of the sending end is a mobile phone, a tablet, or a laptop; (2) the sending end supports application relay, and the constraint conditions B corresponding to application relay include: (1) the device type of the receiving end is a mobile phone, a tablet, or a laptop; (2) the receiving end supports application relay.

[0231] Assume that the smart decision module determines that the tablet supports application relay based on the device information A of the tablet, and determines that the smart speaker supports audio projection based on the device information B of the smart speaker. At this time, the smart decision module can determine that the second interactive function corresponding to the tablet is application relay, the second interactive function corresponding to the smart speaker is audio projection, and the second interactive function corresponding to the smart large screen is empty, and can add the information of application relay corresponding to the tablet to the device information A of the tablet, and add the information of audio projection corresponding to the smart speaker to the device information B of the smart speaker. Subsequently, the smart decision module can send the device information A with the information of application relay added and the device information B with the information of audio projection added to the control center respectively.

[0232] After the control center obtains the device information A with the application relay information added and the device information B with the sound projection information added, it can directly display the second interactive function corresponding to the tablet and the second interactive function corresponding to the smart speaker through a prompt window or a card, or it can display the second interactive function corresponding to the tablet and the second interactive function corresponding to the smart speaker through a prompt window or a card when operation 1 is detected.

[0233] Alternatively, after the control center obtains the device information A with the application relay information added and the device information B with the audio projection information added, the function icon can be displayed in the interface, and when the user clicks the function icon, the second interactive function corresponding to the tablet and the second interactive function corresponding to the smart speaker can be displayed. Alternatively, when operation 1 is detected, the function icon is displayed in the interface, and when the click operation on the function icon is detected, the second interactive function corresponding to the tablet or the second interactive function corresponding to the smart speaker can be displayed.

[0234] Among them, operation 1 is the operation of clicking the control corresponding to the tablet in the interface, or the operation of dragging the control corresponding to the tablet in the interface to the vicinity of the control corresponding to the mobile phone, or the operation of clicking the control corresponding to the smart speaker in the interface, or the operation of dragging the control corresponding to the smart speaker to the vicinity of the control corresponding to the mobile phone in the interface. Exemplarily, when operation 1 is for the control corresponding to the tablet, the function icon displayed in the interface corresponds to the tablet, that is, when a click operation on the function icon is detected, the control center displays the second interactive function corresponding to the tablet. When operation 1 is for the control corresponding to the smart speaker, the function icon displayed in the interface corresponds to the smart speaker, that is, when a click operation on the function icon is detected, the control center displays the second interactive function corresponding to the smart speaker.

[0235] In another example, when it is determined that the mobile phone needs to perform device interaction, the intelligent decision-making module can determine the current application scenario of the mobile phone based on the current operating status of the mobile phone, and can determine the first interactive function corresponding to the application scenario based on the aforementioned Table 3.

[0236] Assuming that a music application is running in the foreground of the mobile phone and the music application is in the music playing state, the intelligent decision-making module can determine that the current application scenario of the mobile phone is an audio scenario, and can determine the first interactive functions 00A_sound, 011_relay and 012_relay corresponding to the audio scenario according to Table 3.

[0237] For each first interactive function, the intelligent decision-making module can determine the constraint conditions A and constraint conditions B corresponding to the first interactive function according to the aforementioned Table 4, and obtain the device information of the mobile phone and the device information of each associated device, so as to determine the second interactive function corresponding to each associated device according to the device information of the mobile phone, the device information of each associated device and the constraint conditions A and constraint conditions B corresponding to the first interactive function, and add the information of the second interactive function corresponding to each associated device to the device information of each associated device.

[0238] Assume that the associated devices of a mobile phone include a tablet, a laptop computer, and a smart speaker. The intelligent decision module can determine from Table 4 that the constraint condition A corresponding to 00A_sound includes: (1) the device type of the transmitting end is a mobile phone or a tablet computer; (2) the transmitting end supports audio projection, and the constraint condition B corresponding to 00A_sound includes: (1) the device type of the receiving end is a smart speaker; (2) the receiving end supports audio projection. Similarly, the intelligent decision module can determine from Table 4 that the constraint condition A corresponding to 011_relay includes: (1) the device type of the transmitting end is a mobile phone; (2) the transmitting end supports application relay, and the constraint condition B corresponding to 011_relay includes: (1) the device type of the receiving end is a tablet computer; (2) the receiving end supports application relay. Similarly, the intelligent decision module can determine from Table 4 that the constraint condition A corresponding to 012_relay includes: (1) the device type of the transmitting end is a mobile phone or a tablet computer; (2) the transmitting end supports application relay, and the constraint condition B corresponding to 012_relay includes: (1) the device type of the receiving end is a laptop computer; (2) the receiving end supports application relay.

[0239] Assume that the intelligent decision-making module determines that the tablet supports application relay based on the device information A of the tablet, determines that the smart speaker supports sound projection based on the device information B of the smart speaker, and determines that the laptop supports application relay based on the device information D of the laptop. At this time, the intelligent decision-making module can determine that the second interactive function corresponding to the tablet is 011_relay, the second interactive function corresponding to the smart speaker is 00A_sound, and the second interactive function corresponding to the laptop is 012_relay, and can add the information of 011_relay corresponding to the tablet to the device information A of the tablet, add the information of 00A_sound corresponding to the smart speaker to the device information B of the smart speaker, and add the information of 012_relay corresponding to the laptop to the device information D of the laptop, and can send the device information A with the information added by 011_relay, the device information B with the information added by 00A_sound, and the device information D with the information added by 012_relay to the control center respectively.

[0240] Similar to the above, after the control center obtains the device information A with the information of 011_relay added, the device information B with the information of 00A_sound added, and the device information D with the information of 012_relay added, it can directly display each second interactive function, or it can display the function icon first, and when a click operation on the function icon is detected, it can display each second interactive function.

[0241] Therefore, the user can directly click the second interactive function displayed in the interface to realize the device interaction between the mobile phone and the selected associated device (such as a tablet).

[0242] That is, in the embodiment of the present application, the mobile phone can determine the first interactive function that may be required for the application scenario based on the current application scenario of the mobile phone, and can intelligently determine the second interactive function that may be required for the current application scenario of the mobile phone among the interactive functions supported by the second electronic device based on the first interactive function, the device information of the mobile phone, and the device information of the second electronic device, so as to present the second interactive function that the user may need to use to the user, facilitate the user to select the interactive function, improve the convenience of user device interaction, improve the efficiency of device interaction, enhance user experience, and have strong ease of use and practicality.

[0243] It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0244] Corresponding to the device interaction method described in the above embodiment, the embodiment of the present application further provides a device interaction apparatus, and each module of the apparatus can correspond to each step of implementing the device interaction method.

[0245] It should be noted that the information interaction, execution process, etc. between the above-mentioned devices / units are based on the same concept as the method embodiment of the present application. Their specific functions and technical effects can be found in the method embodiment part and will not be repeated here.

[0246] The technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.

[0247] The present application also provides an electronic device, the electronic device comprising at least one memory, at least one processor, and a computer program stored in the at least one memory and executable on the at least one processor, wherein when the processor executes the computer program, the electronic device implements the steps in any of the above-mentioned method embodiments. Exemplarily, the structure of the electronic device can be as follows: Figure 1 shown.

[0248] An embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program. When the computer program is executed by a computer, the computer implements the steps in any of the above method embodiments.

[0249] An embodiment of the present application provides a computer program product. When the computer program product is executed on an electronic device, the electronic device implements the steps in any of the above method embodiments.

[0250] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, which can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable storage medium may at least include: any entity or device that can carry the computer program code to the device / electronic device, a recording medium, a computer memory, a read-only memory (ROM), a random access memory (RAM), an electric carrier signal, a telecommunication signal, and a software distribution medium. For example, a USB flash drive, a mobile hard disk, a magnetic disk or an optical disk. In some jurisdictions, according to legislation and patent practice, a computer-readable storage medium cannot be an electric carrier signal and a telecommunication signal.

[0251] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0252] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0253] In the embodiments provided in the present application, it should be understood that the disclosed devices / electronic devices and methods can be implemented in other ways. For example, the device / electronic device embodiments described above are merely schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0254] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0255] The embodiments described above are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. A device interaction method, characterized in that: Applied to a first electronic device, the method includes: Determining a current application scenario of the first electronic device; Determining at least one first interactive function corresponding to the application scenario; Determining, according to the first interactive function, device information of the first electronic device and device information of the second electronic device, a second interactive function corresponding to the second electronic device, where the second electronic device is associated with the first electronic device, the device information of the second electronic device includes information of interactive functions supported by the second electronic device, and the second interactive function is one or more of the first interactive functions; uniformly displaying a second interactive function corresponding to the second electronic device; In response to a first operation on a third interactive function, it is determined to execute the third interactive function with the second electronic device, where the third interactive function is one of the second interactive functions corresponding to the second electronic device.

2. The method according to claim 1, characterized in that The determining a current application scenario of the first electronic device includes: Detect preset operations; In response to the preset operation, a current application scenario of the first electronic device is determined.

3. The method according to claim 2, characterized in that The preset operation includes touching a preset area of ​​the first electronic device to a preset area of ​​the second electronic device.

4. The method according to claim 2, characterized in that: The preset operation includes entering the first interface of the first electronic device, or clicking the second control in the first interface, or dragging the second control in the first interface, and releasing the second control when the distance between the second control and the first control is less than a preset threshold, the first interface includes the second control, or the first interface includes the first control and the second control, the first control is a control corresponding to the first electronic device, and the second control is a control corresponding to the second electronic device.

5. The method according to claim 4, characterized in that The unified display of the second interactive function corresponding to the second electronic device includes: In response to a second operation on the second control, a second interactive function corresponding to the second electronic device is uniformly displayed.

6. The method according to claim 5, characterized in that The second operation includes clicking the second control, or dragging the second control, and releasing the second control when the distance between the second control and the first control is less than a preset threshold.

7. The method according to claim 4, characterized in that After determining the second interactive function corresponding to the second electronic device, the method further includes: Displaying a function icon corresponding to the second interactive function; The unified display of the second interactive function corresponding to the second electronic device includes: In response to a click operation on the function icon, a second interactive function corresponding to the second electronic device is uniformly displayed.

8. The method according to claim 4, characterized in that After determining the second interactive function corresponding to the second electronic device, the method further includes: In response to a third operation on the second control, displaying a function icon corresponding to the second interactive function; The unified display of the second interactive function corresponding to the second electronic device includes: In response to a click operation on the function icon, a second interactive function corresponding to the second electronic device is uniformly displayed.

9. The method according to claim 8, characterized in that The third operation includes clicking the second control, or dragging the second control, and releasing the second control when the distance between the second control and the first control is less than a preset threshold.

10. The method according to any one of claims 1 to 9, characterized in that The determining of at least one first interactive function corresponding to the application scenario includes: At least one first interactive function corresponding to the application scenario is determined according to a preset corresponding relationship between the application scenario and the interactive function.

11. The method according to any one of claims 1 to 9, characterized in that The determining of at least one first interactive function corresponding to the application scenario includes: According to the device information of the first electronic device and the preset correspondence between the application scenario and the interactive function, a first interactive function corresponding to the application scenario is determined.

12. The method according to any one of claims 1 to 9, characterized in that The determining, according to the first interactive function, the device information of the first electronic device and the device information of the second electronic device, a second interactive function corresponding to the second electronic device includes: For each of the first interactive functions, determine a first constraint condition and a second constraint condition corresponding to the first interactive function, where the first constraint condition is a condition that a sending end corresponding to the first interactive function needs to satisfy, and the second constraint condition is a condition that a receiving end corresponding to the first interactive function needs to satisfy; According to the first constraint condition and the device information of the first electronic device, and the second constraint condition and the device information of the second electronic device, a second interactive function corresponding to the second electronic device is determined from the first interactive functions.

13. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the electronic device implements the device interaction method according to any one of claims 1 to 12.

14. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a computer, the computer is enabled to implement the device interaction method according to any one of claims 1 to 12.

15. A computer program product, characterized in that When the computer program product runs on a computer, the computer is enabled to implement the device interaction method according to any one of claims 1 to 12.

Images