Guiding method and equipment
By guiding users to choose the cooperative protocols and perform corresponding operations in the multi-device collaboration scenario, the problem of multi-device collaboration failure caused by different device ecology and operating systems is solved, and cross-ecology collaboration and a better user experience is achieved.
Patent Information
- Application Number
- CN202310970257.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-08-02
- Publication Date
- 2025-02-14
- Estimated Expiration
- 2043-08-02
AI Technical Summary
Different devices have different ecology and operating system capabilities, resulting in the inability to implement or failing in collaborative operation across ecology or across operating systems, such as failure to project screens.
Through the boot method, the second device receives the message sent by the first device, selects a cooperative protocol that is jointly supported, and displays a boot interface to guide the user to perform operations to achieve multi-device collaboration.
There is no need for binding relationships or pre-negotiation between multiple devices to achieve multi-device collaboration across ecosystems or across operating systems, reducing the occurrence of collaboration failures and improving user experience.
Smart Images

Figure CN119449912A_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present application relate to the field of terminal technology, and in particular to a booting method and device. Background Art
[0002] In recent years, with the rapid development of the electronics industry and communication technology, there are more and more devices, such as mobile phones, tablet computers, smart TVs, etc., and people's lives are becoming more and more intelligent. In addition, with the increase in device types and the enrichment of device functions, the application scenarios of multi-device collaboration are becoming more and more extensive.
[0003] However, due to the different ecosystems or operating system capabilities of different devices, there may be many problems with the interconnection and interoperability between devices. For example, when a user wants to perform cross-ecosystem or cross-operating system device operations, it may be impossible to achieve multi-device collaboration or collaboration failure. For example, when the screen projection protocols used by mobile phones and TVs are inconsistent, users will be unable to cast screens or screen projection will fail. Summary of the invention
[0004] The embodiment of the present application provides a guidance method and device. The method can guide the user to adopt a collaboration protocol that multiple devices have for multi-device collaboration, or guide the user on how to adopt a collaboration method corresponding to a selected collaboration protocol for multi-device collaboration, thereby reducing the occurrence of multi-device collaboration failures and improving the user experience.
[0005] The first aspect provides a boot method. In the method, a second device receives a first message sent by a first device, the first message is used to instruct the first device to initiate multi-device collaboration using a first protocol, the first message includes a collaboration protocol supported by the first device, and the collaboration protocol supported by the first device includes the first protocol; the second device selects a second protocol based on the collaboration protocol supported by the first device and the collaboration protocol supported by the second device; the second device displays a boot interface, the boot interface is used to guide the user to perform m operations, and through the m operations, the first device and the second device use the multi-device collaboration method corresponding to the second protocol to perform multi-device collaboration, and m is an integer greater than 0. Among them, the first device can be understood as the initiator of multi-device collaboration, the second device can be understood as the receiver of multi-device collaboration, the first message can be, for example, a discovery message sent by the first device, and multi-device collaboration refers to multiple devices implementing collaborative processing of a business scenario, and multi-device collaboration includes but is not limited to: screen projection scenario, audio projection scenario, file sharing scenario, etc.; wherein, multi-device collaboration is generally implemented based on the corresponding collaboration protocol, and different collaboration protocols can correspond to different multi-device collaboration methods. Taking multi-device collaboration as an example, there are many screen projection protocols that can be used for screen projection, such as but not limited to: miracast (a wireless display standard based on Wi-Fi direct connection), cast+ (a screen projection protocol), dmsdp (a screen projection protocol), google cast (a screen projection proprietary protocol), (a screen projection protocol), etc.
[0006] In this method, the receiver is configured with the ability to receive the discovery message sent by the initiator, so that the receiver can receive the message sent by the initiator, and the receiver can learn the operational intention of the multi-device collaboration initiated by the initiator based on the discovery message. In addition, the receiver can also make decisions on the collaboration protocol for multi-device collaboration, select a collaboration protocol from at least one optional collaboration protocol, and can guide the user based on the collaboration method corresponding to the selected collaboration protocol, so as to guide the user to adopt the collaboration method corresponding to the selected collaboration protocol to achieve multi-device collaboration. Therefore, this method does not require a binding relationship or prior negotiation between multiple devices, and can achieve multi-device collaboration across ecosystems or operating systems, thereby avoiding the problem of collaboration failure or inability to collaborate in multi-device collaboration, such as the problem of being unable to cast a screen or failing to cast a screen.
[0007] In a possible implementation, the second device displays the guide interface, including but not limited to: displaying the guide interface using a sidebar, a notification bar, or a full-screen interface.
[0008] In this implementation, the second device may use a variety of possible display methods to provide the user with a guidance interface, for example, the guidance interface may be displayed to the user in a full-screen interface manner from the perspective of convenient viewing by the user, or the guidance interface may be displayed to the user in a sidebar or notification bar manner from the perspective of reducing the occlusion of the display interface, etc. Therefore, the diversity of user guidance can be improved, and the user experience can be guaranteed.
[0009] In a possible implementation, the second device selects the second protocol based on the collaborative protocols supported by the first device and the collaborative protocols supported by the second device, including: the second device selects the second protocol from one or more collaborative protocols supported by both the first device and the second device.
[0010] In this implementation, the second device selects a collaborative protocol from the collaborative protocols supported by both devices, which can improve the efficiency of switching the multi-device collaborative mode and reduce user operations. For example, through negotiation between the two devices, the multi-device collaborative mode selected by the user can be switched to the multi-device collaborative mode corresponding to the collaborative protocol selected by the second device, thereby achieving multi-device collaboration.
[0011] In a possible implementation, the second protocol is a collaborative protocol supported by the second device and not supported by the first device; and the guide interface is used to guide the user to perform m operations on the first device.
[0012] In this implementation, different guidance interfaces can be displayed according to the collaboration protocol selected by the second device and the support capabilities of the two devices for the collaboration protocol. Therefore, the accuracy of user guidance can be improved. For example, when the selected collaboration protocol is a collaboration protocol that is not supported by the first device, the user can be guided to perform user operations on the first device, so that the first device can support the collaboration protocol.
[0013] In a possible implementation, the guidance interface includes one or more of the following information: a QR code for establishing a communication connection between the first device and the second device, and operation steps of a user on the first device.
[0014] In this implementation, by providing a guidance interface to the user, switching of the multi-device collaboration mode can be achieved, thereby solving the problem that collaboration cannot be achieved using the multi-device collaboration mode selected by the user.
[0015] In a possible implementation, the second protocol is a collaborative protocol supported by the first device and not supported by the second device; and the guide interface is used to guide the user to perform m operations on the second device.
[0016] In this implementation, different guidance interfaces can be displayed according to the collaboration protocol selected by the second device and the support capabilities of the two devices for the collaboration protocol. Therefore, the accuracy of user guidance can be improved. For example, when the selected collaboration protocol is not supported by the second device, the user can also be guided to perform user operations on the second device, so that the second device can support the collaboration protocol.
[0017] In a possible implementation, the method further includes: the second device receiving a second message sent by the first device using a second protocol, where the second message includes multi-device collaboration data sent by the first device to the second device.
[0018] In this implementation, based on the second device, it is possible to switch from the multi-device collaboration mode selected by the user to the multi-device collaboration mode selected by the second device, thereby successfully achieving multi-device collaboration based on the switched multi-device collaboration mode, and avoiding the problem of multi-device collaboration being unable to be achieved due to the multi-device collaboration mode selected by the user.
[0019] In a possible implementation manner, the second device receiving the first message sent by the first device includes: the second device receiving the first message sent by the first device through a Bluetooth connection or a wireless-fidelity (Wi-Fi) connection.
[0020] In this implementation, the frequently used Bluetooth connection or Wi-Fi connection can be used to enable the second device to have the ability to receive discovery messages sent by other devices, thereby implementing the guidance method introduced in the above implementations, and further improving the success rate of multi-device collaboration.
[0021] In a possible implementation, before the second device selects the second protocol based on the collaborative protocols supported by the first device and the collaborative protocols supported by the second device, the method further includes: the second device determines that it does not support the first protocol; or the second device detects that multi-device collaboration with the first device using the first protocol has failed.
[0022] In this implementation, the second device detects the multi-device collaboration with the first device using the first protocol, and only provides user guidance when it detects that the multi-device protocol cannot be performed with the first device using the first protocol, thereby avoiding any impact when the second device can successfully collaborate with the first device using the first protocol.
[0023] The second aspect also provides a guidance method. The method can be applied to a second device. In the method, the second device receives a first message sent by the first device, the first message is used to instruct the first device to initiate a digital living network alliance (DLNA) screen projection; the second device displays a guidance interface, the guidance interface is used to guide the user to turn on the hotspot on the first device; the second device accesses the hotspot of the first device, and performs DLNA screen projection of the first device and the second device based on the hotspot of the first device.
[0024] In this method, in the DLNA screen projection scenario, due to the router's restriction on multicast message forwarding, multiple devices cannot discover each other. By configuring the receiver to receive the discovery message sent by the initiator, the receiver can receive the message sent by the initiator, so that the receiver can learn the operation intention of multi-device collaboration initiated by the initiator based on the discovery message. In addition, the receiver can also guide the initiator to turn on the hotspot, so that the router forwarding can be switched to the initiator building a local area network through the hotspot, so as to ensure the successful implementation of screen projection.
[0025] The third aspect provides a boot method. The method can be applied to a first device. In the method, the first device detects and responds to a user operation of a user triggering multi-device collaboration, and sends a first message, wherein the first message is used to instruct the first device to initiate multi-device collaboration using a first protocol, and the first message includes a collaboration protocol supported by the first device, and the collaboration protocol supported by the first device includes the first protocol. Exemplarily, the first device can send the first message in a unicast, multicast, or broadcast manner.
[0026] The first device may receive a guidance message from the second device, and the guidance message may be used for the first device to perform multi-device collaboration with the second device using a multi-device collaboration method corresponding to the second protocol. The guidance message may be used, for example, to instruct the first device to turn on a hotspot, or download an application for multi-device collaboration, or automatically trigger switching of the multi-device collaboration method corresponding to the second protocol, etc., and this application does not limit this.
[0027] Alternatively, based on the second device displaying the guide interface, the first device may also detect a user operation, such as a code scanning operation, etc. The first message may be, for example, a discovery message.
[0028] In this method, the first device can act as the initiator of multi-device collaboration, and in response to a user operation initiating multi-device collaboration, can send a discovery message, so that the second device can receive the message sent by the first device and learn the operational intention of the multi-device collaboration initiated by the initiator, etc., thereby realizing the guidance method described in the first aspect and its various embodiments.
[0029] A fourth aspect provides a guidance system. The system includes a second device as described in the first aspect or the second aspect and its respective embodiments and a first device as described in the third aspect and its respective embodiments, wherein the second device can be used to execute the method described in the first aspect or the second aspect and its respective embodiments, and the first device can be used to execute the method described in the third aspect and its respective embodiments.
[0030] A fifth aspect provides a second device, the second device includes multiple functional modules; the multiple functional modules interact with each other to implement the method performed by the second device in the first aspect and its respective embodiments, or implement the method performed by the second device in the second aspect and its respective embodiments. The multiple functional modules can be implemented based on software, hardware, or a combination of software and hardware, and the multiple functional modules can be arbitrarily combined or divided based on specific implementations.
[0031] A sixth aspect provides a first device, the first device comprising multiple functional modules; the multiple functional modules interact with each other to implement the method performed by the first device in the third aspect and its respective embodiments. The multiple functional modules can be implemented based on software, hardware, or a combination of software and hardware, and the multiple functional modules can be arbitrarily combined or divided based on specific implementations.
[0032] The seventh aspect also provides a second device, including at least one processor and at least one memory, wherein the at least one memory stores a program, and when the second device is running, the at least one processor executes the method executed by the second device in the above-mentioned first aspect and its various embodiments, or executes the method executed by the second device in the above-mentioned second aspect and its various embodiments.
[0033] The eighth aspect also provides a first device, comprising at least one processor and at least one memory, wherein the at least one memory stores a program, and when the first device is running, the at least one processor executes the method executed by the first device in the above-mentioned third aspect and each embodiment thereof.
[0034] The ninth aspect provides a readable storage medium, which stores instructions. When the instructions are executed on a second device, the second device executes the method described in the first aspect and its possible implementation methods, or executes the method described in the second aspect and its possible implementation methods; or, when the instructions are executed on a first device, the first device executes the method described in the third aspect and its possible implementation methods.
[0035] The tenth aspect provides a program product, which, when running on a second device, enables the second device to execute the method described in the first aspect and its possible implementation modes, or execute the method described in the second aspect and its possible implementation modes; or, when running on a first device, enables the first device to execute the method described in the third aspect and its possible implementation modes.
[0036] The eleventh aspect also provides a chip, which is used to read the program stored in the memory, execute the method executed by the second device of the above-mentioned first aspect and its possible implementation methods, or execute the method executed by the second device of the above-mentioned second aspect and its possible implementation methods, or execute the method executed by the first device of the above-mentioned third aspect and its possible implementation methods.
[0037] The twelfth aspect also provides a chip system, which includes a processor for supporting a second device to implement the above-mentioned first aspect and its various possible implementation methods of the second device, or for supporting a second device to implement the above-mentioned second aspect and its various possible implementation methods of the second device, or for supporting a first device to implement the above-mentioned third aspect and its various possible implementation methods of the first device. In a possible implementation, the chip system also includes a memory, which is used to store necessary programs and data for the device. The chip system can be composed of chips, or it can include chips and other discrete devices.
[0038] For the beneficial effects of any aspect from the second to the twelfth aspect and its possible implementation methods, please refer to the beneficial effects of various possible implementation methods in the first aspect, which will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0039] Figure 1 A schematic diagram of the hardware structure of a possible device provided in an embodiment of the present application;
[0040] Figure 2 A software system architecture block diagram of a device provided in an embodiment of the present application;
[0041] Figure 3 One of the application scenario schematic diagrams of a guidance method provided in an embodiment of the present application;
[0042] Figure 4 A second schematic diagram of an application scenario of a guidance method provided in an embodiment of the present application;
[0043] Figure 5 A third schematic diagram of an application scenario of a guidance method provided in an embodiment of the present application;
[0044] Figure 6 A fourth schematic diagram of an application scenario of a guidance method provided in an embodiment of the present application;
[0045] Figure 7 A fifth schematic diagram of an application scenario of a guidance method provided in an embodiment of the present application;
[0046] Figure 8 One of the flowchart diagrams of a guidance method provided in an embodiment of the present application;
[0047] Fig. 9 A second flowchart of a guidance method provided in an embodiment of the present application;
[0048] Fig.10 The third flowchart of a guidance method provided in an embodiment of the present application. DETAILED DESCRIPTION
[0049] The embodiments of the present application will be described in detail below with reference to the accompanying drawings.
[0050] Devices such as mobile phones, tablets, smart screens and smart home devices are becoming more and more popular, and as the types of devices increase and the functions of devices become richer, the application scenarios of multi-device collaboration are becoming more and more extensive; among them, multi-device collaboration refers to the collaborative processing of multiple devices for a business scenario. For example, multi-device collaboration includes but is not limited to: screen projection scenarios, audio projection scenarios, file sharing scenarios, etc. It can be understood that the application scenarios of multi-device collaboration are implemented using corresponding collaboration protocols; for example, the screen projection scenario is implemented using the screen projection protocol, the audio projection scenario is implemented using the audio projection protocol, and the file sharing scenario is implemented using the file sharing protocol. However, due to the differences in the ecology, operating system capabilities, etc. of different devices, there may be many problems in the interconnection and interoperability between devices.
[0051] For ease of understanding, the following embodiments use the screen projection scenario as an example to introduce the method provided by the present application. For other application scenarios of multi-device collaboration, please refer to the embodiments of the screen projection scenario, which will not be repeated in the following embodiments.
[0052] The current mainstream screen projection scenarios include mirror projection and application projection. Among them, mirror projection can, for example, project the display interface of the mobile phone onto the large screen for mirror display; application projection can, for example, project the video data of the video application included in the mobile phone onto the large screen for video display. Based on different screen projection scenarios, different types of devices, etc., there are also many screen projection protocols, such as but not limited to: miracast (a wireless display standard based on Wi-Fi direct connection), cast+ (a screen projection protocol), dmsdp (a screen projection protocol), google cast (a proprietary screen projection protocol), (a screen projection protocol), etc. Due to reasons such as the device's ecology and operating system, the screen projection protocols supported by devices from different manufacturers may be different or not completely the same. It can be understood that when the source device (for example, it can be understood as the initiator in the screen projection scenario) selects the screen projection method using the screen projection protocol, and the target device (for example, it can be understood as the receiver that can receive the projection data in the screen projection scenario) cannot support the screen projection protocol, it will cause the user to be unable to project the screen or the screen projection fails, and the user experience is poor.
[0053] In a possible implementation, in the scenario of a mobile phone and a large screen supporting the same system and distributed capabilities, after the mobile phone and the large screen are bound, the user can maintain a connection with the large screen through a distributed soft bus in the scenario of content playback on the mobile phone; wherein, the mobile phone and the large screen are bound, which can also be understood as the mutual authentication and authentication when the mobile phone and the large screen need to establish a connection for the first time for multi-device collaboration, and the binding relationship between the mobile phone and the large screen can be stored, so that when the mobile phone and the large screen need to establish a connection again for multi-device collaboration, there is no need to authenticate again. Since the viewing experience of the large screen is better, the user can be prompted on the mobile phone whether to play the stream. When the user agrees to the stream, the mobile phone can send a stream instruction to the large screen through the distributed soft bus, so that the content on the mobile phone can be played by the large screen, and the playback control interface can be displayed on the mobile phone. It can be understood that in this implementation, it is possible to actively send a prompt operation to the user through the interface to ask whether to play the content. However, this implementation also cannot solve the problem that the screen projection cannot be realized when the screen projection protocols adopted by the source device and the target device are different.
[0054] In view of this, an embodiment of the present application provides a guidance method. In this method, the target device can determine the operation intention of the source device and the collaborative capabilities supported by the source device based on the discovery message of the source device. Then, the target device can select one or more collaborative modes based on the collaborative capabilities supported by the source device and the collaborative capabilities supported by the target device. And, the target device can provide the user with one or more pages of guidance interfaces for realizing collaboration based on the selected one or more collaborative modes; or, the target device can also send the selected one or more collaborative modes to the source device, and the source device provides the user with one or more pages of guidance interfaces for realizing collaboration based on the selected one or more collaborative modes. Therefore, through this method, there is no need for the source device and the target device to have a binding relationship, nor is there a need for the source device and the target device to negotiate in advance; wherein, the binding relationship between the source device and the target device can be understood as the relationship stored after the mobile phone and the large screen are bound. Through the perception capability of the target device, and based on the collaborative capabilities of the source device and the target device, the collaborative capabilities supported by both the source device and the target device are selected. And, based on the supported collaborative capabilities, the user is guided to use the collaborative mode corresponding to the collaborative capability for device collaboration. In this way, the method can improve the success probability of multi-device collaboration, thereby optimizing the user experience.
[0055] It is understandable that the source device of the embodiment of the present application can be a device such as a mobile phone, tablet computer, laptop computer, or even a large screen that has the ability to initiate multi-device collaboration; and the target device of the embodiment of the present application can be a device such as a large screen, projector, smart speaker, or even a mobile phone, tablet computer, laptop computer, etc. that has the ability to receive multi-device collaboration. In addition, the embodiment of the present application does not impose any restrictions on the specific type of source device or target device. The devices to which the embodiment of the present application can be applied include, but are not limited to, devices equipped with Or devices with other operating systems.
[0056] Figure 1 1 shows a possible hardware structure diagram of a device. The device 100 includes: a radio frequency (RF) circuit 210, a power supply 220, a processor 230, a memory 240, an input unit 250, a display unit 260, an audio circuit 270, a communication interface 280, and a wireless fidelity (Wi-Fi) module 290. Those skilled in the art will understand that Figure 1 The hardware structure of the device 100 shown in the figure does not constitute a limitation on the device 100. The device 100 provided in the embodiment of the present application may include more or fewer components than those shown in the figure, may combine two or more components, or may have different component configurations. Figure 1The various components shown in the EMBODIMENTS 2000 may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application specific integrated circuits.
[0057] Combine the following Figure 1 The components of the device 100 are described in detail:
[0058] The RF circuit 210 can be used for receiving and sending data during communication or calls. In particular, after receiving downlink data from the base station, the RF circuit 210 sends it to the processor 230 for processing; in addition, the uplink data to be sent is sent to the base station. Generally, the RF circuit 210 includes but is not limited to an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier (LNA), a duplexer, etc.
[0059] In addition, the RF circuit 210 can also communicate with other devices through a wireless communication network. The wireless communication can use any communication standard or protocol, including but not limited to global system of mobile communication (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), long term evolution (LTE), 5G, email, short messaging service (SMS), etc.
[0060] Wi-Fi technology is a short-range wireless transmission technology. The device 100 can connect to an access point (AP) through the Wi-Fi module 290 to access the data network. The Wi-Fi module 290 can be used for receiving and sending data during the communication process.
[0061] The device 100 can be physically connected to other devices through the communication interface 280. Optionally, the communication interface 280 is connected to the communication interface of the other device through a cable to achieve data transmission between the device 100 and the other device.
[0062] The device 100 can also implement communication services and interact with service-side devices or other devices, so the device 100 needs to have a data transmission function, that is, the device 100 needs to include a communication module. Figure 1 Communication modules such as the RF circuit 210, the Wi-Fi module 290, and the communication interface 280 are shown, but it is understandable that at least one of the above components or other communication modules (such as a Bluetooth module) for implementing communication exist in the device 100 to perform data transmission.
[0063] For example, when the device 100 is a mobile phone, the communication module included in the device 100 may include the RF circuit 210, and may also include the Wi-Fi module 290, or may include a Bluetooth module ( Figure 1 When the device 100 is a tablet computer, the communication module included in the device 100 may include the Wi-Fi module, or may include a Bluetooth module ( Figure 1 (not shown in the figure). In an embodiment of the present application, when the device 100 is a mobile phone, it can communicate with the large screen through a communication module such as an RF circuit 210 or a Wi-Fi module 290. For example, when the mobile phone detects the user's screen projection operation, in response to the screen projection operation, a discovery message can be sent through a communication module such as an RF circuit 210 or a Wi-Fi module 290; the large screen can receive the discovery message sent by the mobile phone through a communication module such as an RF circuit 210 or a Wi-Fi module 290. For another example, when the mobile phone and the large screen can perform multi-device collaboration through the guidance method provided in an embodiment of the present application, the mobile phone can send collaboration data to the large screen through a communication module such as an RF circuit 210 or a Wi-Fi module 290. Similarly, the large screen can receive collaboration data sent by the mobile phone through a communication module such as an RF circuit 210 or a Wi-Fi module 290.
[0064] The memory 240 can be used to store software programs and software modules. The processor 230 executes various functional applications and data processing of the device 100 by running the software programs and software modules stored in the memory 240. Optionally, the memory 240 may mainly include a program storage area and a data storage area. Among them, the program storage area can store an operating system (mainly including software programs or software modules corresponding to the kernel layer, system layer, application framework layer, and application layer). In addition, the memory 240 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage device. In an embodiment of the present application, when the device 100 is a large screen, a screen projection protocol supported by the large screen may be stored in the memory 240. For example, the screen projection protocols stored in the memory 240 of the large screen may include miracast, cast+, and dmsdp.
[0065] The input unit 250 can be used to receive the editing operations of various types of data objects such as digital or character information input by the user, and generate key signal input related to the user settings and function control of the device 100. Optionally, the input unit 250 can include a touch panel 251 and other input devices 252.
[0066] Among them, the touch panel 251, also known as a touch screen, can collect the user's touch operations on or near it (such as the user's operation on or near the touch panel 251 using any suitable object or accessory such as a finger, stylus, etc.), and drive the corresponding connection device according to a pre-set program. In an embodiment of the present application, the touch panel 251 can collect user operations on or near it. For example, when the device 100 is a mobile phone, the mobile phone can collect operations for indicating triggering screen projection through the touch panel 251. For another example, when the device 100 is a large screen, the guidance interface provided to the user on the large screen can collect user operations for indicating the user based on the guidance of the large screen through the touch panel 251, such as the user determines to adopt the projection method provided by the large screen on the guidance interface.
[0067] Optionally, the other input devices 252 may include, but are not limited to, one or more of a physical keyboard, function keys (such as a volume control button, a switch button, etc.), a mouse, a joystick, etc.
[0068] The display unit 260 can be used to display information input by the user or information provided to the user and various menus of the device 100. The display unit 260 is the guidance system of the device 100, which is used to present an interface and realize human-computer interaction. The display unit 260 may include a display panel 261. For example, the display unit 260 may be a display. In an embodiment of the present application, the display unit 260 may be used to display the display content involved in the method provided in the present application. For example, when the device 100 is a large screen, the display unit 260 can be used to display the guidance interface, and can also be used to display the projection data from the mobile phone in a scenario where the large screen and the mobile phone can perform multi-device collaboration. For another example, when the device 100 is a mobile phone, the display unit 260 can be used to display the video data being played on the mobile phone, and can also display controls for users to project the video data.
[0069] The processor 230 is the control center of the device 100, and uses various interfaces and lines to connect various components, and executes various functions of the device 100 and processes data by running or executing software programs and / or software modules stored in the memory 240, and calling data stored in the memory 240, thereby realizing various services based on the device 100. In the embodiment of the present application, the processor 230 can be used to implement the method provided in the embodiment of the present application.
[0070] The device 100 also includes a power supply 220 (such as a battery) for supplying power to various components. Optionally, the power supply 220 can be logically connected to the processor 230 through a power management system, so that the power management system can manage functions such as charging, discharging, and power consumption.
[0071] like Figure 1 As shown, the device 100 also includes an audio circuit 270, a microphone 271 and a speaker 272, which can provide an audio interface between the user and the device 100. The audio circuit 270 can be used to convert audio data into a signal that can be recognized by the speaker 272, and transmit the signal to the speaker 272, which is converted into a sound signal and output by the speaker 272. The microphone 271 is used to collect external sound signals (such as the sound of a person speaking, or other sounds, etc.), and convert the collected external sound signals into signals that can be recognized by the audio circuit 270, and send them to the audio circuit 270. The audio circuit 270 can also be used to convert the signal sent by the microphone 271 into audio data, and then output the audio data to the RF circuit 210 to send it to, for example, another device, or output the audio data to the memory 240 for subsequent further processing.
[0072] Although not shown, the device 100 may further include a camera, at least one sensor, etc., which will not be described in detail herein. The at least one sensor may include but is not limited to an acceleration sensor, a distance sensor, a fingerprint sensor, a touch sensor, a temperature sensor, etc.
[0073] Alternatively, the device 100 may further include a graphics processing unit (GPU). The GPU may be used to render an image.
[0074] The operating system (OS) involved in the embodiment of the present application is the most basic system software running on the device 100. The software system of the device 100 can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes an operating system adopting a layered architecture as an example to illustrate the software structure of the device 100.
[0075] Figure 2This is a software structure diagram of a device provided in an embodiment of the present application. Figure 2 As shown, the software structure of the device can be a layered architecture, for example, the software can be divided into several layers, each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the operating system is divided into five layers, from top to bottom, namely, the application layer, the application framework layer (framework, FWK), the runtime and system library, the kernel layer, and the hardware layer.
[0076] The application layer can include a series of application packages. Figure 2 As shown, the application layer may include camera, settings, user interface (UI), wireless local area network (WLAN), music, Bluetooth, video, etc.
[0077] In one possible implementation, applications can be developed using the Java language by calling the application programming interface (API) provided by the application framework layer. Developers can interact with the bottom layer of the operating system (such as the hardware layer, kernel layer, etc.) through the application framework layer to develop their own applications. The application framework layer is mainly a series of services and management systems of the operating system.
[0078] The application framework layer provides application programming interfaces and programming frameworks for applications in the application layer. The application framework layer includes some predefined functions. Figure 2 As shown, the application framework layer may include an activity manager, a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.
[0079] The activity manager is used to manage the life cycle of each application and provide common navigation back functions, providing an interactive interface for all program windows.
[0080] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc. The content provider is used to store and obtain data and make the data accessible to applications. The data may include video, images, audio, etc.
[0081] The view system includes visual controls, such as controls for displaying text and controls for displaying images. The view system can be used to build applications. The display interface can be composed of one or more views. For example, it includes a view for displaying text and a view for displaying images.
[0082] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, etc.
[0083] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of an icon or scroll bar text, such as a notification of an application running in the background, or a notification that appears on the screen in the form of a dialog window.
[0084] The runtime includes the core library and the virtual machine. The runtime is responsible for the scheduling and management of the operating system.
[0085] The core library consists of two parts: one is the function that the Java language needs to call, and the other is the core library of the operating system. The application layer and the application framework layer run in the virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform object life cycle management, stack management, thread management, security and exception management, and garbage collection.
[0086] The system library may include multiple functional modules, such as a surface manager, a media framework, a 3D graphics processing library (such as OpenGL ES), a 2D graphics engine (such as SGL), etc.
[0087] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.
[0088] The media framework supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media framework can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, etc.
[0089] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
[0090] A 2D graphics engine is a drawing engine for 2D drawings.
[0091] In some embodiments, the 3D graphics processing library may be used to draw 3D motion images, and the 2D graphics engine may be used to draw 2D motion images.
[0092] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, audio driver, and sensor driver.
[0093] The hardware layer may include display units, audio circuits, etc.
[0094] Usually, the device 100 can run multiple applications at the same time. In a simpler way, one application can correspond to one process, and in a more complex way, one application can correspond to multiple processes. Each process has a process number (process ID).
[0095] It should be understood that in the embodiments of the present application, "at least one of the following" or similar expressions refer to any combination of these items, including any combination of single items or plural items. For example, at least one of a, b or c can represent: a, b, c, a and b, a and c, b and c, or a, b and c, where a, b, c can be single or multiple. "Multiple" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships can exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the previous and subsequent associated objects are in an "or" relationship.
[0096] In addition, it should be understood that, in the description of this application, words such as "first" and "second" are only used for the purpose of distinguishing the description, and cannot be understood as indicating or implying relative importance, nor can they be understood as indicating or implying an order.
[0097] It should be understood that the hardware structure of the device can be as follows Figure 1 As shown, the software system architecture can be Figure 2 As shown, the software programs and / or modules corresponding to the software system architecture in the device can be stored in the memory 240, and the processor 230 can run the software programs and applications stored in the memory 240 to execute the process of a boot method provided in an embodiment of the present application.
[0098] In order to facilitate understanding of a guidance method provided by the present application, the following Figures 3 to 9 The content shown introduces the implementation process of the method provided by this application.
[0099] The method provided in the embodiment of the present application can be applied to the scenario of multi-device interconnection and can be used for multi-device collaboration of multiple devices, so as to provide a better device usage experience. For ease of understanding, in the following embodiments, the multi-device collaboration scenario takes the screen projection scenario as an example. Figure 3A schematic diagram of an application scenario for screen projection operation. The application scenario may include at least a mobile phone 310 and a large screen 320. In the scenario where the display interface of the mobile phone 310 is projected onto the large screen 320, the user can trigger the screen projection scenario by clicking on the icon 300 for wireless screen projection in the drop-down notification interface of the mobile phone 310; wherein the mobile phone 310 responds to the user's touch operation on the icon 300, and can trigger the screen projection operation based on the screen projection protocol corresponding to the icon 300 (assuming it is screen projection protocol 1). In a possible application scenario, when the large screen 320 can also support screen projection protocol 1, the large screen 320 can be scanned on the mobile phone 310, so that the display interface of the mobile phone 310 can be projected onto the large screen 320, for example Figure 3 The display interface of the mobile phone 310 can be displayed on the display screen of the large screen 320.
[0100] In another possible application scenario, when Figure 3 When the large screen 320 in the screen does not support the screen projection protocol 1, the mobile phone 310 may not be able to scan the large screen 320, or even if it scans the large screen 320, the screen projection may fail. Through the method provided in the embodiment of the present application, the user can be guided to achieve successful screen projection in this scenario through one or more pages of guidance interface. Among them, the guidance method provided in the embodiment of the present application may also include one or more possible application scenarios, including but not limited to the following scenarios A to D, as follows:
[0101] Scene A. Figure 4 A schematic diagram of an application scenario of a guidance method provided in an embodiment of the present application. In this application scenario, the large screen 320 can display the interface 410; wherein the interface 410 may include a prompt box, and the prompt box is used to indicate other screen projection protocols that the user can use to implement screen projection. As shown in the interface 410, the prompt box may include but is not limited to: prompt information such as "Do you need to project the screen and understand how to operate", "Confirm" control, "Reject" control, etc. Among them, other screen projection protocols can be understood as screen projection protocols supported by both the mobile phone 310 and the large screen 320, such as screen projection protocol 2; or, other screen projection protocols can also be understood as screen projection protocols that are easy for users to operate. For example, although the mobile phone 310 does not support screen projection protocol 3, screen projection protocol 3 can be implemented by downloading the corresponding application (application, APP).
[0102] In a possible embodiment, when the large screen 320 detects a user's touch operation on the "Confirm" control on the interface 410, in response to the touch operation, the interface 420 can be displayed; wherein the interface 420 may include an operation guide box, and the operation guide box can be used to instruct the user how to use other projection methods corresponding to other projection protocols to achieve projection. As shown in the interface 420, the operation guide box may include but is not limited to: a QR code for scanning code to achieve projection, a projection tutorial including an operation tutorial, etc.; wherein the operation tutorial can be used to indicate how to achieve projection through user operation. It can be understood that when the large screen 320 detects a user's touch operation on the "Reject" control on the interface 410, in response to the touch operation, the home page interface or the playing interface of the large screen can be displayed.
[0103] based on Figure 4 The QR code provided in the interface 420 in the figure can guide the user to scan the code through the mobile phone 310. It can be understood that the mobile phone 310 can identify the content corresponding to the QR code in response to the code scanning operation. Exemplarily, after the mobile phone 310 identifies the content corresponding to the QR code, the display interface of the mobile phone 310 can be directly projected to the large screen 320. Another exemplary embodiment, after the mobile phone 310 identifies the content corresponding to the QR code, it can also display an interface for implementing screen projection, through which the user can be guided to project the display interface of the mobile phone 310 to the large screen 320.
[0104] In addition, the large screen 320 can also collect and count the user operations on the interface 410, analyze the user preferences based on the statistical results, and then guide the user according to the user preferences. Exemplarily, when the large screen 320 analyzes that the user's preference is to confirm the need for screen projection and understand how to operate, the next time the user's screen projection scene is detected and guidance is required, the interface 420 can be directly displayed, thereby simplifying the user operation. Another exemplary example, when the large screen 320 analyzes that the user's preference is to refuse the need for screen projection and understand how to operate, even if the user's screen projection scene is detected next time and guidance is required, the interface 410 and interface 420 will no longer be displayed to the user, thereby avoiding causing a bad user experience.
[0105] It should be noted that interface 410 is only a possible example, and the style of the prompt box is not limited in the embodiment of the present application. For example, it can also be implemented by notification messages, voice playback, etc., or it can also be implemented by a combination of multiple methods. In another possible embodiment, Figure 5 A schematic diagram of another application scenario of a guidance method provided in an embodiment of the present application. Figure 4 In the interface 410, Figure 5The prompt box of interface 510 included in the screen may include but is not limited to: prompt information such as "Do you need to cast the screen?", "Confirm" control, "Reject" control, and "Confirm and learn how to cast the screen" control. When the mobile phone detects the user's touch operation on the "Confirm" control, in response to the touch operation, interface 520 may be displayed; wherein, compared with Figure 4 The operation guide box included in the interface 420 and the interface 520 may not include the screen casting tutorial. It is understandable that when the mobile phone detects the user's touch operation on the "Confirm and learn how to cast the screen" control, in response to the touch operation, the following may be displayed: Figure 4 As shown in the interface 420, the operation guide box included in the interface 420 may include not only code scanning and screen projection, but also screen projection tutorials and other display contents.
[0106] It should also be noted that interface 420 is only a possible example, and the style and display content of the operation guide box are not limited in the embodiments of the present application. For example, when the other screen projection protocol is a screen projection protocol that is easy for the user to operate, the operation guide box displayed on interface 420 includes downloading the APP icon corresponding to screen projection protocol 3; or, when the guidance is implemented on mobile phone 310, the operation guide box may also include a control to guide the jump to the application market. For another example, the operation tutorial in the screen projection tutorial included in interface 420 can be in a folded state or a slidable state, etc.
[0107] Scenario B Figure 6 Schematic diagram of another application scenario of a guidance method provided in an embodiment of the present application. In this application scenario, the large screen 320 can display an interface 610; wherein the interface 610 can include an operation guidance frame, and the operation guidance frame can be used to indicate such as Figure 4 The operation guide box shown in the interface 420 in the figure can be used to instruct the user how to use other screen projection methods to achieve screen projection. Figure 4 and Figure 6 It can be seen that the operation guide box in the interface 610 can be displayed on one side of the large screen 320; and, compared to Figure 4 The scene shown, Figure 6 The scene shown can directly overlay the operation guide frame on one side of the large screen 320. Through this scene, compared with Figure 4 The implementation method that requires clicking the "Confirm" control or the "Reject" control in the interface 410 can reduce user operations, and by displaying it on one side of the large screen 320, the blocking effect on the playing interface of the large screen 320 can be reduced.
[0108] In a possible embodiment, when the large screen 320 detects that the user slides the operation guide frame on the interface 610 toward the outside of the screen, in response to the sliding operation, the operation guide frame in the interface 610 may no longer be displayed.
[0109] Alternatively, in another possible embodiment, the operation guide frame in the interface 610 may be pre-set for a display duration; wherein the display duration may be, for example, 5 seconds or 10 seconds. Exemplarily, the timing starts from the display of the operation guide frame, and when the timing reaches the set display duration, the operation guide frame may no longer be displayed. Therefore, this embodiment can reduce user operations and avoid long-term obstruction of the display screen of the large screen 320. In addition, the display duration can also be manually set by the user on a display interface such as a setting interface.
[0110] Scenario C Figure 7 Schematic diagram of another application scenario of a guidance method provided in an embodiment of the present application. In this application scenario, the large screen 320 can display an interface 710; wherein the interface 710 can include Figure 4 The prompt box may be different from the prompt box in the style of the prompt box in the example, and the prompt box may also be used to indicate other screen projection protocols that the user can use to implement screen projection. As shown in interface 710, the prompt box may include but is not limited to: prompt information such as "Do you need to cast the screen and learn how to do it?". Figure 4 and Figure 6 It can be seen that the prompt box in the interface 710 can be displayed at the top of the large screen 320; and, compared to Figure 4 The scene shown, Figure 7 The scenario shown can directly overlay the prompt box on the top of the large screen 320.
[0111] In a possible embodiment, when the large screen 320 detects a first touch operation of the user on the prompt box on the interface 710, the interface 720 may be displayed in response to the first touch operation. For example, the first touch operation may be a click operation, a long press operation, etc. Among them, the interface 720 may include an operation guide box, and the operation guide box may be used to instruct the user how to implement screen projection using a projection method corresponding to other screen projection protocols. As shown in the interface 720, the operation guide box may include but is not limited to: a QR code for implementing scan code projection, a screen projection tutorial, etc. In another possible embodiment, when the large screen 320 detects a second touch operation of the user on the prompt box on the interface 710, in response to the second touch operation, the prompt box in the interface 710 may no longer be displayed. The second touch operation may be, for example, a sliding operation to the outside of the screen.
[0112] Alternatively, in another possible embodiment, the prompt box in the interface 710 may be pre-set for a display duration. For example, the timer starts from the display of the prompt box, and when the timer reaches the set display duration, the prompt box may no longer be displayed. Therefore, this embodiment can reduce user operations and avoid long-term obstruction of the display screen of the large screen 320.
[0113] Scenario D: Figures 4 to 7In the embodiment shown, in addition to implementing guidance on the large screen 320, guidance can also be implemented on the mobile phone 310, thereby improving the convenience of user operation. For specific implementation scenarios, please refer to the introduction content in the above scenarios A to C, which will not be repeated here.
[0114] Based on the above description of the interface processing effect that can be achieved by the method provided in the embodiment of the present application, the following describes the implementation process of the guidance method provided in the present application to illustrate how to use the method provided in the present application to achieve the above-mentioned effect. Figures 4 to 7 The interface processing effect is shown.
[0115] In one possible embodiment, Figure 8 A flowchart of a boot method provided in an embodiment of the present application. The method can be applied to a second device, and the process may include the following steps:
[0116] Step 801: The first device detects a first user operation, where the first user operation is used to perform screen projection. The first device may be, for example, the source device described in the above embodiments, such as the mobile phone 310 described in scenarios A to D. For example, Figure 3 As shown, the first user operation may be, for example, a touch operation of the user on the icon 300 .
[0117] Step 802, the first device sends a discovery message in response to the first user operation. The discovery message can be used by the first device to discover other nearby devices, and can indicate the screen projection intention of the first device. For example, the screen projection intention can be to initiate screen projection using screen projection protocol 1; wherein, the discovery message can also include at least one screen projection protocol supported by the first device. In a possible embodiment, the first device can send the discovery message via Bluetooth, Wi-Fi, or other connections. The connection method for the first device to send the discovery message is not limited in the embodiments of the present application.
[0118] Step 803: The second device determines at least one screen projection protocol supported by the first device according to the discovery message. The second device may be, for example, the target device described in the above embodiments, such as the large screen 320 described in scenes A to D.
[0119] In a possible embodiment, the second device can receive the discovery message of the nearby device in real time. In this way, after the first device sends the discovery message, the second device can receive the discovery message sent by the first device. It should be noted that the number of discovery messages that the second device can receive is not limited in the embodiment of the present application. For example, the discovery message of the source device 1 can be received, and the discovery message of the source device 2 can also be received.
[0120] In an optional embodiment, the second device can determine at least one screen projection protocol supported by the first device based on step 803, and the second device can store at least one screen projection protocol supported by itself. Therefore, when it is determined that the second device does not support the screen projection protocol 1 supported by the first device in the screen projection intention, step 804 can be continued to select other screen projection protocols and guide the user to use the screen projection method corresponding to other screen projection protocols to achieve successful screen projection. In another optional embodiment, the second device can also continue to execute step 804 when it detects that the screen projection with the first device using screen projection protocol 1 fails; wherein, the second device detects that the screen projection failure can be indicated to the second device by the first device, or it can be detected by the second device itself. In another optional embodiment, the second device can also continue to execute step 804 when it detects that the screen projection with the first device using screen projection protocol 1 is successful, so as to determine whether there is a better screen projection protocol to improve the user experience. Alternatively, it can be understood that the second device can also stop executing the following step 804 when it detects that the screen projection with the first device using screen projection protocol 1 is successful, so as to avoid affecting the scene of successful screen projection.
[0121] Step 804: The second device selects a screen projection protocol based on at least one screen projection protocol supported by the first device and at least one screen projection protocol supported by the second device.
[0122] In an optional embodiment, the first device supports screen projection protocol 1 and screen projection protocol 2, and the second device supports screen projection protocol 2 and screen projection protocol 3. When the first device detects that screen projection protocol 1 is used for screen projection in step 801, the discovery message sent by the first device in step 802 can indicate that the operation intention of the first device is to use the screen projection method corresponding to screen projection protocol 1 for screen projection. After the second device receives the discovery message sent by the first device, the second device determines that the operation intention of the first device is to use screen projection protocol 1 for screen projection, and determines that the first device not only supports screen projection protocol 1 but also supports screen projection protocol 2. At this time, the second device can select screen projection protocol 2 supported by both the first device and the second device for screen projection. Then, the second device can guide the user to use screen projection protocol 2 for screen projection. For example, the screen projection method corresponding to screen projection protocol 1 can be mirror projection. Since the mobile phone and the large screen use different operating systems, the mobile phone cannot use the mirror projection method to project the screen to the large screen; the screen projection method corresponding to screen projection protocol 2 can be application projection. Based on the mobile phone and the large screen being connected to the same Wi-Fi, the large screen can guide users to use the application projection method to project the screen to the large screen.
[0123] In another optional embodiment, the first device supports screen projection protocol 1 and screen projection protocol 2, and the second device supports screen projection protocol 3 and screen projection protocol 4. When the first device detects in step 801 that screen projection is performed using screen projection protocol 1, the discovery message sent by the first device in step 802 may indicate that the operation intention of the first device is to perform screen projection using the screen projection method corresponding to screen projection protocol 1. After the second device receives the discovery message sent by the first device, the second device determines that the operation intention of the first device is to perform screen projection using screen projection protocol 1, and determines that the first device not only supports screen projection protocol 1 but also supports screen projection protocol 2, while the second device supports screen projection protocol 3 and screen projection protocol 4. Based on the fact that the first device and the second device do not have the same screen projection protocol, the second device may select a screen projection protocol from screen projection protocol 3 and screen projection protocol 4 to guide the user to use the selected screen projection protocol for screen projection. For example, the projection method corresponding to projection protocol 1 can be mirror projection. Since the mobile phone and the large screen use different operating systems, the mobile phone cannot use the mirror projection method to project the screen to the large screen; the projection method corresponding to projection protocol 2 can be application projection. Since the mobile phone and the large screen are not connected to the same Wi-Fi, the mobile phone cannot use the application projection method to project the screen to the large screen; the projection method corresponding to projection protocol 3 is with the help of the projection APP. When the large screen selects projection protocol 3, the large screen can guide the user to download the projection APP on the mobile phone, so that the screen can be projected to the large screen based on the projection APP.
[0124] In the above embodiment, the large screen can select the screen projection protocol based on one or more factors such as the complexity of the user's operation, the user experience of the screen projection protocol, etc.
[0125] Step 805: The second device performs screen projection guidance according to the selected screen projection protocol. For example, the screen projection guidance can be as follows: Figure 4 Interface 410 and interface 420 are shown. For another example, the screen projection guide can be as follows Figure 5 The screen projection guide can also be as shown in the interface 510 and the interface 520. Figure 6 Interface 610 shown. Or for example, the screen projection guide can also be as follows Figure 7 Interfaces 710 and 720 are shown. It can be understood that the second device can also detect user operations during the screen projection guidance process, such as detecting the user's touch operation on the "Confirm" control on the interface 410, and the user's touch operation on the prompt box on the interface 710.
[0126] In one possible embodiment, the second device can collect touch operations during the screen projection guidance process, collect statistics and analyze the touch operations, and obtain user preferences, so as to set the next screen projection guidance method based on the user preferences. For example, when the second device analyzes that the user's preference is to accept the screen projection protocol selected by the second device, the next time the user's screen projection scene is detected and guidance is required, it can be assumed that the user accepts the screen projection protocol selected by the second device, and the operation guidance box is directly displayed to the user, and user feedback is no longer required. For example, it is directly displayed as follows: Figure 4 The interface 420 shown in FIG. Figure 4 The interface 410 shown can simplify the user operation. For another example, when the second device analyzes that the user's preference is not to accept the projection protocol selected by the second device, it can be assumed that the user rejects the projection protocol selected by the second device, and no longer provide the user with a guidance interface, thereby avoiding a bad user experience.
[0127] It should be noted that the implementation method of the screen projection guidance is not limited in the embodiment of the present application. For example, it can be implemented through at least one of the guidance interface, prompt box interface, notification interface, voice, etc.
[0128] Step 806: The first device detects a second user operation, where the second user operation is an operation performed by the user according to the guidance of the second device. Figure 4 In the interface 420 shown, the second user operation that can be detected by the first device can be a code scanning operation. In another exemplary embodiment, when the guidance of the second device is to download the projection screen APP, the second user operation that can be detected by the first device can be a download operation of the projection screen APP.
[0129] Step 807: The first device and the second device exchange messages, and the interaction messages are used to perform screen projection of the first device to the second device. Exemplarily, the interaction message can be used to establish a screen projection connection between the first device and the second device, for example, the interaction message can be used for the second device to access the same Wi-Fi network as the first device; or, when the first device establishes a screen projection connection with the second device through step 806, the interaction message can be the data to be projected.
[0130] In another possible embodiment, Fig. 9 A flowchart of a boot method provided in an embodiment of the present application. The method can be applied to a scenario where the first device uses the Digital Living Network Alliance (DLNA) to project the screen, and the process may include the following steps:
[0131] Step 901: The first device detects a first user operation, where the first user operation is used to perform screen projection. The first device may be, for example, the source device described in the above embodiments, such as the mobile phone 310 described in scenarios A to D. For example, Figure 3 As shown, the first user operation may be, for example, a touch operation of the user on the icon 300 .
[0132] Step 902a: The router receives the discovery message multicasted by the first device. The DLNA screen casting discovery process is based on the local area network coap protocol, and the coap message is a multicast message.
[0133] Step 903a: The router does not forward the discovery message and directly discards it. Since some routers may include restricting the forwarding of multicast messages in their processing strategies, the first device may not be able to find the second device when casting the screen, and thus the first device cannot cast the screen to the second device.
[0134] Step 902b: The second device receives the discovery message multicast by the first device. In the embodiment of the present application, the second device can be configured with the capability of receiving layer 2 messages, so the second device can receive the discovery message multicast by the first device without relying on the forwarding of the router.
[0135] Step 903b: The second device determines the operation intention of the first device according to the discovery message. It can be understood that based on the content of step 901, it can be determined that the operation intention of the first device is to perform screen projection.
[0136] Step 904: The second device performs screen projection guidance, and the screen projection guidance is used to instruct the first device to turn on the hotspot. It is understandable that the content of the screen projection tutorial displayed on the guidance interface of the second device in this scenario can be a prompt message of "Please start hotspot".
[0137] Step 905: The first device detects a third user operation, and the third user operation is used to turn on the hotspot. It is understandable that the user can turn on the hotspot of the first device through the screen projection guidance of the second device.
[0138] Step 906: The second device connects to the hotspot of the first device. It is understandable that after the second device performs the screen projection guidance based on step 904, it can start the wireless local area scanning process based on the screen projection guidance, so as to facilitate the connection to the hotspot of the first device.
[0139] Step 907: The first device starts to project the screen to the second device. It is understandable that after the second device connects to the hotspot of the first device, the first device and the second device are in the same local area network, and the first device and the second device can establish a communication connection, so that the projection data of the first device can be sent to the second device based on the communication connection, thereby realizing the projection of the screen from the first device to the second device.
[0140] In the method provided in the embodiment of the present application, by configuring the target device with the ability to receive discovery messages from other devices, the target device can receive messages sent by the source device, thereby realizing the operation intention of multi-device collaboration initiated by the source device based on the discovery message. In addition, the target device can also make decisions on the collaboration mode of multi-device collaboration, select a collaboration mode from at least one optional collaboration mode, and can perform collaboration guidance based on the selected collaboration mode to guide the user to adopt the selected collaboration mode to achieve multi-device collaboration. Therefore, the method does not require a binding relationship or prior negotiation between multiple devices, and can achieve multi-device collaboration across ecosystems or operating systems, thereby avoiding the problem of collaboration failure or inability to collaborate in multi-device collaboration, such as the problem of being unable to cast a screen or failing to cast a screen.
[0141] In an optional implementation, Fig.10 An interactive process of a guidance method provided in an embodiment of the present application. The interactive process may include the following steps:
[0142] Step 1001: A second device receives a first message sent by a first device, where the first message is used to instruct the first device to initiate multi-device collaboration using a first protocol, and the first message includes a collaboration protocol supported by the first device, and the collaboration protocols supported by the first device include the first protocol.
[0143] Among them, the first device can be understood as the initiator of multi-device collaboration, such as the mobile phone introduced in the aforementioned embodiment; the second device can be understood as the receiver of multi-device collaboration; for example, the large screen introduced in the aforementioned embodiment; the first message can be, for example, a discovery message sent by the first device.
[0144] Step 1002: The second device selects a second protocol based on the collaboration protocol supported by the first device and the collaboration protocol supported by the second device.
[0145] Step 1003: The second device displays a guide interface, wherein the guide interface is used to guide the user to perform m operations, and through the m operations, the first device and the second device perform multi-device collaboration in a multi-device collaboration manner corresponding to the second protocol, where m is an integer greater than 0. For example, the guide interface may be as follows: Figure 4The interface 410 and the interface 420 shown in FIG. Figure 5 The interface 510 and the interface 520 shown in FIG. Or for example, the guide interface can also be as shown in FIG. Figure 6 The interface 610 shown in FIG. 10A and 10B are also provided. For example, the guide interface can also be as shown in FIG. Figure 7 Interfaces 710 and 720 are shown.
[0146] Based on the above embodiments, the present application further provides a second device, which includes multiple functional modules; the multiple functional modules interact with each other to implement the functions performed by the second device in each method described in the embodiments of the present application. The multiple functional modules can be implemented based on software, hardware, or a combination of software and hardware, and the multiple functional modules can be arbitrarily combined or divided based on the specific implementation. Figure 8 In the embodiment shown, the second device performs steps 802 to 805 and step 807. Alternatively, perform Fig. 9 In the embodiment shown, the second device performs steps 902b, 903b to 904, and 906 to 907. Alternatively, perform Fig.10 In the illustrated embodiment, steps 1001 to 1003 are performed by the second device.
[0147] Based on the above embodiments, the present application further provides a first device, which includes multiple functional modules; the multiple functional modules interact with each other to implement the functions performed by the first device in each method described in the embodiments of the present application. The multiple functional modules can be implemented based on software, hardware, or a combination of software and hardware, and the multiple functional modules can be arbitrarily combined or divided based on the specific implementation. Figure 8 In the embodiment shown, the first device performs steps 801 to 802, 806 to 807. Alternatively, perform Fig. 9 In the illustrated embodiment, the first device executes steps 901 to 902b and steps 905 to 907.
[0148] Based on the above embodiments, the present application further provides a second device, which includes at least one processor and at least one memory, wherein the at least one memory stores program instructions, and when the second device is running, the at least one processor executes the functions executed by the second device in each method described in the embodiments of the present application. Figure 8 In the embodiment shown, the second device performs steps 802 to 805 and step 807. Alternatively, perform Fig. 9 In the embodiment shown, the second device performs steps 902b, 903b to 904, and 906 to 907. Alternatively, perform Fig.10 In the illustrated embodiment, steps 1001 to 1003 are performed by the second device.
[0149] Based on the above embodiments, the present application further provides a first device, which includes at least one processor and at least one memory, wherein the at least one memory stores program instructions, and when the first device is running, the at least one processor executes the functions executed by the first device in each method described in the embodiments of the present application. Figure 8 In the embodiment shown, the first device performs steps 801 to 802, 806 to 807. Alternatively, perform Fig. 9 In the illustrated embodiment, the first device executes steps 901 to 902b and steps 905 to 907.
[0150] Based on the above embodiments, the present application also provides a guidance system, which may include the first device and the second device introduced in the above embodiments.
[0151] Based on the above embodiments, the present application also provides a program product, which includes: a program (also referred to as code, or instruction), which enables a device or computer to execute the methods described in the embodiments of the present application when the program is executed.
[0152] Based on the above embodiments, the present application also provides a readable storage medium, in which a program is stored. When the program is executed by a device or a computer, the device or the computer executes the methods described in the embodiments of the present application.
[0153] Based on the above embodiments, the present application also provides a chip, which is used to read the program stored in the memory to implement the methods described in the embodiments of the present application.
[0154] Based on the above embodiments, the present application provides a chip system, which includes a processor for supporting a device to implement the methods described in the embodiments of the present application. In one possible design, the chip system also includes a memory, which is used to store necessary programs and data. The chip system can be composed of a chip, or it can include a chip and other discrete devices. It should be understood by those skilled in the art that the embodiments of the present application can be provided as methods, systems, or program products. Therefore, the present application can take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware.
[0155] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the scope of protection of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.
Claims
1. A guiding method, characterized in that: include: The second device receives a first message sent by the first device, where the first message is used to instruct the first device to initiate multi-device collaboration using a first protocol, the first message includes a collaboration protocol supported by the first device, and the collaboration protocols supported by the first device include the first protocol; The second device selects a second protocol based on the collaboration protocol supported by the first device and the collaboration protocol supported by the second device; The second device displays a guide interface, which is used to guide the user to perform m operations. Through the m operations, the first device and the second device perform multi-device collaboration in a multi-device collaboration manner corresponding to the second protocol, where m is an integer greater than 0.
2. The method according to claim 1, characterized in that The second device displays a guide interface, including: The guide interface is displayed using a sidebar, a notification bar, or a full-screen interface.
3. The method according to claim 1 or 2, characterized in that The second device selects a second protocol based on the collaboration protocol supported by the first device and the collaboration protocol supported by the second device, including: The second device selects the second protocol from one or more collaborative protocols supported by both the first device and the second device.
4. The method according to claim 1 or 2, characterized in that: The second protocol is a collaborative protocol supported by the second device and not supported by the first device; The guidance interface is used to guide the user to perform m operations on the first device.
5. The method according to claim 4, characterized in that The guide interface includes one or more of the following information: a QR code for establishing a communication connection between the first device and the second device, and operation steps of a user on the first device.
6. The method according to claim 1 or 2, characterized in that: The second protocol is a collaborative protocol supported by the first device and not supported by the second device; The guidance interface is used to guide the user to perform m operations on the second device.
7. The method according to any one of claims 1 to 6, characterized in that The method further comprises: The second device receives a second message sent by the first device using a second protocol, where the second message includes multi-device collaboration data sent by the first device to the second device.
8. The method according to any one of claims 1 to 7, characterized in that The second device receives a first message sent by the first device, including: The second device receives the first message sent by the first device through a Bluetooth connection or a Wireless Fidelity Wi-Fi connection.
9. The method according to any one of claims 1 to 8, characterized in that Before the second device selects the second protocol based on the collaborative protocol supported by the first device and the collaborative protocol supported by the second device, the method further includes: The second device determines that it does not support the first protocol; or The second device detects that multi-device collaboration with the first device using the first protocol fails.
10. A guiding method, characterized in that: include: The second device receives a first message sent by the first device, where the first message is used to instruct the first device to initiate a DLNA screen projection; The second device displays a guidance interface, where the guidance interface is used to guide the user to turn on the hotspot on the first device; The second device accesses the hotspot of the first device, and performs DLNA screen projection of the first device and the second device based on the hotspot of the first device.
11. A second device, characterized in that: The device comprises at least one processor coupled to at least one memory, and the at least one processor is used to read the program stored in the at least one memory so that the second device executes the method as claimed in any one of claims 1 to 9, or executes the method as claimed in claim 10.
Citation Information
Patent Citations
Multi-screen interactive connection method and terminal
CN107797781A
Screen projection method, device and equipment and computer readable storage medium
CN111427527A
Wireless screen projection method and system, intelligent equipment and computer readable storage medium
CN114697736A
Multi-device cooperation method and device, electronic device and medium
CN114741146A
Multi-device cooperation method, electronic device and related product
CN115002937A