Screen projection method, screen projection device and electronic equipment
By presetting a trust relationship between the screen projection device and the screen projection device, automatically discovering the screen and performing security authentication, the existing screen projection process is solved, and a screen projection method that simplifies operation and improves convenience is realized.
Patent Information
- Application Number
- CN202410150610.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-01-31
- Publication Date
- 2025-08-01
AI Technical Summary
The operating steps of existing electronic devices during screen projection are complicated, which affects the convenience of screen projection function. Especially in the screen projection process between multi-screen devices, multiple steps are required to determine the target screen and perform safety certification.
By presetting a trust relationship between the screen projection device and the screen projection device, the screen projection process is simplified, allowing the device to automatically discover screen information and perform secure authentication, combining the selection of the target screen and the authentication step into one operation, reducing user interaction.
It improves the convenience and security of the screen projection process, reduces the operation steps of users when projecting screens between devices, and improves the user experience.
Smart Images

Figure CN120406879A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of electronic devices, and more particularly, to a screen mirroring method, a screen mirroring device, and an electronic device. Background Art
[0002] With the development of science and technology, users can obtain immersive experiences in multiple scenarios such as games, entertainment, and navigation through electronic devices. In various service scenarios provided by electronic devices for users, the screen mirroring function is often used. The screen mirroring function can display the content that needs to be interacted on a specific screen to meet different actual needs of users. Currently, most electronic devices support the screen mirroring function. For example, a mobile terminal can be screen mirrored to a car infotainment system screen, or a mobile terminal can be screen mirrored to a smart screen. Before the screen mirroring is completed, multiple operations are required between the screen mirroring device and the device to be screen mirrored, which affects the convenience of the screen mirroring function.
[0003] Therefore, how to simplify the screen mirroring process, reduce the time required for the screen mirroring process, and improve the convenience of the screen mirroring function while ensuring secure screen mirroring is an urgent problem to be solved currently. Summary of the Invention
[0004] This application provides a screen mirroring method, a screen mirroring device, and an electronic device, which simplifies the screen mirroring process and improves the user experience.
[0005] In a first aspect, a screen mirroring method is provided. The method is applied to a first device that displays first content. The method includes: receiving a first operation for screen mirroring the first content; and displaying a first interface that includes an identifier of a first screen, an identifier of a second screen, and an identifier of a third screen. The first screen and the second screen are screens of a second device, and the third screen is a screen of a third device. The first device is connected to the second device and the first device is connected to the third device.
[0006] It should be noted that the connection between the first device and the second device can be understood as mutual trust between the first device and the second device; the connection between the first device and the third device can be understood as mutual trust between the first device and the third device. The first device can be a screen mirroring device, such as a mobile terminal or a tablet computer. The second device can be a device to be screen mirrored, such as a car infotainment system terminal including multiple screens, or a smart screen including a second extended screen. The second device and the third device are peripheral devices of the first device. That is, when the first device receives the first operation, it can display the screen identifiers of the peripheral devices. Among them, the first operation can be an operation to trigger the screen mirroring function.
[0007] The screen mirroring function in the embodiments of this application may include synchronous screen mirroring and asynchronous screen mirroring. Among them, synchronous screen mirroring can be understood as the screen mirroring device and the device being mirrored displaying the same content; asynchronous screen mirroring can be understood as the screen mirroring device and the device being mirrored displaying different content. For example, the mirror screen mirroring of the screen mirroring device belongs to synchronous screen mirroring, and the screen mirroring function of the application program carried by the screen mirroring device belongs to asynchronous screen mirroring.
[0008] Based on the above solution, it is assumed that the screen mirroring device and the device being mirrored trust each other. During the process of the screen mirroring device and the device being mirrored discovering each other, the screen mirroring device can obtain the screen information of the device being mirrored, which simplifies the screen mirroring process and improves the convenience of the screen mirroring function.
[0009] Combined with the first aspect, in some implementation manners of the first aspect, the method further includes: receiving an operation of selecting an identifier of the first screen, and sending first information to the second device; where the first information is used to instruct the second device to display the first content on the first screen.
[0010] Exemplarily, the identifier of the first screen may also be a control of the first screen. The operation of the user on the identifier of the first screen indicates that the user selects the first screen.
[0011] Based on the above solution, when the user selects the first screen, the first device and the second device complete the screen mirroring connection, and the first content can be displayed on the first screen of the second device, indicating that the screen mirroring is completed.
[0012] Combined with the first aspect, in some implementation manners of the first aspect, before displaying the first interface, the method further includes: sending second information; receiving third information, where the third information includes a first field, and the first field is used to represent the first screen and the second screen.
[0013] It can be understood that the second information may be a discovery message, and the first device may send the discovery message in a broadcast manner; the third information may be a feedback message of the discovery message sent by the second device. The feedback message of the discovery message may include the first field.
[0014] Optionally, the first device may determine the specific screens included in the second device according to the first field, so as to display the identifiers of the screens.
[0015] Based on the above solution, during the process of the first device and the second device discovering each other, the first device can determine the specific screens included in the second device.
[0016] Combined with the first aspect, in some implementation manners of the first aspect, the method further includes: receiving fourth information, where the fourth information includes a second field, and the second field is used to represent the third screen.
[0017] It can be understood that the fourth information is a feedback message of the discovery message sent by the third device. The feedback message of the discovery message may include a first field. Optionally, the first device may determine the specific screen included in the third device according to the second field, so as to display the identifier of the screen.
[0018] Based on the above solution, during the mutual discovery process between the first device and the third device, the first device can determine the specific screen included in the third device.
[0019] Combined with the first aspect, in some implementation manners of the first aspect, before sending the first information to the second device, the method further includes: outputting a first prompt; receiving an operation of inputting first data within the first prompt, and outputting a second prompt, where the second prompt is used to instruct the second device to authenticate whether the first data is consistent with second data, and the second data is displayed on the first screen.
[0020] It should be noted that the first data and the second data are information for security authentication.
[0021] Exemplarily, when the user selects a screen, the first device may display a first prompt, the first prompt may be an input box, the first data may be a PIN code, and the user may input the PIN code within the input box. After the user finishes inputting, a second prompt may be displayed, and the second prompt may be a prompt message indicating that the second device is authenticating whether the PIN code input by the user is consistent with the PIN code displayed on the screen selected by the user.
[0022] It should be understood that the embodiments of the present application do not limit the specific manner of outputting the first prompt and the second prompt, nor the specific manner of the first data and the second data.
[0023] Based on the above solution, before displaying the projection content on the device to be projected, security authentication may also be performed to ensure the security of the projection.
[0024] Combined with the first aspect, in some implementation manners of the first aspect, before outputting the first prompt, the method further includes: sending a fifth information, where the fifth information is used to instruct the second device to display the second data on the first screen.
[0025] Optionally, the fifth information may also be a request information, which is used to request the second device to display the second data on the first screen.
[0026] That is to say, before the first device displays the first prompt for inputting the first data, it is necessary to request or instruct the second device to display the second data on the selected screen.
[0027] It should be noted that the first data input by the user may be the same as or different from the second data displayed on the selected screen.
[0028] Based on the above solution, security authentication information is displayed on the screen selected by the user for security authentication.
[0029] Combined with the first aspect, in some implementation manners of the first aspect, before outputting the second prompt, the method further includes: sending sixth information to the second device, where the sixth information is used to instruct the second device to determine whether the first data is consistent with the second data; receiving seventh information, where the seventh information includes an authentication result, and the authentication result is used to indicate whether the first data is consistent with the second data; when the authentication result indicates that the first data is consistent with the second data, determining the first screen as the target screen; where the first information is specifically used to instruct to display the first content on the target screen.
[0030] Exemplarily, the sixth information may be a request information for requesting the second device to determine the authentication result. After the second device determines the authentication result, it can feedback the authentication result to the first device. If the authentication is successful (that is, the first data is consistent with the second data), the selected screen is determined as the target screen, and the first content can be displayed.
[0031] Based on the above solution, the second device can perform security authentication. When the authentication is successful, the screen selected by the user can be used as the target screen to display the screen mirroring content to ensure the security of the screen mirroring.
[0032] Combined with the first aspect, in some implementation manners of the first aspect, the method further includes: receiving an operation of selecting the identifier of the first screen and the identifier of the second screen, and sending eighth information to the second device; where the eighth information is used to instruct the second device to display the first content on the first screen and the second screen.
[0033] Based on the above solution, the user can select multiple screens of the same device to implement the solution of displaying the screen mirroring content on multiple screens.
[0034] Combined with the first aspect, in some implementation manners of the first aspect, receiving an operation of selecting the identifier of the first screen and the identifier of the third screen, sending the first information to the second device, and sending ninth information to the third device; where the first information is used to instruct the second device to display the first content on the first screen, and the ninth information is used to instruct the third device to display the first content on the third screen.
[0035] Based on the above solution, the user can select screens of different devices to implement the solution of displaying the screen mirroring content on the screens of multiple devices.
[0036] Combined with the first aspect, in some implementation manners of the first aspect, the first device is a mobile phone terminal or a tablet computer, and the second device is a vehicle-mounted terminal or a smart screen.
[0037] In a second aspect, a screen mirroring method is provided. The method is applied to a second device, and the screen of the second device includes a first screen and a second screen. The method includes: receiving second information sent by a first device; sending third information to the first device, where the third information includes a first field for indicating the first screen and the second screen, and the identifiers of the first screen and the second screen are displayed on a first interface of the first device. The first interface further includes the identifier of a third screen, and the third screen is the screen of a third device. The second device is connected to the first device, and the third device is connected to the first device.
[0038] It should be noted that when the first device is connected to the second device, it can be understood that the first device and the second device exchange information with each other; when the first device is connected to the third device, it can be understood that the first device and the third device trust each other. The first device can be a screen mirroring device, and the second device and the third device can be devices to be screen mirrored. The second device and the third device are peripheral devices of the first device.
[0039] The screen mirroring function in the embodiments of the present application can include synchronous screen mirroring and asynchronous screen mirroring. Among them, synchronous screen mirroring can be understood as the screen mirroring device and the device to be screen mirrored displaying the same content; asynchronous screen mirroring can be understood as the screen mirroring device and the device to be screen mirrored displaying different content. For example, the mirror screen mirroring of the screen mirroring device belongs to synchronous screen mirroring, and the screen mirroring function of the application program carried by the screen mirroring device belongs to asynchronous screen mirroring.
[0040] It can be understood that the second information can be a discovery message, and the third information can be a feedback message of the discovery message. The feedback message of the discovery message may include a first field.
[0041] Based on the above solution, during the mutual discovery process between the second device and the first device, the second device sends the third information carrying the first field to the first device, so that the first device can obtain the screen information of the second device during the mutual discovery stage.
[0042] In combination with the second aspect, in some implementation manners of the second aspect, the method further includes: receiving fifth information; and displaying second data on the first screen according to the fifth information.
[0043] Optionally, the fifth information may also be a request message for requesting the second device to display the second data on the first screen.
[0044] It should be noted that the second data is information for security authentication, such as a PIN code.
[0045] Based on the above solution, the second device can display the PIN code on the screen selected by the user according to the request of the first device, so that the user can input the PIN code on the first device.
[0046] In combination with the second aspect, in some implementations of the second aspect, the method further includes: receiving sixth information, where the sixth information includes first data; determining an authentication result according to the sixth information, where the authentication result is used to indicate whether the first data is consistent with the second data; and sending seventh information, where the seventh information includes the authentication result.
[0047] Exemplarily, the sixth information may be a request message for requesting a second device to determine an authentication result. After the second device determines the authentication result, it may feedback the authentication result to the first device.
[0048] Based on the above solution, the second device can perform security authentication to ensure the security of screen mirroring.
[0049] In combination with the second aspect, in some implementations of the second aspect, the method further includes: when the authentication result is that the first data is consistent with the second data, the method further includes: receiving first information, where the first information is used for the first device to instruct the second device to display first content on the first screen; and displaying the first content, where the first content is associated with the first device.
[0050] It can be understood that the first content is the content to be screen-mirrored displayed on the first device. Before the screen mirroring between the first device and the second device is established, the first content may be displayed on the first device. After the screen mirroring between the first device and the second device is established, the first content may or may not be displayed on the first device.
[0051] Based on the above solution, when the authentication is successful (the first data is consistent with the second data), the screen-mirrored content can be displayed on the selected screen to ensure the security of screen mirroring.
[0052] In combination with the second aspect, in some implementations of the second aspect, the method further includes: when the authentication result of N consecutive times is that the first data is inconsistent with the second data, and the tenth information from the first device is received within a preset time, ignoring the tenth information, where N is a positive integer greater than or equal to 1, and the tenth information is used to request to display third data on the first screen.
[0053] It should be noted that the third data may be a PIN code, which may be the same as the second data or different from the second data. That is to say, the third data can be updated according to the request of the first device.
[0054] For example, if the PIN code input by the first device three consecutive times is inconsistent with the PIN code displayed on the first screen, to ensure the security of screen mirroring, the second device may ignore the information requesting to display the PIN code on the first screen received from the first device within 10 minutes.
[0055] Based on the above solution, when the authentication result shows that the first data is inconsistent with the second data, the user can re-enter the PIN code on the first device and continue to attempt to connect the first device to the second device for screen mirroring. To ensure the security of screen mirroring, the number of consecutive attempts for screen mirroring by the screen mirroring device can be set.
[0056] In combination with the second aspect, in some implementation manners of the second aspect, the first content is displayed on the first device.
[0057] It should be noted that for synchronous screen mirroring, the first content is synchronously displayed on the first screens of the first device and the second device. For asynchronous screen mirroring, the first content may not be displayed on the first device. The user can exit the interface where the first content is displayed on the first device. As long as the screen mirroring connection with the second device is not disconnected, the operations of the user on the first device will not affect the display of the first content on the second device.
[0058] In a third aspect, a screen mirroring device is provided. The device includes a processing unit for displaying the first content; the device further includes a transceiver unit for receiving a first operation for screen mirroring the first content; the processing unit is further for displaying a first interface, and the first interface includes an identifier of a first screen, an identifier of a second screen, and an identifier of a third screen. The first screen and the second screen are screens of the second device, and the third screen is a screen of a third device. The device is connected to the second device and the device is connected to the third device.
[0059] In combination with the third aspect, in some implementation manners of the third aspect, the transceiver unit is further for receiving an operation of selecting the identifier of the first screen and sending a first message to the second device; wherein, the first message is for instructing the second device to display the first content on the first screen.
[0060] In combination with the third aspect, in some implementation manners of the third aspect, the transceiver unit is further for sending a second message; and is further for receiving a third message, and the third message includes a first field for representing the first screen and the second screen.
[0061] In combination with the third aspect, in some implementation manners of the third aspect, the transceiver unit is further for receiving a fourth message, and the fourth message includes a second field for representing the third screen.
[0062] In combination with the third aspect, in some implementation manners of the third aspect, the processing unit is further for outputting a first prompt; and is further for receiving an operation of inputting first data within the first prompt and outputting a second prompt for instructing the second device to authenticate whether the first data is consistent with second data, and the second data is displayed on the first screen.
[0063] In combination with the third aspect, in some implementation manners of the third aspect, the transceiver unit is further configured to send a fifth piece of information, where the fifth piece of information is used to instruct the second device to display the second data on the first screen.
[0064] In combination with the third aspect, in some implementation manners of the third aspect, the transceiver unit is configured to send a sixth piece of information to the second device, where the sixth piece of information is used to instruct the second device to determine whether the first data is consistent with the second data; and is further configured to receive a seventh piece of information, where the seventh piece of information includes an authentication result, and the authentication result is used to indicate whether the first data is consistent with the second data; the processing unit is configured to determine that the first screen is the target screen when the authentication result indicates that the first data is consistent with the second data; where the first piece of information is specifically used to instruct to display the first content on the target screen.
[0065] In combination with the third aspect, in some implementation manners of the third aspect, the transceiver unit is configured to receive an operation of selecting the identifier of the first screen and the identifier of the second screen, and send an eighth piece of information to the second device; where the eighth piece of information is used to instruct the second device to display the first content on the first screen and the second screen.
[0066] In combination with the third aspect, in some implementation manners of the third aspect, the transceiver unit is configured to receive an operation of selecting the identifier of the first screen and the identifier of the third screen, send a first piece of information to the second device, and send a ninth piece of information to the third device; where the first piece of information is used to instruct the second device to display the first content on the first screen, and the ninth piece of information is used to instruct the third device to display the first content on the third screen.
[0067] In combination with the third aspect, in some implementation manners of the third aspect, the device is a mobile phone terminal or a tablet computer, and the second device is a vehicle-mounted terminal or a smart screen.
[0068] In a fourth aspect, a screen projection device is provided. The screen of the device includes a first screen and a second screen. The device includes: a transceiver unit, configured to receive a second piece of information sent by a first device; and is further configured to send a third piece of information to the first device, where the third piece of information includes a first field, and the first field is used to represent the first screen and the second screen, the identifiers of the first screen and the second screen are displayed on a first interface of the first device, and the first interface further includes an identifier of a third screen, where the third screen is the screen of a third device, the device is connected to the first device, and the third device is connected to the first device.
[0069] In combination with the fourth aspect, in some implementation manners of the fourth aspect, the transceiver unit is configured to receive a fifth piece of information; the device further includes a processing unit, and the processing unit is configured to display second data on the first screen according to the fifth piece of information.
[0070] In combination with the fourth aspect, in some implementations of the fourth aspect, the transceiver unit is configured to receive sixth information, where the sixth information includes first data; the processing unit is configured to determine an authentication result according to the sixth information, where the authentication result is used to indicate whether the first data is consistent with the second data; and send seventh information, where the seventh information includes the authentication result.
[0071] In combination with the fourth aspect, in some implementations of the fourth aspect, the transceiver unit is configured to receive first information, where the first information is used for the first device to instruct the apparatus to display first content on the first screen, and the first content is associated with the first device; the processing unit is configured to display the first content.
[0072] In combination with the fourth aspect, in some implementations of the fourth aspect, the processing unit is configured to, when the authentication results of consecutive N times indicate that the first data is inconsistent with the second data and the tenth information from the first device is received within a preset time, ignore the tenth information, where N is a positive integer greater than or equal to 1, and the tenth information is used to request to display third data on the first screen.
[0073] In combination with the fourth aspect, in some implementations of the fourth aspect, the first content is displayed on the first device.
[0074] In a fifth aspect, an electronic device is provided. The electronic device is a first device and includes: one or more memories; one or more processors; the one or more memories are coupled to the one or more processors, and the one or more memories are configured to store computer program code, where the computer program code includes computer instructions. When the one or more processors execute the computer instructions, the first device is caused to execute the method in the first aspect and any of its possible implementations, or execute the method in the second aspect and any of its possible implementations.
[0075] In a sixth aspect, an electronic device is provided. The electronic device is a second device and includes: one or more memories; one or more processors; the one or more memories are coupled to the one or more processors, and the one or more memories are configured to store computer program code, where the computer program code includes computer instructions. When the one or more processors execute the computer instructions, the second device is caused to execute the method in the first aspect and any of its possible implementations, or execute the method in the second aspect and any of its possible implementations.
[0076] In a seventh aspect, a screen mirroring system is provided, which includes a first device and a second device configured to execute the method in the first aspect and any of its possible implementation manners, or includes a first device and a second device configured to execute the method in the second aspect and any of its possible implementation manners.
[0077] In an eighth aspect, a screen mirroring device is provided, including: a processor coupled to a memory, the memory being configured to store a computer program, and the processor being configured to run the computer program so that the screen mirroring device executes the method in the first aspect and any of its possible implementation manners, or the method in the second aspect and any of its possible implementation manners.
[0078] In combination with the eighth aspect, in some implementation manners of the eighth aspect, the device further includes a transceiver configured to receive signals and / or transmit signals.
[0079] In a ninth aspect, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a computer, the computer is caused to implement the method in the first aspect and any of its possible implementation manners, or the method in the second aspect and any of its possible implementation manners.
[0080] In a tenth aspect, a computer program product including instructions is provided. When the computer program product runs on a computer, the computer is caused to execute the method in the first aspect and any of its possible implementation manners, or the method in the second aspect and any of its possible implementation manners.
[0081] In an eleventh aspect, a chip is provided, which includes a processor and a data interface. The processor reads instructions stored on a memory through the data interface to execute the method in the first aspect and any of its possible implementation manners, or the method in the second aspect and any of its possible implementation manners.
[0082] In combination with the eleventh aspect, in some implementation manners of the eleventh aspect, the processor is coupled to the memory through an interface.
[0083] In combination with the eleventh aspect, in some implementation manners of the eleventh aspect, the chip system further includes a memory, and a computer program or computer instructions are stored in the memory. Description of the Drawings
[0084] Figure 1 is a schematic structural diagram of an electronic device.
[0085] Figure 2 is a software structure block diagram of an electronic device.
[0086] Figure 3It is a schematic diagram of an applicable scenario of a screen mirroring method provided by an embodiment of the present application.
[0087] Figure 4 It is a group of GUIs applicable to the existing screen mirroring method provided by an embodiment of the present application.
[0088] Figure 5 It is a schematic flowchart of an existing screen mirroring method provided by an embodiment of the present application.
[0089] Figure 6 It is a group of GUIs provided by an embodiment of the present application.
[0090] Figure 7 It is a group of GUIs provided by an embodiment of the present application.
[0091] Figure 8 It is a schematic flowchart of a screen mirroring method provided by an embodiment of the present application.
[0092] Figure 9 It is a schematic flowchart of a screen mirroring method provided by an embodiment of the present application.
[0093] Figure 10 It is a schematic diagram of a screen mirroring device provided by an embodiment of the present application.
[0094] Figure 11 It is a schematic diagram of a screen mirroring device provided by an embodiment of the present application. Detailed implementation manners
[0095] Next, the technical solutions in the present application will be described in conjunction with the accompanying drawings.
[0096] The terms used in the following embodiments are only for the purpose of describing specific embodiments and are not intended to limit the present application. As used in the specification and claims of the present application, the singular forms "a", "an", "the", "above", "said", "this" are also intended to include the forms such as "one or more", unless there is a clear opposite indication in the context. It should also be understood that in the following embodiments of the present application, "at least one", "one or more" refer to one, two or more than two. The term "and / or" is used to describe the association relationship of associated objects and indicates that three relationships may exist; for example, A and / or B may represent: A exists alone, A and B exist simultaneously, and B exists alone, where A and B may be singular or plural. The character " / " generally represents an "or" relationship between the associated objects before and after.
[0097] References to "one embodiment" or "some embodiments" etc. described in this specification mean that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the present application. Thus, statements such as "in one embodiment", "in some embodiments", "in other some embodiments", "in still other embodiments", etc. that appear in different places in this specification are not necessarily all referring to the same embodiment, but mean "one or more but not all of the embodiments", unless otherwise specifically emphasized. The terms "comprising", "including", "having" and their variants all mean "including but not limited to", unless otherwise specifically emphasized.
[0098] Embodiments of an electronic device, a user interface for such an electronic device, and for using such an electronic device are described below. In some embodiments, the electronic device may be a portable electronic device that also includes other functions such as a personal digital assistant and / or music player functions, such as a mobile phone, a tablet computer, a wearable electronic device with wireless communication functions (such as a smart watch), etc. Exemplary embodiments of the portable electronic device include, but are not limited to, portable electronic devices running or other operating systems. The above portable electronic device may also be other portable electronic devices, such as a laptop computer. It should also be understood that in other some embodiments, the above electronic device may not be a portable electronic device, but a desktop computer. In other some embodiments, the electronic device may be an instrument for measurement, such as an oscilloscope.
[0099] Exemplarily, Figure 1A schematic structural diagram of the electronic device 100 is shown. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. Among them, the sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
[0100] It can be understood that the structure schematically shown in the embodiments of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than those shown in the figure, or combine certain components, or split certain components, or have different component arrangements. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.
[0101] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modulation and demodulation processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units may be independent devices or integrated in one or more processors.
[0102] Among them, the controller may be the nerve center and command center of the electronic device 100. The controller may generate operation control signals according to the instruction operation code and timing signals to complete the control of fetching instructions and executing instructions.
[0103] A memory can also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can hold the instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can be directly called from the said memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.
[0104] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.
[0105] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modulation and demodulation processor, and the baseband processor, etc.
[0106] The antenna 1 and the antenna 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization rate of the antennas. For example: the antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.
[0107] The mobile communication module 150 may provide solutions for wireless communications such as 2G / 3G / 4G / 5G applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 may receive electromagnetic waves through the antenna 1, filter and amplify the received electromagnetic waves, and then transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 may also amplify the signal modulated by the modulation and demodulation processor and convert it into electromagnetic waves through the antenna 1 for radiation. In some embodiments, at least some functional modules of the mobile communication module 150 may be provided in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be provided in the same device.
[0108] The modulation and demodulation processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. Subsequently, the demodulator transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, receiver 170B, etc.), or displays an image or video through the display screen 194. In some embodiments, the modulation and demodulation processor may be an independent device. In other embodiments, the modulation and demodulation processor may be independent of the processor 110 and be provided in the same device as the mobile communication module 150 or other functional modules.
[0109] The wireless communication module 160 may provide solutions for wireless communications applied to the electronic device 100, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite systems (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering processing on the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 may also receive signals to be sent from the processor 110, perform frequency modulation and amplification on them, and convert them into electromagnetic waves through the antenna 2 for radiation.
[0110] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, such that electronic device 100 can communicate with a network and other devices through wireless communication technologies. The wireless communication technologies may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. The GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), beidou navigation satellite system (BDS), quasi-zenith satellite system (QZSS), and / or satellite based augmentation systems (SBAS).
[0111] Electronic device 100 implements a display function through a GPU, display screen 194, and an application processor, etc. The GPU is a microprocessor for image processing, and is connected to display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or change display information.
[0112] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include one or N display screens 194, where N is a positive integer greater than 1.
[0113] The electronic device 100 can implement the shooting function through the ISP, the camera 193, the video codec, the GPU, the display screen 194, and the application processor, etc.
[0114] The ISP is used to process the data fed back by the camera 193. For example, when taking a photo, the shutter is opened, and the light passes through the lens and is transmitted to the camera photosensitive element. The optical signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye. The ISP can also optimize the noise, brightness, and skin color of the image through algorithms. The ISP can also optimize parameters such as the exposure and color temperature of the shooting scene. In some embodiments, the ISP can be provided in the camera 193.
[0115] The camera 193 is used to capture static images or videos. An object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in standard RGB, YUV, etc. formats. In some embodiments, the electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1.
[0116] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy, etc.
[0117] The video codec is used to compress or decompress digital videos. The electronic device 100 can support one or more video codecs. In this way, the electronic device 100 can play or record videos in multiple coding formats, such as: Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.
[0118] The NPU is a neural-network (NN) computing processor. By learning from the biological neural network structure, such as learning from the transmission pattern between human brain neurons, it can quickly process the input information and can also continuously self-learn. Through the NPU, applications such as intelligent cognition of the electronic device 100 can be realized, such as: image recognition, face recognition, voice recognition, text understanding, etc.
[0119] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement the data storage function. For example, files such as music and videos are saved in the external memory card.
[0120] The internal memory 121 can be used to store computer-executable program code, and the executable program code includes instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 can include a program storage area and a data storage area. Among them, the program storage area can store the operating system, application programs required for at least one function (such as the sound playback function, the image playback function, etc.). The data storage area can store the data created during the use of the electronic device 100 (such as audio data, phone book, etc.). In addition, the internal memory 121 can include high-speed random access memory and can also include non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.
[0121] The electronic device 100 can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor, etc. For example, music playback, recording, etc.
[0122] The audio module 170 is used to convert digital audio information into an analog audio signal for output, and is also used to convert an analog audio input into a digital audio signal. The audio module 170 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 170 can be disposed in the processor 110, or some functional modules of the audio module 170 can be disposed in the processor 110.
[0123] The speaker 170A, also known as a "loudspeaker", is used to convert an audio electrical signal into a sound signal. The electronic device 100 can listen to music or a hands-free call through the speaker 170A.
[0124] The receiver 170B, also known as an "earpiece", is used to convert an audio electrical signal into a sound signal. When the electronic device 100 answers a call or a voice message, the user can listen to the voice by bringing the receiver 170B close to the ear.
[0125] The microphone 170C, also known as a "microphone" or "transmitter", is used to convert a sound signal into an electrical signal. When making a call or sending a voice message, the user can speak by bringing the mouth close to the microphone 170C to input the sound signal into the microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In some other embodiments, the electronic device 100 can be provided with two microphones 170C, which can not only collect sound signals but also implement a noise reduction function. In some other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C to implement functions such as collecting sound signals, noise reduction, identifying the sound source, and implementing a directional recording function.
[0126] The pressure sensor 180A is used to sense a pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be disposed on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. The capacitive pressure sensor can include at least two parallel plates with conductive materials. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure according to the change in capacitance. When a touch operation acts on the display screen 194, the electronic device 100 detects the intensity of the touch operation according to the pressure sensor 180A. The electronic device 100 can also calculate the position of the touch according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations with the same touch position but different touch operation intensities can correspond to different operation instructions. For example, when a touch operation with a touch operation intensity greater than or equal to a first pressure threshold acts on the alarm application icon, the instruction to create a new alarm is executed.
[0127] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access to application locks, fingerprint photography, fingerprint answering of incoming calls, etc. For example, when the mobile phone detects a user's touch operation on the lock screen interface, the mobile phone can collect the user's fingerprint information through the fingerprint sensor 180H, and match the collected fingerprint information with the pre-set fingerprint information in the mobile phone. If the match is successful, the mobile phone can enter the non-lock screen interface from the lock screen interface.
[0128] The touch sensor 180K, also known as the "touch panel". The touch sensor 180K can be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also known as the "touch screen". The touch sensor 180K is used to detect touch operations acting thereon or nearby. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In some other embodiments, the touch sensor 180K can also be disposed on the surface of the electronic device 100, at a different position from that of the display screen 194.
[0129] Figure 2 It is a software structure block diagram of the electronic device 100 according to an embodiment of the present application. The layered architecture divides the software into several layers, and each layer has a clear role and division of labor. Communication between layers is through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom are the application layer, the application framework layer, the Android runtime, and the system library, and the kernel layer. The application layer can include a series of application packages.
[0130] Such as Figure 2 shown, the application layer can include a camera, settings, a skin module, a user interface (UI), third-party applications, etc. Among them, the third-party applications can include a gallery, a calendar, a call, a map, a navigation, a WLAN, a Bluetooth, music, a video, a short message, etc.
[0131] The application framework layer provides application programming interfaces (APIs) and programming frameworks for the applications in the application layer. The application framework layer can include some predefined functions.
[0132] Such as Figure 2 shown, the application framework layer can include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, etc.
[0133] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc. The content provider is used to store and obtain data, and make this data accessible to application programs. The said data may include videos, images, audio, incoming and outgoing calls, browsing history and bookmarks, phone books, etc.
[0134] The view system includes visual controls, such as controls for displaying text, controls for displaying pictures, etc. The view system can be used to build application programs. The display interface can be composed of one or more views.
[0135] The phone manager is used to provide the communication function of the electronic device 100. For example, the management of call status (including connection, disconnection, etc.).
[0136] The resource manager provides various resources for application programs, such as localized strings, icons, pictures, layout files, video files, and so on.
[0137] The notification manager enables application programs to display notification information in the status bar. It can be used to convey notification-type messages, which can automatically disappear after a short stay without user interaction. For example, the notification manager is used to inform that the download is completed, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as the notification of a background-running application program, and can also be a notification that appears on the screen in the form of a dialogue window. For example, it prompts text information in the status bar, emits a prompt sound, the electronic device vibrates, the indicator light flashes, etc.
[0138] The Android runtime includes a core library and a virtual machine. The Android runtime is responsible for the calls and management of the Android system.
[0139] The core library consists of two parts: one part is the functional functions that need to be called by the Java language, and the other part is the core library of Android.
[0140] The application layer and the application framework layer run in the virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as the management of object life cycles, stack management, thread management, security and exception management, and garbage collection.
[0141] The system library can include multiple functional modules. For example: surface manager, media libraries, 3D graphics processing library (such as: OpenGL ES), 2D graphics engine (such as: SGL), etc.
[0142] The surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications.
[0143] The media library supports the playback and recording of a variety of common audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video coding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
[0144] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis, and layer processing, etc.
[0145] The 2D graphics engine is a drawing engine for 2D drawing.
[0146] In addition, the system library can also include a status monitoring service module, etc., such as a physical state recognition module for analyzing and recognizing user gestures; a sensor service module for monitoring sensor data uploaded by various sensors in the hardware layer to determine the physical state of the electronic device 100.
[0147] The kernel layer is the layer between the hardware and the software. The kernel layer at least includes a display driver, a camera driver, an audio driver, and a sensor driver.
[0148] The hardware layer can include various sensors, such as Figure 1 the various sensors introduced in
[0149] Combined with the above Figure 1 and Figure 2 the electronic devices introduced, in the embodiments of the present application, electronic devices such as mobile phone terminals, tablet computers, in-vehicle terminals, etc., which can support the screen mirroring function. The physical devices involved in the electronic device 100 mainly include hardware components such as sensors, decision support systems (DSS), display chips, touch display screens, fingerprint recognition modules, etc.; and kernel software layers such as a screen management module, a display driver, a fingerprint driver, and anti-misoperation; application framework layer functions such as anti-misoperation input, screen control, always on display (AOD) service, and power management; and application layer services such as special adaptation applications (camera), third-party applications, system hibernation, and AOD.
[0150] Figure 3It is a schematic diagram of a scenario applicable to the screen mirroring method provided by an embodiment of the present application. This scenario includes a screen mirroring device and a device to be screen mirrored. Among them, the screen mirroring device can be an electronic device such as a mobile phone terminal, a tablet computer, a personal computer, etc. that supports the screen mirroring function. The device to be screen mirrored can be an electronic device including a screen, such as a car machine terminal, a smart screen, etc. Further, the device to be screen mirrored can also be an electronic device including multiple screens. For example, a car machine terminal including a central control screen, a co-pilot screen, and a rear seat screen, or a smart screen including a second extended screen, etc. The screen mirroring device and the device to be screen mirrored can be in different local area network environments. The screen mirroring device triggers a screen mirroring request. When the device to be screen mirrored accepts the screen mirroring request, the screen of the device to be screen mirrored can display the screen mirroring content. The screen mirroring function can be synchronous screen mirroring or asynchronous screen mirroring. Among them, synchronous screen mirroring can be understood as the screen mirroring device and the device to be screen mirrored displaying the same content; asynchronous screen mirroring can be understood as the screen mirroring device and the device to be screen mirrored displaying different content. For example, the mirror screen mirroring of the screen mirroring device belongs to synchronous screen mirroring, and the screen mirroring function of the application program carried by the screen mirroring device belongs to asynchronous screen mirroring. The present application does not limit the specific screen mirroring function. An embodiment of the present application will introduce the screen mirroring method with a mobile phone terminal as the screen mirroring device and a car machine terminal including multiple screens as the device to be screen mirrored.
[0151] With the development of electronic device technology, through the screen mirroring function of the electronic device, the screen mirroring content can be displayed on the corresponding screen to facilitate users to obtain information or achieve interaction on a specific screen. Before implementing the screen mirroring function, the screen mirroring device and the device to be screen mirrored need to complete a certain interaction process. The following will be combined with Figure 4 , to introduce an existing screen mirroring method.
[0152] As Figure 4 shown, a set of graphical user interfaces (GUI) provided by the present application is shown. Taking a mobile phone terminal as the screen mirroring device and a car machine terminal as the device to be screen mirrored as an example, an existing screen mirroring method is introduced.
[0153] As Figure 4 shown in (a) of Figure 4 , the main interface of the mobile phone terminal (Device A) is shown. The main interface includes icons of multiple application programs (App), and the multiple application programs include a clock, a calendar, a gallery, a memo, and a browser application program, etc. After receiving the user's operation on the icon 401 of the browser application program, the mobile phone terminal can display the GUI shown in (b) of
[0154] As Figure 4As shown in (b) therein, upon receiving the user's operation on the icon 401 of the browser application, the mobile terminal displays the display interface of the browser application. This display interface shows the content recommended by the browser application for the user. For example, it shows article A recommended for the user. The top of the mobile terminal screen also shows power information, time information, etc. Upon receiving the user's operation of swiping down from the top of the mobile terminal screen, the mobile terminal can display a GUI as shown in Figure 4 in (c).
[0155] As Figure 4 shown in (c) therein, upon receiving the user's operation of swiping down from the top of the mobile terminal screen, the mobile terminal displays the control center interface. This interface includes multiple controls, and the multiple controls include a mute control, a mobile data control, a screen recording control, a wireless screen mirroring control, etc. Among them, a control is a visual graphical interface element presented to the user. It is a software component included in the application, controlling the data processed by the application and the interaction operations regarding these data. The user can interact with the control through operations such as touching and swiping, so as to read and edit relevant information of the application. Generally speaking, a control can include visual interface elements such as icons, buttons, menus, tabs, text boxes, status bars, etc. Upon receiving the user's operation on different controls (such as: touch operation or click operation), different interfaces can be displayed on the screen of the electronic device. Upon receiving the user's operation on the wireless screen mirroring control 402, the mobile terminal can display a GUI as shown in Figure 4 in (d).
[0156] As Figure 4 shown in (d) therein, upon receiving the user's operation on the wireless screen mirroring control 402, the mobile terminal displays the display interface of the browser application. This display interface shows a prompt message 403, and the prompt message 403 is used to prompt the user to select the device to be screen mirrored. The prompt message 403 includes a vehicle head unit control 404 and a personal computer control. That is to say, when the mobile terminal enables the wireless screen mirroring function, it is found that the devices that can implement the wireless screen mirroring function around include the vehicle head unit and the personal computer. It should be noted that the prompt message 403 can also display the device identifiers of the devices that can implement the wireless screen mirroring function around the screen mirroring device mobile terminal. Upon receiving the user's operation on the vehicle head unit control 404, the central control screen of the vehicle head unit corresponding to the vehicle head unit control 404 can display a GUI as shown in Figure 4 in (e).
[0157] It should be noted that the vehicle head unit can include multiple screens such as a central control screen, a co-pilot screen, and a rear seat screen.
[0158] As Figure 4As shown in (e) therein, upon receiving the user's operation on the in-vehicle terminal control 404, a prompt message 405 can be displayed on the central control screen of the in-vehicle terminal corresponding to the in-vehicle terminal control 404. The prompt message 405 is used to prompt the user whether to trust device A (mobile terminal). The prompt message 405 includes a trust control and a distrust control. Upon receiving the user's operation on the trust control 406, the mobile terminal can display a GUI as shown in Figure 4 (f) therein.
[0159] It should be noted that when the user clicks the trust control 406 on the central control screen, it means that the in-vehicle terminal trusts the screen mirroring device, the mobile terminal. Since the in-vehicle terminal includes multiple screens, before screen mirroring, it is also necessary to determine the specific screen on which the screen mirroring content will be displayed.
[0160] As Figure 4 shown in (f) therein, upon receiving the user's operation on the trust control 406, the mobile terminal displays the display interface of a browser application. The display interface displays a prompt message 407, and the prompt message 407 is used to prompt the user to select a screen. The prompt message 407 includes the control of the central control screen of the in-vehicle terminal and the control of the co-pilot screen of the in-vehicle terminal. That is to say, after selecting the in-vehicle terminal as the screen mirroring device, it is also necessary to select any screen from the multiple screens of the in-vehicle terminal. It should be noted that the prompt message 407 can also display the identifiers of the respective screens of the in-vehicle terminal. Upon receiving the user's operation on the control 408 of the co-pilot screen of the in-vehicle terminal, the mobile terminal can display a GUI as shown in Figure 4 (g) therein.
[0161] As Figure 4 shown in (g) therein, upon receiving the user's operation on the control 408 of the co-pilot screen of the in-vehicle terminal, the mobile terminal displays the display interface of a browser. The display interface displays a prompt message 409, and the prompt message 409 is used to prompt the user that the authentication information is being obtained. It should be noted that after the user selects the co-pilot screen, the mobile terminal also needs to complete a security authentication with the co-pilot screen, and the prompt message 409 is used to indicate that the co-pilot screen is loading the security authentication information. When the co-pilot screen finishes loading the security authentication information, the co-pilot screen corresponding to the control 408 of the co-pilot screen of the in-vehicle terminal can display a GUI as shown in Figure 4 (h) therein, and the mobile terminal can display a GUI as shown in Figure 4 (i) therein.
[0162] As Figure 4As shown in (h) therein, after the information for security authentication is loaded, a prompt message 210 can be displayed on the co-pilot screen corresponding to the control 408 of the in-vehicle terminal. The prompt message 410 displays the information for security authentication. For example, the personal identification number (PIN) is "123456".
[0163] As Figure 4 shown in (i) therein, after the information for security authentication is loaded, the display interface of the browser application is shown on the mobile terminal. The display interface shows an input box 411 and also shows a virtual keyboard 412. The input box 411 includes a confirmation control 413 and a cancellation control. The user can input the PIN code "123456" shown in the prompt message 410 into the input box 411 through the virtual keyboard 412. After receiving the user's input of the PIN code and the operation on the confirmation control 413, the mobile terminal can display the GUI as shown in Figure 4 (j) therein.
[0164] As Figure 4 shown in (j) therein, after receiving the user's input of the PIN code and the operation on the confirmation control 413, the display interface of the browser application is shown on the mobile terminal. The display interface shows a prompt message 414, and the prompt message 414 is used to prompt that the mobile terminal is establishing a screen mirroring connection with the in-vehicle terminal device. When the screen mirroring connection is established, the mobile terminal can display the GUI as shown in Figure 4 (k) therein. Meanwhile, the co-pilot screen corresponding to the control 408 of the in-vehicle terminal can display the GUI as shown in Figure 4 (l) therein.
[0165] As Figure 4 shown in (k) therein, after the screen mirroring connection is established, the display interface of the browser application is shown on the mobile terminal. A prompt message 415 is shown at the top of the display interface, and the prompt message 415 is used to prompt the user that screen mirroring is in progress.
[0166] As Figure 4 shown in (l) therein, after the screen mirroring connection is established, the co-pilot screen corresponding to the control 408 of the in-vehicle terminal displays the display interface of the browser application on the mobile terminal. The display interface of the browser application on the mobile terminal is displayed on the co-pilot screen as the screen mirroring content, indicating that the process of establishing the screen mirroring connection has been completed, and the co-pilot screen can synchronously display the screen mirroring content on the mobile terminal screen as the target screen.
[0167] It should be noted that Figure 4A set of GUIs shown introduce a screen mirroring method. Before the screen mirroring content is displayed on the selected screen, the user needs to perform certain operations on the screen mirroring device side and the device to be screen mirrored side. For example, on the screen mirroring device side, the user needs to first trigger the screen mirroring function and select the device to be screen mirrored. Since the device to be screen mirrored includes multiple screens, the user also needs to select any screen from the multiple screens and enter a PIN code to complete the security authentication. On the device to be screen mirrored side, the user needs to select whether to trust the screen mirroring device. It can be seen that before completing the screen mirroring, the user performs 4 operation steps on the screen mirroring device side and 1 operation step on the device to be screen mirrored side, that is, the user needs to complete at least 5 operation steps to display the screen mirroring content on the selected screen. Obviously, such a screen mirroring process is rather cumbersome and affects the convenience of the screen mirroring function.
[0168] As Figure 5 shown, a schematic flowchart of an existing screen mirroring method is shown. This method 500 can be applied to a screen mirroring device and a device to be screen mirrored, and corresponds to the screen mirroring process as Figure 4 shown. The following is a specific introduction to method 500.
[0169] S501, the screen mirroring device and the device to be screen mirrored discover each other.
[0170] Exemplarily, the screen mirroring device broadcasts a discovery message, and the device to be screen mirrored receives the discovery message and feeds back a return message to the screen mirroring device.
[0171] It should be noted that when the user triggers the screen mirroring function on the screen mirroring device, the screen mirroring device starts Bluetooth scanning and discovers the device to be screen mirrored through the Bluetooth discovery broadcast protocol. Among them, the screen mirroring function includes synchronous screen mirroring or asynchronous screen mirroring.
[0172] Exemplarily, when the screen mirroring device receives the return message, it indicates that the discovery between the screen mirroring device and the device to be screen mirrored is completed.
[0173] It should be noted that the discovery message is a broadcast message, and the device to be screen mirrored belongs to the peripheral devices of the screen mirroring device. All peripheral devices of the screen mirroring device may receive the discovery message, and all peripheral devices that receive the discovery message can feed back the return message. When multiple peripheral devices feed back the return message to the screen mirroring device, a prompt message 403 as shown in Figure 4 (d) can be displayed on the screen mirroring device. The prompt message 403 can be understood as a list of peripheral devices that feed back the return message.
[0174] S502, the screen mirroring device and the device to be screen mirrored perform a handshake to establish a connection.
[0175] Exemplarily, the screen mirroring device sends a link establishment request to the device to be screen mirrored, for requesting the device to be screen mirrored to trust the screen mirroring device. The device to be screen mirrored sends a link establishment response to the screen mirroring device, and the link establishment response is used to notify whether the device to be screen mirrored trusts the screen mirroring device.
[0176] It should be noted that the user selects any device (for example, device 1) from multiple peripheral devices in the feedback return message, and after the screen mirroring device and device 1 determine mutual trust, device 1 can be used as the device to be screen mirrored.
[0177] Exemplarily, after the user selects device 1 among the peripheral devices, the screen mirroring device can stop Bluetooth scanning to discover peripheral devices. The screen mirroring device performs a handshake to establish a link with device 1.
[0178] It should be noted that the screen mirroring device and device 1 complete mutual trust through the process of handshake to establish a link. For example, after selecting device 1, device 1 can receive a link establishment request from the screen mirroring device and display a prompt message 405 as shown in (e) below, for the user to determine whether device 1 trusts the screen mirroring device. If it is determined to trust the screen mirroring device, it can be fed back to the screen mirroring device through a link establishment response, so that the screen mirroring device displays an interface as shown in (f) below, determining that device 1 is the device to be screen mirrored. Figure 4 If it is determined to trust the screen mirroring device, it can be fed back to the screen mirroring device through a link establishment response, so that the screen mirroring device displays an interface as shown in (f) below, determining that device 1 is the device to be screen mirrored. Figure 4 in (f) below, determining that device 1 is the device to be screen mirrored.
[0179] Furthermore, the device to be screen mirrored can include multiple screens, and the user can select any screen (for example, screen 1) from the multiple screens, and the selected screen can be used as the screen to be screen mirrored and displayed. A PIN code can be displayed on the selected screen 1, so that the screen mirroring device and screen 1 complete PIN code authentication.
[0180] S503, PIN code authentication between the screen mirroring device and the device to be screen mirrored.
[0181] Exemplarily, the user enters a PIN code on the screen mirroring device, and the screen mirroring device sends an authentication request to the device to be screen mirrored, for requesting to authenticate whether the PIN code entered by the user is the same as the PIN code displayed on screen 1. The device to be screen mirrored performs PIN code comparison through the screen mirroring protocol. If the PIN codes are the same, it indicates successful authentication. If the PIN codes are different, it indicates failed authentication.
[0182] S504, the screen mirroring device determines the target screen.
[0183] It should be noted that if the authentication is successful, the screen mirroring device determines screen 1 as the target screen, and the content to be screen mirrored can be displayed on the target screen.
[0184] S505, screen mirroring connection between the screen mirroring device and the device to be screen mirrored.
[0185] It should be noted that through the screen mirroring protocol, the screen mirroring content on the screen mirroring device (for example, the interface, pictures, videos, etc. of the screen mirroring device) can be displayed on the interface of the device being mirrored.
[0186] As can be seen from the above steps, on the screen mirroring device side, the user needs to first select the device being mirrored and then determine the target screen from multiple screens on the device being mirrored. On the device being mirrored side, the user needs to first determine that the screen mirroring device can be trusted. To avoid this cumbersome process, the embodiments of the present application provide a screen mirroring method that combines the original process of the user selecting the device being mirrored and determining the target screen into one operation step, and at the same time optimizes the operation of the security authentication of the device being mirrored, simplifies the operation steps of the screen mirroring process while ensuring the security of screen mirroring, and improves the screen mirroring efficiency.
[0187] It should be noted that the screen mirroring method provided by the embodiments of the present application can be synchronous screen mirroring or asynchronous screen mirroring. Among them, synchronous screen mirroring can be understood as the screen mirroring device and the device being mirrored displaying the same content; asynchronous screen mirroring can be understood as the screen mirroring device and the device being mirrored displaying different content. For example, the mirror screen mirroring of the screen mirroring device belongs to synchronous screen mirroring, and the screen mirroring function of the application program carried by the screen mirroring device belongs to asynchronous screen mirroring. The present application does not limit the specific operations for the user to trigger synchronous screen mirroring or asynchronous screen mirroring. The processes of the above synchronous screen mirroring and asynchronous screen mirroring are introduced below respectively.
[0188] As Figure 6 shown, a group of GUIs provided by the embodiments of the present application are shown. Taking the screen mirroring device as a mobile phone terminal and the device being mirrored as a car machine terminal as an example, a synchronous screen mirroring method is introduced.
[0189] As Figure 6 shown in (a) therein, the main interface of the mobile phone terminal (Device A) is shown. The main interface includes icons of multiple application programs, and the multiple application programs include a clock, a calendar, a gallery, a memo, and a browser application program, etc. After receiving the operation of the user on the icon 601 of the browser application program, the mobile phone terminal can display the GUI as shown in Figure 6 shown in (b) therein.
[0190] As Figure 6 shown in (b) therein, after receiving the operation of the user on the icon 601 of the browser application program, the display interface of the browser application program is displayed on the mobile phone terminal. The display interface displays the content recommended by the browser application program for the user. For example, it is shown as Article A recommended for the user. The power information, time information, etc. are also displayed at the top of the mobile phone terminal screen. After receiving the operation of the user sliding down from the top of the mobile phone terminal screen, the mobile phone terminal can display the GUI as shown in Figure 6 shown in (c) therein.
[0191] As Figure 6As shown in (c), when the mobile terminal receives the operation of the user sliding down from the top of the mobile terminal screen, the mobile terminal displays a control center interface. The interface includes multiple controls, and the multiple controls include a mute control, a mobile data control, a screen recording control, a wireless screen mirroring control, etc. When the mobile terminal receives the operation of the user on the wireless screen mirroring control 602, the mobile terminal can display a GUI as shown in Figure 6 in (d).
[0192] As shown in Figure 6 in (d), when the mobile terminal receives the operation of the user on the wireless screen mirroring control 602, the mobile terminal displays a display interface of a browser application. The display interface displays a prompt message 603, and the prompt message 603 is used to prompt the user to select a screen. The prompt message 603 includes the identifiers of each screen. Optionally, the identifier of the screen can be displayed on the control of the screen. When the user clicks on the control of a certain screen, it means that the user selects the identifier corresponding to the control of the screen, that is, it means that the user selects the specific screen corresponding to the control of the screen. Among them, the identifier of the screen can include the device information where the screen is located, the location information of the screen, the number information of the screen, etc. Exemplarily, when the identifier of the screen is "the co-pilot screen of the in-vehicle terminal", it means that the screen belongs to the in-vehicle terminal and the screen is located in the co-pilot position. When there are multiple screens at the same position, the number information of the screen can be used for identification. Exemplarily, when there are multiple screens in the co-pilot, and the identifier of the screen is "the co-pilot screen 2 of the in-vehicle terminal", it means that the screen belongs to the in-vehicle terminal and the screen is the screen numbered 2 at the co-pilot position. It can be understood that the number information of the screen can also be directly used to refer to the number of the screen in the device. Exemplarily, when the identifier of the screen is "the second screen of the in-vehicle terminal", it means that the screen belongs to the in-vehicle terminal and is the screen numbered 2 of the in-vehicle terminal.
[0193] For example, the identifiers of the screens in the prompt message 603 include: "the screen of the personal computer", "the central control screen of the in-vehicle terminal", and "the co-pilot screen of the in-vehicle terminal". In a possible implementation manner, the identifiers of the screens are displayed on the corresponding controls, so these identifiers of the screens are respectively displayed on the controls of the screen of the personal computer, the central control screen of the in-vehicle terminal, and the co-pilot screen of the in-vehicle terminal. The user can directly select the control of any screen among the various screens to determine the selected screen and project the screen mirroring content onto the selected screen.
[0194] It should be noted that when the mobile terminal receives the operation of the user on the wireless screen mirroring control 602 and the mobile terminal displays the prompt message 603, the specific display manner and specific display position of the prompt message 603 in the embodiments of the present application are not limited. For example, the prompt message 603 can be displayed at the bottom of the display interface of the browser application, or be full-screen displayed on the screen of the mobile terminal, or be displayed in the form of a floating window on the display interface of the browser application.
[0195] It is understandable that the selected screen can be the target screen, which can be understood as the screen on the device to be mirrored that displays the mirrored content after the mirroring connection is completed. In one implementation, after the user selects the identifier of a certain screen, the mirrored content can be displayed on that screen. In this case, the selected screen is the target screen.
[0196] Optionally, on the display interface of the browser application as shown in (d) of Figure 6 , when an operation on the control 604 of the co-pilot screen of the in-vehicle terminal is received from the user, the mobile terminal can display a GUI as shown in (e) of Figure 6 .
[0197] As shown in (e) of Figure 6 , when an operation on the control 604 of the co-pilot screen of the in-vehicle terminal is received from the user, the mobile terminal displays the display interface of the browser application. This display interface displays a prompt message 605, and the prompt message 605 is used to prompt that the mobile terminal is establishing a mirroring connection with the in-vehicle terminal. After the mirroring connection is established, the mobile terminal can display a GUI as shown in (f) of Figure 6 . Meanwhile, the co-pilot screen corresponding to the control 604 of the co-pilot screen of the in-vehicle terminal can display a GUI as shown in (g) of Figure 6 .
[0198] As shown in (f) of Figure 6 , after the mirroring connection is established, the mobile terminal displays the display interface of the browser application. A prompt message 606 is displayed at the top of this display interface, and the prompt message 606 is used to prompt the user that mirroring is in progress.
[0199] As shown in (g) of Figure 6 , after the mirroring connection is established, the co-pilot screen corresponding to the control 604 of the co-pilot screen of the in-vehicle terminal displays the display interface of the browser application on the mobile terminal. The display interface of the browser application on the mobile terminal is displayed as the mirrored content on the co-pilot screen, indicating that the process of establishing the mirroring connection has been completed. The co-pilot screen, as the target screen, can synchronously display the mirrored content on the mobile terminal screen.
[0200] It should be noted that the above process realizes mirroring in a synchronous mirroring mode. Therefore, the same content as that on the screen of the mirroring device is displayed on the screen of the device to be mirrored.
[0201] In another implementation, after the user selects the identifier of a certain screen and the authentication is successful, the screen mirroring content can be displayed on that screen, and the selected screen is the target screen. Herein, the embodiments of the present application do not limit the specific manner of authentication. Taking whether the PIN codes are the same as an authentication method as an example, the screen mirroring method will be introduced below.
[0202] Optionally, on the display interface of the browser application as shown in (d) of Figure 6 , when receiving the operation of the user on the control 604 of the co-pilot screen of the vehicle-mounted terminal, the mobile terminal can display the GUI as shown in (h) of Figure 6 .
[0203] As shown in (h) of Figure 6 , when receiving the operation of the user on the control 604 of the co-pilot screen of the vehicle-mounted terminal, the mobile terminal displays the display interface of the browser application. The display interface displays a prompt message 607, and the prompt message 607 is used to prompt the user that the authentication information is being obtained. It should be noted that after the user selects the co-pilot screen, the mobile terminal also needs to complete the security authentication with the co-pilot screen. The prompt message 607 is used to indicate that the co-pilot screen is loading the security authentication information. After the security authentication information is loaded, the co-pilot screen corresponding to the control 604 of the co-pilot screen of the mobile terminal can display the GUI as shown in (i) of Figure 6 , and the mobile terminal can display the GUI as shown in (j) of Figure 6 .
[0204] As shown in (i) of Figure 6 , after the security authentication information is loaded, a prompt message 608 can be displayed on the co-pilot screen corresponding to the control 604 of the vehicle-mounted terminal's co-pilot screen. The prompt message 608 displays the security authentication information. For example, the PIN code "123456".
[0205] Optionally, the prompt message 608 can also be a QR code, and the security authentication is realized by the mobile terminal scanning the prompt message 608.
[0206] As shown in (j) of Figure 6 , after the security authentication information is loaded, the mobile terminal displays the display interface of the browser application. The display interface displays an input box 609 and also displays a virtual keyboard 610. The input box 609 includes a confirmation control 611 and a cancellation control. The user can input the PIN code "123456" displayed in the prompt message 608 in the input box 609 through the virtual keyboard 610. When receiving the operation of the user inputting the PIN code, the mobile terminal can display the GUI as shown in (k) of Figure 6 . Optionally, when receiving the operation of the user inputting the PIN code and the confirmation control 611, the mobile terminal can display the GUI as shown in (l) of Figure 6The GUI shown in (k).
[0207] As Figure 6 shown in (k), upon receiving the operation of the user inputting the PIN code, or upon receiving the operation of the user inputting the PIN code and the operation on the determination control 611, the mobile terminal displays the display interface of the browser application. This display interface displays a prompt message 612, and the prompt message 612 is used to prompt that the mobile terminal and the in-vehicle terminal are establishing a screen mirroring connection, or is used to prompt whether the PIN code input by the user is consistent with the PIN code displayed in the prompt message 608. For example, the prompt message 612 displays "Connecting..." indicating that the PIN code input by the user is consistent with the PIN code displayed in the prompt message 608, and the mobile terminal and the in-vehicle terminal are establishing a screen mirroring connection; or the prompt message 612 displays "Connecting..." indicating that the in-vehicle terminal is authenticating whether the PIN code input by the user is consistent with the PIN code displayed in the prompt message 608. When the authentication result is that the PIN code input by the user is consistent with the PIN code displayed in the prompt message 608 and the screen mirroring connection is established, the mobile terminal can display the GUI shown in (l), and at the same time, the co-pilot screen corresponding to the control 604 of the in-vehicle terminal can display the GUI shown in (m). Figure 6 shown in (l), after the screen mirroring connection is established, the mobile terminal displays the display interface of the browser application. A prompt message 613 is displayed at the top of this display interface, and the prompt message 613 is used to prompt the user that screen mirroring is in progress. Figure 6 shown in (m), after the screen mirroring connection is established, the co-pilot screen corresponding to the control 604 of the in-vehicle terminal displays the display interface of the browser application of the mobile terminal, and the display interface of the browser application of the mobile terminal is displayed on the co-pilot screen as the screen mirroring content, indicating that the process of establishing the screen mirroring connection has been completed, and the co-pilot screen can synchronously display the screen mirroring content on the mobile terminal screen as the target screen.
[0208] As Figure 6 shown in (l), after the screen mirroring connection is established, the mobile terminal displays the display interface of the browser application. A prompt message 613 is displayed at the top of this display interface, and the prompt message 613 is used to prompt the user that screen mirroring is in progress.
[0209] As Figure 6 shown in (m), after the screen mirroring connection is established, the co-pilot screen corresponding to the control 604 of the in-vehicle terminal displays the display interface of the browser application of the mobile terminal, and the display interface of the browser application of the mobile terminal is displayed on the co-pilot screen as the screen mirroring content, indicating that the process of establishing the screen mirroring connection has been completed, and the co-pilot screen can synchronously display the screen mirroring content on the mobile terminal screen as the target screen.
[0210] It can be understood that the selected screen may or may not be the target screen. In one possible implementation, after the user selects a certain screen, the screen mirroring content can be directly displayed on the selected screen. In this case, the selected screen is the target screen. For example, upon receiving an operation on the control 604 of the co-pilot screen of the in-vehicle terminal by the user, the co-pilot screen of the in-vehicle terminal serves as the target screen and displays the screen mirroring content. In another possible implementation, after the user selects a certain screen and the authentication is successful, the screen mirroring content can be displayed on the selected screen. In this case, the selected screen is the target screen. If the authentication fails, the selected screen this time will not serve as the target screen. For example, upon receiving an operation on the control 604 of the co-pilot screen of the in-vehicle terminal by the user, the co-pilot screen of the in-vehicle terminal is the selected screen. If the authentication is successful, the co-pilot screen of the in-vehicle terminal serves as the target screen and displays the screen mirroring content; if the authentication fails, the co-pilot screen of the in-vehicle terminal will not serve as the target screen.
[0211] It should be noted that the above process realizes screen mirroring in a synchronous manner. Therefore, the same content as that on the screen of the screen mirroring device is displayed on the screen of the device being screen mirrored.
[0212] Optionally, if the PIN code entered by the user in the input box 609 through the virtual keyboard 610 in the GUI shown in (j) of Figure 6 is inconsistent with the PIN code displayed in the prompt message 608, and the user inputs the PIN code and operates the OK control 611, the mobile terminal can display the GUI shown in (n) of Figure 6 .
[0213] As shown in (n) of Figure 6 , upon receiving the user's input of the PIN code and operation on the OK control 611, the mobile terminal displays the display interface of the browser application. This interface displays a prompt message 614, and the prompt message 614 is used to prompt that the screen mirroring connection fails.
[0214] It should be understood that Figure 6 the screen mirroring method provided in
[0215] is only an exemplary illustration of the embodiments of the present application. In some other realizable ways, screen mirroring can also be triggered by means of voice, gesture, etc.; each prompt message can be displayed in the form of a floating window, label, etc. on the entire screen of the screen mirroring device or the device being screen mirrored, or any interface, and the embodiments of the present application do not limit this. Figure 7 As shown in
[0216] , a group of GUIs provided by the embodiments of the present application are shown. Taking the screen mirroring device as the mobile terminal and the device being screen mirrored as the in-vehicle terminal as an example, an asynchronous screen mirroring method is introduced. Figure 7As shown in (a) therein, the main interface of the mobile terminal (Device A) is shown. The main interface includes icons of multiple applications, and the multiple applications include a clock, a calendar, a gallery, a memo, a video application, etc. Upon receiving an operation by the user on the icon 701 of the video application, the mobile terminal can display a GUI as shown in Figure 7 in (b) therein.
[0217] As shown in Figure 7 in (b) therein, upon receiving an operation by the user on the icon 701 of the video application, the display interface of the video application is shown on the mobile terminal. The display interface displays videos recommended by the video application for the user or videos selected by the user for playback, and these videos can be used as screen mirroring content, and the screen mirroring content can be screen-mirrored and displayed on the target screen. The display interface also displays a screen mirroring control 702, wherein the screen mirroring control 702 is used to perform screen mirroring on the screen mirroring content. Upon receiving an operation by the user on the screen mirroring control 702, the mobile terminal can display a GUI as shown in Figure 7 in (c) therein.
[0218] As shown in Figure 7 in (c) therein, upon receiving an operation by the user on the screen mirroring control 702, a prompt message 703 is shown on the display interface of the mobile terminal, and the prompt message 703 is used to prompt the user to select a screen. Exemplarily, the mobile terminal can display the display interface of the video application, and the display interface of the video application includes the prompt message 703. The prompt message 703 includes the identifiers of each screen. Optionally, the identifier of the screen can be shown on the control of the screen. When the user clicks on the control of a certain screen, it means that the user selects the identifier corresponding to the control of that screen, that is, it means that the user selects the specific screen corresponding to the control of that screen.
[0219] For example, the identifiers of the screens in the prompt message 703 include: "the screen of the personal computer", "the central control screen of the vehicle-mounted terminal", and "the co-pilot screen of the vehicle-mounted terminal". In a possible implementation manner, the identifiers of the screens are shown on the corresponding controls, so these identifiers of the screens are respectively shown on the controls of the screen of the personal computer, the central control screen of the vehicle-mounted terminal, and the co-pilot screen of the vehicle-mounted terminal. The user can directly select the control of any screen among the various screens to determine the selected screen, and project the screen mirroring content onto the selected screen.
[0220] It should be noted that upon receiving an operation by the user on the screen mirroring control 702, the mobile terminal displays the prompt message 703. The embodiments of the present application do not limit the specific display manner and specific display position of the prompt message 703. For example, the prompt message 703 can be shown at the bottom of the display interface of the video application, or be full-screen displayed on the screen of the mobile terminal, or be shown in the form of a floating window on the display interface of the video application.
[0221] In one implementation, after the user selects the identifier of a certain screen, the screen mirroring content can be displayed on that screen.
[0222] Optionally, on the display interface of the video application shown in (c) of Figure 7 , when an operation on the control 704 of the co-pilot screen of the in-vehicle terminal is received by the user, the mobile terminal can display the GUI shown in (d) of Figure 7 .
[0223] As shown in (d) of Figure 7 , when an operation on the control 704 of the co-pilot screen of the in-vehicle terminal is received by the user, the mobile terminal displays the display interface of the video application. This display interface displays a prompt message 705, and the prompt message 705 is used to prompt that the mobile terminal is establishing a screen mirroring connection with the in-vehicle terminal. After the screen mirroring connection is established, the mobile terminal can display the GUI shown in (e) of Figure 7 , and at the same time, the co-pilot screen corresponding to the control 704 of the co-pilot screen of the in-vehicle terminal can display the GUI shown in (f) of Figure 7 .
[0224] As shown in (e) of Figure 7 , after the screen mirroring connection is established, the mobile terminal displays the display interface of the video application. This display interface displays a prompt message 706, and the prompt message 706 is used to prompt the user that screen mirroring is in progress and to prompt the user that the user can watch the screen mirroring display video on the co-pilot screen corresponding to the control 704 of the in-vehicle terminal.
[0225] As shown in (f) of Figure 7 , after the screen mirroring connection is established, the co-pilot screen corresponding to the control 704 of the co-pilot screen of the in-vehicle terminal displays the screen mirroring display video, indicating that the process of establishing the screen mirroring connection has been completed, and the co-pilot screen can asynchronously display the screen mirroring content of the mobile terminal as the target screen.
[0226] It should be noted that the above process realizes screen mirroring in an asynchronous screen mirroring manner. Therefore, the content displayed on the screen of the device being screen mirrored can be different from the content displayed on the screen of the screen mirroring device. For example, Figure 7 the content shown in (e) of Figure 7 is different from the content shown in (f) of the mobile terminal and the in-vehicle terminal respectively. Of course, after the screen mirroring connection between the mobile terminal and the in-vehicle terminal is established, the mobile terminal can also exit the display interface of the video application without affecting the in-vehicle terminal from displaying the screen mirroring content.
[0227] In another implementation, after the user selects the identifier of a certain screen and the authentication is successful, the screen mirroring content can be displayed on that screen. Herein, the embodiments of the present application do not limit the specific manner of authentication. Taking whether the PIN codes are consistent as an example of an authentication method, the screen mirroring method will be introduced below.
[0228] Optionally, on the display interface of the video application as shown in (c) of Figure 7 , when an operation on the control 704 of the co-pilot screen of the vehicle-mounted terminal is received by the mobile terminal, the mobile terminal can display a GUI as shown in (g) of Figure 7 .
[0229] As shown in (g) of Figure 7 , when an operation on the control 704 of the co-pilot screen of the vehicle-mounted terminal is received, the display interface of the video application is displayed on the mobile terminal. The display interface displays a prompt message 707, and the prompt message 707 is used to prompt the user that the authentication information is being obtained. It should be noted that after the user selects the co-pilot screen, the mobile terminal also needs to complete a security authentication with the co-pilot screen. The prompt message 707 is used to indicate that the co-pilot screen is loading the security authentication information. After the security authentication information is loaded, the co-pilot screen corresponding to the control 704 of the co-pilot screen of the mobile terminal can display a GUI as shown in (h) of Figure 7 , and the mobile terminal can display a GUI as shown in (i) of Figure 7 .
[0230] As shown in (h) of Figure 7 , after the security authentication information is loaded, a prompt message 708 can be displayed on the co-pilot screen corresponding to the control 704 of the co-pilot screen of the vehicle-mounted terminal. The prompt message 708 displays the security authentication information. For example, the PIN code "123456".
[0231] Optionally, the prompt message 708 can also be a QR code, and the security authentication is achieved by scanning the prompt message 708 with the mobile terminal.
[0232] As shown in (i) of Figure 7 , after the security authentication information is loaded, the display interface of the video application is displayed on the mobile terminal. The display interface displays an input box 709 and also displays a virtual keyboard 710. The input box 709 includes a confirmation control 711 and a cancellation control. The user can input the PIN code "123456" displayed in the prompt message 708 in the input box 709 through the virtual keyboard 710. After receiving the user's input of the PIN code and the operation on the confirmation control 711, the mobile terminal can display a GUI as shown in (j) of Figure 7 .
[0233] As shown in (j) of Figure 7As shown in (j), after receiving the user's input of the PIN code and the operation on the determination control 711, the mobile terminal displays the display interface of the video application. This display interface shows a prompt message 712, which is used to prompt that the mobile terminal and the vehicle head unit terminal are establishing a screen mirroring connection, or to prompt whether the PIN code input by the user is consistent with the PIN code displayed in the prompt message 708 on the vehicle head unit terminal. For example, the prompt message 712 shows "Connecting..." indicating that the PIN code input by the user is consistent with the PIN code displayed in the prompt message 708, and the mobile terminal and the vehicle head unit terminal are establishing a screen mirroring connection; or it means that the vehicle head unit terminal is authenticating whether the PIN code input by the user is consistent with the PIN code displayed in the prompt message 708, and the authentication result has not been obtained yet. When the authentication result is that the PIN code input by the user is consistent with the PIN code displayed in the prompt message 708 and the screen mirroring connection is established, the mobile terminal can display the GUI as shown in Figure 7 in (k). At the same time, the co-pilot screen corresponding to the control 704 of the co-pilot screen of the vehicle head unit terminal can display the GUI as shown in Figure 7 in (l).
[0234] As Figure 7 shown in (k), after the screen mirroring connection is established, the mobile terminal displays the display interface of the video application. This display interface shows a prompt message 713, which is used to prompt the user that screen mirroring is in progress and to prompt the user that they can watch the screen-mirrored video on the co-pilot screen corresponding to the control 704 of the co-pilot screen of the vehicle head unit terminal.
[0235] As Figure 7 shown in (l), after the screen mirroring connection is established, the co-pilot screen corresponding to the control 704 of the co-pilot screen of the vehicle head unit terminal displays the screen-mirrored video, indicating that the process of establishing the screen mirroring connection has been completed, and the co-pilot screen can asynchronously display the screen-mirrored content on the mobile terminal screen as the target screen.
[0236] It should be noted that the above process realizes screen mirroring in an asynchronous manner. Therefore, the screen-mirrored content displayed on the screen of the device being screen-mirrored can be different from the content displayed on the screen of the screen-mirroring device. For example, Figure 7 the content shown in (k) and Figure 7 the content shown in (l) of the mobile terminal and the vehicle head unit terminal are different respectively. Of course, after the screen mirroring connection between the mobile terminal and the vehicle head unit terminal is established, the mobile terminal can also exit the display interface of the video application without affecting the vehicle head unit terminal from displaying the screen-mirrored content.
[0237] It should be understood that Figure 7The screen mirroring method provided in [the relevant context] is only an exemplary illustration of the embodiments of this application. In some other implementable ways, screen mirroring can also be triggered by means such as voice and gestures; each prompt message can be displayed in a floating window, label, or other display methods on the entire screen of the screen mirroring device or the device being screen mirrored, or on any interface, and the embodiments of this application do not limit this.
[0238] It should be noted that Figure 6 and Figure 7 introduced the screen mirroring method provided by the embodiments of this application. Before the screen mirroring content is displayed on the target screen, the user needs to perform certain operations on the screen mirroring device side. For example, on the mobile terminal side of the screen mirroring device, the user needs to first trigger the screen mirroring function, then select any screen from multiple screens, and enter the PIN code to complete the security authentication. After completing the security authentication, the selected screen can be used as the target screen. It can be seen that before completing the screen mirroring, the user performs 3 steps on the screen mirroring device. Compared with Figure 4 the screen mirroring method shown, it simplifies the steps performed by the user on the screen mirroring device side and also simplifies the steps performed by the user on the device being screen mirrored, saving the time consumed in the screen mirroring process and improving the convenience of the screen mirroring process.
[0239] As Figure 8 shown, a schematic flowchart of a screen mirroring method provided by the embodiments of this application is shown. This method 800 can be applied to the screen mirroring device and the device being screen mirrored, and the screen mirroring device and the device being screen mirrored can be communicatively connected. Specifically, the screen mirroring device and the device being screen mirrored trust each other. And corresponding to the screen mirroring process shown in Figure 6 or Figure 7 shown, the method 800 will be specifically introduced below.
[0240] S801, when the screen mirroring function is started, send a discovery message. Correspondingly, the device being screen mirrored receives the discovery message.
[0241] Exemplarily, the screen mirroring device and the device being screen mirrored can be wirelessly connected or wired connected. Among them, the wireless connection can include Wi-Fi connection and Bluetooth connection. The wired connection can include high definition multimedia interface (HDMI) connection or mobile high-definition link (MHL) connection. In the embodiments of this application, a screen mirroring method is introduced taking the Bluetooth connection as an example.
[0242] It should be noted that the screen mirroring device can send discovery messages in a broadcast manner at a certain period. The discovery message is used for the screen mirroring device and peripheral devices to discover each other, and among them, the device being screen mirrored belongs to the peripheral devices of the screen mirroring device.
[0243] Optionally, the discovery message can also be used to request the screen information of the device to be screen-cast.
[0244] Exemplarily, the screen-casting function can be started according to the user's operation on the screen-casting device. For example, clicking on the wireless screen-casting control 602 on the GUI shown in (c) of Figure 6 or clicking on the screen-casting control 702 on the GUI shown in (b) of Figure 7 can trigger the start of the screen-casting function, or the user shakes the screen-casting device, or the user wakes up the screen-casting function by voice. The embodiments of the present application do not limit the form of the user's operation.
[0245] S802. The device to be screen-cast sends a feedback message of the discovery message. Correspondingly, the screen-casting device receives the feedback message of the discovery message.
[0246] Optionally, before the device to be screen-cast sends the feedback message of the discovery message, the device to be screen-cast determines the feedback message of the discovery message according to the discovery message.
[0247] It should be noted that the feedback message of the discovery message includes a reserved field, and the reserved field is used to represent the screen information of the device to be screen-cast.
[0248] Optionally, the device to be screen-cast can carry the screen information of the device to be screen-cast in the feedback message of the discovery message according to the request of the screen-casting device.
[0249] S803. The screen-casting device displays a screen list according to the feedback message of the discovery message.
[0250] Exemplarily, the screen list can be the prompt information 603 shown in (d) of Figure 6 . The screen list can include the identifiers of each screen. Optionally, the identifier of the screen can be displayed on the control of the screen. When the user clicks on the control of a certain screen, it means that the user selects the identifier corresponding to the control of the screen, that is, it means that the user selects the specific screen corresponding to the control of the screen.
[0251] For example, the control 604 of the co-pilot screen of the in-vehicle terminal displays the identifier of the screen "co-pilot screen of the in-vehicle terminal", and the control of this screen corresponds to the co-pilot screen of the in-vehicle terminal. The user selects the control 604 of the co-pilot screen of the in-vehicle terminal, indicating that the user selects the co-pilot screen on the in-vehicle terminal. It can be seen that the user can determine the device to be screen-cast and one or more screens in the device to be screen-cast through one selection operation.
[0252] Optionally, the screen mirroring device can display the identifiers of peripheral devices. The identifiers of peripheral devices are used to represent the devices that have mutually discovered with the screen mirroring device. For example, displaying the identifier of a personal computer indicates that the screen mirroring device and the personal computer have mutually discovered each other. Alternatively, the screen mirroring device can display the identifiers of peripheral devices, and the user can operate on the identifiers of peripheral devices to filter the identifiers of the screens. For example, the identifiers of a personal computer, a vehicle head unit terminal, and a smart screen are displayed. When the user selects the identifier of the vehicle head unit terminal, the identifiers of the screens included in the vehicle head unit terminal can be displayed, so that in a scenario with a large number of peripheral devices, the user can filter out the screens of a certain device, facilitating the user to select a screen. It should be noted that the screen mirroring device can determine the screen information of the device to be screen mirrored according to the feedback message of the discovery message received, where the device to be screen mirrored is the device that sends the feedback message of the discovery message. That is to say, when the screen mirroring device receives the feedback message of the discovery message, it can determine the screen of the device to be screen mirrored. Among them, the screen information is used to represent the screen of the device to be screen mirrored that sends the feedback message of the discovery message.
[0253] For example, when the mobile terminal receives the feedback message of the discovery message from the vehicle head unit terminal, it can determine that the vehicle head unit terminal includes a co-pilot screen.
[0254] It can be seen that in the stage of mutual discovery between the screen mirroring device and the device to be screen mirrored, the screen mirroring device can obtain the screen of the device to be screen mirrored.
[0255] It should be noted that the feedback message of the discovery message reserves an extended field, and the one-to-one correspondence with the screen is realized through the bits in the extended field.
[0256] For example, taking a 4-bit extended field as an example, the correspondence between the extended field and the screen is shown. 0001 represents the central control screen of the vehicle head unit terminal; 0010 represents the co-pilot screen of the vehicle head unit terminal; 0100 represents the rear seat screen of the vehicle head unit terminal; 1000 represents the curtain of the vehicle head unit terminal. If the extended field carried in the return message received by the screen mirroring device is 0111, it means that the vehicle head unit terminal that sends the feedback message of the discovery message includes the central control screen, the co-pilot screen, and the rear seat screen, but does not include a curtain.
[0257] It should be noted that before the screen mirroring device determines the specific screens included in the device to be screen mirrored, the screen mirroring device can obtain the screen mirroring protocol. The screen mirroring protocol is used to indicate the correspondence between the extended field and the screen.
[0258] That is to say, before step S803, the screen mirroring device obtains the screen mirroring protocol.
[0259] It should be noted that before the screen mirroring device obtains the screen mirroring protocol, the correspondence between the extended field and the screen is carried in the screen mirroring protocol.
[0260] Exemplarily, the screen mirroring protocol includes PlayerClient.setDiscoverable. By calling PlayerClient.setDiscoverable, the correspondence between the extended field and the screen is carried in the deviceInfo parameter. Among them, the call to PlayerClient.setDiscoverable can configure the screen mirroring device to be discoverable by peripheral devices. PlayerClient.setDiscoverable includes a deviceInfo parameter, which is used to represent the screen included in the screen mirroring device.
[0261] In the first implementation, after the user selects a certain screen identifier, the screen mirroring content can be displayed on that screen. In this implementation, the following steps S808 and S809 are continued.
[0262] In the second implementation, after the user selects a certain screen identifier and the authentication is successful, the screen mirroring content can be displayed on that screen. In this implementation, the following steps S804 to S809 are continued.
[0263] S804, the screen mirroring device receives the selection operation and sends a PIN code request message. Correspondingly, the screen mirroring target device receives the PIN code request message.
[0264] It should be noted that the selection operation can be an operation of selecting any one or more screens from multiple screens. The selected screens can belong to a certain device or different devices. For example, as shown in (d) of, the prompt message 603 includes the controls of the center control screen of the in-vehicle terminal and the controls of the co-pilot screen of the in-vehicle terminal. When the user clicks the control of the co-pilot screen of the in-vehicle terminal, it means that the co-pilot screen of the in-vehicle terminal is selected. Figure 6 as shown in (d) of, the prompt message 603 includes the controls of the center control screen of the in-vehicle terminal and the controls of the co-pilot screen of the in-vehicle terminal. When the user clicks the control of the co-pilot screen of the in-vehicle terminal, it means that the co-pilot screen of the in-vehicle terminal is selected.
[0265] It should be noted that the PIN code request message includes the information of the selected screen. For example, the identifier of the selected screen. When the user clicks the control 604 of the co-pilot screen of the in-vehicle terminal, the PIN code request message can include the identifier of the co-pilot screen of the in-vehicle terminal.
[0266] Exemplarily, the screen mirroring device sends an EVEN_ID_PIN_CODE_SHOW message, carrying the identifier of the selected screen.
[0267] Optionally, if the user selects multiple screens and the multiple screens belong to different devices, the screen mirroring device can separately send PIN code request messages to the devices of the selected screens, requesting to display the PIN code on the selected screens.
[0268] For example, when the user selects the co-pilot screen of the in-vehicle terminal and the screen of the personal computer, the PIN code can be displayed on the co-pilot screen of the in-vehicle terminal and the screen of the personal computer.
[0269] It should be noted that the selected screen(s) can be one or more, and the corresponding target screen(s) can also be one or more. It can be understood that the selected screen(s) that pass the authentication are the target screen(s). After determining one or more target screens, the screen mirroring method provided by the embodiments of the present application can display the screen mirroring content on one target screen or on multiple target screens. Correspondingly, the security authentication information can include one or more, and there is a corresponding relationship between the security authentication information and the selected screen(s). Multiple selected screens of the same device can share one security authentication information; or, multiple selected screens of the same device correspond to different security authentication information; or multiple selected screens of different devices correspond to different security authentication information. By the user separately inputting the security authentication information, one or more screens are determined, where the security authentication information can be the PIN code in step S805 below.
[0270] Optionally, when the user selects a certain screen, the screen can emit a prompt sound to indicate that the screen has been selected by the user; or, when the user selects a certain screen, the screen mirroring device indicates that the user has completed the selection of the screen by emitting a prompt sound and displaying a prompt message; or, when the user selects a certain screen, the corresponding identifier of the screen is highlighted to indicate that the user has completed the selection of the screen.
[0271] S805, The device to be screen mirrored displays the PIN code according to the PIN code request information.
[0272] It should be noted that the device to be screen mirrored can determine the screen selected by the user according to the identifier of the selected screen carried in the PIN code request information, and display the PIN code on the screen selected by the user.
[0273] Exemplarily, upon receiving the user's selection of any screen from the prompt message 603 shown in (d) of Figure 6 , the screen mirroring device sends the PIN code request information to the device including the selected screen. And the PIN code can be displayed on the selected screen.
[0274] It can be seen that the operation of the user selecting the device to be screen mirrored is cancelled on the screen mirroring device side, and the prompt message for displaying whether to trust the screen mirroring device is cancelled on the device to be screen mirrored side. In the screen mirroring method provided by the embodiments of the present application, the screen mirroring device and the device to be screen mirrored may not be in the same local area network, but the preset screen mirroring device and the device to be screen mirrored trust each other.
[0275] S806. The screen mirroring device receives the input of the PIN code and sends authentication information. Correspondingly, the device to be screen mirrored receives the authentication information.
[0276] S807. The device to be screen mirrored sends authentication feedback information. Correspondingly, the screen mirroring device receives the authentication feedback information.
[0277] It should be noted that before the device to be screen mirrored sends the authentication feedback information, the PIN code input by the screen mirroring device is compared with the PIN code displayed on the selected screen. The authentication feedback information includes the comparison result.
[0278] It should be noted that in the screen mirroring method provided in the embodiments of the present application, the preset screen mirroring device and the device to be screen mirrored trust each other, and the security of screen mirroring is ensured through the PIN code authentication process.
[0279] Exemplarily, call PlayerClient.setConnectRequestChooseResult to set that the device to be screen mirrored always trusts the screen mirroring device. Among them, the RequestChooseResult interface is used to set whether the device to be screen mirrored allows the screen mirroring device to connect.
[0280] To further ensure the security of screen mirroring, if the PIN codes input by the same screen mirroring device are inconsistent with the PIN code displayed on the selected screen for three consecutive times, within a certain preset time, the device to be screen mirrored will not display the PIN code according to the PIN code request information of the screen mirroring device.
[0281] S808. The screen mirroring device sends the screen mirroring content. Correspondingly, the device to be screen mirrored receives the screen mirroring content.
[0282] Before the screen mirroring device sends the screen mirroring content, the screen mirroring device receives a selection operation. The user can select any one or more screens from multiple screens. The screen mirroring content can be displayed on the selected one or more screens.
[0283] Optionally, in the above first implementation manner, the device to be screen mirrored receives the screen mirroring content.
[0284] Optionally, in the above second implementation manner, the device to be screen mirrored can receive the screen mirroring content from the screen mirroring device when the comparison result of the PIN codes is consistent.
[0285] S809. The device to be screen mirrored displays the screen mirroring content.
[0286] Optionally, in the above first implementation manner, when the user selects a certain screen, screen mirroring can be achieved without authentication. If the user selects multiple screens, the screen mirroring content can be displayed on the selected multiple screens.
[0287] Optionally, in the second implementation manner described above, if the comparison results of the PIN codes are the same, the selected screen is determined as the target screen, and steps S808 and S809 are continued to be executed, and the screen mirroring content on the screen mirroring device can be displayed on the target screen.
[0288] It should be noted that in method 800, steps S804, S805, S806, and S807 may be optional steps. In the above step S803, a screen list is displayed on the screen mirroring device. After the user selects any one or more screens, the selected one or more screens can be directly used as the target screen to display the screen mirroring content without undergoing authentication processing; or, the selected one or more screens need to undergo authentication processing, and only after successful authentication can they be used as the target screen to display the screen mirroring content.
[0289] Based on the above solution, when the screen mirroring device and the device to be screen mirrored are in different local area network environments, and it is preset that the screen mirroring device and the device to be screen mirrored trust each other, the operations of selecting the device to be screen mirrored and the target screen are combined into one step, which simplifies the user operation during the screen mirroring process while ensuring the security of screen mirroring and improving the user experience of using the screen mirroring function.
[0290] As Figure 9 shown, a schematic flowchart of a screen mirroring method provided by an embodiment of the present application is shown. This method can be applied to a scenario including a screen mirroring device and a device to be screen mirrored as Figure 1 shown. Taking the first device as the screen mirroring device (for example, a mobile phone terminal, a tablet computer) and the second device as the device to be screen mirrored (for example, a car machine terminal, a smart screen) as an example, method 900 will be specifically introduced below.
[0291] S901, the first device receives a first operation.
[0292] It should be noted that the first device displays first content, and the first operation is used to screen mirror the first content. That is to say, when the first device completes screen mirroring, the first content, as the screen mirroring content, can be displayed on the device to be screen mirrored.
[0293] Exemplarily, the first operation can be understood as an operation by which the user triggers the screen mirroring function, and the screen mirroring function includes synchronous screen mirroring and / or asynchronous screen mirroring.
[0294] S902, the first device displays a first interface.
[0295] It should be noted that the first interface includes the identifier of the first screen, the identifier of the second screen, and the identifier of the third screen. Among them, the first screen and the second screen are the screens of the second device, and the third screen is the screen of the third device. Among them, the first device is connected to the second device, and the first device is connected to the third device.
[0296] Among them, the second device and the third device can be peripheral devices of the first device. In the embodiments of the present application, it can be preset that the first device and the second device trust each other, and the first device and the second device trust each other.
[0297] That is to say, when the first device receives the first operation, it can display the screen information of the peripheral device (for example, the identifier of the first screen, the identifier of the second screen, and the identifier of the third screen).
[0298] In one implementation, the first device receives an operation of selecting the identifier of the first screen and sends a first message to the second device; the first message is used to instruct the second device to display the first content on the first screen.
[0299] That is to say, when the user selects the first screen, the first device and the second device complete the screen mirroring connection, and the first content can be displayed on the first screen of the second device, indicating that the screen mirroring is completed.
[0300] In a possible implementation, before the first device displays the first interface, the first device sends a second message to the second device and receives a third message from the second device. The third message includes a first field, and the first field is used to represent the first screen and the second screen.
[0301] Among them, the second message can be a discovery message, and the first device can send the discovery message in a broadcast manner; the third message can be a feedback message of the discovery message. The feedback message of the discovery message can include a first field, and the first field can be the reserved field introduced in method 800.
[0302] Optionally, the first device can determine the specific screens included in the second device according to the first field, so as to display the identifiers of the screens.
[0303] It can be seen that during the mutual discovery process of the first device and the second device, the first device can determine the specific screens included in the second device.
[0304] In a possible implementation, before the first device displays the first interface, the first device sends a second message to the third device and receives a fourth message from the third device. The fourth message includes a second field, and the second field is used to represent the third screen.
[0305] Among them, the second message can be a discovery message, and the first device can send the discovery message in a broadcast manner; the fourth message can be a feedback message of the discovery message. The feedback of the discovery message can include the second field.
[0306] Optionally, the first device can determine the specific screens included in the third device according to the second field, so as to display the identifiers of the screens.
[0307] It can be seen that during the process of mutual discovery between the first device and the third device, the first device can determine the specific screen included in the third device.
[0308] Optionally, after the user selects a certain screen, authentication processing is also required. Only after the authentication passes can the first content be displayed on the selected screen.
[0309] In one implementation, before sending the first information to the second device, a first prompt is output; the operation of inputting the first data within the first prompt is received, and a second prompt is output. The second prompt is used to indicate whether the second device authenticates that the first data is consistent with the second data, and the second data is displayed on the first screen.
[0310] Among them, the first data and the second data are information for security authentication.
[0311] In a possible implementation, when the user selects a screen, the first device can display a first prompt. The first prompt can be an input box, and the first data can be a PIN code. The user can input the PIN code within the input box. After the user finishes inputting, a second prompt can be displayed. The second prompt can be a prompt message indicating that the second device is authenticating whether the PIN code input by the user is consistent with the PIN code displayed on the screen selected by the user.
[0312] It should be understood that the embodiments of the present application do not limit the specific manner of outputting the first prompt and the second prompt, nor the specific manner of the first data and the second data.
[0313] In one implementation, before the first device outputs the first prompt, the first device can send a fifth information to the second device. The fifth information is used to instruct the second device to display the second data on the first screen.
[0314] Optionally, the fifth information can also be a request information, which is used to request the second device to display the second data on the first screen.
[0315] That is to say, before the first device displays the first prompt that the first data can be input, it is necessary to request or instruct the second device to display the second data on the selected screen.
[0316] It should be noted that the first data input by the user may be the same as or different from the second data displayed on the selected screen.
[0317] In one implementation, before the first device outputs a second prompt, the first device sends sixth information to the second device, and the sixth information is used to instruct the second device to determine whether the first data is consistent with the second data; the first device receives seventh information, and the seventh information includes an authentication result, and the authentication result is used to indicate whether the first data is consistent with the second data; when the authentication result is that the first data is consistent with the second data, it is determined that the first screen is the target screen, and the first content can be displayed on the target screen.
[0318] Exemplarily, the sixth information may be a request message, which is used to request the second device to determine the authentication result. After the second device determines the authentication result, it can feedback the authentication result to the first device. If the authentication is successful (that is, the first data is consistent with the second data), the selected screen is determined as the target screen, and the first content can be displayed.
[0319] Of course, there may also be a situation where the first data for input is different from the second data displayed on the selected screen.
[0320] In one implementation, when the authentication results of N consecutive times are that the first data is inconsistent with the second data, and the second device receives the tenth information from the first device within a preset time, the second device ignores the tenth information; where N is a positive integer greater than or equal to 1, and the tenth information is used to request to display the third data on the first screen.
[0321] It should be noted that the third data may be a PIN code, and the third data may be different from or the same as the second data.
[0322] Exemplarily, if the PIN code input by the first device three consecutive times is inconsistent with the PIN code displayed on the first screen, to ensure the security of screen mirroring, within 10 minutes, when the second device receives the information from the first device requesting to display the PIN code on the first screen, it can be ignored.
[0323] It should be noted that after the screen mirroring between the first device and the second device is completed, the first content can be displayed on the first screen selected by the user, and the first content may not necessarily be displayed on the first device.
[0324] Optionally, for synchronous screen mirroring, the first screens of the first device and the second device are synchronously displayed, and both the first device and the second device display the first content. For asynchronous screen mirroring, the first content may not be displayed on the first device. The user can exit the interface where the first content is displayed on the first device. As long as the screen mirroring connection with the second device is not disconnected, the operations of the user on the first device will not affect the display of the first content on the second device.
[0325] The above text exemplarily introduced the solution where the user selects one screen. Optionally, the user can also select multiple screens.
[0326] In one implementation, a user can select multiple screens of a device. Specifically, a first device receives an operation of selecting an identifier of a first screen and an identifier of a second screen, and sends eighth information to a second device; the eighth information is used to instruct the second device to display first content on the first screen and the second screen.
[0327] It should be noted that a user can select the first screen and the second screen of the second device, and when the screen mirroring connection is completed, the first content can be displayed on the first screen and the second screen.
[0328] In one implementation, a user can select multiple screens of different devices. Specifically, a first device receives an operation of selecting an identifier of a first screen and an identifier of a third screen, sends first information to a second device, and sends ninth information to a third device; the first information is used to instruct the second device to display first content on the first screen, and the ninth information is used to instruct the third device to display first content on the third screen.
[0329] It should be noted that a user can select the first screen of the second device and the third screen of the third device, and when the screen mirroring is completed, the first content can be displayed on the first screen and the third screen.
[0330] Based on the above solution, it is preset that the screen mirroring device and the device to be screen mirrored trust each other, and the operations of selecting the device to be screen mirrored and the target screen are combined into one step, which simplifies the screen mirroring process, ensures the security of screen mirroring, and improves the user experience of using the screen mirroring function.
[0331] In the above text, in combination with Figures 3 to 9 The screen mirroring method provided by the embodiments of the present application is described in detail. In various embodiments of the present application, if there is no special description and logical conflict, the terms and / or descriptions between the various embodiments are consistent and can be referenced to each other, and the technical features in different embodiments can be combined to form new embodiments according to their internal logical relationships.
[0332] Next, in combination with Figure 10 and Figure 11 The device provided by the embodiments of the present application will be described in detail. It should be understood that the description of the device embodiments corresponds to the description of the method embodiments. Therefore, the content that is not described in detail can be referred to the above method embodiments, and for the sake of brevity, it will not be repeated here.
[0333] Figure 10 A schematic block diagram of a screen mirroring device 1000 provided by an embodiment of the present application is shown. The screen mirroring device 1000 may include units for executing Figure 9 the screen mirroring method in
[0334] Specifically, the screen mirroring device 1000 includes a processing unit 1010 and a transceiver unit 1020.
[0335] Optionally, the screen mirroring device 1000 further includes a storage unit, which can be used to store instructions and / or data. The processing unit 1010 can read the instructions and / or data in the storage unit to enable the screen mirroring device to perform the relevant actions executed by the electronic device in the foregoing method embodiments.
[0336] The screen mirroring device 1000 can be used to perform the actions executed by the electronic device in the foregoing method embodiments. At this time, the screen mirroring device 1000 can be a component of the electronic device. For example, the screen mirroring device 1000 can also be a chip or integrated circuit in the electronic device. The processing unit 1010 is used to perform the operations related to the processing of the electronic device in the foregoing method embodiments, and the transceiver unit 1020 is used to perform the operations related to the transceiver of the electronic device in the foregoing method embodiments.
[0337] It should be understood that the specific processes of each unit performing the corresponding steps have been described in detail in the foregoing method embodiments. For the sake of brevity, they will not be repeated here.
[0338] In a specific implementation, the actions performed by the processing unit 1010 and the transceiver unit 1020 can be implemented by one processor, or can also be implemented by multiple processors.
[0339] Figure 11 It is another schematic block diagram of the screen mirroring device provided by the embodiments of the present application. Figure 11 The illustrated screen mirroring device 1100 may include: a processor 1110, a transceiver 1120, and a memory 1130. Among them, the processor 1110, the transceiver 1120, and the memory 1130 are connected through an internal connection path. The memory 1130 is used to store instructions, and the processor 1110 is used to execute the instructions stored in the memory 1130 to implement the methods in the foregoing embodiments. Optionally, the memory 1130 can be coupled to the processor 1110 through an interface, or can also be integrated with the processor 1110.
[0340] It should be noted that the foregoing transceiver 1120 may include, but is not limited to, a transceiver device such as an input / output interface, to implement communication between the screen mirroring device 1100 and other devices or communication networks.
[0341] The memory 1130 can be a volatile memory and / or a non-volatile memory. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable PROM (EEPROM), or a flash memory. The volatile memory can be a random access memory (RAM). For example, the RAM can be used as an external cache. By way of example and not limitation, the RAM includes the following various forms: static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchlink DRAM (SLDRAM), and direct rambus RAM (DR RAM).
[0342] It should be noted that when the processor is a general-purpose processor, a DSP, an ASIC, an FPGA, or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, the memory (storage module) can be integrated in the processor.
[0343] It should also be noted that the memory described in this article is intended to include but not limited to these and any other suitable types of memory.
[0344] The transceiver 1120 uses a transceiver device such as but not limited to a transceiver to implement communication between the screen mirroring device 1100 and other devices or communication networks, so as to receive / send data / information for implementing the methods in the above embodiments.
[0345] The screen mirroring device 1100 can be a chip or circuit provided in the above electronic device.
[0346] The embodiments of the present application provide a computer program product. When the computer program product runs on a device, it causes the device to execute the technical solutions in the above embodiments. The implementation principle and technical effects are similar to those of the related embodiments of the above method, and will not be elaborated here.
[0347] An embodiment of the present application provides a readable storage medium. The readable storage medium contains instructions that, when run on a device, cause the device to execute the technical solutions of the above embodiments. The implementation principles and technical effects are similar and will not be elaborated here.
[0348] An embodiment of the present application provides a chip. The chip is used to execute instructions and, when the chip runs, executes the technical solutions in the above embodiments. The implementation principles and technical effects are similar and will not be elaborated here.
[0349] Those of ordinary skill in the art can realize that the units and algorithm steps of each example described in combination with the embodiments disclosed herein can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are executed in a hardware or software manner depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the embodiments of the present application.
[0350] Those skilled in the art can clearly understand that for the convenience and brevity of description, the specific working processes of the above-described devices and units (modules) can refer to the corresponding processes in the foregoing method embodiments and will not be elaborated here.
[0351] In several embodiments provided by the present application, it should be understood that the disclosed devices, apparatuses, and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the unit is only a logical function division. In actual implementation, there can be other division methods. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the displayed or discussed couplings or direct couplings or communication connections to each other can be through some interfaces. The indirect couplings or communication connections of the devices or units can be in electrical, mechanical, or other forms.
[0352] The units described as separate components above may or may not be physically separated. The components displayed as units may or may not be physical units, that is, they can be located in one place, or they can be distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0353] In addition, the functional units in each embodiment of the present application can be integrated into one processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit.
[0354] If the above functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiments of the present application, in essence, or the part that contributes to the prior art, or a part of this technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage medium includes: various media such as USB flash drives, mobile hard disks, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical discs that can store program codes.
[0355] The above is only the specific implementation manner of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art within the technical scope disclosed by the present application can easily think of changes or substitutions, which should all be covered by the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.
Claims
1. A screen mirroring method, characterized in that, The method is applied to a first device that displays first content, and the method includes: Receiving a first operation for mirroring the first content; Displaying a first interface that includes identifiers of a first screen, a second screen, and a third screen. The first screen and the second screen are screens of a second device, and the third screen is a screen of a third device. The first device is connected to the second device and the first device is connected to the third device.
2. The method according to claim 1, characterized in that, The method further includes: Receiving an operation of selecting the identifier of the first screen and sending a first message to the second device; Wherein, the first message is used to instruct the second device to display the first content on the first screen.
3. The method according to claim 1 or 2, characterized in that, Before displaying the first interface, the method further includes: Sending a second message; Receiving a third message that includes a first field for representing the first screen and the second screen.
4. The method according to claim 3, characterized in that, The method further includes: Receiving a fourth message that includes a second field for representing the third screen.
5. The method according to claim 2, characterized in that, Before sending the first message to the second device, the method further includes: Outputting a first prompt; Receiving an operation of inputting first data within the first prompt and outputting a second prompt for instructing the second device to authenticate whether the first data is consistent with second data, where the second data is displayed on the first screen.
6. The method according to claim 5, characterized in that, Before outputting the first prompt, the method further includes: Sending a fifth message for instructing the second device to display the second data on the first screen.
7. The method according to claim 5 or 6, characterized in that, Before outputting the second prompt, the method further includes: Sending a sixth message to the second device for instructing the second device to determine whether the first data is consistent with the second data; Receiving a seventh message that includes an authentication result for indicating whether the first data is consistent with the second data; When the authentication result indicates that the first data is consistent with the second data, determining the first screen as the target screen; Wherein, the first message is specifically used to instruct to display the first content on the target screen.
8. The method according to claim 1, wherein The method further includes: Receiving an operation of selecting the identifiers of the first screen and the second screen and sending an eighth message to the second device; Wherein, the eighth message is used to instruct the second device to display the first content on the first screen and the second screen.
9. The method according to claim 1, wherein The method further includes: Receiving an operation of selecting the identifiers of the first screen and the third screen, sending the first message to the second device, and sending a ninth message to the third device; Wherein, the first message is used to instruct the second device to display the first content on the first screen, and the ninth message is used to instruct the third device to display the first content on the third screen.
10. The method according to any one of claims 1 to 9, characterized in that The first device is a mobile phone terminal or a tablet computer, and the second device is a vehicle-mounted terminal or a smart screen.
11. A screen mirroring method, characterized in that, The method is applied to a second device, and the screen of the second device includes a first screen and a second screen. The method includes: Receiving second information sent by a first device; Sending third information to the first device, where the third information includes a first field, and the first field is used to represent the first screen and the second screen. The identifiers of the first screen and the second screen are displayed on a first interface of the first device. The first interface further includes an identifier of a third screen, and the third screen is the screen of a third device. The second device is connected to the first device, and the third device is connected to the first device.
12. The method according to claim 11, wherein The method further includes: Receiving fifth information; Displaying second data on the first screen according to the fifth information.
13. The method according to claim 12, wherein The method further includes: Receiving sixth information, where the sixth information includes first data; Determining an authentication result according to the sixth information, and the authentication result is used to indicate whether the first data is consistent with the second data; Sending seventh information, where the seventh information includes the authentication result.
14. The method according to claim 13, wherein When the authentication result is that the first data is consistent with the second data, the method further includes: Receiving first information, where the first information is used to indicate to display first content on the first screen; Displaying the first content, and the first content is associated with the first device.
15. The method according to claim 13, wherein The method further includes: When the authentication results of consecutive N times are that the first data is inconsistent with the second data, and when receiving tenth information from the first device within a preset time, ignoring the tenth information, where N is a positive integer greater than or equal to 1, and the tenth information is used to request to display third data on the first screen.
16. The method according to claim 14, wherein The first content is displayed on the first device.
17. An electronic device, characterized in that, The electronic device is the first device and includes: One or more memories; One or more processors; The one or more memories are coupled to the one or more processors. The one or more memories are used to store computer program code, and the computer program code includes computer instructions. When the one or more processors execute the computer instructions, the first device is caused to execute the method according to any one of claims 1 to 16 above.
18. A computer-readable storage medium, characterized in that, A computer program is stored thereon, and when the computer program is executed by the computer, the computer is caused to implement the method according to any one of claims 1 to 10, 11 to 16.
19. A computer program product containing instructions, characterized in that, When the computer program product runs on the computer, the computer is caused to execute the method according to any one of claims 1 to 10, 11 to 16.
20. A chip, characterized in that, The chip includes a processor and a data interface. The processor reads instructions stored on a memory through the data interface to execute the method according to any one of claims 1 to 10, 11 to 16.