Screen projection method, device and medium
By adjusting the display mode according to the number of devices on the receiving end device, the problem of only two terminals being able to project screens alone or at most two terminals in the prior art is solved, and the flexible display and volume adjustment of multi-terminal interfaces on large-screen devices is realized. , improves the user experience.
Patent Information
- Application Number
- CN202011050757.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-09-29
- Publication Date
- 2024-11-26
- Estimated Expiration
- 2040-09-29
AI Technical Summary
The prior art can only implement display interface projection of a single or at most two terminals to large-screen devices, and cannot switch between dual-channel projection and single-channel projection, resulting in poor user experience.
Provide a screen projection method and device, by establishing a connection with the transmitting device, determining the display mode according to the number of currently connected transmitting devices, and displaying the screen projection data simultaneously on the receiving device, supporting the interface projection of multiple transmitting devices and adjust the display mode adaptively on the receiver device.
The interfaces of multiple transmitting devices are displayed simultaneously on the receiving device, making full use of the interfaces of the receiving device, improving the user experience, and supporting switching of multiple display modes and volume adjustment.
Smart Images

Figure CN114327313B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of smart terminal technology, and in particular to a screen projection method, device and medium. Background Art
[0002] More and more terminal users hope to project the terminal display interface onto a large-screen display device. For example, users hope to play games, watch movies, etc. on the large-screen display device.
[0003] Currently, only the display interface of a single terminal (up to two terminals) can be projected to a large-screen display device. In addition, when projecting the display interfaces of two terminals, it is impossible to switch between dual-channel projection and single-channel projection. That is, when using the dual-channel projection function, the terminal can only be connected to the display device through a fixed dual-channel projection entrance, and if only one terminal is connected to the display device, only half of the screen can be used, such as Figure 1 As shown, the user experience is very poor. Summary of the invention
[0004] In order to overcome the problems existing in the related art, the present disclosure provides a screen projection method, device and medium.
[0005] According to a first aspect of an embodiment of the present disclosure, a screen projection method is provided, which is applied to a receiving end device, and the method includes:
[0006] When a connection has been established with a transmitting end device to synchronously display the projection data sent by the transmitting end device, a connection is established with a new transmitting end device;
[0007] Determining a display mode based on the number of currently connected sending-end devices;
[0008] Based on the display mode, the screen projection data sent by each currently connected sending device is synchronously displayed on the receiving device.
[0009] Wherein, when a connection has been established with a transmitting end device to synchronously display the projection data sent by the transmitting end device, establishing a connection with a new transmitting end device includes:
[0010] When a connection has been established with at least two sending devices to synchronously display the projection data sent by the at least two sending devices, a connection is established with a new sending device.
[0011] Wherein, the method further comprises:
[0012] Receive display mode switching message;
[0013] Determine the target display mode;
[0014] Based on the target display mode, the projection data sent by each currently connected sending device is synchronously displayed on the receiving device.
[0015] Wherein, the method further comprises:
[0016] Determine whether the number of currently connected sending end devices has changed;
[0017] When the number changes, determining a new display mode based on the number of currently connected sending-end devices;
[0018] Switching the display mode of the receiving end device from the current display mode to the new display mode in real time;
[0019] Based on the new display mode, the screen projection data sent by each currently connected sending device is synchronously displayed on the receiving device.
[0020] The determining whether the number of currently connected transmitting-end devices changes includes at least one of the following methods:
[0021] Method 1: monitor in real time whether the number of currently connected sending devices changes;
[0022] Method 2: determining whether the number of currently connected sending-end devices has changed by judging whether a disconnection message with the sending-end device has been received.
[0023] After establishing a connection with the new sending end device, the method further includes:
[0024] Sending a query message about whether the new sending end device is a replacement device or an additional device of the connected sending end device;
[0025] receiving a response message to the inquiry message;
[0026] Based on the response message, the number of the currently connected sending-end devices is determined.
[0027] Wherein, the method further comprises:
[0028] Receive volume adjustment messages;
[0029] Determine the sending end device of the volume to be adjusted and the corresponding target volume;
[0030] Based on the corresponding target volume, the volume of the transmitting end device of the volume to be adjusted is adjusted.
[0031] According to a second aspect of an embodiment of the present disclosure, a screen projection device is provided, which is applied to a receiving end device, and the device includes:
[0032] A connection establishment module, configured to establish a connection with a new sending end device when a connection has been established with the sending end device to synchronously display the projection data sent by the sending end device;
[0033] A mode determination module is configured to determine a display mode based on the number of currently connected transmitting end devices;
[0034] The display module is configured to synchronously display the projection data sent by each currently connected sending device on the receiving device based on the display mode.
[0035] Wherein, the connection establishment module is further configured to:
[0036] When a connection has been established with at least two sending devices to synchronously display the projection data sent by the at least two sending devices, a connection is established with a new sending device.
[0037] Wherein, the mode determination module is further configured to: receive a display mode switching message, and determine a target display mode;
[0038] The display module is also configured to: based on the target display mode, synchronously display the projection data sent by each currently connected sending device on the receiving device.
[0039] The mode determination module is further configured to: determine whether the number of currently connected transmitting-end devices changes; when the number changes, determine a new display mode based on the number of currently connected transmitting-end devices;
[0040] The device further comprises a mode switching module, which is configured to switch the display mode of the receiving end device from the current display mode to the new display mode in real time;
[0041] The display module is also configured to: based on the new display mode, synchronously display the projection data sent by each currently connected sending device on the receiving device.
[0042] The mode determination module is further configured to determine whether the number of currently connected transmitting-end devices changes by at least one of the following methods:
[0043] Method 1: monitor in real time whether the number of currently connected sending devices changes;
[0044] Method 2: determining whether the number of currently connected sending-end devices has changed by judging whether a disconnection message with the sending-end device has been received.
[0045] Wherein, the device further comprises:
[0046] a message sending module, configured to send, after establishing a connection with a new sending end device, an inquiry message as to whether the new sending end device is a replacement device or an additional device for the connected sending end device;
[0047] A message receiving module, configured to receive a response message to the inquiry message;
[0048] The quantity determination module is configured to determine the quantity of the currently connected sending-end devices based on the response message.
[0049] Wherein, the device further comprises:
[0050] A message receiving module, configured to receive a volume adjustment message;
[0051] A volume determination module is configured to determine a sending end device of a volume to be adjusted and a corresponding target volume;
[0052] The volume adjustment module is configured to adjust the volume of the sending end device of the volume to be adjusted based on the corresponding target volume.
[0053] According to a third aspect of an embodiment of the present disclosure, a screen projection device is provided, characterized in that it includes:
[0054] processor;
[0055] a memory for storing processor-executable instructions;
[0056] The processor is configured to implement the following steps when executing the executable instructions:
[0057] When a connection has been established with a transmitting end device to synchronously display the projection data sent by the transmitting end device, a connection is established with a new transmitting end device;
[0058] Determining a display mode based on the number of currently connected sending-end devices;
[0059] Based on the display mode, the screen projection data sent by each currently connected sending device is synchronously displayed on the receiving device.
[0060] According to a fourth aspect of an embodiment of the present disclosure, a non-transitory computer-readable storage medium is provided. When instructions in the storage medium are executed by a processor of a device, the device is enabled to perform a screen projection method, the method comprising:
[0061] When a connection has been established with a transmitting end device to synchronously display the projection data sent by the transmitting end device, a connection is established with a new transmitting end device;
[0062] Determining a display mode based on the number of currently connected sending-end devices;
[0063] Based on the display mode, the screen projection data sent by each currently connected sending device is synchronously displayed on the receiving device.
[0064] The present disclosure proposes a screen projection method, in which, when a connection has been established with a transmitting device, a connection is established with a new transmitting device; based on the number of currently connected transmitting devices, a display mode is determined; and then based on the display mode, the projection data sent by each currently connected transmitting device is synchronously displayed on the receiving device. By adopting this method, multiple transmitting devices can simultaneously project the display interface to the receiving device, and the interfaces of multiple transmitting devices can be flexibly displayed on the receiving device, thereby making full use of the entire interface of the receiving device, greatly improving the user experience.
[0065] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS
[0066] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.
[0067] Figure 1 It is a schematic diagram of a display interface with only one screen projection when a dual-channel screen projection function is used in the prior art according to an exemplary embodiment.
[0068] Figure 2 The figure is a flow chart of a screen projection method according to an exemplary embodiment.
[0069] Figure 3 The figure is a flow chart of a screen projection method according to an exemplary embodiment.
[0070] Figure 4 It is a block diagram of a screen projection device according to an exemplary embodiment.
[0071] Figure 5 It is a block diagram of a device according to an exemplary embodiment. DETAILED DESCRIPTION
[0072] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Instead, they are merely examples of devices and methods consistent with some aspects of the present invention as detailed in the appended claims.
[0073] Currently, when the display interfaces of two terminals are projected, it is not possible to switch between dual-channel projection and single-channel projection. When using the dual-channel projection function, the terminal can only be connected to the display device through a fixed dual-channel projection entrance, and if only one terminal is connected to the display device, only half of the screen can be used, and the user experience is very poor.
[0074] In addition, the current screen projection method only supports dual-channel screen projection, and does not support the switching of display modes. It is impossible to achieve seamless switching between dual-channel screen projection and single-channel screen projection. For example, in the dual-channel screen projection state, when one connection is disconnected, the other connected channel can only use half of the screen of the display device. Figure 1 As shown, the interface cannot occupy the full screen of the display device, which makes the user experience very poor.
[0075] The present disclosure proposes a screen projection method, in which, when a connection has been established with a transmitting device, a connection is established with a new transmitting device; based on the number of currently connected transmitting devices, a display mode is determined; and then based on the display mode, the projection data sent by each currently connected transmitting device is synchronously displayed on the receiving device. By adopting this method, multiple transmitting devices can simultaneously project display interfaces to the receiving device, and the receiving device can adaptively adjust the display modes of the multiple interfaces according to the number of connected transmitting devices.
[0076] By adopting this method, not only can the interfaces of multiple (more than two, for example, three, four, five, etc.) sending devices be displayed on the receiving device, but the display mode can also be adaptively adjusted according to the number of connected sending devices, thereby making full use of the entire interface of the receiving device and greatly improving the user experience.
[0077] The transmitting device in the present disclosure may be a mobile terminal, such as a mobile phone, a PAD, etc.; the receiving device may be a large-screen display device, such as a television, etc.
[0078] Figure 2 is a flowchart of a screen projection method according to an exemplary embodiment, which is applied to a receiving device, such as Figure 2 As shown, the method comprises the following steps:
[0079] Step 201, when a connection has been established with a transmitting end device to synchronously display the projection data sent by the transmitting end device, a connection is established with a new transmitting end device;
[0080] Step 202, determining a display mode based on the number of currently connected transmitting end devices;
[0081] Step 203: Based on the display mode, the screen projection data sent by each currently connected sending device is synchronously displayed on the receiving device.
[0082] This method is particularly suitable for application scenarios in which the interfaces of multiple sending devices (such as mobile phones) are projected onto a receiving device (such as a TV), for example, multiplayer competitions, spectator games, anchor commentary, etc.
[0083] Before step 201, the receiving device and the transmitting device establish a connection via wired or wireless means, such as joining the same local area network, scanning connection, WIFI P2P, HDMI wired connection, etc. The specific implementation is in a manner known to those skilled in the art, which will not be described in detail here.
[0084] In step 201, when the receiving device has established a connection with one or more sending devices and synchronously displays the projection data sent by the sending device (synchronously displays the display interface of the sending device), a new sending device establishes a connection with the receiving device through the wired or wireless method mentioned above. The new sending device refers to a device that is not included in the sending devices that have established a connection with the receiving device.
[0085] In step 202, after the new transmitting-end device is connected to the receiving-end device, the number of transmitting-end devices connected to the receiving-end device may change. At this time, it is necessary to determine the display mode of the receiving-end device based on the number of transmitting-end devices currently connected, so as to achieve the best display effect of the interface of the transmitting-end device on the receiving-end device. It should be noted that after the transmitting-end device is connected to the receiving-end device, the number of transmitting-end devices connected to the receiving-end device may change, or the number of transmitting-end devices connected to the receiving-end device may remain unchanged. Therefore, when determining the display mode based on the number of transmitting-end devices currently connected, it is usually necessary to first determine the number of transmitting-end devices currently connected.
[0086] Display mode refers to the way in which a receiving device displays the interface of a connected transmitting device, such as tile mode, picture-in-picture mode, focus mode, main screen mode, etc. Among them, tile mode is that the connected transmitting devices divide the display interface of the receiving device equally, including equal division up and down, equal division left and right, etc.; picture-in-picture mode is that the interface of one transmitting device occupies the entire interface of the receiving device as the main interface, and the interfaces of other transmitting devices are set in the main interface; focus mode is that the interface of one transmitting device occupies most of the interface of the receiving device as the main interface, and the interfaces of other transmitting devices occupy the remaining interfaces of the receiving device to highlight the main interface; main screen mode is that the interface of one transmitting device occupies the entire interface of the receiving device as the main interface, and the interfaces of other transmitting devices are not displayed. When the number of transmitting devices connected to the receiving device is different, the specific display modes in the tile mode, picture-in-picture mode, focus mode, and main screen mode are also different. For example, when there are two transmitting devices connected to the receiving device, the tile mode can adopt a left-right split-screen mode or a top-bottom split-screen mode; when there are two transmitting devices connected to the receiving device, the tile mode can adopt a grid-like split-screen mode.
[0087] It should be noted that the display mode here can be determined in one of the tile mode, picture-in-picture mode, focus mode, main screen mode, etc., and can also be refined to determine a specific method included in one of the tile mode, picture-in-picture mode, focus mode, and main screen mode, such as left-right split screen or top-bottom split screen in the tile mode, which sending end device's interface is the main interface of the focus mode, and whether the main interface is on the top or the bottom, etc. The specific level of the display mode can be determined according to the user's settings or the system's settings.
[0088] In addition, in this step, the display mode is determined based on the number of currently connected transmitting-end devices. The display mode may be selected by the user and determined based on the user's selection; or the system default display mode may be selected.
[0089] In step 203, after the display mode is determined, based on the display mode, the projection data sent by each currently connected sending device is synchronously displayed on the receiving device, that is, the display interface of each connected sending device is synchronously displayed.
[0090] By adopting this method, the interfaces of multiple sending devices can be displayed on the receiving device. In theory, as long as the processing capability of the receiving device is strong enough, the interfaces of any multiple sending devices can be displayed synchronously. In addition, no matter how many sending devices are connected to the receiving device, the receiving device can adaptively adjust the display mode according to the number of connected sending devices, thereby making full use of the entire interface of the receiving device, greatly improving the user experience.
[0091] In an optional implementation manner, when a connection has been established with a transmitting end device to synchronously display the projection data sent by the transmitting end device, establishing a connection with a new transmitting end device includes:
[0092] When a connection has been established with at least two sending devices to synchronously display the projection data sent by the at least two sending devices, a connection is established with a new sending device.
[0093] In this embodiment, when the receiving device has established a connection with two or more sending devices and displays their projection data, it can still establish a connection with a new sending device. In this way, the receiving device can display the interfaces of more than two sending devices on its display interface. This is particularly suitable for the scenario of displaying terminal interfaces used by more than two users at the same time.
[0094] In an optional embodiment, the method further comprises:
[0095] Receive display mode switching message;
[0096] Determine the target display mode;
[0097] Based on the target display mode, the projection data sent by each currently connected sending device is synchronously displayed on the receiving device.
[0098] By using the method of this embodiment, the display mode can be switched during the process of the receiving device displaying the interface of the receiving device. The switching of the display mode here is not caused by the change in the number of connected sending devices, but by the display mode switching message sent by the user. The user can send the display mode switching message through the remote control of the receiving device.
[0099] After receiving the display mode switching message, a prompt message for selecting a display mode may be given, for example, displayed on the display screen of the receiving device in the form of a message window, so that the user can make a selection. Based on the user's selection (the user can make a selection through a touch screen or a remote control of the receiving device or a transmitting device), a target display mode is determined, that is, the display mode that the user wants to switch to. Then, display is performed based on the determined target display mode.
[0100] By adopting this implementation, the display mode switching in the same screen process can be realized, so that the user can switch the display mode according to the scene needs, improving the user experience. For example, in a game, four players are active in different positions, and the tiling mode of the grid is selected at this time. In the following scene, one player is active and the other three players are waiting, and the focus mode is selected at this time.
[0101] In an optional embodiment, the method further comprises:
[0102] Determine whether the number of currently connected sending end devices has changed;
[0103] When the number changes, determining a new display mode based on the number of currently connected sending-end devices;
[0104] Switching the display mode of the receiving end device from the current display mode to the new display mode in real time;
[0105] Based on the new display mode, the screen projection data sent by each currently connected sending device is synchronously displayed on the receiving device.
[0106] In this implementation, the display mode can be adjusted in real time according to the change in the number of connected sending devices, so that the interface of the sending device can be displayed more reasonably on the display screen of the receiving device. Therefore, each time a projection is added or reduced, the screen can be adapted to achieve the best projection effect. For example, when converting from a single-channel projection to a two-channel projection, the original full-screen single-channel projection automatically shrinks to half, and the other projection occupies the other half; conversely, when one of the two projections exits the projection, the remaining projection will automatically fill the full screen.
[0107] In this embodiment, when it is determined that the number of currently connected transmitting-end devices has changed, the display mode is switched to a determined new display mode in real time, without causing display interruption to the user.
[0108] In an optional implementation manner, the determining whether the number of currently connected transmitting end devices changes includes at least one of the following methods:
[0109] Method 1: monitor in real time whether the number of currently connected sending devices changes;
[0110] Method 2: determining whether the number of currently connected sending-end devices has changed by judging whether a disconnection message with the sending-end device has been received.
[0111] In order to be able to adaptively adjust the display mode according to the number of connected transmitting devices, it is necessary to determine in real time whether the number of currently connected transmitting devices has changed. The number of currently connected transmitting devices can be detected in real time, and the current number can be compared with the number previously detected to determine whether there has been a change. The number of currently connected transmitting devices can be obtained, for example, by detecting the number of channels connected to the receiving device, or other detection methods known to those skilled in the art can be used, which will not be described here. It can also be determined by judging whether a disconnection message sent by the transmitting device is received. This method is applicable to the case where a disconnection message is sent to the receiving device when the transmitting device is disconnected from the receiving device.
[0112] In an optional implementation manner, after establishing a connection with a new sending end device, the method further includes:
[0113] Sending a query message about whether the new sending end device is a replacement device or an additional device of the connected sending end device;
[0114] receiving a response message to the inquiry message;
[0115] Based on the response message, the number of the currently connected sending-end devices is determined.
[0116] When a new transmitting device establishes a connection with a receiving device, it can replace the device that is already connected to the receiving device, or it can be added as a new device to the device group connected to the receiving device. For example, transmitting device B, transmitting device C, and transmitting device D are already connected to receiving device A, and transmitting device E is connected to receiving device A as a new transmitting device. At this time, transmitting device E can replace transmitting device C, in which case there are still three transmitting devices connected to the receiving device; transmitting device E can also be added as an added device to the connected device group, in which case there are four transmitting devices connected to the receiving device.
[0117] Therefore, based on the response message, ie, the selection of the new sender device as a replacement device or an additional device for the connected sender device, the number of currently connected sender devices is determined, which may or may not have changed.
[0118] Through the above-mentioned method, more usage options are provided to the user, and at the same time, the display mode can be adaptively adjusted to the best one based on the user's selection.
[0119] In an optional embodiment, the method further comprises:
[0120] Receive volume adjustment messages;
[0121] Determine the sending end device of the volume to be adjusted and the corresponding target volume;
[0122] Based on the corresponding target volume, the volume of the transmitting end device of the volume to be adjusted is adjusted.
[0123] This embodiment enables the user to adjust the volume of any transmitting device as needed. The user can send a volume adjustment message through the remote control of the receiving device. After receiving the volume adjustment message, the receiving device can provide an entry for selecting a transmitting device corresponding to the display interface. When it is determined that the user has selected a display interface, a volume adjustment window is provided, and the user can adjust the volume through the remote control of the receiving device or the corresponding transmitting device. Based on the received user adjustment operation message, the corresponding target volume is determined to achieve the volume adjustment effect of the corresponding transmitting device.
[0124] It should be noted that the volume of a sound of a transmitting device played by a receiving device is the product of the volume setting value of the transmitting device and the volume setting value of the receiving device. For example, if the volume setting value of the transmitting device is 40% of the maximum volume value of the transmitting device, and the volume setting value of the receiving device is 50% of the maximum volume value of the receiving device, then the volume of the transmitting device played by the receiving device is 40%*50%=20%, that is, 20% of the maximum volume value of the receiving device. Here, the volume value is described as a percentage of the maximum volume value of the device. Of course, the volume value can also be described by decibels or other methods, which are not limited here.
[0125] The receiving device can also play the sounds of multiple sending devices at the same time. For example, a TV is connected to two mobile phones, the TV volume is 60% of its maximum value, the volume of mobile phone 1 is 10% of its maximum value, and the volume of mobile phone 2 is 90% of its maximum value. Then the volume played by mobile phone 1 when casting the screen is 60%*10%=6%, and the volume played by mobile phone 2 when casting the screen is 60%*90%=54%.
[0126] The receiving device plays the sound of the first connected sending device by default. If it is necessary to play the sound of other sending devices at the same time or only play the sound of another sending device, it can be achieved by sending a volume adjustment message to the receiving device.
[0127] In addition, when the volume value of the transmitting device changes, the receiving device can receive the changed volume value and adjust its own playback volume accordingly.
[0128] Adjusting the volume of the receiving device will change the upper limit of the sound of all connected sending devices when casting. Adjusting the volume of the sending device itself under the premise of this upper limit will change the volume of each sending device when casting.
[0129] The following describes a specific embodiment according to the present disclosure in conjunction with a specific application scenario. In this embodiment, the transmitting device is a mobile phone, and the receiving device is a TV. The application scenario of this embodiment is: the TV and mobile phones 1 and 2 join the same local area network and establish a connection, and mobile phones 1 and 2 send the projection data to the TV through the connection, and the TV displays the projection data sent by mobile phones 1 and 2 in real time. At this time, mobile phone 3 also joins the local area network where the TV and mobile phones 1 and 2 are located, discovers the TV and establishes a connection with the TV. The method of this embodiment includes the following steps:
[0130] Step 301 , when the TV is connected to mobile phone 1 and mobile phone 2 and displays the interfaces of mobile phone 1 and mobile phone 2 in real time, it is connected to mobile phone 3 .
[0131] Step 302, sending an inquiry message "Is mobile phone 3 a replacement device or an additional device?" and displaying the inquiry message in a message window on the TV.
[0132] Step 303, receiving a response message of "Mobile phone 3 is an added device".
[0133] Step 304: determine that the number of currently connected transmitting-end devices is 3.
[0134] Step 305: Based on the number 3, a display mode selection message is sent, and the selection message is displayed in a message window on the television.
[0135] Step 306: receiving a user's selection and determining that the display mode is a left-right split screen in a tiled mode.
[0136] Step 307: Based on the left-right split screen mode, the interfaces of mobile phone 1, mobile phone 2 and mobile phone 3 are synchronously displayed on the TV.
[0137] Step 308: receiving a display mode switching message, determining that the target display mode is a picture-in-picture display mode with mobile phone 1 as the main interface.
[0138] Step 309, synchronously displaying the interfaces of mobile phone 1, mobile phone 2 and mobile phone 3 on the TV in picture-in-picture mode.
[0139] The present disclosure also provides a screen projection device, which is applied to a receiving end device, such as Figure 4 As shown, the device comprises:
[0140] The connection establishment module 401 is configured to establish a connection with a new sending end device when a connection has been established with the sending end device to synchronously display the projection data sent by the sending end device;
[0141] The mode determination module 402 is configured to determine the display mode based on the number of currently connected transmitting end devices;
[0142] The display module 403 is configured to synchronously display the projection data sent by each currently connected sending device on the receiving device based on the display mode.
[0143] In an optional implementation manner, the connection establishing module 401 is further configured to:
[0144] When a connection has been established with at least two sending devices to synchronously display the projection data sent by the at least two sending devices, a connection is established with a new sending device.
[0145] In an optional implementation, the mode determination module 402 is further configured to: receive a display mode switching message, and determine a target display mode;
[0146] The display module 403 is also configured to: based on the target display mode, synchronously display the projection data sent by each currently connected sending device on the receiving device.
[0147] In an optional implementation, the mode determination module 402 is further configured to: determine whether the number of currently connected transmitting-end devices changes; when the number changes, determine a new display mode based on the number of currently connected transmitting-end devices;
[0148] The device further comprises a mode switching module, which is configured to switch the display mode of the receiving end device from the current display mode to the new display mode in real time;
[0149] The display module 403 is also configured to: based on the new display mode, synchronously display the projection data sent by each currently connected sending device on the receiving device.
[0150] In an optional implementation manner, the mode determination module 402 is further configured to determine whether the number of currently connected transmitting-end devices changes by at least one of the following methods:
[0151] Method 1: monitor in real time whether the number of currently connected sending devices changes;
[0152] Method 2: determining whether the number of currently connected sending-end devices has changed by judging whether a disconnection message with the sending-end device has been received.
[0153] In an optional embodiment, the device further comprises:
[0154] a message sending module, configured to send, after establishing a connection with a new sending end device, an inquiry message as to whether the new sending end device is a replacement device or an additional device for the connected sending end device;
[0155] A message receiving module, configured to receive a response message to the inquiry message;
[0156] The quantity determination module is configured to determine the quantity of the currently connected sending-end devices based on the response message.
[0157] In an optional embodiment, the device further comprises:
[0158] A message receiving module, configured to receive a volume adjustment message;
[0159] A volume determination module is configured to determine a sending end device of a volume to be adjusted and a corresponding target volume;
[0160] The volume adjustment module is configured to adjust the volume of the sending end device of the volume to be adjusted based on the corresponding target volume.
[0161] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.
[0162] In the above device, when a connection has been established with a transmitting device, a connection is established with a new transmitting device; based on the number of currently connected transmitting devices, a display mode is determined; and then based on the display mode, the projection data sent by each currently connected transmitting device is synchronously displayed on the receiving device. By adopting this method, multiple transmitting devices can simultaneously project the display interface to the receiving device, and the receiving device can adaptively adjust the display mode of the multiple interfaces according to the number of connected transmitting devices.
[0163] By adopting this device, not only can the interfaces of multiple (more than two, for example, three, four, five, etc.) sending devices be displayed on the receiving device, but the display mode can also be adaptively adjusted according to the number of connected sending devices, thereby making full use of the entire interface of the receiving device and greatly improving the user experience.
[0164] Figure 5 It is a block diagram of a screen projection device 500 according to an exemplary embodiment.
[0165] Reference Figure 5, the device 500 may include one or more of the following components: a processing component 502 , a memory 504 , a power component 506 , a multimedia component 508 , an audio component 510 , an input / output (I / O) interface 512 , a sensor component 514 , and a communication component 516 .
[0166] The processing component 502 generally controls the overall operation of the device 500, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 502 may include one or more processors 520 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 502 may include one or more modules to facilitate the interaction between the processing component 502 and other components. For example, the processing component 502 may include a multimedia module to facilitate the interaction between the multimedia component 508 and the processing component 502.
[0167] The memory 504 is configured to store various types of data to support operations on the device 500. Examples of such data include instructions for any application or method operating on the device 500, contact data, phone book data, messages, pictures, videos, etc. The memory 504 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.
[0168] Power component 506 provides power to various components of device 500. Power component 506 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for device 500.
[0169] The multimedia component 508 includes a screen that provides an output interface between the device 500 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 508 includes a front camera and / or a rear camera. When the device 500 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
[0170] The audio component 510 is configured to output and / or input audio signals. For example, the audio component 510 includes a microphone (MIC), and when the device 500 is in an operating mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 504 or sent via the communication component 516. In some embodiments, the audio component 510 also includes a speaker for outputting audio signals.
[0171] I / O interface 512 provides an interface between processing component 502 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.
[0172] The sensor assembly 514 includes one or more sensors for providing various aspects of status assessment for the device 500. For example, the sensor assembly 514 can detect the open / closed state of the device 500, the relative positioning of components, such as the display and keypad of the device 500, and the sensor assembly 514 can also detect the position change of the device 500 or a component of the device 500, the presence or absence of user contact with the device 500, the orientation or acceleration / deceleration of the device 500, and the temperature change of the device 500. The sensor assembly 514 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 514 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 514 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
[0173] The communication component 516 is configured to facilitate wired or wireless communication between the device 500 and other devices. The device 500 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 516 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 516 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.
[0174] In an exemplary embodiment, the apparatus 500 may be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to perform the above methods.
[0175] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 504 including instructions, and the instructions can be executed by the processor 520 of the device 500 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.
[0176] A non-temporary computer-readable storage medium, when the instructions in the storage medium are executed by the processor of a mobile terminal, enables the mobile terminal to perform a screen projection method, the method comprising: establishing a connection with a new sending device when a connection has been established with a sending device to synchronously display the projection data sent by the sending device; determining a display mode based on the number of currently connected sending devices; and synchronously displaying the projection data sent by each currently connected sending device on the receiving device based on the display mode.
[0177] Those skilled in the art will readily appreciate other embodiments of the present invention after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses or adaptations of the present invention that follow the general principles of the present invention and include common knowledge or customary techniques in the art that are not disclosed in this disclosure. The specification and examples are to be considered exemplary only, and the true scope and spirit of the present invention are indicated by the following claims.
[0178] It should be understood that the present invention is not limited to the exact construction that has been described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present invention is limited only by the appended claims.
Claims
1. A screen projection method, applied to a receiving device, characterized in that: The method comprises: When a connection has been established with a transmitting end device to synchronously display the projection data sent by the transmitting end device, a connection is established with a new transmitting end device; Determining a display mode based on the number of currently connected sending-end devices; Based on the display mode, synchronously displaying the projection data sent by each currently connected sending device on the receiving device; The method further comprises: Receive a display mode switching message sent by a user; Determine the target display mode; Based on the target display mode, the projection data sent by each currently connected sending device is synchronously displayed on the receiving device.
2. The method according to claim 1, characterized in that The step of establishing a connection with a new sending end device when a connection has been established with the sending end device to synchronously display the projection data sent by the sending end device includes: When a connection has been established with at least two sending devices to synchronously display the projection data sent by the at least two sending devices, a connection is established with a new sending device.
3. The method according to claim 1, characterized in that The method further comprises: Determine whether the number of currently connected sending end devices has changed; When the number changes, determining a new display mode based on the number of currently connected sending-end devices; Switching the display mode of the receiving end device from the current display mode to the new display mode in real time; Based on the new display mode, the screen projection data sent by each currently connected sending device is synchronously displayed on the receiving device.
4. The method according to claim 3, characterized in that The determining whether the number of currently connected transmitting-end devices changes includes at least one of the following methods: Method 1: monitor in real time whether the number of currently connected sending devices changes; Method 2: determining whether the number of currently connected sending-end devices has changed by judging whether a disconnection message with the sending-end device has been received.
5. The method according to claim 1, characterized in that After establishing a connection with the new sending end device, the method further includes: Sending a query message about whether the new sending end device is a replacement device or an additional device of the connected sending end device; receiving a response message to the inquiry message; Based on the response message, the number of the currently connected sending-end devices is determined.
6. The method according to claim 1, characterized in that The method further comprises: Receive volume adjustment messages; Determine the sending end device of the volume to be adjusted and the corresponding target volume; Based on the corresponding target volume, the volume of the transmitting end device of the volume to be adjusted is adjusted.
7. A screen projection device, applied to a receiving device, characterized in that: The device comprises: A connection establishment module, configured to establish a connection with a new sending end device when a connection has been established with the sending end device to synchronously display the projection data sent by the sending end device; A mode determination module is configured to determine a display mode based on the number of currently connected transmitting end devices; A display module is configured to synchronously display the projection data sent by each currently connected sending end device on the receiving end device based on the display mode; The mode determination module is further configured to: receive a display mode switching message sent by a user, and determine a target display mode; The display module is also configured to: based on the target display mode, synchronously display the projection data sent by each currently connected sending device on the receiving device.
8. The device according to claim 7, characterized in that The connection establishment module is also configured to: When a connection has been established with at least two sending devices to synchronously display the projection data sent by the at least two sending devices, a connection is established with a new sending device.
9. The device according to claim 7, characterized in that The mode determination module is further configured to: determine whether the number of currently connected transmitting-end devices changes; when the number changes, determine a new display mode based on the number of currently connected transmitting-end devices; The device further comprises a mode switching module, which is configured to switch the display mode of the receiving end device from the current display mode to the new display mode in real time; The display module is also configured to: based on the new display mode, synchronously display the projection data sent by each currently connected sending device on the receiving device.
10. The device according to claim 9, characterized in that The mode determination module is further configured to determine whether the number of currently connected transmitting-end devices changes by at least one of the following methods: Method 1: monitor in real time whether the number of currently connected sending devices changes; Method 2: determining whether the number of currently connected sending-end devices has changed by judging whether a disconnection message with the sending-end device has been received.
11. The device according to claim 7, characterized in that The device also includes: a message sending module, configured to send, after establishing a connection with a new sending end device, an inquiry message as to whether the new sending end device is a replacement device or an additional device for the connected sending end device; A message receiving module, configured to receive a response message to the inquiry message; The quantity determination module is configured to determine the quantity of the currently connected sending-end devices based on the response message.
12. The device according to claim 7, characterized in that The device also includes: A message receiving module, configured to receive a volume adjustment message; A volume determination module is configured to determine a sending end device of a volume to be adjusted and a corresponding target volume; The volume adjustment module is configured to adjust the volume of the sending end device of the volume to be adjusted based on the corresponding target volume.
13. A screen projection device, characterized in that: include: processor; a memory for storing processor-executable instructions; The processor is configured to implement the following steps when executing the executable instructions: When a connection has been established with a transmitting end device to synchronously display the projection data sent by the transmitting end device, a connection is established with a new transmitting end device; Determining a display mode based on the number of currently connected sending-end devices; Based on the display mode, synchronously displaying the projection data sent by each currently connected sending device on the receiving device; The processor is further configured to implement the following steps when executing the executable instructions: Receive a display mode switching message sent by a user; Determine the target display mode; Based on the target display mode, the projection data sent by each currently connected sending device is synchronously displayed on the receiving device.
14. A non-transitory computer-readable storage medium, when the instructions in the storage medium are executed by a processor of a device, enables the device to perform a screen projection method, the method comprising: When a connection has been established with a transmitting end device to synchronously display the projection data sent by the transmitting end device, a connection is established with a new transmitting end device; Determining a display mode based on the number of currently connected sending-end devices; Based on the display mode, synchronously displaying the projection data sent by each currently connected sending device on the receiving device; The method further comprises: Receive a display mode switching message sent by a user; Determine the target display mode; Based on the target display mode, the projection data sent by each currently connected sending device is synchronously displayed on the receiving device.
