A method and communication system for multi-screen device control
By identifying the master control device among multiple screen devices and using Bluetooth connection to achieve device information sharing and control signal forwarding within the screen group, the problems of increased hardware complexity and cost in traditional technologies are solved, and convenient control of multiple screen devices is realized.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- HUAWEI TECH CO LTD
- Filing Date
- 2021-01-30
- Publication Date
- 2026-04-14
AI Technical Summary
In existing technologies, controlling multiple screen devices in a home requires additional hardware devices or modules, increasing hardware complexity and cost. Furthermore, traditional Bluetooth remote controls are fixed one-to-one and cannot meet the needs of combined screen control scenarios.
By identifying the master control device among multiple screen devices, Bluetooth connectivity enables device information sharing and control signal forwarding within the screen group, allowing any Bluetooth device to control the screen group and avoiding the need for additional hardware devices or modules.
It enables convenient control of multiple screen devices via any Bluetooth device without adding hardware, simplifying user operation and reducing hardware complexity and cost.
Smart Images

Figure CN114840156B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of communication technology, and in particular to a method and communication system for controlling multi-screen devices. Background Technology
[0002] There may be multiple screen devices in a home, each equipped with a Bluetooth remote control. Usually, the user operates the Bluetooth remote control paired with the screen device to control the screen device. This one-to-one pairing technology between the screen device and the Bluetooth remote control cannot meet all screen control scenarios, such as when the user splices the screens of multiple screen devices into a large combined screen.
[0003] In existing technologies, additional hardware devices or modules are usually configured separately for the combined screens in order to receive and process control signals from each Bluetooth controller, thereby completing the control of the combined screens. However, this approach is not suitable for scenarios in the home where there are only screen devices and Bluetooth remote controls that come with the screen devices. Moreover, configuring additional hardware devices or modules increases hardware complexity and cost. Summary of the Invention
[0004] This application provides a method and communication system for controlling multiple screen devices, enabling users to control multiple screen devices conveniently without adding hardware devices or modules.
[0005] In a first aspect, embodiments of this application provide a method for controlling a multi-screen device. This method is applied to a communication system, which includes a first screen device and a second screen device, a first Bluetooth device connected to the first screen device via Bluetooth, and a second Bluetooth device connected to the second screen device via Bluetooth. The method includes: the first screen device and the second screen device forming a first screen group; determining the first screen device as the master control device of the first screen group; the first screen device sending first instruction information to the second screen device; the first instruction information being used to instruct the second Bluetooth device to communicate with the first screen device.
[0006] Using the above method, the main control screen in the screen group can establish a connection with all Bluetooth devices corresponding to the screen group. Any Bluetooth device can control the main control device, thereby realizing the control of multiple screen devices in the screen group.
[0007] In one possible design, the first instruction information is also used to instruct the second screen device to share the received control signal with the first screen device. This allows the auxiliary device to forward the received control signal to the master device without altering the pairing relationship between the screen device and the Bluetooth device, thus enabling the master device to control the auxiliary device.
[0008] In one possible design, the first instruction information is used to instruct the second Bluetooth device to establish a Bluetooth connection with the first screen device; after the first screen device sends the first instruction information to the second screen device, the process includes: the first screen device establishing a Bluetooth connection with the second Bluetooth device. In this way, any Bluetooth device corresponding to the screen group can control the main control screen, allowing the user to freely pick up any Bluetooth device to control the main control screen, thereby achieving control of the screen group.
[0009] In one possible design, the first instruction information is also used to instruct the second screen device to disconnect the Bluetooth connection with the second Bluetooth device; after the first screen device sends the first instruction information to the second screen device, the method further includes: the second screen device releasing the Bluetooth connection with the second Bluetooth device according to the first instruction information.
[0010] In one possible design, a first screen device and a second screen device form a first screen group, including: the first screen device detecting a first screen combination operation; and the first screen device responding to the first screen combination operation by forming a first screen group with the second screen device.
[0011] In one possible design, the first screen combination operation is the operation triggered by the user to physically combine the first screen device and the second screen device into a combined screen.
[0012] In one possible design, before the first screen device responds to the first screen combination operation and forms a first screen group with the second screen device, the following steps are included: the first screen device displays a first prompt message indicating whether the first screen device and the second screen device form a screen group; a first Bluetooth device sends a first control signal to the first screen device; the first control signal is used to instruct the first screen device and the second screen device to form a screen group.
[0013] In one possible design, before the first screen device and the second screen device form the first screen group, the process includes: the first screen device and the second screen device discovering each other and establishing a network connection to form a screen group; the screen devices within the screen group sharing device information, as well as pairing information between the screen devices and their paired Bluetooth devices. This enables the sharing of device information within the screen group.
[0014] In one possible design, the first screen device and the second screen device determine the first screen device as the master control device of the first screen group. This includes: the first screen device and the second screen device negotiating to determine that the first screen device is the screen device with the best resources, and determining the first screen device as the master control device of the first screen group. The screen device with the best resources is determined based on the screen device's performance and the master control identifier. This allows for a more reasonable consideration of the resource situation of each screen device within the screen group when determining the master control device.
[0015] In one possible design, after the first screen device establishes a Bluetooth connection with the second Bluetooth device, the process further includes: the first screen device receiving a first control signal from a target Bluetooth device (either the first or second Bluetooth device), the first control signal being used to manipulate the content to be displayed in the first screen group; the first screen device dividing the content to be displayed into a first part and a second part according to the first control signal; the first screen device sending a first control command to the second screen device, the first control command instructing the second screen device to display the second part of the content to be displayed; the first screen device displaying the first part; and the second screen device displaying the second part. In this way, it is possible to control each screen device within the screen group through any Bluetooth device corresponding to the screen group.
[0016] In one possible design, after the first screen device establishes a Bluetooth connection with the second Bluetooth device, it also includes:
[0017] The first screen device receives a second control signal from a target Bluetooth device, which can be either the first or second Bluetooth device. The second control signal is used to control each screen device in the first screen group. The first screen device then sends a second control command corresponding to the second control signal to the second screen device. The second control command instructs the second screen device to perform a control operation. The first screen device performs the control operation. The second screen device then performs the control operation according to the second control command. In this way, it is possible to control each screen device within the screen group through any Bluetooth device corresponding to the screen group.
[0018] In one possible design, the communication system further includes a third screen device in the screen group and a third Bluetooth device connected to the third screen device via Bluetooth. The method further includes: the first screen group acquiring second indication information, which instructs the third screen device to be added to the first screen group; the first screen device detecting a second screen grouping operation; the first screen device responding to the second screen grouping operation and forming a second screen group with the second screen device and the third screen device; the first screen device, the second screen device, and the third screen device determining the master control device of the second screen group; if the first screen device is the master control device of the second screen group, the first screen device sending second indication information to the third screen device, which instructs the third screen device to disconnect its Bluetooth connection with the third Bluetooth device; the third screen device releasing its Bluetooth connection with the third Bluetooth device according to the second indication information; and the first screen device establishing a Bluetooth connection with the third Bluetooth device. Thus, after adding a screen device to the screen group, a new master control device is determined to allow for reasonable control of the new screen group through the master control device.
[0019] In one possible design, the first screen group receives a fourth instruction message, which instructs the removal of a target screen device from the first screen group. The target screen device is either the first screen device or the second screen device. The target screen device receives a third control signal from a target Bluetooth device, which is either the first Bluetooth device or the second Bluetooth device. If the target screen device is the first screen device, then the first screen device binds to the target Bluetooth device according to the third control signal and disconnects from other Bluetooth devices. If the target screen device is the second screen device, then: the first screen device sends a fifth instruction message to the second screen device, which instructs the second screen device to bind to the target Bluetooth device; the second screen device establishes a connection with the target Bluetooth device; and the first screen device disconnects from the target Bluetooth device.
[0020] Using this method, if the screen to be removed is the main control device (i.e., the first screen device mentioned above), then when the user operates any Bluetooth device among all the Bluetooth devices corresponding to the first screen group, the main control device can directly bind to the Bluetooth device the user is operating. If the screen to be removed is an auxiliary device (i.e., the second screen device mentioned above), then when the user operates any Bluetooth device among all the Bluetooth devices corresponding to the first screen group, the main control device instructs the auxiliary screen to bind to the Bluetooth device the user is operating. In this way, the user does not need to distinguish between each Bluetooth device; they can simply pick up any Bluetooth device to control the screen device to be removed.
[0021] In one possible design, the communication system includes at least three screen devices, which together form a first screen group; the method also includes:
[0022] The first screen group receives the sixth instruction message, which is used to instruct the removal of any two screen devices from the first screen group;
[0023] For one of the two screen devices to be removed, execute:
[0024] The target screen device establishes connections with all Bluetooth devices corresponding to the first screen group;
[0025] The target screen device receives a fourth control signal from the target Bluetooth device, which is any one of all Bluetooth devices corresponding to the first screen group;
[0026] The target screen device determines the angle of arrival formed by the receiving antenna of the target screen device and the target Bluetooth device, as well as the distance between the target screen device and the target Bluetooth device, based on the fourth control signal.
[0027] The screen devices to be dismantled are determined to be controlled by the target Bluetooth device based on their respective first and second angles of arrival, and / or their respective first and second distances.
[0028] This method allows for the determination of which dismantled screen device is being controlled by the currently operating Bluetooth device by determining the angle of arrival and / or distance in scenarios where multiple screen devices are being removed from the first screen group. This eliminates the need for the user to distinguish between each Bluetooth device; the user can simply pick up any Bluetooth device to accurately control the dismantled screen device, making the operation process simple.
[0029] In one possible design, after the first screen group receives the fourth instruction information, it also includes:
[0030] The first screen device displays a first prompt message, and the second screen device displays a second prompt message; wherein, the first prompt message is used to prompt a first button operation bound to the first screen device, and the second prompt message is used to prompt a second button operation bound to the second screen device;
[0031] The first screen device receives a fourth control signal from the target Bluetooth device, which is either the first Bluetooth device or the second Bluetooth device.
[0032] If the first screen device determines that the button operation of the fourth control signal matches the first button operation, then the target screen device controlled by the target Bluetooth device is determined to be the first screen device; or, if the second screen device determines that the button operation of the fourth control signal matches the second button operation, then the target screen device controlled by the target Bluetooth device is determined to be the second screen device.
[0033] This method guides users to bind screen devices to Bluetooth devices through specific remote control operations based on the prompts output by each screen device in the screen group. It also allows users to control the screen device to be removed without distinguishing between each Bluetooth device.
[0034] Secondly, embodiments of this application provide a communication system for controlling multiple screen devices. The communication system includes a first screen device and a second screen device in the same screen group, a first Bluetooth device connected to the first screen device via Bluetooth, and a second Bluetooth device connected to the second screen device via Bluetooth.
[0035] The first screen device is used to: form a first screen group with the second screen device, and determine the first screen device as the master control device of the first screen group; send first instruction information to the second screen device; the first instruction information is used to instruct the second Bluetooth device to communicate with the first screen device.
[0036] In one possible design, the first instruction information is also used to instruct the second screen device to share the received control signals with the first screen device.
[0037] In one possible design, the first indication information is used to instruct the second Bluetooth device to establish a Bluetooth connection with the first screen device; the first screen device is also used for:
[0038] Establish a Bluetooth connection with the second Bluetooth device.
[0039] In one possible design, the first indication information is also used to instruct the second screen device to disconnect the Bluetooth connection from the second Bluetooth device;
[0040] Second screen device, used for:
[0041] The second screen device releases the Bluetooth connection with the second Bluetooth device according to the first instruction information.
[0042] In one possible design, the first screen device is also used to: detect the first screen combination operation;
[0043] In response to the first screen combination operation, it forms a first screen group with the second screen device.
[0044] In one possible design, the first screen combination operation is the operation triggered by the user to physically combine the first screen device and the second screen device into a combined screen.
[0045] In one possible design, in response to a first screen combination operation, before forming a first screen group with a second screen device, the first screen device is further configured to: display a first prompt message indicating whether the first screen device forms a screen group with the second screen device;
[0046] The first Bluetooth device is used to: send a first control signal to the first screen device; the first control signal is used to instruct the first screen device and the second screen device to form a screen group.
[0047] In one possible design, before the first screen device and the second screen device form a first screen group, the first screen device is also used to: discover each other with the second screen device and establish a network connection to form a screen group; the screen devices in the screen group share device information and pairing information between the screen devices and their paired Bluetooth devices.
[0048] In one possible design, the first screen device is also used for:
[0049] The first screen device is determined to be the screen device with the best resources through consultation with the second screen device, and the first screen device is determined to be the master control device of the first screen group. The screen device with the best resources is determined based on the performance of the screen device and the master control identifier.
[0050] In one possible design, after the first screen device establishes a Bluetooth connection with the second Bluetooth device, the first screen device is also used to: receive a first control signal sent from a target Bluetooth device, the target Bluetooth device being either the first Bluetooth device or the second Bluetooth device, the first control signal being used to operate on the content to be displayed in the first screen group;
[0051] Based on the first control signal, the content to be displayed is divided into a first part and a second part;
[0052] Send a first control command to the second screen device, the first control command being used to instruct the second screen device to display a second part of the content to be displayed;
[0053] Showing the first part;
[0054] The second screen device is also used to display the second part.
[0055] In one possible design, after the first screen device establishes a Bluetooth connection with the second Bluetooth device, the first screen device is also used for:
[0056] Receive a second control signal from a target Bluetooth device, which may be a first Bluetooth device or a second Bluetooth device. The second control signal is used to control the screen devices of the first screen group.
[0057] Send a second control command corresponding to the second control signal to the second screen device. The second control command is used to instruct the second screen device to perform a control operation; execute the control operation.
[0058] The second screen device is also used to: perform control operations according to the second control command.
[0059] In one possible design, the communication system further includes a third screen device and a third Bluetooth device connected to the third screen device via Bluetooth. The first screen device is further configured to: acquire second instruction information, the second instruction information being used to instruct the third screen device to join the first screen group; detect a second screen grouping operation; in response to the second screen grouping operation, form a second screen group with the second screen device and the third screen device; determine the master control device of the second screen group with the second screen device and the third screen device; if the first screen device is the master control device of the second screen group, send second instruction information to the third screen device, the second instruction information being used to instruct the third screen device to disconnect the Bluetooth connection with the third Bluetooth device; the third screen device is configured to: release the Bluetooth connection with the third Bluetooth device according to the second instruction information; the first screen device is further configured to: establish a Bluetooth connection with the third Bluetooth device.
[0060] In one possible design, the first screen group further includes a fourth screen device, which is also connected to a fourth Bluetooth device; the first screen device is also used to: receive a fourth instruction message, which is used to instruct the removal of a fifth screen device from the first screen group; the fifth screen device is any one of the first screen device, the second screen device, or the fourth screen device; the fifth screen device is also used to: if the fifth screen device is the second screen device or the fourth screen device, establish connections with the first Bluetooth device, the second Bluetooth device, and the fourth Bluetooth device respectively, based on the device information of the first Bluetooth device, the device information of the second Bluetooth device, and the device information of the fourth Bluetooth device.
[0061] In one possible design, the fifth screen device is also used for:
[0062] Receive a third control signal from a target Bluetooth device, which is any one of a first Bluetooth device, a second Bluetooth device, or a fourth Bluetooth device;
[0063] Bind to the target Bluetooth device and disconnect from other Bluetooth devices.
[0064] In one possible design, the first screen group further includes a fourth screen device, and the first screen device is also connected to a fourth Bluetooth device; the first screen device is also used to: receive a fifth instruction message, the fifth instruction message being used to instruct the removal of the sixth screen device and the seventh screen device from the first screen group; the sixth screen device is any one of the first screen device, the second screen device, or the fourth screen device, and the seventh screen device is any one of the first screen device, the second screen device, or the fourth screen device other than the sixth screen device;
[0065] The sixth screen device is also used to: if the sixth screen device is the second screen device or the fourth screen device, establish connections with the first Bluetooth device, the second Bluetooth device, and the fourth Bluetooth device respectively based on the device information of the first Bluetooth device, the device information of the second Bluetooth device, and the device information of the fourth Bluetooth device;
[0066] The seventh screen device is also used to: if the seventh screen device is the second screen device or the fourth screen device, establish connections with the first Bluetooth device, the second Bluetooth device, and the fourth Bluetooth device respectively based on the device information of the first Bluetooth device, the device information of the second Bluetooth device, and the device information of the fourth Bluetooth device;
[0067] In one possible design, the sixth screen device is also used to: receive a third control signal from the target Bluetooth device; and determine, based on the third control signal, a first angle of arrival formed by the receiving antenna of the sixth screen device and the second Bluetooth device, and a first distance between the sixth screen device and the target Bluetooth device.
[0068] The seventh screen device is further configured to: receive a third control signal from a target Bluetooth device; determine, based on the third control signal, a second angle of arrival formed by the receiving antenna of the seventh screen device and the target Bluetooth device, and a second distance between the seventh screen device and the target Bluetooth device; and determine the target screen device controlled by the target Bluetooth device based on the first angle of arrival and the second angle of arrival, and / or the first distance and the second distance.
[0069] In one possible design, after the fifth screen device establishes connections with the first Bluetooth device, the second Bluetooth device, and the fourth Bluetooth device, the first screen device is further configured to: display a first prompt message and receive a fourth control signal from a target Bluetooth device, wherein the target Bluetooth device is any one of the first Bluetooth device, the second Bluetooth device, or the fourth Bluetooth device; wherein the first prompt message is used to prompt the button operation of binding the first screen device, and if it is determined that the button operation of the fourth control signal matches the button operation displayed on the first screen device, then the target screen device controlled by the target Bluetooth device is determined to be the first screen device;
[0070] The second screen device is also used to: display a second prompt message, receive a fourth control signal from the target Bluetooth device, the second prompt message being used to prompt the button operation of binding the second screen device, and if it is determined that the button operation of the fourth control signal matches the button operation displayed on the second screen device, then the target screen device controlled by the target Bluetooth device is determined to be the second screen device.
[0071] The fourth screen device is also used to: display a third prompt message, receive a fourth control signal from the target Bluetooth device, the third prompt message being used to prompt the button operation of the fourth screen device; if it is determined that the button operation of the fourth control signal matches the button operation displayed on the fourth screen device, then the target screen device controlled by the target Bluetooth device is determined to be the fourth screen device.
[0072] Thirdly, embodiments of this application provide a computer-readable storage medium storing program instructions that, when executed on an electronic device, cause the electronic device to perform the steps of the methods described in the first aspect of the embodiments of this application and any possible design thereof.
[0073] Fourthly, the present application provides a computer program product that, when run on an electronic device, enables the electronic device to perform the steps of the first aspect described above and any possible design of the present application.
[0074] Fifthly, an embodiment of this application provides a chip that is coupled to a memory in an electronic device and controls the electronic device to execute the steps of the first aspect of the embodiments of this application and any possible design thereof.
[0075] Furthermore, the technical effects brought about by the second to fifth aspects can be found in the descriptions of the methods in the above-mentioned method section, and will not be repeated here. Attached Figure Description
[0076] Figure 1 A schematic diagram of the communication system provided in the embodiments of this application;
[0077] Figure 2 A schematic diagram of another communication system provided in the embodiments of this application;
[0078] Figure 3 A schematic diagram of yet another communication system provided in the embodiments of this application;
[0079] Figure 4 This is a schematic diagram of an exemplary scenario to which the control method for a multi-screen device provided in the embodiments of this application applies;
[0080] Figure 5 One of the flowcharts for a control method for a multi-screen device provided in this application embodiment;
[0081] Figure 6 A schematic diagram of an interface provided for an embodiment of this application;
[0082] Figure 7 A second flowchart illustrating the control method for a multi-screen device provided in this application embodiment;
[0083] Figure 8 The third flowchart of the control method for a multi-screen device provided in the embodiments of this application;
[0084] Figure 9 A schematic diagram illustrating another exemplary scenario to which the control method for a multi-screen device provided in the embodiments of this application is applicable;
[0085] Figure 10 Flowchart four of the control methods for multi-screen devices provided in the embodiments of this application;
[0086] Figure 11 This is a schematic diagram illustrating yet another exemplary scenario to which the control method for a multi-screen device provided in this application is applicable;
[0087] Figure 12 The fifth flowchart of the control method for a multi-screen device provided in the embodiments of this application;
[0088] Figure 13A This is a schematic diagram illustrating yet another exemplary scenario to which the control method for a multi-screen device provided in this application is applicable;
[0089] Figure 13BThis is a schematic diagram illustrating yet another exemplary scenario to which the control method for a multi-screen device provided in this application is applicable;
[0090] Figure 13C This is a schematic diagram of the demolition scene control provided in an embodiment of this application;
[0091] Figure 13D Flowchart six of the control methods for multi-screen devices provided in the embodiments of this application;
[0092] Figure 14 A schematic diagram of an interface provided for an embodiment of this application;
[0093] Figure 15A A schematic diagram of an interface provided for an embodiment of this application;
[0094] Figure 15B A schematic diagram of an interface provided for an embodiment of this application;
[0095] Figure 16 A schematic diagram of the angle measurement principle provided in the embodiments of this application;
[0096] Figure 17 A schematic diagram illustrating another exemplary scenario to which the control method for a multi-screen device provided in the embodiments of this application is applicable;
[0097] Figure 18 Flowchart seven of the control methods for multi-screen devices provided in the embodiments of this application;
[0098] Figure 19 This is a schematic diagram of the structure of a Bluetooth device provided in an embodiment of this application;
[0099] Figure 20 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation
[0100] The following is an explanation of some of the terms used in the embodiments of this application.
[0101] The embodiments of this application involve at least one, including one or more; wherein, multiple means two or more. Furthermore, it should be understood that in the description of this application, terms such as "first" and "second" are used only for descriptive purposes and should not be construed as indicating or implying relative importance, nor as indicating or implying order.
[0102] A home typically contains multiple screen devices, each with its own Bluetooth remote. Users can generally use one screen device in a single room. When a larger screen is desired, multiple screen devices can be moved to a room (e.g., the living room) and combined to form a combined screen system (hereinafter referred to as a screen group system), thus enhancing the viewing experience. When the combined screen system is no longer needed, it can be disassembled into individual screen devices.
[0103] This application provides a control method for multiple screen devices, enabling users to control multiple screen devices conveniently without adding hardware devices or modules. This method is applicable to scenarios where multiple screen devices are combined into a single screen, as well as scenarios where the combined screen is split into multiple individual screens. In the control method provided by this application, a master control device can be determined from among the multiple screen devices. The master control device manages the pairing information of other screen devices and the Bluetooth devices paired with each screen device, enabling data interaction between the master control device and any Bluetooth device, thereby facilitating user control of multiple screen devices.
[0104] The embodiments of this application will now be described in detail with reference to the accompanying drawings.
[0105] Please refer to Figure 1 This diagram illustrates a communication system provided in an embodiment of this application. The communication system includes at least one Bluetooth device 100 and at least one screen device 200. The remote control device 100 and the screen device 200 can establish a Bluetooth connection. Based on this Bluetooth connection, short-range data interaction can be achieved between the remote control device 100 and the screen device 200.
[0106] The remote control device 100 involved in this application embodiment can be a Bluetooth device, such as a touch remote control, a button remote control, etc., or it can be other devices capable of controlling screen devices, such as an infrared remote control, without limitation here. The remote control can be paired with the screen device, meaning that the screen device can only be controlled by a specific remote control; or the remote control can be a universal remote control, meaning that the remote control can control all screen devices, without limitation here. The following description uses a Bluetooth device as an example for the remote control device 100.
[0107] The screen device 200 involved in this application embodiment can be a television set, computer, mobile internet device (MID), in-vehicle device, virtual reality (VR) device, augmented reality (AR) device, smart home device, etc., with a display screen, or it can be other devices with a display screen capable of establishing a wireless communication connection, without limitation. This screen device can be equipped with... Alternatively, other operating systems may be used, which are not limited in the embodiments of this application.
[0108] Based on the above Figure 1 The communication system shown includes multiple screen devices. These screen devices can discover each other through short-range networks or local area networks (LANs). The screen devices that have discovered each other can connect to each other through a network. One way is that the screen devices can connect via WiFi or Bluetooth. The interconnected screen devices can form a screen group within the network (referred to as a screen group). Another way is that the screen devices that have discovered each other join the LAN to form a screen group. In a screen group, at least two screen devices are physically spliced together to form a combined screen, which is called a screen group system (referred to as a screen group).
[0109] The following explanation uses a screen group consisting of four screen devices (screen A, screen B, screen C, and screen D) and a Bluetooth remote control as an example.
[0110] Please refer to Figure 2 This is a schematic diagram of another communication system provided in an embodiment of this application. The communication system includes screen device A, screen device B, screen device C, screen device D, and Bluetooth device 1 paired with screen device A, Bluetooth device 2 paired with screen device B, Bluetooth device 3 paired with screen device C, and Bluetooth device 4 paired with screen device D.
[0111] like Figure 2 As shown, each screen device includes an independent host as its core processing module, which contains memory and network communication functions. The host of the main control device (i.e., screen device A) establishes a data connection with the hosts of each auxiliary device (i.e., screen device B, screen device C, and screen device D) through a network, which is used by the host of the main control device to control the data transmission and interaction within the combined screen devices.
[0112] Each screen device also includes an independent Bluetooth short-range module, which connects to the host as a communication module. This Bluetooth short-range module is used for short-range Bluetooth communication. The Bluetooth short-range module of the screen device communicates with the Bluetooth short-range module of the Bluetooth device via a short-range wireless signal connection to receive control signals from the Bluetooth device. After receiving the control signal, the Bluetooth short-range module of the screen device works with the host to complete the signal processing, converting the control signal into input to the screen combination control system, which then controls the interface browsing and operation.
[0113] When each screen device is used for the first time after leaving the factory, the host device can scan for and discover the Bluetooth device it is paired with via a short-range Bluetooth module. During the pairing process, the host device stores pairing information such as the Media Access Control (MAC) address of the paired Bluetooth device in its memory. Afterwards, each time the screen device is powered on, it scans for the corresponding Bluetooth device based on the stored pairing information. Upon finding the device, the screen device sends a pairing request and, upon receiving a response message, establishes a Bluetooth connection. Alternatively, if the screen is powered off and the Bluetooth remote disconnects from it, the screen will wait for the Bluetooth device to reconnect upon powering on again. The Bluetooth device will then automatically reconnect to the screen when it receives another button press. After receiving a button operation, the Bluetooth device sends the corresponding control signal to the Bluetooth short-range module of the screen device via Bluetooth connection. The Bluetooth short-range module of the screen device receives the control signal corresponding to the button operation and sends it to the host of the screen device. The host of the screen device converts the control signal corresponding to the button operation into a system button DOWN / UP event and key value, and then sends it to the interface module to realize the control of the user interface.
[0114] Because each screen device in the screen group actively scans for Bluetooth devices, they have already connected to their respective Bluetooth devices before forming the screen group, such as... Figure 2 As shown, screen device A is connected to Bluetooth device 1, screen device B is connected to Bluetooth device 2, screen device C is connected to Bluetooth device 3, and screen device D is connected to Bluetooth device 4.
[0115] When screen devices A, B, C, and D are spliced together to form a screen group, a network connection is first established between the screen devices based on the screen device discovery protocol. Then, a cross-device screen group splicing management service is established based on this network connection. Finally, the screen group splicing management service of the master control device creates a control information table for the combined screens, including the number of screens, identifier ID, master / slave flag, location information, and Bluetooth device pairing information. For example... Figure 2 As shown, screen device A is the main control device of the screen group, while screen devices B, C, and D are auxiliary devices (also known as slave devices). During the operation of the screen group system, screen device A generates a control information table (see Tables 1 to 3 below) based on the basic information of the combined screens maintained by the screen group splicing management service, and realizes the display layout of the screen output, interface focus switching, browsing, operation control, etc. based on Bluetooth device input.
[0116] When screen splicing relationships change, such as when new screen devices are added to a screen group or when some screen devices are removed from a combined screen, the main control device's screen group splicing management service maintains and refreshes the basic information of the combined screens and switches Bluetooth device control connections. In scenarios where the system switches main control devices, the original main control device's screen group splicing management service disconnects itself from its paired Bluetooth devices and notifies the new main control device of the pairing information of the Bluetooth devices currently controlling the screen group. The new main control device's screen group splicing management service then controls the entire screen group. The new main control device pairs with the Bluetooth devices in the current screen group based on their pairing information, refreshes and saves the control information table, and can receive control signals from the Bluetooth devices in the current screen group, thus controlling the screen group. After some screen devices are removed from the screen group, the control information table is refreshed, the control mode is changed to independent control, and a reconnection scan is initiated during power-on and screen-on events, reconnecting to Bluetooth devices in the saved Bluetooth MAC whitelist. A many-to-many Bluetooth connection is established between independent screen devices and Bluetooth devices. When a Bluetooth device receives a button operation, it sends the corresponding control signal to multiple independent screen devices. Each screen device detects the distance and angle between its own Bluetooth signal and the Bluetooth device's signal, and submits these measurements to the screen group control service for comparison. The screen with the closest distance and near-right angle is selected as the receiving screen. Simultaneously, prompts for controlling and pairing the Bluetooth device are displayed on the corresponding screen, and the pairing information is recorded as instructed.
[0117] The following section provides a detailed introduction to screen clusters using specific examples.
[0118] Figure 3 A schematic diagram of yet another communication system provided in an embodiment of this application is shown. For example... Figure 3As shown, the communication system includes a screen group consisting of screen A, screen B and screen C, and a Bluetooth device 1 paired with screen A, a Bluetooth device 2 paired with screen B and a Bluetooth device 3 paired with screen C. These three Bluetooth remote controls can be used as shared Bluetooth devices within the screen group.
[0119] The various screen devices within a screen cluster can share device information, such as information about the screen device itself and the Bluetooth device paired with it. There are several ways to share this information, and two possible implementation methods are provided below.
[0120] One possible implementation is, such as Figure 3 As shown, screens A, B, and C within the screen group exchange device information with each other.
[0121] In another implementation, screens A, B, and C can negotiate to determine one screen as the master control device of the screen group. For example, screen B acts as the master control device of the screen group, receiving device information sent by each auxiliary device (screen A and screen C) and then sharing it with all auxiliary devices.
[0122] For example, a specific negotiation method could be to compare screens based on factors such as central processing unit (CPU) and random access memory (RAM) using a weighted scoring system to select the screen with the best resources from the screen group as the master control device. If the master control device is powered off, then a screen with the best resources from the other screen devices in the screen group would be negotiated to become the master control device for the screen group. For example, such as... Figure 3 As shown, screens A, B, and C negotiate with each other to determine that screen B is the main control device, while screens A and C are auxiliary screens. Users can operate a Bluetooth remote control paired with the main control device of the screen group, that is, operate Bluetooth remote control 2 paired with screen B, to control and manage information of each screen in the screen group.
[0123] After determining the master control device for the screen group, the master control device can manage the information of all screens and Bluetooth remote controls in the group, save the control information table, and share it with the auxiliary screens in the group. For example, the content of the control information table may include the screen list Screen A, Screen B, and Screen C. Another example is the Bluetooth remote control MAC list: MAC1, MAC2, and MAC3. Yet another example is that screen B can obtain the pairing information between screen A and Bluetooth remote control 1 (Screen A: MAC1), and also obtain the pairing information between screen C and Bluetooth remote control 2 (Screen C: MAC3). Therefore, the control information table may include a mapping table (RcuScreenMap) between the remote control and the screen: Screen A: MAC1, Screen B: MAC2, Screen C: MAC3. This control information table can also contain any combination of the above-mentioned contents.
[0124] In addition, the main control device of the screen cluster can update its own stored control information table, and after updating the control information table, synchronize the updated control information table to each auxiliary screen in the screen cluster. For example, the control information table can be found in Table 1 below:
[0125] Table 1
[0126]
[0127]
[0128] Based on the above, the following describes screen control methods, which can specifically include three scenarios:
[0129] Scenario 1: Multiple screen devices are spliced together to form a combined screen (i.e., a screen group).
[0130] Scenario 2: Adding a new screen device during the use of the screen group.
[0131] Scenario 3: The screen assembly is split into multiple independent screen devices during use.
[0132] The three scenarios described above will be described below.
[0133] Scenario 1: For a scenario where multiple screen devices are spliced together to form a combined screen, taking a scenario that includes three screen devices and three Bluetooth devices as an example, this section introduces the screen control process from using multiple screen devices independently to splicing them together to form a combined screen.
[0134] For example, Figure 4 This illustration shows an exemplary scenario to which the control method for a multi-screen device provided in this application is applicable. Figure 4In this setup, screens A, B, and C within the same screen group are each connected to their paired Bluetooth devices. Specifically, screen A is connected to Bluetooth device 1, screen B to Bluetooth device 2, and screen C to Bluetooth device 3. When a user moves two screen devices (e.g., screens B and C) together to create a combined screen, screen A remains an independent screen, while screens B and C form the first screen group. The individual screen devices within this first group can negotiate to determine one screen as the master control device, with the others serving as auxiliary screens. The negotiation method for the master control device of the screen group can be referenced from the discussion of master control device negotiation methods for screen groups mentioned above, and will not be repeated here.
[0135] After determining the master control device for the screen group, the master control device can manage information about all screen devices in the screen group and the information about the Bluetooth devices paired with each screen device. It also shares the device information corresponding to the screen group and the information about the Bluetooth devices paired with each screen device with the auxiliary screens in the screen group. In this embodiment, the master control device of the screen group is connected to all Bluetooth devices corresponding to the screen group. Users can operate any one of the Bluetooth devices corresponding to the screen group. For example, if screen B is the master control device of the screen group and screen C is an auxiliary screen, then operating Bluetooth devices 2 and 3 allows for control and information management of each screen in the screen group.
[0136] It should be noted that the main control device of the screen group and the main control device of the screen cluster can be the same screen device, for example, both are screen B. The main control device of the screen group and the main control device of the screen cluster can also be different screen devices, for example, the main control device of the screen cluster is screen A, and the main control device of the screen group is screen B.
[0137] The following example, using a group of three screen devices, illustrates the control methods for multi-screen devices.
[0138] Please see Figure 5 This is one of the flowcharts for a control method of a multi-screen device provided in the embodiments of this application. Figure 5 The example shown can be applied to Figure 4 In the scenario shown, Figure 5 In the example shown, the first screen device can be screen B, the second screen device can be screen C, and the third screen device can be screen A. Specifically, the process of this example may include the following steps:
[0139] S501, enable Bluetooth on the first screen device.
[0140] The following describes the specific implementation of enabling Bluetooth on the first screen device.
[0141] When the first screen device is used for the first time, it can be turned on by responding to the operation of the power button on the first screen device. After the first screen device is turned on, each module of the first screen device is in working state. For example, if the Bluetooth short-range module is in working state, the first screen device will enable the Bluetooth function.
[0142] In some embodiments, after the Bluetooth function of the first screen device is enabled, it can enter a Bluetooth scanning state, and the host of the screen device scans for available devices in the vicinity via a Bluetooth short-range module. In some embodiments, a specific broadcast, including a broadcast of the Bluetooth address of the Bluetooth remote control, can also be sent to connect to a paired Bluetooth device. In other embodiments, the Bluetooth device can also be triggered to actively establish a connection with the screen device via a button on the Bluetooth device.
[0143] S502, enable Bluetooth on the second screen device.
[0144] The S503 also enables Bluetooth functionality on the third screen device.
[0145] For details on enabling Bluetooth on the second and third screen devices, please refer to the relevant introduction on enabling Bluetooth on the first screen device in S501.
[0146] S504, the first screen device establishes a Bluetooth connection with the accompanying first Bluetooth device.
[0147] The following describes the specific implementation of establishing a Bluetooth connection between the first screen device and the first Bluetooth device.
[0148] If the first screen device periodically broadcasts Bluetooth information, then when the first Bluetooth device powers on and receives the Bluetooth information, it can send a pairing request to the first screen device based on the Bluetooth information. After receiving the pairing request, the first screen device can return a pairing success response message to the first Bluetooth device, thus the Bluetooth short-range module in the first screen device and the Bluetooth short-range module in the first Bluetooth device are successfully paired, thereby establishing a Bluetooth connection.
[0149] Alternatively, the first Bluetooth device can periodically broadcast Bluetooth information after powering on. When the Bluetooth function of the first screen device is enabled, the first screen device periodically scans for Bluetooth information. If the first screen device scans for the Bluetooth information broadcast by the first Bluetooth device, it can send a pairing request to the first Bluetooth device. After receiving the pairing request, the first Bluetooth device can return a pairing success response message to the first screen device. Thus, the Bluetooth short-range module in the first screen device and the Bluetooth short-range module of the first Bluetooth device are successfully paired, thereby establishing a Bluetooth connection.
[0150] In the initial connection scenario between the first screen device and its paired first Bluetooth device, the first Bluetooth device may have pre-installed identification information of the screen device, such as its MAC address, name, or unique identifier. After powering on, the Bluetooth device can directly page the first screen device based on the pre-installed identifier to quickly establish a Bluetooth connection. In other embodiments, pairing between the first screen device and the Bluetooth device can also employ a proximity discovery method. That is, when the distance between the first screen device and the Bluetooth device is less than a first threshold, or when the received signal strength indication (RSSI) value is greater than or equal to a preset threshold, a prompt message can be displayed on the first screen device's screen. This prompt message indicates whether to establish a Bluetooth connection with the first Bluetooth device. Figure 6 As shown, the prompt message can be displayed as a pop-up on the screen of the first screen device. This pop-up can also include yes and no controls. The first screen device receives user input for different controls via the first Bluetooth device, and can respond to different actions. For example, when the first Bluetooth device receives a user selecting "yes" using the directional buttons and the "OK" button on the remote control, the first screen device sends a pairing request to the first Bluetooth device to establish a Bluetooth connection. If the user selects "no," the first screen device does not trigger the pairing process with the first Bluetooth device.
[0151] When the screen device is used for the first time, its main unit pairs with a Bluetooth device via a short-range Bluetooth module. During the pairing process, the screen device stores a whitelist of the paired Bluetooth device's Bluetooth MAC address, and the Bluetooth device stores a whitelist of the paired screen device's Bluetooth MAC address. This ensures that the screen device and the Bluetooth device maintain their pairing relationship and can reconnect after a disconnection. When the screen device is powered on again, it can scan for Bluetooth devices based on the stored whitelist information and reconnect to establish a wireless signal connection with the Bluetooth device.
[0152] S505: The second screen device establishes a Bluetooth connection with the accompanying second Bluetooth device.
[0153] S506: The third screen device establishes a Bluetooth connection with the accompanying third Bluetooth device.
[0154] For details on how the second and third screen devices establish Bluetooth connections with their respective Bluetooth devices, please refer to the relevant introduction on establishing Bluetooth connections between the first screen device and its corresponding first Bluetooth device in S504.
[0155] After establishing Bluetooth connections between each screen device and each Bluetooth device, data exchange can be performed via Bluetooth. Upon receiving a button operation, the Bluetooth device sends the corresponding control signal to the screen device via Bluetooth. The screen device's Bluetooth short-range module receives the control signal, converts it into a system button DOWN / UP event and key value, and then sends it to the interface module to control the interface.
[0156] In S507, the first screen device, the second screen device, and the third screen device discover each other, establish network connections between each other, form a screen group, and share device information and pairing relationships among the screen devices in the screen group.
[0157] The device information includes information about the screen device and information about the Bluetooth device paired with the screen device. The pairing relationship includes the pairing relationship between the screen device and the Bluetooth device.
[0158] The following example illustrates the specific implementation of mutual discovery between screen devices, using the first screen device discovering the second screen device as an example.
[0159] In some embodiments, the first screen device may discover the second screen device using a short-range proximity detection method. That is, the first screen device discovers the second screen device when it determines that the distance between itself and the second screen device is less than a first threshold, or when the first screen device detects that the RSSI value of a Bluetooth broadcast sent by the second screen device is greater than or equal to a preset threshold. Correspondingly, the second screen device may also discover the first screen device using a proximity detection method.
[0160] In other embodiments, the first screen device can send a Bluetooth broadcast, and after receiving the Bluetooth broadcast, the second screen device sends a response message to the first screen device. Upon receiving the response message from the second screen device, the first screen device has discovered the second screen device. Similarly, the second screen device can also send a Bluetooth broadcast, and after receiving the Bluetooth broadcast from the second screen device, the first screen device sends a response message to the second screen device. Upon receiving the response message, the second screen device has discovered the first screen device.
[0161] After discovering other nearby screen devices, each screen device can create a list of nearby devices. Once the screen devices discover each other, any two screen devices can establish a network connection, thus forming a screen group. Taking the establishment of a network connection between the first and second screen devices as an example, the process is as follows: First, the first screen device sends a connection request to the second screen device. This connection request includes the first screen device's identifier. After receiving the connection request, the second screen device sends a connection response to the first screen device. This connection response includes the second screen device's identifier. Upon receiving the connection response from the second screen device, the first screen device completes the establishment of a network connection with the second screen device.
[0162] In S507, there are several possible ways to share device information and establish pairing relationships among various screen devices in a screen group.
[0163] In one possible implementation, the screen devices in the screen group can exchange device information and pairing relationships with each other. Taking the exchange of device information and pairing relationships between the first screen device and the second screen device as an example, the second screen device sends the identifier of the second screen device, the identifier of the second Bluetooth device, and the pairing relationship between the second screen device and the second Bluetooth device to the first screen device. Correspondingly, the first screen device can send the identifier of the first screen device, the identifier of the first Bluetooth device, and the pairing relationship between the first screen device and the first Bluetooth device to the second screen device.
[0164] In another possible implementation, after the first screen device, the second screen device, and the third screen device form a screen group, the master control device of the screen group is determined. Then, the master control device of the screen group receives the device information and pairing relationship sent by each auxiliary device, and then shares it with each auxiliary device in a unified manner. Taking the first screen device as the main control device of the screen group, and the second and third screen devices as auxiliary screens as an example, the first screen device, as the main control device of the screen group, can receive the identifier of the second screen device, the identifier of the second Bluetooth device, and the pairing relationship between the second screen device and the second Bluetooth device sent by the second screen device, and also receive the identifier of the third screen device, the identifier of the third Bluetooth device, and the pairing relationship between the third screen device and the third Bluetooth device sent by the third screen device. Then, the first screen device sends the identifier of the first screen device, the identifier of the first Bluetooth device, and the pairing relationship between the first screen device and the first Bluetooth device, the identifier of the third screen device, the identifier of the third Bluetooth device, and the pairing relationship between the third screen device and the third Bluetooth device to the second screen device. The first screen device sends the identifier of the first screen device, the identifier of the first Bluetooth device, and the pairing relationship between the first screen device and the first Bluetooth device, the identifier of the second screen device, the identifier of the second Bluetooth device, and the pairing relationship between the second screen device and the second Bluetooth device to the third screen device.
[0165] The following example, using two screen devices (i.e., the first screen device and the second screen device) in a screen group, illustrates the control method for multiple screen devices.
[0166] Please see Figure 7 This is a second flowchart of a control method for a multi-screen device provided in an embodiment of this application. Figure 7 The example shown can be applied to Figure 4 In the scenario shown, Figure 7 In the example shown, the first screen device can be screen B, and the second screen device can be screen C. Specifically, the process of this example may include the following steps:
[0167] S701, the second screen device detects a first screen combination operation for the first screen device and the second screen device, and in response to the first screen combination operation, forms a first screen group with the first screen device.
[0168] In one example, the first screen combination operation can be an operation triggered by the user to physically connect the first screen device and the second screen device. The first screen device can detect the first screen combination operation by detecting it based on short-distance proximity. For example, if the first screen device detects that the distance between itself and the second screen device is less than or equal to a second threshold, it determines to trigger the screen combination operation, and the first screen device and the second screen device form the first screen group.
[0169] In some other embodiments, the first screen combination operation can be a user's key operation. For example, the screen device receives a key operation for the screen device, and in response to the key operation, the first screen device and the second screen device form a screen group.
[0170] In this example, the screen group includes a single screen and a screen set, namely a third screen device and a first screen set. The first screen set includes two screen devices, namely a first screen device and a second screen device. In other embodiments, a screen group may also include multiple screen sets, and a screen set may also include multiple screen devices.
[0171] S702, the first screen device and the second screen device negotiate and determine that the first screen device is the master control device of the first screen group.
[0172] In one possible implementation, the first screen device and the second screen device negotiate to determine the master control device of the first screen group. This can be done by comparing factors such as central processing unit (CPU) and random access memory (RAM) through weighted scoring, and selecting the screen device with the best resources from the first screen group as the master control device. For example, in S702, the first screen device is the screen device with the best resources in the first screen group, thus determining the first screen device as the master control device of the first screen group.
[0173] In other embodiments, after the first screen device and the second screen device form a screen group, the master control device of the screen group can be determined through negotiation. For example, if the master control device of the screen group is the first screen device, it means that the first screen device is the screen device with the best resources among the first screen device and the second screen device. Therefore, in the first screen group formed by the first screen device and the second screen device in S701, the first screen device is also the screen device with the best resources in the first screen group. Therefore, after forming the first screen group, there is no need to negotiate again, and the first screen device can be determined as the master control device of the first screen group. As another example, if the master control device of the screen group is the third screen device, then after the first screen device and the second screen device form the first screen group, it is necessary to re-negotiate to determine the master screen of the first screen group. The specific negotiation method can be found in the method for determining the master control device of the first screen group in S702 above, which will not be repeated here.
[0174] In this embodiment of the application, if the screen device periodically broadcasts Bluetooth information, then S504 to S506 can also be executed after S702. That is, after the first screen device and the second screen device determine the master control device, the first screen device establishes a Bluetooth connection with the first Bluetooth device, and the second screen device establishes a Bluetooth connection with the second Bluetooth device.
[0175] S703, the first screen device sends a first instruction message to the second screen device, wherein the first instruction message is used to instruct the second screen device to disconnect the Bluetooth connection with the second Bluetooth device.
[0176] S704, the second screen device disconnects from the second Bluetooth device via Bluetooth.
[0177] In S701, the second screen device can send a request to release the Bluetooth connection to the second Bluetooth device. After receiving the request, the second Bluetooth device sends a response to release the Bluetooth connection to the second screen device. Upon receiving the response, the second screen device disconnects from the second Bluetooth device. In this embodiment, disconnecting the Bluetooth connection can also be understood as releasing the Bluetooth connection, which will not be elaborated further below. For example, in S704, disconnecting the Bluetooth connection between the second screen device and the second Bluetooth device can also be replaced by the second screen device releasing the Bluetooth connection between itself and the second Bluetooth device.
[0178] S705: The first screen device establishes a Bluetooth connection with the second Bluetooth device.
[0179] The S705 first screen device scans for nearby Bluetooth devices, and after discovering a second Bluetooth device, establishes a Bluetooth connection with the second Bluetooth device.
[0180] The following is combined Figure 4 Taking screen B as the first screen device and screen C as the second screen device as an example, this paper explains the Bluetooth device management method in the process of screen B and screen C forming the first screen group.
[0181] like Figure 4 As shown, screen B is connected to remote control 2, and screen C is connected to remote control 3. During the process of assembling screen B and screen C into the first screen group, screen B reads the first screen group list (Screen_B, Screen_C) from the control information table (Table 1 above), and selects the auxiliary screen from the list. In this example, there is only one auxiliary screen in the first screen group, namely screen C (Screen_C). Then, it looks up the MAC address of the remote control corresponding to the auxiliary screen from the remote control screen mapping table in Table 1. From the found Screen C:MAC3, it can be seen that the MAC address corresponding to screen C is MAC3. Screen B controls screen C to disconnect the Bluetooth connection with remote control 3 based on MAC3, and simultaneously notifies remote control 3 to enter the scanning and receiving state. Then, screen B's Bluetooth short-range module actively pairs with remote control 3 and establishes a Bluetooth connection. At this time, as... Figure 4 As shown, screen B is connected to both remote controller 2 and remote controller 3. Afterwards, screen B refreshes the connection mapping table, changing "A:1,B:2,C:3" in Table 1 to "A:1,B:2&3". Therefore, the control information table shown in Table 1 can be updated to Table 2 as follows:
[0182] Table 2
[0183]
[0184] Then, screen B synchronizes the above table 2 to the other screen devices in the first screen group, that is, it is synchronously saved in screen C of the first screen group.
[0185] After the first screen device establishes a Bluetooth connection with the second Bluetooth device, the first screen device has established Bluetooth connections with both the first and second Bluetooth devices. The user can operate either the first or the second Bluetooth device to control the main control device, i.e., control the first screen device, thereby controlling the first screen group.
[0186] The following description uses the operation of a second Bluetooth device as an example; see S706 to S704.
[0187] S706, the second Bluetooth device detected the user's key press operation.
[0188] The second Bluetooth device has many buttons, and users can press different buttons to trigger different control signals.
[0189] S707, the second Bluetooth device sends a first control signal to the first screen device.
[0190] In one possible implementation, the first control signal is used to operate the playback content of the first screen group. For example, it can be used to click to play the content, adjust the playback speed (e.g., from 1x to 2x), switch from one video source to another, or change the channel logo. In this implementation, after receiving the first control signal, the Bluetooth short-range module of the first screen device sends it to the host of the first screen device. The host of the first screen device processes the playback content based on the first control signal and then sends the processed content to the auxiliary device via multicast or broadcast. It also sends a first control command to the second screen device so that the auxiliary device can display the processed content. The following describes the subsequent control process using the first control signal to open the content to be displayed, in conjunction with steps S708 to S518.
[0191] S708, the first screen device divides the content to be displayed into a first part and a second part according to the first control signal.
[0192] S709, the first screen device sends a first control instruction to the second screen device, the first control instruction including a second part of the content to be displayed.
[0193] In S709, the host of the first screen device sends a first control command to the second screen device via a Bluetooth short-range module, and the Bluetooth short-range module of the second screen device receives the first control command.
[0194] S710, the first screen device displays the first part of the content to be displayed.
[0195] S711, the second screen device displays the second part of the content to be displayed.
[0196] For example, if a user selects an image using a second Bluetooth device, the second Bluetooth device, in response to clicking the play button, sends a control signal to the first screen device to instruct the image to be played. The first screen device then sends a control command to the second screen device to instruct the display of a second portion of the image. The first screen device displays the first portion of the image on a first interface, and the second screen device displays the second portion of the image on a second interface.
[0197] The above Figure 7 The example shown illustrates how a user operates a second Bluetooth device to control the first screen group. In other embodiments, since the first screen device establishes Bluetooth connections with both the first and second Bluetooth devices, the user can also operate the first Bluetooth device to control the first screen device. That is, S706 can be replaced by: the first Bluetooth device detecting a user's button press; then S707 can be replaced by: the first Bluetooth device sending a first control signal to the first screen device. Subsequent steps are the same as S708 to S711 and will not be repeated here. Thus, when a user wants to display content on the first screen group composed of the first and second screen devices, picking up the first Bluetooth device also allows control of the main control device, thereby enabling control of other auxiliary screens in the entire first screen group.
[0198] In the above S702, the first screen device and the second screen device automatically negotiate the master control device. The user is unaware of the negotiation process, that is, the user does not know which screen device in the first screen group is the master control device. In this embodiment, by disconnecting all auxiliary devices from their paired Bluetooth devices, the master control device establishes Bluetooth connections with all Bluetooth devices corresponding to the first screen group. In this way, all Bluetooth devices corresponding to the first screen group can control the master control device. When it is necessary to control the first screen group, it is not necessary to find the Bluetooth device that is paired with the master control device. Therefore, even if the user does not know which screen device is the master control device, he / she can pick up any Bluetooth device and control the master control device, thereby controlling the first screen group.
[0199] In this application embodiment, there are multiple ways to determine the master control device of the first screen group. The above embodiment is an example of the method of automatic negotiation between the first screen device and the second screen device to determine the master control device. In other embodiments, before the first screen device and the second screen device form the first screen group, the user can set the independent first screen device as the master control device. Then, when the first screen device forms a screen group with any other screen device, the first screen device can determine the identifier of the master control device from the configuration information stored in its own storage. After that, it can notify other screen devices that it is the master control device. For example, in the process of the first screen device and the second screen device forming the first screen group, if the first screen device is determined to be the master control device, the Bluetooth device paired with the first screen device can be directly operated to control the first screen group.
[0200] Figure 7 The example shown illustrates a first screen group composed of two screen devices. In other embodiments, more screen devices can discover each other to form a screen group. For example, when at least three screen devices are spliced together to form a second screen group, after the master control device in the screen group is identified, the other auxiliary devices disconnect their paired Bluetooth devices. Then, the second screen group dynamically switches the connection between the master control device and the shared Bluetooth device based on the information of the shared Bluetooth device. That is, the master control device of the second screen group establishes a Bluetooth connection with the Bluetooth devices paired with all the auxiliary devices. In this way, the user can control the master control device by operating any Bluetooth device corresponding to the second screen group, thereby enabling the master control device to control other auxiliary devices.
[0201] In some other embodiments, the second Bluetooth device detects a user's key press and sends a second control signal to the first screen device. This second control signal is used to control the individual screen devices within the first screen group, such as adjusting volume, adjusting brightness, switching video sources, or fast-forwarding. After receiving the second control signal, the Bluetooth short-range module of the first screen device sends it to the host device. The host device generates a second control command corresponding to the second control signal based on the first control signal, and then sends the second control command to the auxiliary screen via the Bluetooth short-range module, so that the auxiliary screen can perform the corresponding operation. The following example uses the first control signal to adjust volume. Figure 8 The subsequent control process will be described.
[0202] Please see Figure 8 This is the third flowchart of the control method for a multi-screen device provided in the embodiments of this application. Figure 8 The example shown can be applied to Figure 4 In the scenario shown, Figure 8In the example shown, the first screen device can be screen B, and the second screen device can be screen C. Specifically, the process of this example may include the following steps:
[0203] The processes involved in S801 to S806 are the same as those involved in S701 to S706, and will not be repeated here.
[0204] S807, the second Bluetooth device sends a second control signal to the first screen device. This second control signal is used to adjust the volume of the first screen device.
[0205] S808, the first screen device generates a second control command based on the second control signal.
[0206] S809, the first screen device sends a second control command to the second screen device, the second control command being used to instruct the second screen device to adjust the volume.
[0207] In S809, the host of the first screen device sends the second control command to the second screen device through the Bluetooth short-range module, and the Bluetooth short-range module of the second screen device receives the second control command.
[0208] In the S810, the first screen device adjusts its own volume according to the second control signal.
[0209] S811, the second screen device adjusts its own volume according to the second control command.
[0210] For example, Figure 9 This illustration shows another exemplary scenario to which the control method for a multi-screen device provided in this application is applicable. Figure 9 In this setup, screens A, B, and C within the same screen group are each connected to paired Bluetooth devices. Specifically, screen A is connected to Bluetooth device 1, screen B to Bluetooth device 2, and screen C to Bluetooth device 3. Figure 4 The scenario shown differs in that after screens B and C form the first screen group, the pairing relationships between each screen within the first screen group and its paired Bluetooth device remain unchanged. That is, the Bluetooth connection between screen B and Bluetooth device 2 is maintained, as is the Bluetooth connection between screen C and Bluetooth device 3. Control signals from Bluetooth device 2 are directly input to the host device B and converted into inputs for controlling the first screen group system. Control signals from Bluetooth device 3 are first input to the host device C. The host device C converts the received control signals into control commands and sends them to the host device B via the network, thus controlling the first screen group system.
[0211] Based on the above, please refer to Figure 10 This is the fourth flowchart of the control method for a multi-screen device provided in the embodiments of this application. Figure 10 The example shown can be applied to Figure 9 In the scenario shown, Figure 10 In the example shown, the first screen device can be screen B, the second screen device can be screen C, and the third screen device can be screen A. Specifically, the process of this example may include the following steps:
[0212] The processes involved in S1001 to S1002 are the same as those involved in S701 to S702, and will not be repeated here.
[0213] S1003, the first screen device sends a second instruction information to the second screen device, the second instruction information being used to instruct the second screen device to forward the control signal to the first screen device when it receives the control signal.
[0214] S1004, the second Bluetooth device detected the user's key press operation.
[0215] S1005, the second Bluetooth device sends a first control signal to the second screen device, the first control signal being used to instruct the opening of the content to be displayed.
[0216] S1006, the second screen device sends a first control signal to the first screen device.
[0217] After S1006, the processes involved in S1007 to S1010 are the same as those involved in S708 to S711, and will not be repeated here.
[0218] In some other embodiments, if the first control signal is used to adjust the volume, the process involved in S1007 to S1010 is the same as that involved in S808-S811, and will not be described again here.
[0219] In this embodiment, after the first screen device and the second screen device form the first screen group, the Bluetooth connection between all auxiliary devices and their paired Bluetooth devices is maintained. The main control device does not establish a connection with the paired Bluetooth devices of the auxiliary devices. That is, each screen device in the first screen group continues to maintain the Bluetooth connection with its original paired Bluetooth device. After receiving the control signal, the auxiliary screen forwards it to the main control device through the network connection. The host of the main control device receives the input button DOWN / UP events and key values of the Bluetooth devices forwarded by all auxiliary screen hosts, and uniformly realizes the interface control of the screen group system.
[0220] In this example, the user can control the main control device by operating a Bluetooth device paired with it. Alternatively, the user can control the auxiliary device by operating a Bluetooth device paired with it. The auxiliary device then sends control commands to the main control device via the internal network of the first screen group system, thus controlling the main control device. This allows for control of the first screen group via any remote control, without the need for additional hardware devices or modules, relying solely on the first screen group system itself.
[0221] Scenario 2: During the use of the first screen group consisting of the first screen device and the second screen device, if the user wants to use a larger screen, a third screen device can be added to the first screen group. Based on the above... Figure 4 The scene shown Figure 11 This illustration shows yet another exemplary scenario to which the control method for a multi-screen device provided in this application is applicable. Figure 11 The system comprises a group of screens, including screens A, B, and C. Screens B and C form the first screen group. Screen A is connected to Bluetooth device 1, and screen B is connected to Bluetooth devices 2 and 3. A new screen D is added to this screen group, and screen D is connected to Bluetooth device 4.
[0222] When the user moves screen D to the vicinity of the first screen group and combines it with the first screen group to form a larger combined screen, the first screen group and screen D form the second screen group. The various screen devices included in the second screen group can negotiate with each other to determine one screen as the master control device of the second screen group, and the other screens as auxiliary screens. The negotiation method of the master control device of the second screen group can refer to the negotiation method of the master control device of the first screen group mentioned above, and will not be repeated here.
[0223] After determining the master control device for the second screen group, the master control device can update the control information table based on the MAC address of the remote control corresponding to screen D (MAC4), the pairing mapping relationship between screen D and the Bluetooth remote control (Screen D:MAC4), and the connection mapping relationship of the screen group (B:2&3&4). Specifically, the master control device (screen D) can update the control information table of the screen group shown in Table 2 above to the following Table 3:
[0224] Table 3
[0225]
[0226] Then, the main control device (screen D) synchronously saves Table 3 to the screen group system, that is, it is distributed and saved in each screen device of the second screen group.
[0227] Based on the above, please refer to Figure 12 This is the fifth flowchart of the control method for a multi-screen device provided in the embodiments of this application. Figure 12The example shown can be applied to Figure 11 In the scenario shown, Figure 11 In the example shown, the first screen device can be screen B, the second screen device can be screen C, and the third screen device can be screen D. Specifically, the process of this example may include the following steps:
[0228] S1201, Bluetooth function is enabled on the third screen device.
[0229] S1202, the third screen device establishes a Bluetooth connection with the matching third Bluetooth device.
[0230] S1203, the first screen device, the second screen device, and the third screen device discover each other, establish network connections between each other, form a screen group, and share device information and pairing relationships among the screen devices in the screen group.
[0231] The device information includes information about the screen device and information about the Bluetooth device paired with the screen device. The pairing relationship includes the pairing relationship between the screen device and the Bluetooth device.
[0232] The screen group includes a first screen group, which includes a first screen device and a second screen device.
[0233] The first screen device receives the identifier of the third screen device, the identifier of the third Bluetooth device, and the pairing relationship between the third screen device and the third Bluetooth device. It can then add the identifier of the third screen device, the identifier of the third Bluetooth device, and the pairing relationship between the third screen device and the third Bluetooth device to the remote control Bluetooth MAC list of the screen group, so that the main control device can pair and connect with the newly added Bluetooth device paired with the third screen device.
[0234] S1204, the third screen device detects the second screen combination operation, and in response to the second screen combination operation, forms a second screen group with the third screen device.
[0235] S1205, the various screen devices in the second screen group negotiate and determine that the first screen device is the main control device of the second screen group.
[0236] S1206, the first screen device sends a second instruction message to the third screen device, wherein the second instruction message is used to instruct the third screen device to disconnect the Bluetooth connection with the third Bluetooth device.
[0237] S1207, the third screen device disconnects from the third Bluetooth device via Bluetooth.
[0238] S1208, the first screen device establishes a Bluetooth connection with the third Bluetooth device.
[0239] After the first screen device establishes a Bluetooth connection with the third Bluetooth device, the first screen device has established Bluetooth connections with the first Bluetooth device, the second Bluetooth device, and the third Bluetooth device respectively. The user can operate any one of the first Bluetooth device, the second Bluetooth device, and the third Bluetooth device to control the main control device, that is, control the first screen device, thereby controlling the second screen group.
[0240] The following section uses the operation of a third Bluetooth device as an example to introduce the subsequent control process.
[0241] S1209, The third Bluetooth device detected the user's key press operation.
[0242] S1210, the third Bluetooth device sends a second control signal to the first screen device.
[0243] S1211, the first screen device divides the content to be displayed into a first part, a second part, and a third part according to the first control signal.
[0244] S1212, the first screen device sends a third control command to the third screen device.
[0245] S1213, the first screen device sends a fourth control command to the second screen device.
[0246] S1214, The first screen device displays the first part of the content to be displayed.
[0247] S1215, the second screen device displays the second part of the content to be displayed.
[0248] S1216, The third screen device displays the third part of the content to be displayed.
[0249] It should be noted that the processes involved in S1201-S1216 are similar to those involved in S501-S507 and S701-S711. For the sake of brevity, in Figure 12 The specific processes of S1201-S1216 will no longer be shown one by one. Figure 12 This only provides a general example; please refer to examples in S501-S507 and S701-S711.
[0250] Scenario 3: During the use of the second screen group consisting of the first screen device, the second screen device, and the third screen device, the user can also separate the screen devices in the second screen group so that one or more of the screen devices can be used independently.
[0251] The following describes a scenario of removing a screen device.
[0252] Figure 13AThis illustration shows another exemplary scenario to which the control method for a multi-screen device provided in this application is applicable. For example... Figure 13A As shown, in the same screen group, there are screens A, B, C, and D. Screen A is an independent screen. In the second screen group composed of screens B, D, and C, screen B is the main control device. Screen B has established Bluetooth connections with Bluetooth remote controllers 2, 3, and 4 respectively.
[0253] If the equipment being removed is auxiliary equipment, such as Figure 13A As shown, when screen C is removed, screen B detects the removal operation and sends a removal command to screen C to notify it to be removed. When the user holds any of the three Bluetooth remote controls (2, 3, or 4), they can control the screen C to be removed. Taking Bluetooth remote control 3 as an example, Bluetooth remote control 3 detects the user's button operation and sends a control signal to screen B. After receiving the control signal, screen B sends an instruction message to screen C, instructing screen C to establish a connection with Bluetooth remote control 3. Simultaneously, screen B disconnects from Bluetooth remote control 3.
[0254] In some other embodiments, if the main control device, i.e., screen B, is removed, then when the user operates any of the Bluetooth remote controls 2, 3, or 4, for example, by pressing a button on Bluetooth remote control 2, screen B receives the control signal from Bluetooth remote control 2. Screen B directly binds to Bluetooth remote control 2 and disconnects from Bluetooth remote control 3 and 4, thereby enabling the user's handheld Bluetooth device to directly control the removed main control device. The remaining screens C and D in the second screen group renegotiate the main control screen; subsequent processes can be found in steps 702 to 711.
[0255] The following describes a scenario where multiple screen devices are removed, using the removal of two screen devices as an example.
[0256] Figure 13B This illustration shows another exemplary scenario to which the control method for a multi-screen device provided in this application is applicable. For example... Figure 13B As shown, in the same screen group, there are screens A, B, C, and D. Screen A is an independent screen. In the second screen group composed of screens B, D, and C, screen B is the main control device. Screen B has established Bluetooth connections with Bluetooth remote controllers 2, 3, and 4 respectively.
[0257] If the two screen devices to be removed include a master device and a slave device, taking the removal of Screen B and Screen C as an example, Screen B detects the screen removal operation for Screen B and Screen C, and Screen B sends a screen removal instruction to Screen C to notify the removal of Screen C.
[0258] Screen C establishes Bluetooth connections with all the Bluetooth remote controls corresponding to the screen group (i.e., Bluetooth Remote Control 2, Bluetooth Remote Control 3, and Bluetooth Remote Control 4). When the user operates any one of the Bluetooth remote controls, such as when Bluetooth Remote Control 3 receives the user operation, in response to the user operation, Bluetooth Remote Control 3 sends control signals to Screen B and Screen C respectively, as Figure 13C shown. Screen B determines the distance d2 between Screen B and Bluetooth Remote Control 3 and the arrival angle β of the signal based on the received control signal. Among them, the distance d2 can be determined by the signal strength of the control signal sent by Screen B detecting Bluetooth Remote Control 3, and the determination method of the arrival angle β can be referred to the angle measurement principle shown in the following text Figure 16 shown. Screen C determines the distance d1 between Screen C and Bluetooth Remote Control 3 and the arrival angle α of the signal based on the received control signal. Among them, the distance d1 can be determined by the signal strength of the control signal sent by Screen C detecting Bluetooth Remote Control 3, and the determination method of the arrival angle α can be referred to the angle measurement principle shown in the following text Figure 16 shown. If the screen group system determines that ∠α > ∠β and d1 < d2, it determines that the target screen controlled by Bluetooth Remote Control 3 is Screen C. Then the screen group system controls Screen C to prompt a request to bind with Bluetooth Remote Control 3, as Figure 13C shown. The user can operate Bluetooth Remote Control 3 to select "yes", then the binding relationship is determined. Screen C disconnects the Bluetooth connections with Bluetooth Remote Control 2 and Bluetooth Remote Control 4, so that holding Bluetooth Remote Control 3 can realize the control of Screen C. Screen B continues to maintain the connections with Bluetooth Remote Control 2 and Bluetooth Remote Control 4 and disconnects the connection with Bluetooth Remote Control 3. The user can control Screen B by using any one of Bluetooth Remote Control 2 and Bluetooth Remote Control 4 to realize the control of the to-be-removed Screen B. The specific implementation method refers to the relevant description of the scenario of removing one master device above.
[0259] If the two screen devices to be removed are both slave devices, for example, removing Screen C and Screen D, both Screen C and Screen D are respectively connected to Bluetooth Remote Control 2, Bluetooth Remote Control 3, and Bluetooth Remote Control 4, and the control of the removed Screen C or D is realized by the user holding any one of Bluetooth Remote Control 2, Bluetooth Remote Control 3, and Bluetooth Remote Control 4, which will not be elaborated here.
[0260] The following introduces the screen control process in the Figure 13B scenario with specific examples.
[0261] Based on the above, please refer to Figure 13D This is the sixth flowchart of a multi-screen device control method provided in the embodiments of this application. Figure 13D The example shown can be applied to Figure 13A In the scenario shown, Figure 13D In the example shown, the first screen device can be screen B, the second screen device can be screen C, and the third screen device can be screen D. Specifically, the process of this example may include the following steps:
[0262] S1301, the first screen device detects a screen removal operation targeting both the first screen device and the second screen device.
[0263] In one possible implementation, the screen removal operation can be actively detected by the first screen device. For example, the first screen device detects the screen removal operation based on the detected distance between itself and other screen devices in the screen group exceeding a certain threshold. In this implementation, the main control device can detect the distance between itself and each auxiliary screen, and each screen device in a screen group can determine whether it has moved through its own sensors and share this information with other screen devices in the screen group, thereby determining which screen device needs to be removed. In one example, for instance, if the second screen device moves and the change in distance between the second screen device and other stationary screen devices exceeds a threshold, it is determined that the second screen device needs to be removed.
[0264] Another implementation method is for the user to actively send a screen removal operation, for example, by receiving a button operation from a first Bluetooth device or a second Bluetooth device, which triggers the removal of the second screen device.
[0265] S1302, the first screen device responds to the screen removal operation by sending a screen removal command to the second screen device.
[0266] In this embodiment of the application, after the second screen device is removed from the screen group, the first screen device and the second screen device are no longer in the same screen group, but are still in the same screen cluster and can still send information to each other.
[0267] S1303, the first screen device sends a third instruction message to the first Bluetooth device, the third instruction message being used to instruct the first Bluetooth device to enter the scanning and receiving state.
[0268] It should be noted that step S1303 is optional. After establishing a Bluetooth connection with the first screen device, the first Bluetooth device can enter a low-power state. This low-power state can be understood as: it can receive messages but does not send responses. In this case, if other screen devices (such as the second screen device) send a connection request to the first Bluetooth device, the first Bluetooth device will not send a connection response, so other screen devices cannot establish a Bluetooth connection with the first Bluetooth device. In order to enable the second screen device to also establish a Bluetooth connection with the first Bluetooth device, an indication message can be sent to the first Bluetooth device to instruct it to enter the scanning and receiving state. In this way, after receiving a connection request from the second screen device, the first Bluetooth device can also send a response message, thereby establishing a Bluetooth connection with the second screen device. In some other examples, after establishing a Bluetooth connection with the first screen device, the first Bluetooth device can remain in the scanning and receiving state, thus eliminating the need for step S1303. The first Bluetooth device can also send a connection response when receiving a connection request from another screen device, thereby establishing a Bluetooth connection with that other screen device.
[0269] S1304, the first screen device sends a fourth indication message to the second Bluetooth device, which is used to instruct the second Bluetooth device to enter the scanning and receiving state.
[0270] It should be noted that S1304 is an optional step. For details, please refer to the description of S1303. It will not be repeated here.
[0271] S1305, the first screen device sends a fifth instruction message to the third Bluetooth device, which is used to instruct the third Bluetooth device to enter the scanning and receiving state.
[0272] It should be noted that S1305 is an optional step. For details, please refer to the description of S1303. It will not be repeated here.
[0273] S1306, the second screen device scans all Bluetooth devices corresponding to the second screen group.
[0274] If the second screen device detects the first Bluetooth device, continue executing S1307; if it detects the second Bluetooth device, continue executing S1308; if it detects the third Bluetooth device, continue executing S1309.
[0275] S1307, the second screen device establishes a first Bluetooth connection with the first Bluetooth device.
[0276] S1308, the second screen device establishes a second Bluetooth connection with the second Bluetooth device.
[0277] S1309, the second screen device establishes a third Bluetooth connection with the third Bluetooth device.
[0278] At this point, the first screen device has established Bluetooth connections with the first, second, and third Bluetooth devices, and the second screen device has also established Bluetooth connections with the first, second, and third Bluetooth devices. The subsequent control process will be described below using the operation of the second Bluetooth device as an example.
[0279] S1310, the second Bluetooth device detected the button operation.
[0280] S1311, the second Bluetooth device responds to the button operation by sending a third control signal to the first screen device and the second screen device respectively.
[0281] S1312, the first screen device determines, based on the received third control signal, the first angle of arrival formed by the receiving antenna of the first screen device and the second Bluetooth device, and the distance between the first screen device and the second Bluetooth device. The distance can be determined based on the signal strength of the third control signal received by the first screen device.
[0282] It should be noted that the angle of arrival can be the angle between the receiving antennas of the second Bluetooth device and the first screen device. In this embodiment, it is assumed that the angle of arrival formed by each of the N receiving antennas of the first screen device and the second Bluetooth device is the same.
[0283] The following example illustrates the principle of determining the angle of arrival formed by the receiving antennas Rx1 and Rx2 of the first screen device and the transmitting antenna Tx1 of the second Bluetooth device.
[0284] Please see Figure 16 This is a schematic diagram of the angle measurement principle provided in the embodiments of this application.
[0285] The transmitted signal from the transmitting antenna Tx1 of the second Bluetooth device is received by the two receiving antennas Rx1 and Rx2 of the first screen device. There is a phase difference ω between the third control signal received by these two receiving antennas. For example, this phase difference ω can be estimated by sampling the signals received by the two receiving antennas Rx1 and Rx2 and then using a spectrum estimation method. Based on this phase difference ω and the wavelength, the distance difference between the two receiving antennas and the second Bluetooth device can be calculated. Figure 16 In the formula dcosθ, where d is the distance between the two receiving antennas and θ is the angle between the second Bluetooth device and the receiving antenna (i.e., the angle of arrival), the value of θ can be calculated, which is the angle of arrival formed by the receiving antenna and the second Bluetooth device.
[0286] S1313, the second screen device determines, based on the received third control signal, the second angle of arrival formed by the receiving antenna of the second screen device and the second Bluetooth device, and the distance between the second screen device and the second Bluetooth device. The distance can be determined based on the signal strength of the third control signal received by any antenna of the second screen device.
[0287] For details regarding the second angle of arrival formed by the receiving antenna of the second screen device and the second Bluetooth device, please refer to the description of the first angle of arrival in S1513, which will not be repeated here.
[0288] S1314, the second screen device sends the second angle of arrival to the first screen device.
[0289] S1315, the first screen device determines the target screen device controlled by the second Bluetooth device based on the first angle of arrival, the second angle of arrival, the distance between the first screen device and the second Bluetooth device, and the distance between the second screen device and the second Bluetooth device.
[0290] In one possible implementation of S1315, the target screen device is determined based on angle conditions and / or distance conditions.
[0291] For example, the angle condition is that the first angle of arrival is greater than the second angle of arrival, and the distance condition is that the distance between the first screen device and the second Bluetooth device is less than the distance between the second screen device and the second Bluetooth device. If both the angle and distance conditions are met simultaneously, the target Bluetooth device is determined to be the first screen device. If the angle and distance conditions cannot be met simultaneously, one option is to select the angle condition as the standard for determining the target screen device, i.e., if the first angle of arrival is greater than the second angle of arrival, then the target Bluetooth device is determined to be the first screen device. Another option is to select the distance condition as the standard for determining the target screen device, i.e., if the distance between the first screen device and the second Bluetooth device is less than the distance between the second screen device and the second Bluetooth device, then the target Bluetooth device is determined to be the first screen device.
[0292] For example, the angle condition is that the second angle of arrival is greater than the first angle of arrival, and the distance condition is that the distance between the second screen device and the second Bluetooth device is less than the distance between the first screen device and the second Bluetooth device. If both the angle and distance conditions are met simultaneously, the target Bluetooth device is determined to be the second screen device. If the angle and distance conditions cannot be met simultaneously, one option is to select the angle condition as the standard for determining the target screen device, i.e., if the second angle of arrival is greater than the first angle of arrival, then the target Bluetooth device is determined to be the second screen device. Another option is to select the distance condition as the standard for determining the target screen device, i.e., if the distance between the second screen device and the second Bluetooth device is less than the distance between the first screen device and the second Bluetooth device, then the target Bluetooth device is determined to be the second screen device.
[0293] The above embodiments are illustrated by using the angle of arrival and / or distance to determine the target screen device. In other embodiments, the emission angle can be used instead of the angle of arrival to determine the target screen device. For specific determination methods, please refer to the relevant content on determining the target device by using the angle of arrival and / or distance, which will not be repeated here.
[0294] Taking the target screen device as the second screen device as an example, the subsequent process will be introduced.
[0295] S1316, the first screen device sends a notification message to the second screen device, the notification message being used to indicate that the target screen device controlled by the second Bluetooth device is the second screen device.
[0296] S1317, the second screen device displays a prompt message indicating whether to bind the current Bluetooth device.
[0297] The prompt message in S1317 can be found here. Figure 14 ,like Figure 14 As shown, the prompt message can be "whether to pair with the current Bluetooth device", and this example does not limit the content of the prompt message.
[0298] S1318, the second Bluetooth device detects the user's key press operation.
[0299] S1319, the second Bluetooth device sends a fourth control signal to the second screen device, the fourth control signal being used to instruct the second Bluetooth device to be bound.
[0300] S1320, the second screen device is paired with a second Bluetooth device.
[0301] S1321, the second screen device disconnects from the first Bluetooth device via the first Bluetooth connection.
[0302] S1322, the second screen device disconnects from the third Bluetooth device via the third Bluetooth connection.
[0303] Accordingly, after S1318, if the second screen device receives the fifth control signal, which is used to indicate that the second Bluetooth device is not bound, the second screen device will not perform any operation.
[0304] Furthermore, users can continue to operate the first Bluetooth device and the third Bluetooth device to control the removed first Bluetooth device. For details on removing a main control device in the screen assembly, please refer to the relevant content.
[0305] In the example above, when the screen group system splits into at least two screen devices, it identifies the screen that the user intends to control based on the distance and angle of the control signal from the Bluetooth remote control operated by the user, so as to enable the connection between the Bluetooth device held by the user and the screen device that has been removed from the screen group.
[0306] In other embodiments, in a scenario where a screen device is being removed, after the first screen device detects a screen removal operation—for example, if the screen removal operation is used to remove an auxiliary screen, such as a second screen device—the process may further include: the first screen device prompting the user whether to remove the second screen device, such as... Figure 15A As shown, the prompt message can be "Remove the second screen device?", or the first screen device can send an instruction message to the second screen device, instructing the second screen device to display a prompt message, such as "Remove the current screen device?". If the user chooses to agree to remove the second screen device, taking the second Bluetooth device receiving a button operation as an example, the second Bluetooth device sends a control signal to the first screen device to indicate agreement to removal, and then the first screen device sends an instruction message to the second screen device to instruct the second screen device to establish a connection with the second Bluetooth device. If the user chooses not to agree to remove the second screen device, the subsequent steps will not be executed. In some other embodiments, if the device to be removed is the main control device, i.e., the first screen device, the first screen device can display the following message after detecting a removal operation on the first screen device: Figure 15B The displayed message asks, "Do you want to remove the current screen device?".
[0307] In this embodiment of the application, when removing the screen device from the screen assembly, there can be multiple pairing methods between the screen device and the Bluetooth device, one of which is as described above. Figure 13D As shown, the target screen device that the user intends to control is determined by measuring the angle at which each screen device receives the control signal from the Bluetooth device and the distance between each screen device and the Bluetooth device. In other embodiments, prompts output by each screen device in the screen group, such as displaying prompts or playing voice messages, can guide the user to complete the binding between the screen device and the Bluetooth device through specific remote control operations.
[0308] Figure 17 This illustration shows another exemplary scenario in which the control method for a multi-screen device provided in this application is applicable.
[0309] like Figure 17As shown, screens A, B, and C are in the same screen group. Screen A is an independent screen, while screens B and C are spliced together to form the first screen group. Screen B is the main control device, and it has established Bluetooth connections with Bluetooth remote controller 2 and Bluetooth remote controller 3 respectively. When screen C is separated from the first screen group, the process is as described above. Figure 13D The processes S1301 to S1308 shown connect screens B and C simultaneously to Bluetooth remote controllers 2 and 3. Screen B prompts the user to press and hold the "up" button to bind the device, while screen C prompts the user to press and hold the "down" button to bind the device. The screen group system determines the screen the user wishes to bind based on the input of the Bluetooth remote controller being used. For example, if the user is using Bluetooth remote controller 3 and receives a long press "up" button operation, both screens B and C can receive this long press "up" button operation. Screen B determines that the long press "up" button operation matches its own prompt information and binds to Bluetooth remote controller 3 after receiving the button operation. Screen C, however, determines that the long press "up" button operation does not match its own prompt information and does not bind to Bluetooth remote controller 3. For example, if a user is using Bluetooth remote control 3 and receives a long press of the "down" button, both screen B and screen C can receive this long press of the "down" button. Then, screen C determines that the long press of the "down" button matches its own prompt information, and thus completes the binding with Bluetooth remote control 3 after receiving the button operation. However, screen B determines that the long press of the "down" button does not match its own prompt information, and thus does not bind with Bluetooth remote control 3.
[0310] The following example illustrates the screen control process in a scenario where a screen group is split into independent screen devices.
[0311] Based on the above, please refer to Figure 18 This is the seventh flowchart of a control method for a multi-screen device provided in the embodiments of this application. Figure 18 The example shown can be applied to Figure 17 In the scenario shown, Figure 18 In the example shown, the first screen device can be screen B, the second screen device can be screen C, and the third screen device can be screen A. Specifically, the process of this example may include the following steps:
[0312] The processes involved in S1801 to S1807 are the same as those involved in S1501 to S1507, and will not be repeated here.
[0313] S1808, the second Bluetooth device detected the user's key press operation.
[0314] S1809, the second Bluetooth device responds to the user's button operation and sends a sixth control signal to the first screen device and the second screen device respectively.
[0315] S1810, the first screen device determines, based on the received sixth control signal, that the user key operation corresponding to the sixth control signal matches the second preset operation, and determines that the second Bluetooth device does not need to control the first screen device.
[0316] S1811, the second screen device determines, based on the received sixth control signal, that the user key operation corresponding to the sixth control signal matches the first preset operation.
[0317] S1812, the second screen device is paired with a second Bluetooth device.
[0318] S1813, the second screen device disconnects from the first Bluetooth device via Bluetooth.
[0319] In some other embodiments, after S1808, the second screen device determines, based on the received seventh control signal, that the user key operation corresponding to the seventh control signal does not match the preset operation, and then the second screen device does not bind to the second Bluetooth device.
[0320] In some other embodiments, if the device to be removed is the main control device, i.e., the first screen device, the removal process is as follows:
[0321] After detecting a removal operation, the first screen device skips processes similar to S1802 to S1807 and directly executes operations similar to S1808 to S1809. Then, it performs the following operations: Based on the received sixth control signal, the first screen device determines that the user button operation corresponding to the sixth control signal matches a second preset operation. Then, it binds to the second Bluetooth device and disconnects the Bluetooth connection from the first Bluetooth device. The other screen devices in the screen group re-determine the master control device; subsequent processes are detailed below. Figure 7 The S702 value S711 in the text will not be elaborated here.
[0322] The Bluetooth device provided in the embodiments of this application is described below.
[0323] Please refer to Figure 19 This is a structural example diagram of a Bluetooth device provided in an embodiment of this application. The Bluetooth device may include a processor 101, a memory 102, a sensor 103, a button 104, a power supply 105, and a wireless communication module 106, etc. It is understood that the structure illustrated in this embodiment does not constitute a specific limitation on the Bluetooth device. In other embodiments of this invention, the Bluetooth device may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0324] Processor 101 may include one or more processing units, such as an application processor (AP), a modem processor, a controller, a memory, a digital signal processor (DSP), a baseband processor, etc. Different processing units may be independent devices or integrated into one or more processors. The controller may serve as the nerve center and command center of the Bluetooth device. The controller can generate operation control signals based on instruction opcodes and timing signals to control instruction fetching and execution.
[0325] The processor 101 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 101 is a buffer memory. This memory can store instructions or data that the processor 101 has just used or that are used repeatedly. If the processor 101 needs to use the instruction or data again, it can directly retrieve it from the memory.
[0326] In some embodiments, the processor 101 may include one or more interfaces. Interfaces may include inter-integrated circuit (I2C) interfaces, pulse code modulation (PCM) interfaces, universal asynchronous receiver / transmitter (UART) interfaces, general-purpose input / output (GPIO) interfaces, and / or universal serial bus (USB) interfaces, etc.
[0327] The processor 101 can control the execution of application code to implement the functions of the Bluetooth device in this embodiment. For example, after the Bluetooth device receives a Bluetooth broadcast sent by the screen device 200 through the wireless communication module 106, it establishes a Bluetooth connection with the screen device 200 in response to the Bluetooth broadcast.
[0328] The memory 102 can be used to store computer executable program code, which includes instructions. The processor 101 executes various functional applications and data processing of the Bluetooth device by running the instructions stored in the memory 102. The memory 102 may include a program storage area. The program storage area may store the operating system, at least one application program required for a function (such as key control functions, etc.), etc. The memory 102 may also include a data storage area. The data storage area may store identification information of the screen device 200 that has been successfully paired with the Bluetooth device, such as the name of the screen device 200 and its Bluetooth address, so that when the screen device 200 is powered on, the Bluetooth device can automatically pair with the screen device 200 based on the identification information.
[0329] Sensor 103 can be a proximity sensor. The processor 101 of the Bluetooth device can use sensor 103 to determine whether there is an object near the Bluetooth device, thereby determining whether the Bluetooth device is close to another Bluetooth device. Alternatively, sensor 103 can be a distance sensor, which the processor 101 of the Bluetooth device can use to determine the distance between Bluetooth devices. In some embodiments, sensor 103 can also be a touch sensor or a pressure sensor, used to detect touch and press operations by the user on the Bluetooth device, respectively. In other embodiments, sensor 103 can also be a fingerprint sensor, used to detect the user's fingerprint, identify the user, etc.
[0330] Button 104 includes a power button, volume buttons, and directional buttons. Button 104 can be a mechanical button or a touch button. The Bluetooth device can receive button input and generate key signal inputs related to the function control of the Bluetooth device.
[0331] The power source 105 can be used to power the various components included in the Bluetooth device. In some embodiments, the power source 105 can be a battery, such as a rechargeable battery.
[0332] The wireless communication module 106 is used to establish a wireless connection with other screen devices (e.g., screen device 200, or other Bluetooth devices), enabling the Bluetooth device to interact with other screen devices. In some embodiments, the wireless communication module 106 may be an NFC module, allowing the Bluetooth device to perform near-field communication with other screen devices (e.g., Bluetooth headsets) that have NFC modules. Other screen devices with NFC modules may store relevant information about the screen device, such as its name and address. The NFC module of the Bluetooth device can then read this relevant information from the NFC module of the screen device and send it to the screen device 200. In other embodiments, the wireless communication module 106 may also be a Bluetooth module, storing the Bluetooth address of the Bluetooth device. This allows the screen device 200 to establish a Bluetooth connection with the Bluetooth device based on the Bluetooth address and transmit data via the Bluetooth connection. In this embodiment, the Bluetooth module may simultaneously support multiple Bluetooth connection types, such as SPP, BLE, or GATT, etc., without limitation.
[0333] In other embodiments, the wireless communication module 106 may also be an infrared module or a WIFI module, etc. The specific implementation of the wireless communication module 106 is not limited here.
[0334] Furthermore, in this embodiment, one wireless communication module 106 may be provided, or multiple modules may be provided as needed. For example, two wireless communication modules may be provided in a Bluetooth device, one of which is a Bluetooth module and the other is a Wi-Fi module. In this way, the Bluetooth device can conduct data communication through these two wireless communication modules respectively. The number of wireless communication modules 106 is not limited here.
[0335] It is understood that the structure illustrated in this embodiment does not constitute a specific limitation on the Bluetooth device. It can have more than Figure 16 The device may include more or fewer components, combinations of two or more components, or different component configurations. For example, the Bluetooth device may also include components such as indicator lights (which can indicate battery level, button input, etc.). Figure 16 The various components shown can be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing or application-specific integrated circuits.
[0336] The following describes the screen device provided in the embodiments of this application.
[0337] Please refer to Figure 20This is a structural example diagram of a screen device provided in an embodiment of this application. The screen device may include a processor 210, an external memory interface 220, an internal memory 221, a universal serial bus (USB) interface 230, a charging management module 240, a power management module 241, a battery 242, an antenna, a wireless communication module 250, an audio module 260, a speaker 260A, a speaker interface 260B, a sensor module 270, buttons 280, an indicator 281, a display screen 282, etc. The sensor module 270 may include a pressure sensor 270A, a gyroscope sensor 270B, a magnetic sensor 270C, a distance sensor 270D, a proximity light sensor 270E, a touch sensor 270F, an ambient light sensor 270G, etc.
[0338] It is understood that the structures illustrated in the embodiments of the present invention do not constitute a specific limitation on the screen device. In other embodiments of the present invention, the screen device may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0339] Processor 210 may include one or more processing units, such as application processors (APs), modem processors, graphics processing units (GPUs), image signal processors (ISPs), controllers, video codecs, digital signal processors (DSPs), baseband processors, and / or neural network processing units (NPUs). These different processing units may be independent devices or integrated into one or more processors.
[0340] The controller can serve as the central nervous system and command center of the screen device. Based on the instruction opcode and timing signals, the controller generates operation control signals to control the fetching and execution of instructions.
[0341] The processor 210 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 210 is a cache memory. This memory can store instructions or data that the processor 210 has just used or that are used repeatedly. If the processor 210 needs to use the instruction or data again, it can directly retrieve it from the memory. This avoids repeated accesses, reduces the waiting time of the processor 210, and thus improves the efficiency of the system.
[0342] In some embodiments, the processor 210 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.
[0343] The processor 210 can control the execution of application code to implement the functions of the screen device in this embodiment. For example, after the screen device receives a Bluetooth broadcast sent by the Bluetooth device 100 through the wireless communication module 250, in response to the Bluetooth broadcast, the processor controls the screen device to initiate a Bluetooth connection with the Bluetooth device 100, so as to achieve the effect of data transmission between the screen device and the Bluetooth device 100 based on the Bluetooth connection.
[0344] USB port 230 is a USB standard compliant interface, specifically a Mini USB port, Micro USB port, or USB Type-C port. USB port 230 can be used to connect a charger to charge the screen device, or to transfer data between the screen device and peripheral devices. It can also be used to connect speakers to play audio. This interface can also be used to connect other screen devices, such as AR devices.
[0345] It is understood that the interface connection relationships between the modules illustrated in the embodiments of the present invention are merely illustrative and do not constitute a structural limitation on the screen device. In other embodiments of the present invention, the screen device may also employ different interface connection methods or a combination of multiple interface connection methods as described in the above embodiments.
[0346] The charging management module 240 receives charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 240 receives charging input from the wired charger via a USB interface 230. In some wireless charging embodiments, the charging management module 240 receives wireless charging input via the wireless charging coil of the screen device. While charging the battery 242, the charging management module 240 can also supply power to the screen device via the power management module 241.
[0347] The power management module 241 connects the battery 242, the charging management module 240, and the processor 210. The power management module 241 receives input from the battery 242 and / or the charging management module 240, providing power to the processor 210, internal memory 221, external memory, display screen 282, and wireless communication module 250. The power management module 241 can also monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage current, impedance). In some other embodiments, the power management module 241 may be located within the processor 210. In other embodiments, the power management module 241 and the charging management module 240 may be located in the same device.
[0348] The wireless communication function of the screen device can be implemented through an antenna, a wireless communication module 250, a modem processor, and a baseband processor.
[0349] Antennas are used to transmit and receive electromagnetic wave signals. Each antenna in a screen device can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, one of multiple antennas can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, antennas can be used in conjunction with tuning switches.
[0350] The modem processor may include a modulator and a demodulator. The modulator modulates the low-frequency baseband signal to be transmitted into a mid-to-high frequency signal. The demodulator demodulates the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After processing by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs sound signals through the audio module 260 (not limited to speaker 260A, speaker interface 260B, etc.) or displays images or videos through the display screen 282. In some embodiments, the modem processor may be a separate device. In other embodiments, the modem processor may be independent of the processor 210 and may be housed in the same device as the wireless communication module 250 or other functional modules.
[0351] The wireless communication module 250 can provide solutions for wireless communication applications on screen devices, including Bluetooth (BT), wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 250 can be one or more devices integrating at least one communication processing module. The wireless communication module 250 receives electromagnetic waves via an antenna, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to the processor 210. The wireless communication module 250 can also receive signals to be transmitted from the processor 210, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via the antenna.
[0352] The screen device implements display functions through a GPU, a display screen 282, and an application processor. The GPU is a microprocessor for image processing, connecting the display screen 282 and the application processor. The GPU performs mathematical and geometric calculations and is used for graphics rendering. The processor 210 may include one or more GPUs, which execute program instructions to generate or modify display information.
[0353] Display screen 282 is used to display images, videos, etc. For example, after receiving a Bluetooth broadcast from Bluetooth device 100, display screen 282 displays pairing information for Bluetooth device 100 and prompts the user whether they need to establish a Bluetooth connection with Bluetooth device 100. If the display device receives an operation from the user instructing them to establish a Bluetooth connection with Bluetooth device 100, it responds to the operation by displaying an interface on display screen 282 to establish a Bluetooth connection with Bluetooth device 100.
[0354] The display screen 282 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a minimized LED, a microLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the screen device may include one or more display screens 282, for example, it may include two, four, or N display screens 282, where N is a positive integer greater than 4.
[0355] The external storage interface 220 can be used to connect an external storage card, such as a Micro SD card, to expand the storage capacity of the screen device. The external storage card communicates with the processor 210 through the external storage interface 220 to perform data storage functions. For example, music, video, and other files can be saved on the external storage card.
[0356] Internal memory 221 can be used to store computer executable program code, which includes instructions. Processor 210 executes various functional applications and data processing of the screen device by running the instructions stored in internal memory 221. Internal memory 221 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.), etc. The data storage area may store data created during the use of the screen device (such as audio data, phonebook, etc.). Furthermore, internal memory 221 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.
[0357] The screen device can implement audio functions through the audio module 260, speaker 260A, speaker interface 260B, and application processor.
[0358] The audio module 260 is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. The audio module 260 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 260 may be located in the processor 210, or some functional modules of the audio module 260 may be located in the processor 210.
[0359] Speaker 260A, also known as a "loudspeaker," is used to convert audio electrical signals into sound signals. The screen device can listen to music or audio through speaker 260A. For example, when the screen device establishes a Bluetooth connection with Bluetooth device 100, speaker 260A can play voice prompts.
[0360] Buttons 280 include a power button, volume buttons, etc. Buttons 280 can be mechanical buttons or touch-sensitive buttons. The screen device can receive button input and generate key signal inputs related to user settings and function control of the screen device.
[0361] Indicator 281 can be an indicator light, used to indicate charging status, power changes, messages, connection status with Bluetooth device 100, notifications, etc.
[0362] In the embodiments provided above, the methods provided by this application are described from the perspective of a screen device (or Bluetooth device) as the executing entity. To implement the functions of the methods provided in the embodiments of this application, the screen device (or Bluetooth device) may include hardware structures and / or software modules, implementing the above functions in the form of hardware structures, software modules, or a combination of hardware structures and software modules. Whether a particular function is implemented in the form of hardware structures, software modules, or a combination of hardware structures and software modules depends on the specific application and design constraints of the technical solution.
[0363] In the above embodiments, the terms "when..." or "after..." can be interpreted, depending on the context, as meaning "if...", "after...", "in response to determining...", or "in response to detecting...". Similarly, the phrases "when..." or "if (the stated condition or event) is detected" can be interpreted, depending on the context, as meaning "if...", "in response to determining...", "when (the stated condition or event) is detected", or "in response to detecting (the stated condition or event)". Furthermore, in the above embodiments, relational terms such as "first" and "second" are used to distinguish one entity from another, without limiting any actual relationship or order between these entities.
[0364] References to "one embodiment" or "some embodiments" as described in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.
[0365] In the above embodiments, implementation can be achieved entirely or partially through software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented entirely or partially in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present invention are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid state disk (SSD)). Where there is no conflict, the solutions in the above embodiments can be combined.
[0366] It should be noted that a portion of this patent application contains copyrighted material. The copyright holder retains all rights except for making copies of the contents of patent documents or records from the patent office.
Claims
1. A method for controlling a multi-screen device, characterized in that, This method is applied to a communication system, which includes at least two screen devices, including a first screen device, a second screen device, and a third screen device. The communication system also includes a first Bluetooth device connected to the first screen device via Bluetooth, a second Bluetooth device connected to the second screen device via Bluetooth, and a third Bluetooth device connected to the third screen device via Bluetooth. The method includes: The first screen device, the second screen device, and the third screen device discover each other and establish a network connection to form a screen group; each screen device in the screen group shares device information and pairing information between each screen device and its paired Bluetooth device. The first screen device and the second screen device form a first screen group, and the first screen device is determined to be the main control device of the first screen group through negotiation; The first screen device sends a first indication message to the second screen device; the first indication message is used to instruct the second screen device to disconnect the Bluetooth connection with the second Bluetooth device, and to instruct the second Bluetooth device to establish a communication connection with the first screen device. The second screen device releases the Bluetooth connection with the second Bluetooth device according to the first instruction information; The first screen device establishes a Bluetooth connection with the second Bluetooth device; The first screen group acquires second indication information, which is used to indicate that a third screen device is added to the first screen group; The first screen device detected a second screen combination operation; The first screen device responds to the second screen combination operation and forms a second screen group with the second screen device and the third screen device; The first screen device, the second screen device, and the third screen device negotiate to determine the main control device of the second screen group; If the first screen device is the master control device of the second screen group, the first screen device sends a second instruction message to the third screen device. The second instruction message is used to instruct the third screen device to disconnect the Bluetooth connection with the third Bluetooth device. The third screen device releases the Bluetooth connection with the third Bluetooth device according to the second instruction information; The first screen device establishes a Bluetooth connection with the third Bluetooth device.
2. The method according to claim 1, characterized in that, The first indication information is also used to instruct the second screen device to share the received control signals with the first screen device.
3. The method according to claim 1 or 2, characterized in that, The first screen device and the second screen device constitute a first screen group, including: The first screen device detected a first screen combination operation; The first screen device responds to the first screen combination operation and forms a first screen group with the second screen device.
4. The method according to claim 3, characterized in that, The first screen combination operation is an operation triggered by the user to physically combine the first screen device and the second screen device into a combined screen.
5. The method according to claim 3, characterized in that, Before the first screen device responds to the first screen combination operation and forms a first screen group with the second screen device, it further includes: The first screen device displays a first prompt message, which indicates whether the first screen device and the second screen device form a screen group; The first Bluetooth device sends a first control signal to the first screen device; the first control signal is used to instruct the first screen device and the second screen device to form a screen group.
6. The method according to claim 1 or 2, characterized in that, The first screen device and the second screen device determine that the first screen device is the master control device of the first screen group, including: The first screen device and the second screen device negotiate and determine that the first screen device is the screen device with the best resources, and determine that the first screen device is the master control device of the first screen group. The optimal screen device is determined based on its performance and the main control identifier.
7. The method according to claim 1, characterized in that, After the first screen device establishes a Bluetooth connection with the second Bluetooth device, the process further includes: The first screen device receives a first control signal from a target Bluetooth device, wherein the target Bluetooth device is either the first Bluetooth device or the second Bluetooth device, and the first control signal is used to operate on the content to be displayed in the first screen group; The first screen device divides the content to be displayed into a first part and a second part according to the first control signal; The first screen device sends a first control command to the second screen device, the first control command being used to instruct the second screen device to display the second portion of the content to be displayed; The first screen device displays the first portion; The second screen device displays the second portion.
8. The method according to claim 1, characterized in that, After the first screen device establishes a Bluetooth connection with the second Bluetooth device, the process further includes: The first screen device receives a second control signal sent from a target Bluetooth device, wherein the target Bluetooth device is either the first Bluetooth device or the second Bluetooth device, and the second control signal is used to control each screen device of the first screen group. The first screen device sends a second control command corresponding to the second control signal to the second screen device. The second control command is used to instruct the second screen device to perform the control operation. The first screen device performs the control operation; The second screen device executes the control operation according to the second control command.
9. The method according to claim 1, characterized in that, The method further includes: The first screen group receives a fourth indication message, which is used to indicate the removal of a target screen device from the first screen group. The target screen device is either the first screen device or the second screen device. The target screen device receives a third control signal from a target Bluetooth device, wherein the target Bluetooth device is either the first Bluetooth device or the second Bluetooth device. If the target screen device is the first screen device, then the first screen device binds to the target Bluetooth device according to the third control signal and disconnects from other Bluetooth devices besides the target Bluetooth device. If the target screen device is the second screen device, then: The first screen device sends a fifth instruction message to the second screen device, the fifth instruction message being used to instruct the second screen device to bind to the target Bluetooth device; The second screen device establishes a connection with the target Bluetooth device; The first screen device disconnects from the target Bluetooth device.
10. The method according to claim 1, characterized in that, The communication system includes at least three screen devices, which together form a first screen group; the method further includes: The first screen group receives a sixth instruction message, which is used to instruct the removal of any two screen devices from the first screen group; For one of the two screen devices to be removed, execute: The target screen device establishes connections with all Bluetooth devices corresponding to the first screen group; The target screen device receives a fourth control signal from a target Bluetooth device, wherein the target Bluetooth device is any one of all Bluetooth devices corresponding to the first screen group; The target screen device determines the angle of arrival formed by the receiving antenna of the target screen device and the target Bluetooth device, as well as the distance between the target screen device and the target Bluetooth device, according to the fourth control signal. The screen devices to be dismantled are determined to be controlled by the target Bluetooth device based on their respective first and second angles of arrival, and / or their respective first and second distances.
11. The method according to claim 9, characterized in that, After the first screen group receives the fourth indication information, it also includes: The first screen device displays a first prompt message, and the second screen device displays a second prompt message; wherein, the first prompt message is used to prompt a first button operation bound to the first screen device, and the second prompt message is used to prompt a second button operation bound to the second screen device; The first screen device receives a fourth control signal from a target Bluetooth device, wherein the target Bluetooth device is either the first Bluetooth device or the second Bluetooth device. If the first screen device determines that the key operation of the fourth control signal matches the first key operation, then it determines that the target screen device controlled by the target Bluetooth device is the first screen device; or, If the second screen device determines that the button operation of the fourth control signal matches the second button operation, then the target screen device controlled by the target Bluetooth device is determined to be the second screen device.
12. A communication system for controlling multiple screen devices, characterized in that, The communication system includes at least two screen devices, including a first screen device, a second screen device, and a third screen device. The communication system also includes a first Bluetooth device connected to the first screen device via Bluetooth, a second Bluetooth device connected to the second screen device via Bluetooth, and a third Bluetooth device connected to the third screen device via Bluetooth. The first screen device is used to: discover each other with the second screen device and the third screen device, and establish a network connection to form a screen group; each screen device in the screen group shares device information and pairing information between each screen device and its paired Bluetooth device; The device and the second screen device form a first screen group, and negotiate to determine that the first screen device is the master control device of the first screen group; send a first instruction message to the second screen device; the first instruction message is used to instruct the second screen device to disconnect the Bluetooth connection with the second Bluetooth device, and to instruct the second Bluetooth device to communicate with the first screen device; The second screen device is configured to release the Bluetooth connection with the second Bluetooth device according to the first instruction information; The first screen device is further configured to: establish a Bluetooth connection with the second Bluetooth device; obtain second indication information, the second indication information being used to indicate that the third screen device be added to the first screen group; detect a second screen grouping operation; in response to the second screen grouping operation, form a second screen group with the second screen device and the third screen device; negotiate with the second screen device and the third screen device to determine the master control device of the second screen group; if the first screen device is the master control device of the second screen group, send second indication information to the third screen device, the second indication information being used to indicate that the third screen device disconnect the Bluetooth connection with the third Bluetooth device; The third screen device is used to: release the Bluetooth connection with the third Bluetooth device according to the second instruction information; The first screen device is also used to: establish a Bluetooth connection with the third Bluetooth device.
13. The communication system according to claim 12, characterized in that, The first indication information is also used to instruct the second screen device to share the received control signals with the first screen device.
14. The communication system according to claim 13, characterized in that, The first screen device is further configured to: detect a first screen combination operation; In response to the first screen combination operation, it forms a first screen group with the second screen device.
15. The communication system according to claim 14, characterized in that, The first screen combination operation is an operation triggered by the user to physically combine the first screen device and the second screen device into a combined screen.
16. The communication system according to claim 14, characterized in that, In response to the first screen combination operation, before forming a first screen group with the second screen device, the first screen device is further configured to: display a first prompt message, the first prompt message indicating whether the first screen device forms a screen group with the second screen device; The first Bluetooth device is configured to: send a first control signal to the first screen device; the first control signal is configured to instruct the first screen device and the second screen device to form a screen group.
17. The communication system according to claim 12, characterized in that, The first screen device is also used for: The system negotiates with the second screen device to determine that the first screen device is the screen device with the best resources, and determines that the first screen device is the master control device of the first screen group. The optimal screen device is determined based on its performance and the main control identifier.
18. The communication system according to claim 12, characterized in that, After the first screen device establishes a Bluetooth connection with the second Bluetooth device, the first screen device is further configured to: receive a first control signal sent from a target Bluetooth device, wherein the target Bluetooth device is either the first Bluetooth device or the second Bluetooth device, and the first control signal is used to operate on the content to be displayed in the first screen group; Based on the first control signal, the content to be displayed is divided into a first part and a second part; Send a first control command to the second screen device, the first control command being used to instruct the second screen device to display the second portion of the content to be displayed; Display the first part; The second screen device is also used to display the second portion.
19. The communication system according to claim 12, characterized in that, After the first screen device establishes a Bluetooth connection with the second Bluetooth device, the first screen device is further configured to: Receive a second control signal from a target Bluetooth device, wherein the target Bluetooth device is either the first Bluetooth device or the second Bluetooth device, and the second control signal is used to control the screen devices of the first screen group. Send a second control command corresponding to the second control signal to the second screen device, the second control command being used to instruct the second screen device to perform the control operation; perform the control operation; The second screen device is also used to: execute the control operation according to the second control instruction.
20. The communication system according to claim 12, characterized in that, The first screen device is further configured to: receive fourth indication information, the fourth indication information being used to indicate the removal of a target screen device from the first screen group, the target screen device being either the first screen device or the second screen device; The target screen device is further configured to: receive a third control signal from a target Bluetooth device, wherein the target Bluetooth device is either the first Bluetooth device or the second Bluetooth device; If the target screen device is the first screen device, then according to the third control signal, the target Bluetooth device is bound and disconnected from other Bluetooth devices besides the target Bluetooth device; If the target screen device is the second screen device, then: The first screen device is further configured to: send a fifth indication message to the second screen device, the fifth indication message being used to instruct the second screen device to bind to the target Bluetooth device; The first screen device is also used to: establish a connection with the target Bluetooth device; and disconnect from the target Bluetooth device.
21. The communication system according to claim 12, characterized in that, The communication system includes at least three screen devices, which together form a first screen group. The first screen device is further configured to: receive a sixth indication message, the sixth indication message being used to indicate the removal of any two target screen devices from the first screen group; For either of the two target screen devices to be dismantled, the target screen device is further configured to perform: Establish connections between all Bluetooth devices corresponding to the first screen group; Receive a fourth control signal from a target Bluetooth device, wherein the target Bluetooth device is any one of all Bluetooth devices corresponding to the first screen group; The target screen device is further configured to: determine, according to the fourth control signal, the angle of arrival formed by the receiving antenna of the target screen device and the target Bluetooth device, and the distance between the target screen device and the target Bluetooth device; Based on the first angle of arrival and the second angle of arrival corresponding to the two screen devices to be dismantled, and / or the first distance and the second distance corresponding to the two screen devices to be dismantled, the screen device controlled by the target Bluetooth device is determined.
22. The communication system according to claim 20, characterized in that, After the first screen group receives the fourth instruction information, the first screen device is further configured to: display a first prompt information, the first prompt information being used to prompt a first button operation bound to the first screen device; receive a fourth control signal from a target Bluetooth device, the target Bluetooth device being either the first Bluetooth device or the second Bluetooth device; if it is determined that the button operation of the fourth control signal matches the first button operation, then it is determined that the target screen device controlled by the target Bluetooth device is the first screen device; The second screen device is further configured to: display a second prompt message, the second prompt message being used to prompt a second button operation bound to the second screen device; receive a fourth control signal from a target Bluetooth device, and if it is determined that the button operation of the fourth control signal matches the second button operation, then determine that the target screen device controlled by the target Bluetooth device is the second screen device.
23. A computer-readable storage medium, characterized in that, Includes a program or instructions that, when run on a computer, cause the method as described in any one of claims 1-11 to be performed.
Citation Information
Patent Citations
Display device and operation method therefor
US20180129462A1