A method and electronic device for cooperative display

Abstract

This paper discloses a collaborative display method and an electronic device, relating to the field of electronic devices. The electronic device adaptively adjusts the collaborative display scheme to achieve correct collaborative display without user intervention. Specifically, the scheme involves: a first electronic device automatically determining the position information of a second electronic device relative to the first electronic device, including top, bottom, left, and right sides. Based on the position information, the first electronic device determines the collaborative display scheme. According to the collaborative display scheme, the first electronic device controls the first and second electronic devices to perform collaborative display.

Description

Technical Field

[0001] This application relates to the field of electronic devices, and more particularly to a collaborative display method and an electronic device. Background Technology

[0002] Multi-screen collaboration technology supports collaborative display by multiple electronic devices and is increasingly widely used. As an example, let's consider the electronic device controlling the collaborative display as the master device, and the electronic devices performing the collaborative display under the master device's control as auxiliary devices. The master device can set options for multi-screen collaboration. These options can include the positional relationship between the master and auxiliary devices. The master device can control other electronic devices with display functions (such as auxiliary devices) that are connected to it, based on the set options, to achieve collaborative display. For example, the master device can determine the content to be displayed by both the master and auxiliary devices based on their positional relationship. Thus, the master device can control its display screen to show the content required by the master device. Additionally, the master device can instruct the auxiliary device to display the content required by the auxiliary device on its display screen.

[0003] Since the positional relationships between electronic devices are set by the user through the main device, collaborative display errors can occur when the positional relationships between the main and auxiliary devices deviate from the set relationships. To correct this, the user needs to reconfigure the multi-screen collaboration options on the main device. This makes collaborative display implementation relatively complex and less intelligent. Summary of the Invention

[0004] This application provides a collaborative display method and an electronic device, which enables an electronic device (such as a first electronic device) to automatically determine the position information of other devices (such as a second electronic device) used for collaborative display relative to the first electronic device, thereby adaptively adjusting the collaborative display scheme to enable correct collaborative display without user intervention.

[0005] To achieve the above objectives, the embodiments of this application adopt the following technical solutions:

[0006] In a first aspect, a collaborative display method is provided. The method includes: a first electronic device automatically determining position information of a second electronic device relative to the first electronic device, the position information including the upper side, lower side, left side, and right side of the first electronic device; the first electronic device determining a collaborative display scheme based on the position information; and the first electronic device controlling the first and second electronic devices to perform collaborative display according to the collaborative display scheme.

[0007] Based on this scheme, a collaborative display solution for two electronic devices is provided. In this example, the first electronic device can act as the master device, and the second electronic device can act as the slave device. For example, during collaborative display, the first electronic device can act as the control center, controlling the content displayed on its screen. Additionally, the first electronic device can also control the content displayed on the screen of the second electronic device, thereby achieving collaborative display between the two devices. In this scheme, the first electronic device can determine the position of the second electronic device itself, for example, by using a direction indicator relative to the first electronic device. The first electronic device can determine the position information of the second electronic device without user intervention and control the collaborative display accordingly. For example, when the second electronic device begins collaborative display with the first electronic device, the first electronic device can automatically determine the content to be displayed on each screen during collaborative display based on the position of the second electronic device, i.e., determine the collaborative display scheme, without requiring active user settings. Since this collaborative display scheme corresponds to the positional relationship between the first and second electronic devices, collaborative display errors caused by inconsistencies between the collaborative display and the positions will not occur. It is understood that this scheme can be applied not only to the scenario of starting collaborative display as described above, but also to scenarios where the relative positions of the first and second electronic devices change during collaborative display. For reasons similar to those described above, the accuracy of the collaborative display can be guaranteed, and users do not need to set up relevant information again.

[0008] In one possible design, before the first electronic device automatically determines the position information of the second electronic device relative to the first electronic device, the method further includes: the first electronic device receiving an operation from a user, the user's operation being used to instruct the first electronic device to activate a collaborative display function. Alternatively, the user's operation is used to instruct the first electronic device to activate an extended display mode. Alternatively, the user's operation is used to instruct the first electronic device to activate a mirrored display mode. Based on this scheme, examples of application scenarios are given. For example, it can be applied in scenarios where a user instructs an electronic device to enter a collaborative display mode. It is understood that in other multi-screen display scenarios such as extended mode and mirrored mode, in order to ensure the accuracy of the content displayed on each screen, it is also necessary to clarify the relative positional relationship of each screen. Therefore, the scheme of the present invention can also be applied to achieve accurate display without requiring user intervention in setting.

[0009] In one possible design, the first electronic device has the ability to detect the strength of the surrounding magnetic field. The first electronic device automatically determines the position information of the second electronic device relative to itself, including: the first electronic device determining its position based on changes in the surrounding magnetic field. Specifically, if the first electronic device determines that the magnetic field strength in a certain direction exceeds a preset threshold, the first electronic device determines the position information of the second electronic device relative to itself. This direction includes the top, bottom, left, and right sides of the first electronic device. Based on this scheme, a specific example of the first electronic device determining the position information of the second electronic device is given. For example, the first electronic device can determine the position of the second electronic device by monitoring changes in the magnetic field in the surrounding environment (such as changes in magnetic field strength). It should be noted that in this example, to avoid misjudgments caused by slight changes in the magnetic field, the first electronic device can determine that the second electronic device is located in the corresponding direction when the magnetic field strength exceeds a preset threshold. This further improves the accuracy of the determined position information.

[0010] In one possible design, the first electronic device is equipped with a magnetic sensor to provide the device with the ability to detect the strength of the surrounding magnetic field. Based on this scheme, a specific method for an electronic device to detect changes in the magnetic field is presented. For example, the electronic device can be equipped with a magnetic sensor for monitoring the magnetic field strength.

[0011] In one possible design, the first electronic device controls the second electronic device to perform collaborative display according to a collaborative display scheme. This includes: the first electronic device controlling its first display screen to display a first portion of the content to be displayed; and the first electronic device controlling the second display screen of the second electronic device to display a second portion of the content to be displayed, where the first and second portions constitute the content to be displayed. Based on this scheme, a specific implementation of collaborative display according to the collaborative display scheme is provided. In this example, the first electronic device can control its screen and the screen of the second electronic device to display corresponding content according to a determined collaborative display scheme. It is understood that since the collaborative display scheme corresponds to the positions of the first and second electronic devices, the positional relationship between the first and second portions in the content to be displayed can also correspond to the positions of the first and second electronic devices. This ensures the accuracy of the collaborative display.

[0012] In one possible design, when the second electronic device is to the left of the first electronic device, the first part is the right-hand portion of the content to be displayed, and the second part is the left-hand portion. When the second electronic device is to the right of the first electronic device, the first part is the left-hand portion of the content to be displayed, and the second part is the right-hand portion. When the second electronic device is above the first electronic device, the first part is the bottom-hand portion of the content to be displayed, and the second part is the top-hand portion. When the second electronic device is below the first electronic device, the first part is the top-hand portion of the content to be displayed, and the second part is the bottom-hand portion. Based on this scheme, a specific correspondence between the positional relationships between electronic devices and the positional relationships between the collaboratively displayed content is given. As can be seen from the description in this example, the position of the content displayed on different screens within the content to be displayed corresponds to the positional relationship between the electronic devices. Therefore, regardless of whether the position of the electronic device changes at the start of collaborative display or during the collaborative display process, the accuracy of the collaborative display can be guaranteed because the position of the collaboratively displayed content remains consistent with the position of the electronic device.

[0013] In one possible design, before the first electronic device determines the collaborative display scheme based on the position information, the method further includes: the first electronic device receiving the posture information of the second electronic device. The first electronic device determines the collaborative display scheme based on the relative position, including: the first electronic device determining the collaborative display scheme based on the relative position and the posture information of the second electronic device. Based on this scheme, another implementation of the first electronic device determining the collaborative display scheme is provided. In this example, the first electronic device can combine the posture information of the second electronic device to further adjust the content of the collaborative display. This further improves the accuracy of the collaborative display content.

[0014] In one possible design, the posture information includes either a landscape or portrait orientation. Based on this scheme, a specific example of posture information is given. For instance, based on the posture information, the first electronic device can determine whether the second electronic device is in a landscape or portrait orientation. It is understandable that the optimal display scheme differs depending on the orientation. For example, the second electronic device can display the second content in a horizontally stretched form in a landscape orientation, or in a vertically stretched form in a portrait orientation. The first electronic device can then further adjust the display scheme of the second electronic device to achieve a better collaborative display effect.

[0015] In one possible design, the first electronic device and the second electronic device are wirelessly connected. Based on this scheme, an example implementation scenario is given. In this example, the first electronic device can maintain a wireless connection with the second electronic device; for example, this wireless connection could be a collaborative display state based on the same local area network. Through the communication channel provided by this wireless connection, the first electronic device can interact with the second electronic device, such as controlling the second electronic device to perform collaborative display according to the collaborative display scheme, or obtaining the posture information of the second electronic device.

[0016] In one possible design, before the first electronic device controls the first and second electronic devices to perform collaborative display according to the collaborative display scheme, the position information of the first electronic device relative to the second electronic device is the first position information. The first and second electronic devices perform a first collaborative display according to the first position information and the first collaborative display scheme. The first position information corresponds to the first collaborative display scheme. When the first position information changes to the second position information, the first electronic device automatically determines the position information of the second electronic device relative to the first electronic device, including: the first electronic device automatically determines the position information of the second electronic device relative to the first electronic device as the second position information. The first electronic device determines the collaborative display scheme according to the position information, including: the first electronic device determines a second collaborative display scheme according to the second position information. The first electronic device controls the first and second electronic devices to perform collaborative display according to the collaborative display scheme, including: the first electronic device controls the first and second electronic devices to switch from the first collaborative display to the second collaborative display according to the second collaborative display scheme, where the second collaborative display is a display corresponding to the second collaborative display scheme. Based on this scheme, a specific implementation scenario example of this scheme is provided. In this example, the positional relationship between the first and second electronic devices may not be fixed. During the collaborative display process, the first electronic device can continuously / intermittently adjust the collaborative display scheme according to the position of the second electronic device. This allows the first electronic device to adaptively adjust the collaborative display scheme when the position of the second electronic device changes (e.g., from the first position information to the second position information), controlling the screens of both the first and second electronic devices to display content corresponding to the current position information.

[0017] Secondly, a collaborative display device is provided, which can be disposed in a first electronic device. The device includes: a determining unit, configured to automatically determine the position information of a second electronic device relative to the first electronic device, the position information including upper side, lower side, left side, and right side; the determining unit is further configured to determine a collaborative display scheme based on the position information; and a control unit, configured to control the first electronic device and the second electronic device to perform collaborative display according to the collaborative display scheme.

[0018] In one possible design, the device further includes: a receiving unit, configured to receive a user operation before the first electronic device automatically determines the position information of the second electronic device relative to the first electronic device, the user operation being used to instruct the first electronic device to activate a collaborative display function. Alternatively, the first user's operation is used to instruct the first electronic device to activate an extended display mode. Alternatively, the first user's operation is used to instruct the first electronic device to activate a mirrored display mode.

[0019] In one possible design, the first electronic device has the ability to detect the strength of the surrounding magnetic field. A determining unit is specifically used to determine position information based on changes in the magnetic field surrounding the first electronic device. Specifically, if the magnetic field strength in one direction exceeds a preset threshold, the determining unit determines the position information of the second electronic device on the first electronic device; the direction includes up, down, left, and right.

[0020] In one possible design, the first electronic device is equipped with a magnetic sensor, which provides the first electronic device with the ability to detect the strength of the surrounding magnetic field.

[0021] In one possible design, the control unit is used by the first electronic device to control its first display screen to display a first portion of the content to be displayed, according to a collaborative display scheme. The control unit is also used to control the second display screen of the second electronic device to display a second portion of the content to be displayed, according to the collaborative display scheme, wherein the first and second portions constitute the content to be displayed.

[0022] In one possible design, when the second electronic device is located to the left of the first electronic device, the first part is the right-hand portion of the content to be displayed, and the second part is the left-hand portion of the content to be displayed. When the second electronic device is located to the right of the first electronic device, the first part is the left-hand portion of the content to be displayed, and the second part is the right-hand portion of the content to be displayed. When the second electronic device is located above the first electronic device, the first part is the bottom-hand portion of the content to be displayed, and the second part is the top-hand portion of the content to be displayed. When the second electronic device is located below the first electronic device, the first part is the top-hand portion of the content to be displayed, and the second part is the bottom-hand portion of the content to be displayed.

[0023] In one possible design, the receiving unit is further configured to receive the attitude information of the second electronic device before the first electronic device determines the collaborative display scheme based on the position information. The determining unit is configured to determine the collaborative display scheme based on the relative position and the attitude information of the second electronic device.

[0024] In one possible design, the posture information includes: landscape posture or portrait posture.

[0025] In one possible design, the first electronic device and the second electronic device are wirelessly connected.

[0026] In one possible design, before the control unit controls the first electronic device and the second electronic device to perform collaborative display according to the collaborative display scheme, the position information of the first electronic device relative to the second electronic device is the first position information. The control unit is used to control the first electronic device to perform a first collaborative display according to the first collaborative display scheme based on the first position information. The first position information corresponds to the first collaborative display scheme. When the first position information changes to second position information, a determining unit is used to automatically determine that the position information of the second electronic device relative to the first electronic device is the second position information. The determining unit is also used to determine a second collaborative display scheme based on the second position information. The control unit is used to control the first electronic device and the second electronic device to switch from the first collaborative display to the second collaborative display according to the second collaborative display scheme, where the second collaborative display is a display corresponding to the second collaborative display scheme.

[0027] Thirdly, an electronic device is provided, comprising one or more processors and one or more memories. Exemplarily, the electronic device may be a first electronic device as described in the first or second aspect. The one or more memories are coupled to the one or more processors, and the one or more memories store computer instructions. When the one or more processors execute the computer instructions, the electronic device causes to perform the cooperative display method as described in any one of the first aspects and any possible designs thereof.

[0028] Fourthly, a chip system is provided, the chip system including interface circuitry and a processor. Exemplarily, this chip system can be applied to a first electronic device as described in the first or second aspect. The interface circuitry and the processor are interconnected via lines; the interface circuitry is configured to receive signals from a memory and send signals to the processor, the signals including computer instructions stored in the memory; when the processor executes the computer instructions, the chip system performs the cooperative display method as described in any one of the first aspects and any possible designs thereof.

[0029] Fifthly, a computer-readable storage medium is provided, comprising computer instructions that, when executed, perform the cooperative display method as described in any one of the first aspects and any possible designs thereof.

[0030] In a sixth aspect, a computer program product is provided, the computer program product including instructions that, when the computer program product is run on a computer, cause the computer to execute the cooperative display method as described in any one of the first aspects and any possible designs thereof.

[0031] It should be understood that the technical features of the technical solutions provided in the second, third, fourth, fifth and sixth aspects mentioned above can all correspond to the collaborative display methods provided in the first aspect and its possible designs, so the beneficial effects that can be achieved are similar, and will not be repeated here. Attached Figure Description

[0032] Figure 1 This is a schematic diagram of a collaborative display.

[0033] Figure 2 This is a schematic diagram illustrating a collaborative display setup.

[0034] Figure 3 This is a schematic diagram illustrating the effect of collaborative display.

[0035] Figure 4 This is a schematic diagram illustrating the effect of another collaborative display.

[0036] Figure 5 A schematic diagram illustrating the composition of an electronic device provided in an embodiment of this application;

[0037] Figure 6 A schematic diagram illustrating location information determination provided in an embodiment of this application;

[0038] Figure 7 A flowchart illustrating a collaborative display method provided in an embodiment of this application;

[0039] Figure 8 This is a schematic diagram illustrating the effect of a collaborative display method provided in an embodiment of this application;

[0040] Figure 9 A flowchart illustrating yet another collaborative display method provided in an embodiment of this application;

[0041] Figure 10 A schematic diagram of a collaborative display scenario provided in an embodiment of this application;

[0042] Figure 11 This is a schematic diagram illustrating the effect of another collaborative display method provided in the embodiments of this application;

[0043] Figure 12 This is a schematic diagram illustrating the composition of a collaborative display device provided in an embodiment of this application;

[0044] Figure 13 A flowchart illustrating another shooting method provided in an embodiment of this application;

[0045] Figure 14 This is a schematic diagram of the composition of a chip system provided in an embodiment of this application. Detailed Implementation

[0046] Multi-screen collaboration technology is playing an increasingly important role in scenarios such as mobile office and smart home. It expands the interaction interface between users and electronic devices, enriching the user experience. Furthermore, by leveraging the sensing capabilities between electronic devices, it makes them more intelligent, thereby simplifying user operations and improving productivity.

[0047] The following combination Figures 1-4 An example of a collaborative display scheme will be given.

[0048] Generally, when using multi-screen collaboration technology for collaborative display, users can configure collaborative display options on the main device. For example, taking the main device as an example... Figure 1 The example shown is a laptop computer with a tablet computer as a secondary device. (Reference) Figure 1 On the laptop's collaborative display settings interface, an interface element as shown in 101 can be displayed. This interface element can be used to prompt the user to use extended mode for collaborative display. The user can select this extended mode using a mouse or other control device, thus putting the laptop into collaborative display mode.

[0049] It should be noted that in some embodiments, such as Figure 1 As shown, before the laptop displays the collaborative display settings interface, the laptop can interconnect with other electronic devices capable of collaborative display. Through this interconnection communication channel, the laptop can collaborate with other electronic devices (such as tablets). For example, after the laptop and tablet are successfully interconnected, the collaborative display settings interface can display the electronic devices (such as device X) that have been connected to the laptop.

[0050] Furthermore, the above example illustrates user input operations (such as selecting extended mode) on a laptop via a control device. In other implementations of this example, for laptops that support touch operation, users can also input the above operations via touch. It is understood that users can also input operations via voice control, etc. The following example illustrates user input of control commands to an electronic device using a mouse.

[0051] In this example, the host device (such as a laptop) can display additional collaborative display settings interfaces (such as display parameter settings interfaces) after receiving a user's selection of an extended mode. For example, see [link to relevant documentation]. Figure 2 The display settings interface may include a "Tablet Screen Position" option for setting the relative position of the tablet and laptop, as well as display settings options for other auxiliary devices (such as...). Figure 2 The "Tablet sidebar location" option is shown.

[0052] like Figure 2 As shown, users can select the corresponding positional relationship in the "Tablet Screen Position" option based on the relative positions of the tablet and laptop during collaborative display. The main device (such as a laptop) can determine the content to be displayed on the main device and the content to be displayed on the auxiliary device (such as a tablet) based on the positional relationship selected by the user. In this embodiment, the positional relationship between the main device and the auxiliary device can include the auxiliary device being located to the left of the main device, the auxiliary device being located to the right of the main device, the auxiliary device being located above the main device, or the auxiliary device being located below the main device, etc.

[0053] For example, consider a tablet placed on the right side of a laptop. The user can use the mouse to select the corresponding option on the interface based on the tablet's position (e.g., selecting...). Figure 2 (Option 201 shown). The laptop can receive this operation, and based on this operation, the laptop can determine that the tablet is located to the right of the laptop during collaborative display. Therefore, the laptop can determine what content needs to be displayed on the laptop's screen and what content needs to be displayed on the tablet during collaborative display.

[0054] In this embodiment of the application, the user can use the above-described... Figure 1 as well as Figure 2 This operation activates the collaborative display function of electronic devices (such as laptops and / or tablets).

[0055] As an example, let's consider expanding the display of an image using collaborative display. Combined with... Figure 3 The image displays as shown on the laptop. Figure 3 (a) In collaborative display, a primary device (such as a laptop) can display a portion of an image on its screen. The primary device can then control a secondary device (such as a tablet) to display another portion of the image on its screen, thereby expanding the display area of ​​the image. Combined Figure 1 and Figure 2 The instructions state that when the tablet is positioned on the right side of the laptop, it can be accessed via, as shown below. Figure 1 and Figure 2 The setup shown allows the laptop to determine a cooperative display based on the tablet's position to the right of the laptop. For example, the laptop can display the left portion of an image on the top of its screen. The laptop can also control the tablet to display the right portion of an image on its screen. Please refer to the display results. Figure 3 (b) in the example. This enables extended display of images on two electronic devices through collaborative display.

[0056] However, the solutions in the above examples also have some problems.

[0057] It is understandable that the positional relationship between the master and slave devices in the actual environment must be consistent with the positional relationship selected during the collaborative display setup process. Only then can the master device know the position of the slave device in the actual environment and thus determine the content that the master and slave devices need to display during the collaborative display process. However, when the positional relationship between the master and slave devices in the actual environment is inconsistent with the positional relationship selected during the collaborative display setup process, or when the positional relationship between the master and slave devices changes during the collaborative display process, the master device cannot accurately know the positional relationship with the slave device, and therefore cannot accurately determine the content that the master and slave devices need to display.

[0058] For example, taking the master device as an example Figure 4 The auxiliary equipment shown in the diagram is as follows: Figure 4 Take device B as an example. (Refer to...) Figure 4 (a) In the collaborative display process, device B may move. For example, device B may move from the right side of device A to the left side of device A. If the user does not reset the collaborative display options, device A will determine that device B is still to the right of device A based on the preset settings. Device A can then continue to control device A and device B for collaborative display. This could lead to situations such as... Figure 4 The situation described in (b) is as follows: Device B on the left displays the right side of the image, while device A on the right actually displays the left side. This clearly does not meet the user's needs for viewing or editing images.

[0059] To address the problems described in the examples above, the collaborative display scheme provided in this application enables electronic devices to automatically determine the positions of other devices during collaborative display and perform collaborative display accordingly. For instance, when using the collaborative display scheme provided in this application on a master device, the master device can automatically determine the position of the auxiliary device and, based on this, determine the content to be displayed by both the master and auxiliary devices. Thus, since the user does not need to actively set collaborative display options, but rather the master device can automatically determine the position of the auxiliary device, the problem of incorrect collaborative display content caused by changes in the positional relationship between the master and auxiliary devices is eliminated.

[0060] The collaborative display scheme provided in the embodiments of this application will be described in detail below with reference to the accompanying drawings.

[0061] Please refer to Figure 5This is a schematic diagram illustrating the composition of an electronic device 500 provided in an embodiment of this application. In this embodiment, the electronic device 500 can be used for collaborative display. For example, the electronic device 500 can act as a main device for collaborative display. Alternatively, the electronic device 500 can also act as an auxiliary device for collaborative display.

[0062] It should be noted that the solutions provided in this application can be applied to users' electronic devices. These electronic devices can be portable mobile devices with displays and capable of collaborative display, such as mobile phones, tablets, personal digital assistants (PDAs), augmented reality (AR) / virtual reality (VR) devices, and media players. They can also be wearable electronic devices with displays and capable of collaborative display, such as smartwatches. This application does not impose any special limitations on the specific form of the electronic device.

[0063] like Figure 5 As shown, the electronic device may include a processor 510, an external memory interface 520, an internal memory 521, a universal serial bus (USB) interface 530, a charging management module 540, a power management module 541, a battery 542, an antenna 1, an antenna 2, a mobile communication module 550, a wireless communication module 560, an audio module 570, a speaker 570A, a receiver 570B, a microphone 570C, a headphone jack 570D, a sensor module 580, buttons 590, a motor 591, an indicator 592, a camera 593, a display screen 594, and a subscriber identification module (SIM) card interface 595, etc.

[0064] It is understood that the structure illustrated in this embodiment does not constitute a specific limitation on the electronic device 500. In other embodiments, the electronic device 500 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0065] The processor 510 may include one or more processing units, such as an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processing unit (NPU). These different processing units may be independent devices or integrated into one or more processors 510.

[0066] The controller can be the nerve center and command center of the electronic device 500. The controller can generate operation control signals according to the instruction opcode and timing signals to complete the control of instruction fetching and execution.

[0067] The processor 510 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 510 is a cache memory. This memory can store instructions or data that the processor 510 has just used or that are used repeatedly. If the processor 510 needs to use the instruction or data again, it can directly retrieve it from the memory. This avoids repeated accesses, reduces the waiting time of the processor 510, and thus improves the efficiency of the system.

[0068] In this embodiment, the processor 510 may store instructions or instruction sets corresponding to the collaborative display scheme provided in this embodiment. For example, the processor 510 may be located in the main device. When implementing the collaborative display scheme provided in this embodiment, the processor 510 can determine the position of the auxiliary device based on changes in the surrounding magnetic field strength. The processor 510 can also be used to determine the content to be displayed by the main device and the auxiliary device respectively, based on the position of the auxiliary device.

[0069] In some embodiments, the processor 510 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an integrated circuit built-in audio (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous transceiver (UART) interface, a Mobile Industry Processor 510 interface (MIPI), a general purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0070] Electronic device 500 can achieve shooting function through ISP, camera 593, video codec, GPU, display 594 and application processor.

[0071] The ISP (Image Signal Processor) is used to process data fed back from the camera 593. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the photosensitive element of the camera 593. The light signal is converted into an electrical signal, and the photosensitive element of the camera 593 transmits the electrical signal to the ISP for processing, converting it into an image visible to the naked eye. The ISP can also perform algorithmic optimization of image noise, brightness, and skin tone. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 593.

[0072] Camera 593 is used to capture still images or videos. An object is projected onto a photosensitive element by generating an optical image through the lens. The photosensitive element converts the light signal into an electrical signal, which is then passed to an ISP (Internet Service Provider) for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP (Digital Signal Processor) for processing. The DSP converts the digital image signal into image signals in standard formats such as RGB and YUV. In some embodiments, the electronic device 500 may include one or N cameras 593, where N is a positive integer greater than 1.

[0073] Digital signal processors (DSPs) are used to process digital signals. Besides digital image signals, they can also process other digital signals. For example, when electronic device 500 is selecting a frequency, the DSP is used to perform Fourier transforms on the frequency energy.

[0074] Video codecs are used to compress or decompress digital video. Electronic device 500 can support one or more video codecs. Thus, electronic device 500 can play or record video in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0075] The NPU (Neural-Network Processor) 510, by drawing inspiration from the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, rapidly processes input information and can continuously learn on its own. The NPU enables intelligent cognitive applications in electronic devices 500, such as image recognition, facial recognition, speech recognition, and text understanding.

[0076] The charging management module 540 receives charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 540 receives charging input from the wired charger via a USB interface 530. In some wireless charging embodiments, the charging management module 540 receives wireless charging input via the wireless charging coil of the electronic device 500. While charging the battery 542, the charging management module 540 can also supply power to the electronic device 500 via the power management module 541.

[0077] The power management module 541 connects the battery 542, the charging management module 540, and the processor 510. The power management module 541 receives input from the battery 542 and / or the charging management module 540, providing power to the processor 510, internal memory 521, external memory, display screen 594, camera 593, and wireless communication module 560. The power management module 541 can also monitor parameters such as battery 542 capacity, battery cycle count, and battery health status (leakage current, impedance). In some other embodiments, the power management module 541 may be located within the processor 510. In other embodiments, the power management module 541 and the charging management module 540 may be located in the same device.

[0078] The wireless communication function of electronic device 500 can be implemented through antenna 1, antenna 2, mobile communication module 550, wireless communication module 560, modem processor, and baseband processor.

[0079] Antennas 1 and 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 500 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with a tuning switch.

[0080] The mobile communication module 550 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the electronic device 500. The mobile communication module 550 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 550 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 550 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1. In some embodiments, at least some functional modules of the mobile communication module 550 may be housed in the processor 510. In some embodiments, at least some functional modules of the mobile communication module 550 and at least some modules of the processor 510 may be housed in the same device.

[0081] The modem processor may include a modulator and a demodulator. The modulator modulates the low-frequency baseband signal to be transmitted into a mid-to-high frequency signal. The demodulator demodulates the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After processing by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs sound signals through an audio device (not limited to a speaker 570A, receiver 570B, etc.) or displays images or videos through a display screen 594. In some embodiments, the modem processor may be a separate device. In other embodiments, the modem processor may be independent of the processor 510 and may be housed in the same device as the mobile communication module 550 or other functional modules.

[0082] The wireless communication module 560 can provide solutions for wireless communication applications on the electronic device 500, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 560 can be one or more devices integrating at least one communication processing module. The wireless communication module 560 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 510. The wireless communication module 560 can also receive signals to be transmitted from processor 510, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.

[0083] In some embodiments, antenna 1 of electronic device 500 is coupled to mobile communication module 550, and antenna 2 is coupled to wireless communication module 560, enabling electronic device 500 to communicate with networks and other devices via wireless communication technology. The wireless communication technology may include, but is not limited to, GSM, GPRS, CDMA, WCDMA, TD-SCDMA, LTE, 5G and subsequent evolution standards, BT, GNSS, WLAN, NFC, FM, and / or IR technologies.

[0084] In some embodiments of this application, the mobile communication module 550 and / or wireless communication module 560 in the electronic device 500 can be used to establish interconnection with other electronic devices under the control of the processor 510. For example, taking the electronic device 500 as a main device, the electronic device 500 can join the same local area network as the auxiliary device through the mobile communication module 550 and / or wireless communication module 560. The electronic device 500 can communicate with the auxiliary device through this local area network. For example, the electronic device 500 can send the corresponding display information of the auxiliary device to the auxiliary device through this local area network, so that the auxiliary device can perform collaborative display based on the received display information.

[0085] Electronic device 500 implements display functions through a GPU, a display screen 594, and an application processor. The GPU is a microprocessor 510 for image processing, connected to the display screen 594 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 510 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0086] The display screen 594 is used to display images, videos, etc. In some embodiments, the electronic device 500 may include one or N display screens 594, where N is a positive integer greater than 1.

[0087] In this embodiment of the application, both the main device and the auxiliary device may be equipped with a display screen 594. In some scenarios, the display screen of the main device can cooperate with the display screen of the auxiliary device for display.

[0088] The external storage interface 520 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 500. The external memory card communicates with the processor 510 through the external storage interface 520 to perform data storage functions. For example, music, video, and other files can be saved on the external memory card.

[0089] Internal memory 521 can be used to store computer executable program code, which includes instructions. Processor 510 executes various functional applications and data processing of electronic device 500 by running the instructions stored in internal memory 521. Internal memory 521 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.), etc. The data storage area may store data created during the use of electronic device 500 (such as audio data, phonebook, etc.). Furthermore, internal memory 521 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, general-purpose flash memory, etc.

[0090] Electronic device 500 can implement audio functions such as music playback and recording through audio module 570, speaker 570A, receiver 570B, microphone 570C, headphone jack 570D, and application processor.

[0091] The audio module 570 is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. The audio module 570 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 570 may be located in the processor 510, or some functional modules of the audio module 570 may be located in the processor 510.

[0092] The speaker 570A, also known as a "loudspeaker," is used to convert audio electrical signals into sound signals. Electronic device 500 can listen to music or make hands-free calls through the speaker 570A.

[0093] The receiver 570B, also known as the "earpiece," is used to convert audio electrical signals into sound signals. When the electronic device 500 answers a telephone call or voice message, the receiver 570B can be brought close to the listener's ear to hear the voice.

[0094] The microphone 570C, also known as a "microphone" or "voice transducer," is used to convert sound signals into electrical signals. The headphone jack 570D is used to connect wired headphones.

[0095] The sensor module 580 provided in the electronic device 500 provided in this application embodiment may include one or more sensors of the same or different types. For example, the sensor module 580 may include a pressure sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer, a distance sensor, a proximity sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, etc.

[0096] Taking a magnetic sensor included in sensor module 580 as an example. This magnetic sensor may include a Hall sensor. The Hall sensor can determine changes in the magnetic field around the electronic device 500 based on the Hall effect. The Hall effect is a type of electromagnetic effect discovered by the American physicist John Hall. According to the Hall effect, when a current passes through a semiconductor perpendicular to an external magnetic field, charge carriers are deflected, and an additional electric field is generated perpendicular to both the current and the magnetic field, thus creating a potential difference across the semiconductor. This potential difference is also known as the Hall potential difference.

[0097] In this embodiment, the electronic device 500 can determine changes in the surrounding magnetic field based on a Hall sensor. It is understood that electronic devices typically incorporate one or more magnetic materials. Therefore, when an auxiliary device approaches a main device, the magnetic material on the auxiliary device influences the magnetic field surrounding the main device. When the electronic device 500 acts as the main device, it can determine the direction in which the auxiliary device approaches the main device based on the changes in the magnetic field, thereby determining the relative positions of the main and auxiliary devices.

[0098] In some other embodiments of this application, the electronic device 500 can use a magnetic sensor to detect the opening and closing of the flip cover. In some embodiments, when the electronic device 500 is a flip phone, the electronic device 500 can detect the opening and closing of the flip cover using a magnetic sensor. Then, based on the detected opening and closing state of the cover or the flip cover, features such as automatic flip unlocking can be set.

[0099] In some other embodiments of this application, when the electronic device 500 is equipped with a foldable screen, the electronic device 500 can use a magnetic sensor to detect the opening and closing state of the foldable screen (such as an unfolded state or a closed state). The electronic device 500 can automatically control functions such as automatic unlocking and volume adjustment based on the detected opening and closing state of the foldable screen.

[0100] A touch sensor, also known as a "touch panel," can be located on the display screen 594. The touch sensor and display screen 594 together form a touchscreen, also known as a "touch screen." The touch sensor detects touch operations applied to or near it. The touch sensor can then transmit the detected touch operation to the application processor to determine the type of touch event. In some embodiments, visual output related to the touch operation can be provided through the display screen 594. In other embodiments, the touch sensor may also be located on the surface of the electronic device 500, in a different position than the display screen 594.

[0101] It should be noted that in some embodiments of this application, the sensor module 580 in the electronic device 500 may be integrated to realize the functions of the above-mentioned components, or it may be partially integrated or separately configured to realize the sensing function of the above-mentioned components. For example, in some embodiments, an inertial measurement unit (IMU) may be provided in the electronic device 500. The IMU can be used to realize 6-axis or 9-axis sensing functions. For example, taking 9-axis detection through an IMU as an example, the IMU can be used to realize the sensing functions of components such as accelerometer sensors, gyroscope sensors, and Hall sensors.

[0102] Buttons 590 include a power button, volume buttons, etc. Electronic device 500 can receive input from buttons 590 and generate key signal inputs related to user settings and function control of electronic device 500.

[0103] Motor 591 can generate vibration alerts. Indicator 592 can be an indicator light, used to indicate charging status, battery level changes, messages, missed calls, notifications, etc. SIM card interface 595 is used to connect a SIM card.

[0104] The collaborative display scheme provided in this application embodiment can be used with the above-mentioned... Figure 5 In the electronic device 500 shown.

[0105] The solutions provided in the embodiments of this application will be described in detail below with reference to the accompanying drawings.

[0106] Generally, electronic devices incorporate one or more magnetic materials to achieve their functions. For example, consider a tablet computer. Tablet computers can be used in several modes, including a case mode. In case mode, the tablet can execute corresponding strategies based on the case's open / closed state, such as turning the screen on / off. To ensure a tight fit between the case and the tablet, magnetic materials are incorporated into the tablet. When the case is closed, the magnetic materials in the case and the tablet attract each other, achieving a secure seal. Of course, some other electronic devices, even those that don't support a case mode, may still incorporate magnetic materials for their intended function.

[0107] When a magnetic material enters a magnetic field, it affects the field. For example, the magnetic field strength at the location corresponding to the magnetic material will change. This change in magnetic field strength can be detected by a Hall sensor, allowing an electronic device equipped with the Hall sensor to determine the orientation of the magnetic material.

[0108] For example, in combination Figure 6 Taking device 1 as an example, which is equipped with a sensor capable of detecting changes in the magnetic field (such as a Hall sensor), and device 2 as an example, where device 1 is equipped with a magnetic material. Device 1 can obtain the distribution of the surrounding magnetic field through the sensor. When device 2 approaches device 1 along the negative X-axis, it will cause a change in the magnetic field strength of device 1 in the positive X-axis direction. Device 1 can obtain this change in magnetic field strength through the sensor. Based on this, device 1 can know that device 2 is approaching device 1 along the negative X-axis, that is, device 2 is located to the right of device 1.

[0109] In the solution provided in this application embodiment, the main device can determine the position of the auxiliary device close to the main device based on the technical means described above. Then, the main device can determine the content to be displayed by the main device and the auxiliary device respectively in the collaborative display based on the position of the auxiliary device. Subsequently, the main device displays the corresponding content on its screen and controls the auxiliary device to display the corresponding content on its screen, thereby achieving collaborative display between the main device and the auxiliary device.

[0110] Understandably, since the main device can automatically identify the position of the auxiliary device based on its internal components, the user does not need to manually set the position options of the auxiliary device during collaborative display (e.g., according to...). Figures 1-2 The scheme shown configures the corresponding options for collaborative display. Therefore, it can avoid collaborative display errors caused by inconsistencies between the user-set location options and the actual locations of the main and auxiliary devices in the scenario, while enabling electronic devices to provide more convenient collaborative display capabilities.

[0111] As an example, please refer to Figure 7This is a flowchart illustrating a collaborative display method provided in an embodiment of this application. The example uses device 1 as the main device, device 2 as the auxiliary device, screen 1 as the main device's display screen, and screen 2 as the auxiliary device's display screen. Figure 7 As shown, the solution may include:

[0112] S701. Based on the changes in the magnetic field, device 1 determines the position information of device 2 relative to device 1.

[0113] The position information of device 2 relative to device 1 may include one of the following: above device 1, below device 1, left side of device 1, and right side of device 1.

[0114] In some embodiments, device 1 can determine the position information of device 2 relative to device 1 when the magnetic field strength in one direction reaches (or exceeds) a preset threshold (such as a first threshold).

[0115] For example, when device 1 determines that the magnetic field strength in the positive X-axis direction reaches a first threshold, it can determine that device 2 is to the right of device 1. In other words, device 1 can determine that device 2 is located to the right of device 1. When device 1 determines that the magnetic field strength in the negative X-axis direction reaches a first threshold, it can determine that device 2 is to the left of device 1. When device 1 determines that the magnetic field strength in the positive Y-axis direction reaches a first threshold, it can determine that device 2 is above device 1. When device 1 determines that the magnetic field strength in the negative Y-axis direction reaches a first threshold, it can determine that device 2 is below device 1.

[0116] In other embodiments, device 1 can determine the position information of device 2 when the change value of magnetic field strength in one direction reaches another preset threshold (such as a second threshold).

[0117] For example, device 1 can determine that device 2 is located to the right of device 1 when the change in magnetic field strength in the positive X-axis direction reaches a second threshold. Device 1 can determine that device 2 is located to the left of device 1 when the change in magnetic field strength in the negative X-axis direction reaches a second threshold. Device 1 can determine that device 2 is located above device 1 when the change in magnetic field strength in the positive Y-axis direction reaches a second threshold. Device 1 can determine that device 2 is located below device 1 when the change in magnetic field strength in the negative Y-axis direction reaches a second threshold.

[0118] S702, Device 1 determines the collaborative display scheme based on the position information of Device 2 relative to Device 1.

[0119] In this embodiment, the collaborative display scheme can also be simply referred to as a display scheme. The display scheme may include display scheme 1 and display scheme 2. Display scheme 1 may be the scheme displayed on screen 1 of device 1 during the collaborative display process. Display scheme 2 may be the scheme displayed on screen 2 of device 2 during the collaborative display process.

[0120] In this example, device 1 can determine display scheme 1 based on the position information of device 2 relative to device 1.

[0121] For example, after determining the position information of device 2 relative to device 1, device 1 can determine the content to be displayed on screen 1 of device 1, that is, determine display scheme 1 on screen 1.

[0122] Taking the collaborative display of images using devices 1 and 2 as an example: Device 1 can determine the left-hand portion of the image to be displayed in display scheme 1 when it determines that device 2 is to its right. Device 1 can also determine the right-hand portion of the image to be displayed in display scheme 1 when it determines that device 2 is to its left. Furthermore, device 1 can determine the bottom portion of the image to be displayed in display scheme 1 when it determines that device 2 is to its top. Finally, device 1 can determine the top portion of the image to be displayed in display scheme 1 when it determines that device 2 is to its bottom.

[0123] In addition, device 1 can determine display scheme 2 based on the position information of device 2 relative to device 1.

[0124] It is understandable that in most collaborative display solutions, device 2 acts as an auxiliary device, and the content it needs to display is determined and controlled by the master device. Therefore, in this embodiment, in conjunction with the foregoing description, device 1 can also determine the content that device 2 needs to display based on the position information of device 2 relative to device 1.

[0125] For example, continuing with the collaborative display of images using devices 1 and 2: Device 1 can determine that the right-hand portion of the image needs to be displayed in display scheme 2 when it determines that device 2 is to its right. Device 1 can determine that the left-hand portion of the image needs to be displayed in display scheme 2 when it determines that device 2 is to its left. Device 1 can determine that the top portion of the image needs to be displayed in display scheme 2 when it determines that device 2 is above it. Device 1 can determine that the bottom portion of the image needs to be displayed in display scheme 2 when it determines that device 2 is below it.

[0126] In this way, the effect of device 1 adaptively adjusting the display scheme on device 1 (such as display scheme 1) and the display scheme on device 2 (such as display scheme 2) based on the position information of device 2 relative to device 1 is achieved.

[0127] It should be noted that in different implementations of the embodiments of this application, the operations of device 1 in determining display scheme 1 and display scheme 2 can have different sequences. For example, in some implementations, device 1 can determine display scheme 2 after determining display scheme 1, thereby avoiding concentrated consumption of computing power. In other implementations, device 1 can determine display scheme 1 after determining display scheme 2, so that device 1 can control device 2 to prepare for display according to display scheme 2 while determining display scheme 1, thereby achieving the effect of parallel processing and improving the synchronization of the content displayed on the two screens during collaborative display. It is understood that in other implementations, device 1 can also determine display scheme 2 at the same time as determining display scheme 1, thereby also saving the time spent on data processing during collaborative display through parallel processing.

[0128] S703, Device 1 controls screen 1 of Device 1 and screen 2 of Device 2 to perform collaborative display according to the collaborative display scheme.

[0129] For example, after determining the display scheme 2 corresponding to device 2, device 1 can send the display scheme 2 to device 2 so that device 2 can display according to the display scheme 2.

[0130] In this example, after device 1 determines display scheme 2 for device 2, device 1 can send display scheme 2 to device 2 via the interconnection channel with device 2. This allows device 2 to perform collaborative display based on display scheme 2 sent by device 1.

[0131] In addition, device 1 can also control screen 1 to perform corresponding displays according to display scheme 1.

[0132] It should be noted that in this example, device 1 can control the display of screen 1 according to display scheme 1 through internal control. However, device 1 needs to communicate with device 2 to control device 2 to execute the corresponding collaborative display according to display scheme 2.

[0133] In some embodiments of this application, device 1 can control screen 1 to display content after acquiring display scheme 1; simultaneously, it can control device 2 to display content according to display scheme 2. In this way, the display on screen 1 may precede the display on screen 2, allowing the user to quickly view a portion of the collaboratively displayed content. For example, this scheme can be applied to scenarios where the collaboratively displayed content is relatively complex.

[0134] In other embodiments, after acquiring display scheme 1 and display scheme 2, device 1 can control the display on screen 1 by referring to the timing of display by control device 2, which has a longer display time. This achieves the effect of simultaneously displaying collaborative display content on screen 1 and screen 2. This allows users to view the collaborative display content completely, better demonstrating the integrity of the collaborative display content to the user. For example, this solution can be applied to scenarios where the collaborative display content is relatively simple.

[0135] In this way, by adaptively determining the position information of device 2 relative to device 1, device 1 can automatically adjust the content to be displayed by each device during collaborative display. This allows device 1 and device 2 to automatically adjust the displayed content based on the position information of device 2 relative to device 1 without user intervention, effectively avoiding collaborative display errors caused by discrepancies between the user-set position options and the actual positions. For example, combined with... Figure 4 Please refer to Figure 8 In the position of a tablet computer as an auxiliary device, such as... Figure 4 When the position shown in (a) changes, the solution provided in the embodiments of this application (such as...) is adopted. Figure 7 (As shown in the diagram), the main device can autonomously adjust the display content of the two devices during collaborative display based on the position changes of the auxiliary device, thus enabling the acquisition of information such as... Figure 8 The correct collaborative display effect is shown, without the following: Figure 4 The problem shown in (b) is as follows.

[0136] Based on the above Figure 7 As can be understood from the description of the solution, the solution provided in this application embodiment can be applied to multiple scenarios to solve corresponding problems.

[0137] For example, in some embodiments, this solution can be applied to scenarios where two devices begin collaborative display. This allows users to use two devices for collaborative display without needing to configure location-related options.

[0138] For example, users can input such as Figure 1 After selecting the extended mode as shown, no further input is required. Figure 2 The operations shown. Correspondingly, the master device (such as...) Figure 1 The laptop shown can, after receiving the user's selected extended mode, proceed as follows: Figure 7The illustrated scheme detects changes in the surrounding magnetic field to determine the position of the auxiliary device (e.g., a tablet) relative to the main device, and based on this, determines the display content for both the main and auxiliary devices (e.g., determining a collaborative display scheme). Then, based on the determined display content, it controls the two electronic devices to perform corresponding collaborative displays. Obviously, in this example, since the user does not need to input options to select the positions of the two electronic devices, the situation where the user-selected position does not match the actual position will not occur. At the same time, because the main device can accurately determine the position information of the auxiliary device, it can perform collaborative displays more accurately. Furthermore, using... Figure 7 The solution shown can also simplify the user's operation when using the collaborative display function and improve convenience.

[0139] In other embodiments, this solution can be applied to scenarios where two devices are engaged in collaborative display. This ensures correct collaborative display between the two devices without requiring the user to reconfigure position-related options when the position information of the auxiliary device changes relative to the master device.

[0140] For example, in a collaborative display process between a primary device (such as a laptop) and a secondary device (such as a tablet), if the user moves the tablet from the left side to the right side of the laptop, the laptop can then... Figure 7 The illustrated scheme, when the magnetic field no longer changes, determines the tablet's position relative to the laptop after movement based on the distribution of the magnetic field at this point compared to when the magnetic field began to change. The laptop can then adjust the collaborative display scheme based on the determined tablet's position information, thus achieving adaptive adjustment of the collaborative display. As can be seen in this example, since the positions of the main and / or auxiliary devices do not need to be reselected after the user moves them, the situation where the user-selected position does not match the actual position will not occur. Furthermore, because the main device can accurately determine the position information of the auxiliary device, collaborative display can be performed more accurately. In addition, using... Figure 7 The solution shown can also simplify the user's operation when using the collaborative display function and improve convenience.

[0141] It should be noted that the above description uses the example of a main device controlling an auxiliary device for collaborative display. In other embodiments of this application, the auxiliary device can also perform corresponding operations, making the adaptive adjustment of the collaborative display more flexible and accurate.

[0142] For example, in combination Figure 7When device 1 executes S701, i.e., determines the position of device 2 based on changes in the magnetic field, device 2 can also determine the changes in the surrounding magnetic field during its movement using a Hall sensor installed on device 2. For example, as device 2 approaches device 1 along the negative X-axis, device 2 can determine the change in the magnetic field along the negative X-axis using its Hall sensor. Therefore, device 2 can determine that it is approaching device 1 from the right side. Device 2 can send its relative position information to device 1 so that device 1 can determine that device 2 is to the right of device 1. Alternatively, device 1 can combine the position information received from device 2 with the position information of device 2 determined by the Hall sensor on device 1 to determine that device 2 is to the right of device 1.

[0143] In other embodiments, device 2 may also send its own posture information (such as landscape or portrait posture) to device 1 so that device 1 can adjust the corresponding display scheme of device 2 accordingly, thereby enabling device 1 to more accurately control the content displayed on device 2.

[0144] For example, in combination Figure 9 This is a schematic diagram illustrating another collaborative display process provided in an embodiment of this application. The example will continue to use device 1 as the main device and device 2 as the auxiliary device. Figure 9 As shown, the method may include:

[0145] S901. Based on the changes in the magnetic field, device 1 determines the position information of device 2 relative to device 1.

[0146] Combined with Figure 7 As explained, the execution method of S901 is similar to that of S701, and will not be repeated here.

[0147] S902, Device 1 determines the display scheme 3 on screen 1 based on the position information of Device 2 relative to Device 1.

[0148] Combined with Figure 7 The execution method of S902 can be referred to in S702, where device 1 determines the specific execution process of display scheme 1 on screen 1, which will not be repeated here.

[0149] It should be noted that in some implementations of this example, device 1 can also combine its posture information 1 with the display scheme 3 during the determination process to make a comprehensive judgment. The posture information 1 of device 1 can include either a landscape or portrait orientation. This posture information 1 can be determined by device 1 through its IMU, its gravity sensor, or the aspect ratio of the content currently displayed on screen 1. This application embodiment does not limit the method by which device 1 obtains its posture information 1.

[0150] S903, Device 2 determines the attitude information 2 of Device 2.

[0151] Based on the description in S902 above, similar to the posture information 1 of device 1, the posture information of device 2 can include either landscape or portrait posture. The method for obtaining this information is similar.

[0152] S904, Device 2 sends attitude information 2 to Device 1.

[0153] For example, device 2 can send attitude information 2 to device 1 through the interconnection communication relationship established with device 1.

[0154] S905. Based on the position information of device 2 relative to device 1 and the attitude information 2, device 1 determines the display scheme 4 of device 2.

[0155] In this example, device 2 can send the acquired posture information 2 to device 1 so that device 1 can more accurately determine the display content corresponding to device 2 during the collaborative display process.

[0156] It is understandable that if device 2 rotates during movement when its screen is rectangular, problems will arise if the display is based on the original display scheme.

[0157] For example, refer to Figure 10 After device 2 moves to the left of device 1, if the screen rotates, for example, from landscape to portrait mode, then if the display is performed in portrait mode according to the landscape display scheme, the image that should be displayed on device 2 will not be fully displayed. To avoid this problem, in this embodiment, device 1 can determine whether the orientation of device 2 is landscape or portrait in the current collaborative display scenario based on the orientation information 2 obtained from device 2. This allows device 1 to flexibly adjust the corresponding display scheme 4 of device 2 accordingly.

[0158] It should be noted that, in the specific execution process of this example, the execution of S901-S905 does not have a fixed order. For example, in some embodiments, device 1 can obtain the posture information of device 2 after determining display scheme 3. It should be understood that device 1 can obtain the posture information of device 2 before determining display scheme 3. Correspondingly, in conjunction with the foregoing... Figure 7 As explained, the timing of device 1 determining display scheme 3 and display scheme 4 is also partly sequential; they can be executed sequentially or in parallel. The two can operate independently without interfering with each other.

[0159] S906. Device 1 controls screen 1 and screen 2 to perform collaborative display according to display scheme 3 and display scheme 4.

[0160] For example, device 1 can send display scheme 4 to device 2 to control device 2 to display on screen 2 according to display scheme 4. In addition, device 1 can also control screen 1 to display according to display scheme 3.

[0161] In this example, after device 1 determines a display scheme 4 that matches the position information of device 2 relative to device 1 and the posture information of device 2, device 1 can control device 2 to display according to the display scheme 4. For example, device 1 can send the display scheme 4 to device 2 so that device 2 can perform collaborative display according to the display scheme 4.

[0162] For example, when using such Figure 9 In the case of the scheme shown, the display effect is as follows: Figure 11 As shown. Comparison Figure 10 And Figure 11 The effect shown. It is obvious that, in Figure 11 In this process, after taking into account the posture information 2 of device 2, device 1 can more reasonably control device 2 to perform collaborative display, so as to avoid the situation where the image content cannot be fully displayed.

[0163] It should be noted that the above Figure 7 as well as Figure 9 In the proposed scheme, the triggering mechanism for device 1 to detect changes in its surrounding magnetic field can be either that device 1 detects its surrounding magnetic field after receiving a user instruction to start collaborative display, or that magnetic field detection is triggered according to a certain period.

[0164] In addition, in some embodiments of this application, device 1 determines the display scheme of device 2 by referring to hardware information such as the device model of device 2. For example, different electronic devices have different effects on magnetic fields. That is, as auxiliary devices of different models approach the main device from different directions, the changes in the magnetic field detected by device 1 are different. Therefore, in some embodiments of this application, device 1 can be configured with the models of devices that may be used for collaborative display, and the correspondence between these models and the magnetic field changes corresponding to different devices. Different magnetic field changes can correspond to different threshold settings. For example, using... Figure 7 Taking the illustrated scheme as an example, device 1 can interconnect with device 2 when collaborative display begins. This allows device 1 to know the device model of device 2. Based on the device model of device 2, device 1 can obtain the threshold value for magnetic field change corresponding to device 2 from the pre-configured correspondence. Therefore, during the execution of step S701, device 1 can more accurately determine whether device 2 is close to device 1 and its position relative to device 1 based on the magnetic field change and the determined threshold value for magnetic field change corresponding to device 2. It is understandable that because device 1 can flexibly select the corresponding threshold value based on the device model of device 2, device 1 can more accurately determine the location information of device 2, thereby enabling device 1 to more accurately control screen 1 and screen 2 of device 2 for collaborative display.

[0165] It should be noted that the above descriptions of the solutions provided in the embodiments of this application are all based on the example of the main device automatically determining the position information of the auxiliary device according to changes in the magnetic field, thereby achieving an accurate and convenient collaborative display effect. In other embodiments, the method provided in the embodiments of this application can also be applied to other multi-screen display scenarios besides collaborative display. For example, in display modes such as mirror display mode or extended display mode, the main device also needs to determine the corresponding display scheme according to the positional relationship between multiple screens, and then control each screen to display the corresponding content. Using the collaborative display scheme provided in the embodiments of this application, the main device can automatically determine the position information of other devices participating in multi-screen display and provide an accurate display scheme accordingly. This also achieves the effect of accurate display without requiring user settings.

[0166] The foregoing primarily describes the solutions provided by the embodiments of this application from the perspective of electronic devices. To achieve the aforementioned functions, it includes corresponding hardware structures and / or software modules for executing each function. Those skilled in the art should readily recognize that, based on the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein, this application can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed by hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0167] This application embodiment can divide the device involved into functional modules according to the above method examples. For example, each function can be divided into its own functional module, or two or more functions can be integrated into one processing module. The integrated module can be implemented in hardware or as a software functional module. It should be noted that the module division in this application embodiment is illustrative and only represents one logical functional division. In actual implementation, there may be other division methods.

[0168] Please refer to Figure 12 This is a schematic diagram illustrating the composition of a collaborative display device 1200 provided in an embodiment of this application. This device can be disposed in a first electronic device to implement the collaborative display scheme in the above embodiments. (Combined with...) Figure 5 , Figure 12 The aforementioned collaborative display device 1200 can be housed within the electronic device 500, or it can be another description of the electronic device 500. The functions of the various units included can be implemented through the hardware components within the electronic device 500.

[0169] For example, the device includes: a determining unit 1201, configured to automatically determine the position information of the second electronic device relative to the first electronic device, the position information including the upper side of the first electronic device, the lower side of the first electronic device, the left side of the first electronic device, and the right side of the first electronic device.

[0170] The determining unit 1201 is also used to determine the collaborative display scheme based on the location information.

[0171] The control unit 1202 is used to control the first electronic device and the second electronic device to perform collaborative display according to the collaborative display scheme.

[0172] In one possible design, the device further includes a receiving unit 1203, configured to receive a user operation before the first electronic device automatically determines the position information of the second electronic device relative to the first electronic device, the user operation being used to instruct the first electronic device to activate a collaborative display function. Alternatively, the first user's operation is used to instruct the first electronic device to activate an extended display mode. Alternatively, the first user's operation is used to instruct the first electronic device to activate a mirror display mode.

[0173] In one possible design, the first electronic device has the ability to detect the strength of the surrounding magnetic field. The determining unit 1201 is specifically used to determine position information based on changes in the magnetic field surrounding the first electronic device. Specifically, if the magnetic field strength in one direction exceeds a preset threshold, the determining unit 1201 determines the position information of the second electronic device relative to the first electronic device, where the direction includes the upper side, lower side, left side, and right side of the first electronic device.

[0174] In one possible design, the first electronic device is equipped with a magnetic sensor, which provides the first electronic device with the ability to detect the strength of the surrounding magnetic field.

[0175] In one possible design, the control unit 1202 is used by the first electronic device to control its first display screen to display a first portion of the content to be displayed, according to a collaborative display scheme. The control unit 1202 is also used to control the second display screen of the second electronic device to display a second portion of the content to be displayed, according to the collaborative display scheme, wherein the first and second portions constitute the content to be displayed.

[0176] In one possible design, when the second electronic device is located to the left of the first electronic device, the first part is the right-hand portion of the content to be displayed, and the second part is the left-hand portion of the content to be displayed. When the second electronic device is located to the right of the first electronic device, the first part is the left-hand portion of the content to be displayed, and the second part is the right-hand portion of the content to be displayed. When the second electronic device is located above the first electronic device, the first part is the bottom-hand portion of the content to be displayed, and the second part is the top-hand portion of the content to be displayed. When the second electronic device is located below the first electronic device, the first part is the top-hand portion of the content to be displayed, and the second part is the bottom-hand portion of the content to be displayed.

[0177] In one possible design, the receiving unit 1203 is further configured to receive the attitude information of the second electronic device before the first electronic device determines the collaborative display scheme based on the position information. The determining unit 1201 is configured to determine the collaborative display scheme based on the relative position and the attitude information of the second electronic device.

[0178] In one possible design, the posture information includes: landscape posture or portrait posture.

[0179] In one possible design, the first electronic device and the second electronic device are wirelessly connected.

[0180] In one possible design, before the control unit 1202 controls the first electronic device and the second electronic device to perform collaborative display according to the collaborative display scheme, the position information of the first electronic device relative to the second electronic device is the first position information. The control unit 1202 is used to control the first electronic device to perform a first collaborative display according to the first collaborative display scheme based on the first position information. The first position information corresponds to the first collaborative display scheme. When the first position information changes to second position information, the determining unit 1201 is used to automatically determine the position information of the second electronic device relative to the first electronic device as the second position information. The determining unit 1201 is also used to determine a second collaborative display scheme based on the second position information. The control unit 1202 is used to control the first electronic device and the second electronic device to switch from the first collaborative display to the second collaborative display according to the second collaborative display scheme, where the second collaborative display is a display corresponding to the second collaborative display scheme.

[0181] It should be noted that all relevant content of each step involved in the above method embodiments can be referenced from the functional description of the corresponding functional module, and will not be repeated here.

[0182] Figure 13 A schematic diagram of the composition of an electronic device 1300 is shown. Exemplarily, this electronic device 1300 can be the first electronic device described in the foregoing embodiments. For example... Figure 13 As shown, the electronic device 1300 may include a processor 1301 and a memory 1302. The memory 1302 is used to store computer execution instructions. Exemplarily, in some embodiments, when the processor 1301 executes the instructions stored in the memory 1302, the electronic device 1300 may execute any of the collaborative display methods shown in the above embodiments.

[0183] It should be noted that all relevant content of each step involved in the above method embodiments can be referenced from the functional description of the corresponding functional module, and will not be repeated here.

[0184] Figure 14A schematic diagram of a chip system 1400 is shown. The chip system 1400 may include a processor 1401 and a communication interface 1402, used to support related devices in implementing the functions involved in the above embodiments. In one possible design, the chip system also includes a memory for storing necessary program instructions and data for the terminal. This chip system may be composed of chips or may include chips and other discrete devices. It should be noted that in some implementations of this application, the communication interface 1402 may also be referred to as an interface circuit.

[0185] It should be noted that all relevant content of each step involved in the above method embodiments can be referenced from the functional description of the corresponding functional module, and will not be repeated here.

[0186] The functions, actions, operations, or steps in the above embodiments can be implemented, in whole or in part, by software, hardware, firmware, or any combination thereof. When implemented using software programs, they can be implemented, in whole or in part, in the form of a computer program product. This computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium accessible to a computer or include one or more data storage devices such as servers and data centers that can be integrated with the medium. The available media can be magnetic media (e.g., floppy disks, hard disks, magnetic tapes), optical media (e.g., DVDs), or semiconductor media (e.g., solid-state disks (SSDs)).

[0187] Although this application has been described in conjunction with specific features and embodiments, it is obvious that various modifications and combinations can be made thereto without departing from the spirit and scope of this application. Accordingly, this specification and drawings are merely exemplary illustrations of this application as defined by the appended claims, and are considered to cover any and all modifications, variations, combinations, or equivalents within the scope of this application. Clearly, those skilled in the art can make various alterations and modifications to this application without departing from the spirit and scope of this application. Thus, if such modifications and modifications of this application fall within the scope of the claims of this application and their equivalents, this application is also intended to include such modifications and modifications.

Claims

1. A collaborative display method, characterized in that, The method includes: The first electronic device receives an operation from a user, the user's operation being used to instruct the first electronic device to activate a collaborative display function; or, the user's operation being used to instruct the first electronic device to activate an extended display mode; or, the user's operation being used to instruct the first electronic device to activate a mirror display mode. The first electronic device automatically determines the position information of the second electronic device relative to the first electronic device based on changes in the magnetic field around it. This position information includes the top, bottom, left, and right sides of the first electronic device. The first electronic device is equipped with a magnetic sensor for detecting magnetic field strength. If the first electronic device determines that the change in magnetic field strength in a certain direction exceeds a preset threshold, it determines the position information of the second electronic device relative to itself. This direction includes the top, bottom, left, and right sides of the first electronic device. The change in magnetic field strength is generated by magnetic materials in the second electronic device. The first electronic device determines a collaborative display scheme based on the location information; The first electronic device controls the first electronic device and the second electronic device to perform collaborative display according to the collaborative display scheme.

2. The method according to claim 1, characterized in that, The first electronic device controls the first electronic device and the second electronic device to perform collaborative display according to the collaborative display scheme, including: According to the collaborative display scheme, the first electronic device controls its first display screen to display a first part of the content to be displayed; the first electronic device controls the second display screen of the second electronic device to display a second part of the content to be displayed, and the first part and the second part constitute the content to be displayed.

3. The method according to claim 2, characterized in that, When the second electronic device is located to the left of the first electronic device, the first part is the right part of the content to be displayed, and the second part is the left part of the content to be displayed. When the second electronic device is located to the right of the first electronic device, the first part is the left part of the content to be displayed, and the second part is the right part of the content to be displayed. When the second electronic device is located above the first electronic device, the first part is the lower part of the content to be displayed, and the second part is the upper part of the content to be displayed. When the second electronic device is located below the first electronic device, the first part is the upper part of the content to be displayed, and the second part is the lower part of the content to be displayed.

4. The method according to claim 1, characterized in that, Before the first electronic device determines the collaborative display scheme based on the location information, the method further includes: The first electronic device receives the posture information of the second electronic device, the posture information including: landscape posture or portrait posture; The first electronic device determines a collaborative display scheme based on the location information, including: The first electronic device determines the collaborative display scheme based on the location information and the posture information of the second electronic device.

5. The method according to claim 1, characterized in that, Before the first electronic device controls the first electronic device and the second electronic device to perform collaborative display according to the collaborative display scheme, the position information of the first electronic device relative to the second electronic device is the first position information; the first electronic device and the second electronic device perform the first collaborative display according to the first collaborative display scheme based on the first position information. The first location information corresponds to the first collaborative display scheme; When the first location information changes to the second location information, the first electronic device automatically determines the location information of the second electronic device relative to the first electronic device based on the change in the magnetic field around the first electronic device, including: The first electronic device automatically determines the position information of the second electronic device relative to the first electronic device as the second position information based on the change of the magnetic field around the first electronic device; The first electronic device determines a collaborative display scheme based on the location information, including: The first electronic device determines the second collaborative display scheme based on the second location information; The first electronic device controls the first electronic device and the second electronic device to perform collaborative display according to the collaborative display scheme, including: According to the second collaborative display scheme, the first electronic device controls the first electronic device and the second electronic device to switch from the first collaborative display to the second collaborative display, whereby the second collaborative display is a display corresponding to the second collaborative display scheme.

6. An electronic device, characterized in that, The electronic device includes one or more processors and one or more memories; the one or more memories are coupled to the one or more processors, and the one or more memories store computer instructions; When the one or more processors execute the computer instructions, the electronic device performs the collaborative display method as described in any one of claims 1-5.

7. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes computer instructions that, when executed, perform the collaborative display method as described in any one of claims 1-5.

Images