A combined display method, mobile device and electronic device

By wirelessly controlling multiple electronic devices under the control of mobile devices, the display can be combined and presented, solving the hardware cost problem of devices with small screen sizes and achieving a better user experience and display effect.

CN114840157BActive Publication Date: 2025-10-24HUAWEI TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202110132290.5
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-01-31
Publication Date
2025-10-24
Estimated Expiration
2041-01-31

AI Technical Summary

Technical Problem

In the existing technology, electronic devices with large display screens are subject to manufacturing and cost limitations, and multi-screen display through wired connections and split-screen devices increases hardware costs.

Method used

By wirelessly broadcasting messages from mobile devices, multiple electronic devices can be combined for display without the need for dedicated split-screen equipment and complex wiring. The mobile device determines the location and address information of the devices to control the combined display.

Benefits of technology

It enables the combined display of multiple electronic devices, reducing hardware costs and improving the user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114840157B_ABST
    Figure CN114840157B_ABST
Patent Text Reader

Abstract

The application relates to a combined display method, a mobile device and an electronic device. The method comprises the following steps: the mobile device broadcasts a first message in response to receiving a first input, the first message being used for indicating that combined display is required; the mobile device acquires a first image, the first image comprising a first display screen and a second display screen, the first display screen displaying first information, and the second display screen displaying second information; the mobile device sends a second message to a first electronic device, the second message comprising the first information, the second information, orientation information and size proportion relationship between the first display screen and the second display screen, and a corresponding relationship between the first information and the first display screen. The first electronic device controls multiple electronic devices to perform combined display in response to receiving the second message. According to the embodiment of the application, wiring between the split-screen device and different electronic devices is no longer required, the cost of the multiple electronic devices performing combined display can be reduced, and the combined display is realized.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to the field of communication, in particular to a combination display method, a mobile device and an electronic device. BACKGROUND

[0002] Generally, compared with the electronic device with a small display screen, the electronic device with a large display screen can bring better visual impact effect and better user experience. However, the electronic device with a large display screen is limited in manufacturing technology and has a significantly increased cost.

[0003] In some occasions such as stage performance or home watching, the combination display of multiple electronic devices with small display screens can be realized through wired connection between different electronic devices and a split screen device, so that the audience far away can also enjoy a better display effect or the same display effect as the electronic device with a large display screen. However, this requires complex wiring and a dedicated split screen device (such as a splitter) to control the combination and image display of different display screens of different electronic devices, thereby increasing the hardware cost.

[0004] Therefore, how to realize the combination display of multiple different electronic devices with small display screens while reducing the hardware cost becomes a technical problem to be solved. SUMMARY

[0005] To solve the above technical problem, the present application provides a combination display method, a mobile device and an electronic device. The technical solution provided by the present application does not require a dedicated split screen device. In addition, the complex wiring between different electronic devices is also not required through a wireless manner. Since the split screen device and the wiring between different electronic devices are no longer used, the cost is reduced. Moreover, the combination display of multiple different electronic devices is realized.

[0006] In a first aspect, a combined display system is provided. The system comprises a mobile device, a first electronic device and a second electronic device located in the same local area network, the first electronic device comprising a first display screen, the second electronic device comprising a second display screen; the mobile device is configured to broadcast a first message in response to a received first input; the first message is configured to indicate that a combined display is required; the first electronic device is configured to display first information on the first display screen in response to the received first message; the first information is configured to indicate address information of the first electronic device; the second electronic device is configured to display second information on the second display screen in response to the received first message; the second information is configured to indicate address information of the second electronic device; the mobile device is further configured to acquire a first image, the first image comprising the first display screen and the second display screen; the first display screen displays the first information; the second display screen displays the second information; the mobile device is further configured to select the first electronic device corresponding to the first display screen as a master device, and send a second message to the first electronic device; the second message comprises the first information, the second information, orientation information between the first display screen and the second display screen, and a correspondence between the first information and the first display screen, which are acquired by the mobile device according to the first image; the second message is further configured to indicate that the first electronic device is selected as the master device; and the first electronic device is further configured to control the first display screen and the second display screen to perform combined display in response to the received second message.

[0007] In this way, the mobile device sends the first message to trigger the first electronic device to display the first information indicating the address information of the first electronic device and the second electronic device to display the second information indicating the address information of the second electronic device. The mobile device can determine the orientation information and the address information of the first electronic device and the second electronic device after acquiring the first image. The mobile device can indicate the orientation information and the address information of the first electronic device and the second electronic device to the first electronic device, so that the first electronic device can control the first electronic device and the second electronic device to perform combined display. No dedicated split-screen device is required. In addition, the split-screen device between different electronic devices is not required, and the cost is reduced. Moreover, the combined display of multiple different electronic devices is achieved.

[0008] Optionally, the mobile device can send the first image to the first electronic device only; the first electronic device can acquire the first information, the second information, the orientation information between the first display screen and the second display screen, and the correspondence between the first information and the first display screen according to the first image. The first electronic device can determine whether it is selected as the master device according to whether the first image is sent to itself. Other embodiments of the present application can also adopt this optional manner.

[0009] In some possible implementation manners, the first information, the second information, the orientation information between the first display screen and the second display screen, and the correspondence relationship between the first information and the first display screen can be carried in a second message; and the information indicating that the first electronic device is selected as the master device can be carried in a third message, and the second message and the third message are different messages.

[0010] In some possible implementation manners, the second message further includes a correspondence relationship between the second information and the second display screen.

[0011] With reference to the first aspect, in some implementation manners of the first aspect, the first electronic device corresponding to the first display screen is selected as the master device; and the method comprises: receiving, by the mobile device, a user selection of the first electronic device corresponding to the first display screen; and in response to the user selection, recording, by the mobile device, the first electronic device as the master device. In this way, the user can conveniently select one electronic device as the master device from a plurality of electronic devices, and the master device controls the plurality of electronic devices for image display in combination.

[0012] With reference to the first aspect, in some implementation manners of the first aspect, the first electronic device corresponding to the first display screen is selected as the master device; and the method comprises: randomly selecting, by the mobile device, the first electronic device corresponding to the first display screen as the master device.

[0013] With reference to the first aspect, in some implementation manners of the first aspect, the first electronic device and the second electronic device are further configured to maintain a first state after being powered on until a preset time length is reached after being powered on, the second message is received, a notification message is received, or a stop message is received; in the first state, the first electronic device and the second electronic device are configured to display the first information and the second information through the first display screen and the second display screen respectively after receiving the first message from the mobile device; the first electronic device is further configured to send a notification message to the second electronic device after receiving the second message from the mobile device, the notification message being used to instruct the second electronic device to stop being in the first state; the second electronic device is further configured to enter a second state after receiving the notification message; in the second state, the second electronic device is only controlled by the master device; and the second electronic device is further configured to no longer display the second information through the second display screen after receiving the stop message.

[0014] In some possible implementation manners, the first state is a discovery state.

[0015] With reference to the first aspect, in some implementations of the first aspect, the controlling the first electronic device and the second electronic device to display in combination comprises: the first electronic device receiving an image frame to be displayed, splitting the image frame according to the orientation information and the size ratio relationship of the first display screen and the second display screen, and the size of the first display screen, to obtain a first part image and a second part image, displaying the first part image on the first display screen, sending the second part image to the second electronic device, and instructing to display the second part image on the second display screen. The size of the first display screen can be obtained by the first electronic device itself. According to the size ratio relationship of the first display screen and the second display screen, the size of the second display screen can be obtained.

[0016] In some possible implementations, the orientation information of the first display screen and the second display screen can be the relative position relationship of the first display screen and the second display screen.

[0017] With reference to the first aspect, in some implementations of the first aspect, the splitting the image frame according to the orientation information and the size ratio relationship of the first display screen and the second display screen, and the size of the first display screen comprises: splitting the image frame according to the orientation information of the first display screen and the second display screen, the size of the first display screen, and the size of the second display screen.

[0018] With reference to the first aspect, in some implementations of the first aspect, the image frame is from the screen projection data of the mobile device.

[0019] With reference to the first aspect, in some implementations of the first aspect, the mobile device is specifically configured to: before obtaining the first image, prompt to take a picture of the first display screen and the second display screen which need to be displayed in combination; and in response to a detected picture taking operation of the first display screen and the second display screen, obtain the first image.

[0020] With reference to the first aspect, in some implementations of the first aspect, the first information is used to indicate the MAC address of the first electronic device, and the second information is used to indicate the MAC address of the second electronic device.

[0021] In a second aspect, a combined display method is provided, which is applied to a mobile device. The mobile device, a first electronic device and a second electronic device are located in a same local area network, the first electronic device comprises a first display screen, and the second electronic device comprises a second display screen. The method comprises: receiving a first input; broadcasting a first message in response to the first input; the first message is used to indicate that combined display is required; obtaining a first image, the first image comprises the first display screen and the second display screen; the first display screen displays first information; the second display screen displays second information; the first information is used to indicate address information of the first electronic device; the second information is used to indicate address information of the second electronic device; selecting the first electronic device corresponding to the first display screen as a master device, and sending a second message to the first electronic device; the second message comprises the first information, the second information, orientation information between the first display screen and the second display screen, and a corresponding relationship between the first information and the first display screen, which are obtained by the mobile device according to the first image; the second message is also used to indicate that the first electronic device is selected as the master device; sending an image frame to the first electronic device, or sending a link address to the first electronic device.

[0022] With reference to the second aspect, in some implementations of the second aspect, the selecting the first electronic device corresponding to the first display screen as the master device comprises: the mobile device receiving user selection of the first electronic device corresponding to the first display screen; and in response to the user selection, the mobile device recording the first electronic device as the master device.

[0023] With reference to the second aspect, in some implementations of the second aspect, the selecting the first electronic device corresponding to the first display screen as the master device comprises: the mobile device randomly selecting the first electronic device corresponding to the first display screen as the master device.

[0024] With reference to the second aspect, in some implementations of the second aspect, the image frame is from screen projection data of the mobile device.

[0025] With reference to the second aspect, in some implementations of the second aspect, the first information is used to indicate a media access control (MAC) address of the first electronic device, and the second information is used to indicate a MAC address of the second electronic device.

[0026] In a third aspect, a combination display method is provided, which is applied to a first electronic device; the first electronic device, a second electronic device and a mobile device are located in a same local area network, the first electronic device comprises a first display screen, and the second electronic device comprises a second display screen; the method comprises: the first electronic device receives a first message, the first message being used to indicate that combination display is required; in response to the received first message, the first display screen displays first information; the first information is used to indicate address information of the first electronic device; the first electronic device receives a second message sent by the mobile device, the second message comprising the first information obtained by the mobile device according to a first image, second information, orientation information between the first display screen and the second display screen, and a correspondence relationship between the first information and the first display screen; the second message is also used to indicate that the first electronic device is selected as a master device; and in response to the received second message, the first electronic device controls the first display screen and the second display screen to perform combination display.

[0027] With reference to the third aspect, in some implementations of the third aspect, before the first electronic device receives the first message, the method further comprises: the first electronic device maintains a first state after being powered on until a preset time length is reached or the second message is received; in the first state, the first electronic device is configured to display the first information on the first display screen after receiving the first message of the mobile device.

[0028] With reference to the third aspect, in some implementations of the third aspect, the method further comprises: after receiving the second message of the mobile device, the first electronic device sends a notification message to the second electronic device, the notification message being used to indicate that the second electronic device stops being in the first state.

[0029] With reference to the third aspect, in some implementations of the third aspect, the first electronic device controls the first display screen and the second display screen to perform combination display; which comprises: the first electronic device receives an image frame to be displayed, splits the image frame according to orientation information and size ratio relationship of the first display screen and the second display screen and size of the first display screen, to obtain a first partial image and a second partial image, displays the first partial image on the first display screen, sends the second partial image to the second electronic device, and indicates the second partial image on the second display screen.

[0030] With reference to the third aspect, in some implementations of the third aspect, the first information is used to indicate a media access control layer (MAC) address of the first electronic device, and the second information is used to indicate a MAC address of the second electronic device.

[0031] In a fourth aspect, a mobile device is provided, comprising one or more processors, one or more memories, and one or more computer programs; the one or more computer programs are stored in the memories, and when the mobile device is running, the processor executes the one or more computer programs stored in the memories, so that the mobile device performs the method according to any one of the second aspect.

[0032] In a fifth aspect, an electronic device is provided, comprising one or more processors, one or more memories, and one or more computer programs; the one or more computer programs are stored in the memories, and when the electronic device is running, the processor executes the one or more computer programs stored in the memories, so that the electronic device performs the method according to any one of the third aspect.

[0033] In a sixth aspect, the present application provides a computer storage medium, comprising computer instructions, when the computer instructions are running on a mobile device, causing the mobile device to perform the method according to any one of the second aspect; or when the computer instructions are running on an electronic device, causing the electronic device to perform the method according to any one of the third aspect.

[0034] In a seventh aspect, the present application provides a computer program product, when the computer program product is running on a mobile device, causing the mobile device to perform the method according to any one of the second aspect; or when the computer program product is running on an electronic device, causing the electronic device to perform the method according to any one of the third aspect.

[0035] It can be understood that the mobile device, the electronic device, the computer storage medium and the computer program product provided above are all used to perform the corresponding method provided above, and therefore the beneficial effects achieved thereby can refer to the beneficial effects of the corresponding method provided above, which will not be described here again. BRIEF DESCRIPTION OF DRAWINGS

[0036] Figure 1 is a scene schematic diagram of a combination display method provided by an embodiment of the present application;

[0037] Figure 2 is a hardware structure schematic diagram of a mobile device provided by an embodiment of the present application;

[0038] Figure 3 is a hardware structure schematic diagram of an electronic device provided by an embodiment of the present application;

[0039] Figure 4 is a schematic flowchart of a combination display method provided by an embodiment of the present application;

[0040] Figure 5 is another schematic flowchart of a combination display method provided by an embodiment of the present application;

[0041] Figure 6 is another exemplary flowchart of a combined display method provided by embodiments of the present application;

[0042] Figure 7 is another exemplary flowchart of a combined display method provided by embodiments of the present application;

[0043] Figure 8 is another exemplary flowchart of a combined display method provided by embodiments of the present application;

[0044] Figure 9 is a set of graphical user interfaces provided by embodiments of the present application;

[0045] Figure 10 is another set of graphical user interfaces provided by embodiments of the present application;

[0046] Figure 11 is another set of graphical user interfaces provided by embodiments of the present application;

[0047] Figure 12 is another set of graphical user interfaces provided by embodiments of the present application;

[0048] Figure 13 is another set of graphical user interfaces provided by embodiments of the present application;

[0049] Figure 14 is another set of graphical user interfaces provided by embodiments of the present application.

[0050] Figure 15 is a structural composition schematic diagram of a mobile device provided by embodiments of the present application;

[0051] Figure 16 is a structural composition schematic diagram of an electronic device provided by embodiments of the present application. DETAILED DESCRIPTION

[0052] The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application. In the description of the embodiments of the present application, the terms used in the following embodiments are only for the purpose of describing the specific embodiments and are not intended to be limiting on the present application. As used in the specification and the appended claims of the present application, the singular forms “a,” “an,” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will also be understood that “at least one” and “one or more” as used in the embodiments herein indicates one or two or more (including two), unless otherwise indicated. The term “and / or” is used to describe the association relationship of the associated objects, which means that there can be three relationships; for example, A and / or B can mean that A exists alone, A and B exist together, and B exists alone, where A and B can be singular or plural. The character “ / ” generally represents an “or” relationship between the associated objects.

[0053] In this specification, the reference “one embodiment” or “some embodiments” means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present application. Thus, the appearances of the phrases “in one embodiment”, “in some embodiments”, “in other embodiments”, “in additional embodiments”, etc. in various places in this specification are not necessarily all referring to the same embodiment, but can refer to one or more but not all embodiments, unless otherwise indicated. The terms “comprising”, “including”, “having” and their variants mean “including but not limited to”, unless otherwise indicated. The term “connected” includes both direct connection and indirect connection, unless otherwise indicated. “First”, “second”, etc. are used only for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features.

[0054] In the embodiments of the present application, the words “exemplary” or “for example” are used to mean serving as an example, instance, or illustration. Any embodiment or design presented as “exemplary” or “for example” in the embodiments of the present application is not necessarily to be construed as preferred or advantageous over other embodiments or design solutions. Rather, the use of the words “exemplary” or “for example” is intended to present concepts in a concrete manner.

[0055] Generally, the electronic device with a larger display screen size can bring better visual impact and better user experience to users than the electronic device with a smaller display screen size. However, the electronic device with a larger display screen size is limited in manufacturing technology and has a significantly increased cost. In some occasions such as stage performance or home viewing, multiple electronic devices with smaller display screen sizes can be connected by wires and a split screen device to achieve a combined display, so that the audience far away can also enjoy a better display effect or the same display effect as the electronic device with a larger display screen size. However, this requires complex wiring and a dedicated split screen device (such as a splitter) to control the combination and image display of different display screens of different electronic devices, thereby increasing the hardware cost. Therefore, how to achieve the combined display of multiple different electronic devices with smaller display screen sizes while reducing the hardware cost becomes a technical problem to be solved.

[0056] To solve the above technical problem, the application provides a combined display method, a mobile device, an electronic device and a combined display system. The technical solution provided by the application does not require a dedicated split screen device. In addition, the complex wiring between different electronic devices is also not required by a wireless manner. Since the split screen device and the wiring between different electronic devices are no longer used, the cost is reduced. Moreover, the combined display of multiple different electronic devices is achieved.

[0057] Exemplarily, Figure 1 A scenario of the combined display method provided by the embodiment of the application is shown. As shown in Figure 1 The mobile device 100 and multiple electronic devices (for example, the electronic device 200, the electronic device 201 and the electronic device 202) are located in the same local area network. When receiving a first input, the mobile device 100 can send a broadcast message to the multiple electronic devices, the broadcast message being used to instruct the multiple electronic devices in the local area network to enter a combined display state. After receiving the broadcast message, the multiple electronic devices can display information indicating their addresses on their respective display screens. The mobile device 100 can determine the position information of each electronic device in the multiple electronic devices and the address information of each electronic device through the first image information. The mobile device 100 can send indication information to one of the multiple electronic devices (for example, the electronic device 200), the indication information being used to indicate the position information of each electronic device in the multiple electronic devices and the address information of each electronic device. The electronic device 200 receiving the indication information can split the image information to be displayed according to the indication information, so as to display part of the image information on the display screen of the electronic device 200 and send the other part of the image information to the remaining electronic devices.

[0058] The mobile device of the embodiments of the present application includes, but is not limited to, a smart phone, a tablet computer, a wearable electronic device (such as a smart watch, a smart bracelet, a smart ring, and smart glasses) with wireless communication function, and the like. The exemplary embodiments of the mobile device include, but are not limited to, a portable electronic device with Windows, Linux or other operating system. The mobile device can also be other portable devices, such as a laptop computer, and the like. It should also be understood that in some other embodiments, the mobile device can also not be a portable device, but a desktop computer. The mobile device of the embodiments of the present application includes, but is not limited to, a smart phone, a tablet computer, a wearable electronic device (such as a smart watch, a smart bracelet, a smart ring, and smart glasses) with wireless communication function, and the like. The exemplary embodiments of the mobile device include, but are not limited to, a portable electronic device with Windows, Linux or other operating system. The mobile device can also be other portable devices, such as a laptop computer, and the like. It should also be understood that in some other embodiments, the mobile device can also not be a portable device, but a desktop computer.

[0059] Exemplarily, Figure 2 The hardware structure of the mobile device 100 provided by the embodiments of the present application is shown. As shown in the figure, Figure 2 The mobile device 100 can include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a loudspeaker 170A, a receiver 170B, a microphone 170C, a headset interface 170D, a sensor module 180, a key 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, and the like. The sensor module 180 can include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.

[0060] It can be understood that the structure shown in the embodiments of the present application does not constitute a specific limitation on the mobile device 100. In some other embodiments of the present application, the mobile device 100 can include more or fewer components than shown in the figure, or combine some components, or split some components, or different arrangement of components. The components shown in the figure can be implemented in hardware, software or a combination of software and hardware.

[0061] The charging management module 140 is used to receive charging input from a charger. The power management module 141 is used to connect the battery 142 with the processor 110. The wireless communication function of the mobile device 100 can be realized through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, a modem processor and a baseband processor, and the like.

[0062] Antenna 1 and antenna 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in mobile device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization of antennas. For example, antenna 1 can be multiplexed as a diversity antenna for wireless local area network. In some other embodiments, antennas can be used in combination with a tuning switch.

[0063] Mobile communication module 150 can provide a solution including 2G / 3G / 4G / 5G wireless communication applied on mobile device 100. Mobile communication module 150 can include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. Mobile communication module 150 can receive electromagnetic waves by antenna 1, and perform filtering, amplification, etc. on the received electromagnetic waves, and transmit the processed signals to a modem processor for demodulation. Mobile communication module 150 can also amplify signals modulated by the modem processor, and convert the signals into electromagnetic waves radiated by antenna 1. In some embodiments, at least part of the functional modules of mobile communication module 150 can be arranged in processor 110.

[0064] The modem processor can include a modulator and a demodulator. The modulator is used to modulate a low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate a received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to a baseband processor for processing. The low-frequency baseband signal processed by the baseband processor is transmitted to an application processor. The application processor outputs a sound signal through an audio device (not limited to loudspeaker 170A, microphone 170B, etc.), or displays an image or video through display screen 194. In some embodiments, the modem processor can be a separate device. In some other embodiments, the modem processor can be independent of processor 110, and arranged in the same device as mobile communication module 150 or other functional modules.

[0065] The wireless communication module 160 can provide solutions for wireless communication applied on the mobile device 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) network), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) technology, etc. The wireless communication module 160 can be one or more devices integrated with at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering processing on the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive signals to be sent from the processor 110, perform frequency modulation and amplification, and convert the signals to electromagnetic wave radiation via the antenna 2.

[0066] In the embodiments of the present application, the mobile device 100 can send a broadcast message through the wireless communication module 160, and the broadcast message is used to enter the combined display state for electronic devices in the local area network. The mobile device 100 can also send indication information to the electronic device 200 through the wireless communication module 160, and the indication information is used to indicate the orientation information of each electronic device in the plurality of electronic devices and the address information of each electronic device.

[0067] In some embodiments, antenna 1 and mobile communication module 150 are coupled, and antenna 2 and wireless communication module 160 are coupled, so that the mobile device 100 can communicate with a network and other devices through wireless communication technologies. The wireless communication technologies can include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. The GNSS can include global positioning system (GPS), global navigation satellite system (GLONASS), beidu navigation satellite system (BDS), quasi-zenith satellite system (QZSS), and / or satellite based augmentation systems (SBAS).

[0068] The mobile device 100 can implement a camera function through an ISP, a camera 193, a video codec, a GPU, a display 194, and an application processor, etc.

[0069] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the mobile device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, music, video, and other files are saved in the external memory card.

[0070] The mobile device 100 can implement an audio function through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, and an application processor, etc. For example, music playing, recording, etc.

[0071] Exemplarily,Figure 3 A hardware structure of the electronic device 200 provided by an embodiment of the present application is shown. The electronic device 200 can include a processor 210, an external memory interface 220, an internal memory 221, a universal serial bus (USB) interface 230, a charging management module 240, a power management module 241, a battery 242, an antenna 3, a wireless communication module 250, a sensor module 260, an input module 270, an output module 280, and a display screen 290, and the like.

[0072] It can be understood that the structure shown in the embodiments of the present application does not constitute a specific limitation on the electronic device 200. In other embodiments of the present application, the electronic device 200 can include more or fewer components than shown, or combine certain components, or split certain components, or different arrangement of components. The components shown can be implemented in hardware, software, or a combination of software and hardware. For example, the electronic device 200 can be a smart lamp, a smart television, a smart speaker, and the like.

[0073] The processor 210 can include one or more processing units. For example: the processor 210 can include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), and the like. Among them, different processing units can be independent components, or can be integrated in one or more processors. In some embodiments, the electronic device 200 can also include one or more processors 210. Among them, the controller can generate operation control signals according to instruction operation codes and timing signals, complete the control of fetching instructions and executing instructions.

[0074] In some embodiments, the processor 210 can include one or more interfaces. The interfaces can include an inter-integrated circuit (I2C) interface, an integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a SIM card interface, and / or a USB interface, etc. Among them, the USB interface 230 is an interface conforming to the USB standard specification, and can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 230 can be used to connect a charger to charge the electronic device 200, and can also be used to transmit data between the electronic device 200 and a peripheral device.

[0075] It can be understood that the interface connection relationship between the modules shown in the embodiments of the present application is only illustrative and does not constitute a limitation on the structure of the electronic device 200. In some other embodiments of the present application, the electronic device 200 can also use different interface connection methods or combinations of multiple interface connection methods in the above embodiments.

[0076] The charging management module 240 is configured to receive charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 240 can receive charging input from a wired charger through the USB interface 230. In some wireless charging embodiments, the charging management module 240 can receive wireless charging input through the wireless charging coil of the electronic device 200. The charging management module 240 can charge the battery 242 while also supplying power to the electronic device through the power management module 241.

[0077] The power management module 241 is configured to connect the battery 242 and the charging management module 240 to the processor 210. The power management module 241 receives input from the battery 242 and / or the charging management module 240 to power the processor 210, the internal memory 221, the external memory interface 220, the wireless communication module 250, and the like. The power management module 241 can also be configured to monitor parameters such as battery capacity, battery cycle count, battery health status (leakage, impedance), and the like. In some other embodiments, the power management module 241 can also be disposed in the processor 210. In some other embodiments, the power management module 241 and the charging management module 240 can also be disposed in the same device.

[0078] The wireless communication function of the electronic device 200 can be implemented by the antenna 3 and the wireless communication module 250, and the like.

[0079] The wireless communication module 250 can provide a wireless communication solution applied to the electronic device 200, including Wi-Fi, Bluetooth (BT), a wireless data transmission module (for example, 433 MHz, 868 MHz, 915 MHz), and the like. The wireless communication module 250 can be one or more devices integrated with at least one communication processing module. The wireless communication module 250 receives electromagnetic waves via the antenna 3, filters and frequency-modulates the electromagnetic wave signals, and transmits the processed signals to the processor 210. The wireless communication module 250 can also receive signals to be transmitted from the processor 210, frequency-modulate, amplify, and radiate the signals as electromagnetic waves via the antenna 3.

[0080] In the embodiments of the present application, the electronic device 200 can receive the broadcast message sent by the mobile device 100 through the wireless communication module. In response to receiving the broadcast message sent by the mobile device 100, the electronic device 200 can display information indicating the address of the electronic device 200 through the display screen 290. The electronic device 200 can also receive the indication information sent by the mobile device 100 through the wireless communication module, the indication information being used to indicate the position information of each electronic device in the plurality of electronic devices and the address information of each electronic device.

[0081] The external memory interface 220 can be configured to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 200. The external memory card communicates with the processor 210 through the external memory interface 220 to implement a data storage function. For example, files such as music and videos are stored in the external memory card.

[0082] The internal memory 221 can be used to store one or more computer programs including instructions. The processor 210 can execute the automatic unlocking method provided in some embodiments of the present application, various applications, and data processing, etc. by running the above-mentioned instructions stored in the internal memory 221. The internal memory 221 can include a code storage area and a data storage area. The code storage area can store an operating system. The data storage area can store data created during the use of the electronic device 200, etc. In addition, the internal memory 221 can include a high-speed random access memory, and can also include a non-volatile memory such as one or more disk storage components, flash memory components, universal flash storage (UFS), etc. In some embodiments, the processor 210 can cause the electronic device 200 to execute the combination display method provided in the embodiments of the present application and other applications and data processing by running the instructions stored in the internal memory 221 and / or the instructions stored in the memory disposed in the processor 210.

[0083] The input module 270 includes but is not limited to a keyboard, a touch screen (which can also be a touch display screen), a mouse, a camera, a laser pointer, a handwriting input pad, a microphone, etc. The microphone includes a single microphone and also includes an array of microphones.

[0084] The output module 280 includes but is not limited to a display screen, an LED lamp, a speaker, a headphone, a motor and its auxiliary devices that generate vibration, a heating device that generates heat, etc.

[0085] The electronic device 200 includes but is not limited to a tablet computer, a desktop computer, a portable electronic device (such as a laptop), a smart television (such as a smart television), a vehicle-mounted computer, an augmented reality (AR) device, a virtual reality (VR) device, other smart devices with display screens, etc. The exemplary embodiments of the electronic device include but are not limited to portable or non-portable electronic devices running Linux or other operating systems.

[0086] The following takes the electronic devices 200-203 included in a local area network as an example, and combines the combination display method provided in the embodiments of the present application with the communication between the electronic devices. Figures 4 to 7 The combination display method provided in the embodiments of the present application is shown in the schematic flowchart. Figure 4 As shown in the schematic flowchart, the combination display method includes: Figure 4

[0087] ​​S401, in response to receiving the first input, the mobile device 100 sends a broadcast message, the broadcast message being used to instruct the electronic devices in the local area network to enter a combined display state.

[0088] In one embodiment, the electronic devices 200-203 can be in a discovery-ready state.

[0089] For example, when the mobile device needs to perform screen projection, the mobile device can search for the electronic devices in the local area network that are in the discovery-ready state, thereby prompting the user to perform screen projection on the electronic devices 200-203. For example, Figure 9 As shown in (a) of FIG. 10, the mobile phone, the smart TV 1, the smart TV 2, the smart TV 3, and the smart TV 4 are in the same local area network, and the mobile phone displays a video playing interface including a video display window 901 and a screen projection control 902. The smart TV 1, the smart TV 2, the smart TV 3, and the smart TV 4 are in the discovery-ready state. In response to detecting that the user clicks the control 902, the mobile phone can display a GUI as shown in (b) of FIG. 10. Figure 9 As shown in the GUI of (b) of FIG. 10, the mobile phone can display a prompt box 903, where the prompt box 903 includes device information of the smart TV 1, the smart TV 2, the smart TV 3, and the smart TV 4 in the local area network that are in the discovery-ready state. Figure 9 As shown in the GUI of (b) of FIG. 10, the mobile phone can display a prompt box 903, where the prompt box 903 includes device information of the smart TV 1, the smart TV 2, the smart TV 3, and the smart TV 4 in the local area network that are in the discovery-ready state.

[0090] In one embodiment, the electronic devices 200-203 can enter the discovery-ready state when detecting a user's power-on operation.

[0091] In one embodiment, the electronic devices 200-203 can also be in the discovery-ready state within a preset time length (for example, 10 minutes) from detecting a user's power-on operation.

[0092] In one embodiment, when the mobile device detects a first operation of the user, the mobile device sends the broadcast message to the devices in the local area network.

[0093] For example, as shown in (b) of FIG. 10, when the mobile phone detects that the user clicks the control 1002, the mobile phone can send the broadcast message to the devices in the local area network. Figure 10 For example, as shown in (a) of FIG. 11, when the mobile phone detects that the user clicks the control 1102, the mobile phone can send the broadcast message to the devices in the local area network.

[0094] Figure 11 For example, as shown in (a) of FIG. 11, when the mobile phone detects that the user clicks the control 1102, the mobile phone can send the broadcast message to the devices in the local area network.

[0095] ​It should be understood that in the embodiments of the present application, the broadcast message is used to instruct the electronic devices in the local area network to enter the combined display state, i.e., instruct the electronic devices in the local area network to perform combined display; it can also be understood that the display screens of the plurality of electronic devices in the local area network form a larger display screen.

[0096] For example, the broadcast message can be a user datagram protocol (UDP) data packet. The UDP data packet includes a data part of an IP datagram. The data part of the IP datagram can include an extensible bit. The electronic devices 200-203 and the mobile device 100 can agree on the content of the extensible bit. When the extensible bit is 1, the electronic devices 200-203 can learn that the mobile device 100 wants them to enter the combined display state.

[0097] In one embodiment, the devices supporting combined display (e.g., the electronic devices 200-203) and the devices not supporting combined display (e.g., tablets, smart watches, sound boxes) can access the same local area network. The devices supporting combined display can respond to the broadcast message sent by the mobile device 100 (e.g., display address information on the display screen) after receiving the broadcast message, and the devices not supporting combined display can ignore the broadcast message after receiving the broadcast message.

[0098] S402, in response to receiving the broadcast message, the electronic device 200 displays first information on the display screen, and the first information is used to indicate the address of the electronic device 200.

[0099] S403, in response to receiving the broadcast message, the electronic device 201 displays second information on the display screen, and the second information is used to indicate the address of the electronic device 201.

[0100] S404, in response to receiving the broadcast message, the electronic device 202 displays third information on the display screen, and the third information is used to indicate the address of the electronic device 202.

[0101] S405, in response to receiving the broadcast message, the electronic device 203 displays fourth information on the display screen, and the fourth information is used to indicate the address of the electronic device 203.

[0102] It should be understood that there is no actual sequence between S402-S405.

[0103] For example, the electronic devices 200-203 are smart TV 1, smart TV 2, smart TV 3, and smart TV 4. Figure 10As shown in (b) of FIG. 1, when the smart TV 1, the smart TV 2, the smart TV 3 and the smart TV 4 receive the broadcast message, the smart TVs can display the two-dimensional code on the display screen respectively, and the two-dimensional code is used to indicate the MAC address.

[0104] It should be understood that the above-mentioned way of displaying the two-dimensional code on each smart TV to indicate the MAC address of the smart TV is only illustrative, and the embodiments of the present application are not limited thereto. For example, after receiving the broadcast message, each smart TV can also display the MAC address of the smart TV on the display screen. For example, after receiving the broadcast message, the smart TV 1 can display "3E-57-48-00-F8-ED" on the display screen.

[0105] S406, the mobile device acquires first image information in response to the received second input, and the first image information includes the display screen of the electronic device 200, the display screen of the electronic device 201, the display screen of the electronic device 202 and the display screen of the electronic device 203.

[0106] In one embodiment, the first image information includes the display screen of the electronic device 200, and the display screen of the electronic device 200 displays first information; the first image information includes the display screen of the electronic device 201, and the display screen of the electronic device 201 displays second information; the first image information includes the display screen of the electronic device 202, and the display screen of the electronic device 202 displays third information; and the first image information includes the display screen of the electronic device 203, and the display screen of the electronic device 203 displays fourth information.

[0107] In one embodiment, the mobile device acquires the first image information when detecting that the user performs the operation of photographing the electronic device 200 to the electronic device 203.

[0108] For example, as shown in (d) of FIG. 1, when the mobile phone detects that the user clicks the control 1006, the mobile phone can acquire the image information in the preview frame, and the image information includes the two-dimensional code information displayed on the smart TV 1, the smart TV 2, the smart TV 3 and the smart TV 4. Figure 10

[0109] It should be understood that the first image information can include one frame or multiple frames of image. The mobile device can prompt the user to take a photo of the electronic device to be combined and displayed, so as to obtain one frame of image information, or the mobile device can also prompt the user to record a video of the electronic device to be combined and displayed, so as to obtain multiple frames of image information.

[0110] In one embodiment, the mobile device acquires the first image information when detecting that the image of the electronic device (such as the electronic device 200 to the electronic device 203) is located in the preview frame for a preset time length, and no image of other electronic device is supplemented into the preview frame. ​

[0111] In one embodiment, before the mobile device detects the second input of the user, the mobile device may further prompt the user to obtain image information including multiple electronic devices that need to be displayed in combination.

[0112] In one embodiment, electronic devices 200-203 may also send a response to the mobile device in response to receiving the broadcast message. If the mobile device receives responses from multiple electronic devices, the mobile device may prompt the user that multiple electronic devices have been discovered within the local area network and prompt the user whether to combine and display the multiple electronic devices. In response to the user determining to combine and display multiple electronic screen devices within the local area network, the mobile device may prompt the user to obtain image information including the multiple electronic devices to be combined and displayed.

[0113] S407: The mobile device determines the position information and address information of each electronic device among the multiple electronic devices based on the first image information.

[0114] In an embodiment of the present application, the mobile device can determine the address information of the electronic device 200-electronic device 203 through the first information to the fourth information displayed on the display screen of the electronic device 200-electronic device 203, and can determine the orientation information of the electronic device 200-electronic device 203 through the position of the electronic device 200-electronic device 203 in the first image information.

[0115] For example, Figure 10 As shown in (d), the mobile phone can determine that the address information of the device on the upper left (smart TV 1) is MAC address 1, the address information of the device on the upper right (smart TV 2) is MAC address 2, the address information of the device on the lower left (smart TV 3) is MAC address 3, and the address information of the device on the lower right (smart TV 4) is MAC address 4.

[0116] S408: The mobile device sends indication information to the electronic device 200. The indication information is used to indicate the position information of each electronic device and the address information of each electronic device in the plurality of electronic devices.

[0117] In one embodiment, the indication information may include the first information, the second information, the third information, the fourth information, the orientation information between the display screen of the electronic device 200 and the display screen of the electronic device 203, the correspondence between the first information and the display screen of the electronic device 200, the correspondence between the second information and the display screen of the electronic device 201, the correspondence between the third information and the display screen of the electronic device 202, and the correspondence between the fourth information and the display screen of the electronic device 203.

[0118] In one embodiment, if the devices that need to be combined for display include the electronic device 200 and the electronic device 201, the indication information can include the first information, the second information, the orientation information of the display screen of the electronic device 200 and the display screen of the electronic device 201, and the correspondence between the first information and the display screen of the electronic device 200.

[0119] In one embodiment, the mobile device can further send another indication information to the electronic device 200, where the another indication information is used to indicate that the electronic device 200 is the master device.

[0120] In one embodiment, the indication information and the another indication information can be carried in the same message or in different messages.

[0121] For example, the mobile device can carry the matrix information in the indication information, where the matrix information is used to indicate the orientation information of each electronic device in the plurality of electronic devices and the address information of each electronic device.

[0122] For example, the matrix information M carried in the indication information can be as shown in the formula (1):

[0123]

[0124] Upon receiving the indication information, the electronic device 200 can obtain the matrix M, where the MAC address 1 shown in the first row and the first column of the matrix M can represent that the MAC address of the electronic device at the top left is the MAC address 1, the MAC address 2 shown in the first row and the second column of the matrix M can represent that the MAC address of the electronic device at the top right is the MAC address 2, the MAC address 3 shown in the second row and the first column of the matrix M can represent that the MAC address of the electronic device at the bottom left is the MAC address 3, and the MAC address 4 shown in the second row and the second column of the matrix M can represent that the MAC address of the electronic device at the bottom right is the MAC address 4. Since the MAC address of the electronic device 200 is the MAC address 1, the electronic device 200 can determine that it is located at the top left of the plurality of electronic devices, and the electronic device 200 can also determine the orientation information of the other electronic devices and the MAC addresses thereof.

[0125] In one embodiment, when the mobile device determines that there are a plurality of electronic devices that need to be combined for display, the mobile device can select an electronic device (e.g., the electronic device 200) at random and send the indication information to the electronic device.

[0126] In one embodiment, in response to receiving the indication information, the electronic device 200 can prompt a user through the display screen that the electronic device 200 can control the electronic devices 200-203 to display image information.

[0127] In one embodiment, before the mobile device sends the instruction information to the electronic device 200 , it may first determine whether the distribution of the multiple electronic devices in the first image information is regular.

[0128] For example, Figure 12 As shown in (b) of FIG, when the mobile phone detects that the user clicks control 1202, the mobile phone can obtain the first image information in the preview frame. The mobile phone can determine the position and address information of Smart TVs 1-5 based on the first image information. For example, the mobile phone can determine from the first image information that the MAC address of the electronic device located at the upper left is MAC address 5; the MAC address of the electronic device located at the upper center is MAC address 1; the MAC address of the electronic device located at the lower center is MAC address 3; the MAC address of the electronic device located at the upper right is MAC address 2; and the MAC address of the electronic device located at the lower right is MAC address 4.

[0129] The mobile phone can convert the position information and address information of smart TV 1 to smart TV 5 into a matrix N. The matrix information N can be shown as formula (2):

[0130]

[0131] The mobile phone can determine that the matrix N is an irregular matrix, and thus the mobile phone can determine that the distribution of smart TVs 1 to 5 is irregular.

[0132] In one embodiment, if the mobile device determines that the multiple electronic devices are irregularly distributed, the electronic device may prompt the user to select some electronic devices from the multiple electronic devices for combined display.

[0133] For example, Figure 12 As shown in (c) of FIG, if the mobile phone determines that Smart TVs 1-5 are irregularly distributed, it can select Smart TVs 1-4, which are regularly distributed, for combined display. The mobile phone can prompt the user, "We have detected that five electronic devices need to be combined for display. To ensure image display quality, we recommend that you select the devices in the dashed box for combined display." In step S409, electronic device 200 controls electronic devices 200-203 to display images based on this instruction.

[0134] It should be understood that the process of S409 can refer to Figures 7-8 The process shown will not be repeated here.

[0135] In one embodiment, the mobile device can also not send the indication information to the electronic device, but send the first image to the electronic device 200. After receiving the first image, the electronic device 200 can determine the first information, the second information, the third information, the fourth information, the orientation information between the display screen of the electronic device 200 and the display screen of the electronic device 203, the corresponding relationship between the first information and the display screen of the electronic device 200, the corresponding relationship between the second information and the display screen of the electronic device 201, the corresponding relationship between the third information and the display screen of the electronic device 202, and the corresponding relationship between the fourth information and the display screen of the electronic device 203 according to the first image. After determining the above information, the electronic device 200 can segment the image frame, and then control the electronic device 200 to the electronic device 203 to display the image.

[0136] The above Figure 4 In S408 shown above, the mobile device can be to select an electronic device (for example, the electronic device 200) from the plurality of electronic devices and send the indication information to the electronic device, or the mobile device can be to send the indication information to the electronic device 200 when detecting that the user selects the electronic device 200 from the plurality of electronic devices. Figure 5 Another schematic flow of the combined display method provided by the embodiments of the present application is shown. As shown in Figure 5 The method includes:

[0137] S4081, in response to determining the orientation information of each electronic device in the plurality of electronic devices and the address information of each electronic device, the mobile device prompts the user to select an electronic device (for example, the electronic device 200) from the plurality of electronic devices as the master device.

[0138] It should be understood that in the embodiments of the present application, after the plurality of electronic devices are combined to display, the master device can be discovered by the devices (for example, the devices that need to be projected) in the local area network, and the master device can be used to segment the image information that needs to be displayed, and control the plurality of electronic devices to display the segmented image information respectively.

[0139] For example, as shown in (e) of Figure 10 When the mobile phone detects that the user selects the electronic device with the MAC address of MAC address 1 and clicks the control 1008, the mobile phone can determine that the electronic device with the MAC address of MAC address 1 is the master device.

[0140] S4082, the mobile device sends the indication information to the electronic device 200 in response to the operation of the user selecting the electronic device 200 as the master device.

[0141] It should be understood that the process of the mobile device sending the indication information to the electronic device 200 can refer to the description of S408 above, which will not be described here.

[0142] In the embodiments of the present application, after receiving the indication information sent by the mobile device, the electronic device 200 can also notify the electronic devices 201-203 to close the device discovery state. Figure 6 Another exemplary flow of the combined display method provided by the embodiments of the present application is shown. As shown in Figure 6 The method comprises:

[0143] S4083, in response to receiving the indication information sent by the mobile device, the electronic device 200 notifies the electronic device 201 to close the device discovery.

[0144] In one embodiment, the electronic device 200 notifying the electronic device 201 to close the device discovery comprises: the electronic device 200 sending a notification message to the electronic device 201, the notification message being used to instruct the electronic device 201 to stop being in the discovery state.

[0145] S4084, the electronic device 201 closes the device discovery.

[0146] S4085, in response to receiving the indication information sent by the mobile device, the electronic device 200 notifies the electronic device 202 to close the device discovery.

[0147] In one embodiment, the electronic device 200 notifying the electronic device 202 to close the device discovery comprises: the electronic device 200 sending a notification message to the electronic device 202, the notification message being used to instruct the electronic device 202 to stop being in the discovery state.

[0148] S4086, the electronic device 202 closes the device discovery.

[0149] S4087, in response to receiving the indication information sent by the mobile device, the electronic device 200 notifies the electronic device 203 to close the device discovery.

[0150] In one embodiment, the electronic device 200 notifying the electronic device 203 to close the device discovery comprises: the electronic device 200 sending a notification message to the electronic device 203, the notification message being used to instruct the electronic device 203 to stop being in the discovery state.

[0151] S4088, the electronic device 203 closes the device discovery.

[0152] It should be understood that, in the embodiments of the present application, the electronic device 200 notifying the electronic devices 201-203 to close the device discovery can also be understood as the electronic device 200 notifying the electronic devices 201-203 to stop being in the discovery state.

[0153] It should also be understood that in an embodiment of the present application, after electronic device 201-electronic device 203 turns off device discovery, other devices in the local area network (for example, mobile devices) will not search for electronic device 201-electronic device 203 when searching for devices in the local area network that can cast screens.

[0154] It should also be understood that there is no actual sequence between S4083-S4084, S4085-S4086 and S4087-S4088.

[0155] For example, Figure 10 As shown in (e) in FIG, when the mobile phone detects that the user selects the electronic device (smart TV 1) with the MAC address of MAC address 1 and clicks the control 1008, the mobile phone can send the instruction information to smart TV 1. After receiving the instruction information, smart TV 1 can notify smart TV 2, smart TV 3 and smart TV 4 to turn off device discovery. Figure 10 As shown in (g), the only device that can be cast screen in the local area network searched by the mobile phone is smart TV 1.

[0156] The following combination Figure 7 and Figure 8 , a detailed description is given of the electronic device 200 controlling the electronic devices 200 to 203 to display images according to the instruction information in the above S409. Figure 7 FIG. 2 shows another schematic flow chart of the combined display method provided in an embodiment of the present application. Figure 7 As shown, the method includes:

[0157] S4091, in response to receiving the third input, the mobile device discovers an electronic device 200 in the local area network that can perform screen projection.

[0158] For example, Figure 10 As shown in (g), the mobile phone can prompt the user to select a screen projection device and display a list of searched devices, which includes smart TV 1.

[0159] It should be understood that the mobile device in S4091 can be used with the above Figures 4-6 The mobile devices in the embodiment of the present application may be the same device or different devices, which is not limited to this.

[0160] S4092, in response to the user selecting the electronic device 200 for screen projection, the mobile device may send image information to be displayed to the electronic device 200.

[0161] For example, Figure 10 As shown in (g), when the mobile phone detects that the user selects the operation of the smart TV 1, the mobile phone can send image information of the video display window 1009 to the smart TV 1.

[0162] S4093, in response to receiving the image information, the electronic device 200 segments the image information according to the indication information.

[0163] In one embodiment, the electronic device 200 segments the image information according to the indication information to obtain first, second, third and fourth partial image information.

[0164] In one embodiment, the electronic device 200 segments the image information according to the indication information, including: the electronic device 200 segments the image information according to the orientation information of the display screen of the electronic device 200, the display screen of the electronic device 201, the display screen of the electronic device 202 and the display screen of the electronic device 203.

[0165] In one embodiment, the electronic device 200 segments the image information according to the indication information, including: the electronic device 200 segments the image information according to the orientation information of the display screen of the electronic device 200, the display screen of the electronic device 201, the display screen of the electronic device 202 and the display screen of the electronic device 203.

[0166] S4094, the electronic device 200 displays the first partial image information according to the indication information.

[0167] In one embodiment, the electronic device 200 displays the first partial image information according to the orientation information of the electronic device 200.

[0168] S4095, the electronic device 200 sends the second partial image information to the electronic device 201 and instructs to display the second partial image information on the display screen of the electronic device 201, sends the third partial image information to the electronic device 202 and instructs to display the third partial image information on the display screen of the electronic device 202, and sends the fourth partial image information to the electronic device 203 and instructs to display the fourth partial image information on the display screen of the electronic device 203 according to the indication information.

[0169] In one embodiment, the electronic device 200 determines to send the second partial image information to the electronic device 201 according to the orientation information of the electronic device 201; the electronic device 200 determines to send the third partial image information to the electronic device 202 according to the orientation information of the electronic device 202; the electronic device 200 determines to send the fourth partial image information to the electronic device 203 according to the orientation information of the electronic device 203.

[0170] For example, when the electronic device 200 obtains the image information sent by the mobile device, the electronic device 200 can split the image information according to the number and the position information of the electronic devices in the matrix M. For example, the matrix M includes MAC addresses 1-4, which indicates that four electronic devices are combined to display, and the four electronic devices are located at the upper left, the upper right, the lower left and the lower right, respectively. Then, the electronic device 200 can split one frame of image information sent by the mobile device into four frames of image information according to the positions of the four electronic devices. Thus, the electronic device 200 can display the image information at the upper left; the electronic device 200 can send the image information at the upper right to the electronic device corresponding to the MAC address 2 in the first row and the second column of the matrix M, so that the electronic device displays the image information at the upper right; the electronic device 200 can send the image information at the lower left to the electronic device corresponding to the MAC address 3 in the second row and the first column of the matrix M, so that the electronic device displays the image information at the lower left; and the electronic device 200 can send the image information at the lower right to the electronic device corresponding to the MAC address 4 in the second row and the second column of the matrix M, so that the electronic device displays the image information at the lower right.

[0171] It should be understood that there is no actual sequence between S4094 and S4095.

[0172] For example, as shown in (h) of FIG. 10, when the smart TV 1 receives the image information sent by the mobile phone, the smart TV 1 can split the image information into image information 1012, image information 1013, image information 1014 and image information 1015. The smart TV 1 can display the image information 1012 at the upper left; the smart TV 1 can also send the image information 1013 to the smart TV 2, so that the smart TV 2 displays the image information 1013 at the upper right; the smart TV 1 can also send the image information 1014 to the smart TV 3, so that the smart TV 3 displays the image information 1014 at the lower left; and the smart TV 1 can also send the image information 1015 to the smart TV 4, so that the smart TV 4 displays the image information 1015 at the lower right. Figure 10

[0173] Another exemplary flow of the combination display method provided by the embodiments of the present application is shown. As shown in FIG. 11, the method includes the following steps. Figure 8 Figure 8

[0174] S4096, the electronic device 200 splits the local content or the live content into image information in response to detecting that the user operates the electronic device 200 to play the local content or the live content.

[0175] In one embodiment, the electronic device 200 splits the image information into first part image information, second part image information, third part image information and fourth part image information according to the indication information.​​

[0176] S4097, the electronic device 200 displays the first part of image information according to the indication information.

[0177] In one embodiment, the electronic device 200 displays the first part of image information according to the orientation information of the electronic device 200.

[0178] S4098, the electronic device 200 sends the second part of image information to the electronic device 201 and instructs to display the second part of image information on the display screen of the electronic device 201, sends the third part of image information to the electronic device 202 and instructs to display the third part of image information on the display screen of the electronic device 202, and sends the fourth part of image information to the electronic device 203 and instructs to display the fourth part of image information on the display screen of the electronic device 203 according to the indication information.

[0179] In one embodiment, the electronic device 200 determines to send the second part of image information to the electronic device 201 according to the orientation information of the electronic device 201, determines to send the third part of image information to the electronic device 202 according to the orientation information of the electronic device 202, and determines to send the fourth part of image information to the electronic device 203 according to the orientation information of the electronic device 203.

[0180] It should be understood that the difference between S4096 and S4093 is that in S4093, the electronic device 200 needs to receive the image information sent by the mobile device and control the electronic devices 200-203 to display images; while in S4096, the electronic device 200 does not need to receive the image information sent by other devices in the local area network, and the electronic device 200 controls the electronic devices 200-203 to display images when playing local content or live content.

[0181] It should also be understood that S4091-S4095 and S4096-S4098 are in a parallel relationship.

[0182] It should also be understood that the process of the electronic device 200 controlling the electronic devices 200-203 to display images in S4096-S4098 can refer to the process of S4093-S4095 described above, and for the sake of brevity, will not be repeated here.

[0183] For example, as Figure 13As shown, when the smart TV 1 detects that the user has switched to the channel display interface via the remote control, the image information corresponding to the channel display interface may be divided into image information 1301, image information 1302, image information 1303, and image information 1304. The smart TV 1 may display the image information 1301 in the upper left corner; the smart TV 1 may also send the image information 1302 to the smart TV 2, so that the smart TV 2 displays the image information 1302 in the upper right corner; the smart TV 1 may also send the image information 1303 to the smart TV 3, so that the smart TV 3 displays the image information 1303 in the upper right corner; and the smart TV 1 may also send the image information 1304 to the smart TV 4, so that the smart TV 4 displays the image information 1304 in the upper right corner.

[0184] The technical solution provided by this application does not require a dedicated split-screen device; in addition, through wireless means, there is no need for complex wiring between different electronic devices; since split-screen devices and wiring between different electronic devices are no longer used, costs are also reduced; and a combined display of multiple different electronic devices is achieved.

[0185] The following combination Figures 9 to 14 The graphical user interface (GUI) shown further illustrates the combined display method of the embodiment of the present application. Figure 9 A set of GUIs provided by an embodiment of the present application is shown.

[0186] like Figure 9 As shown in (a) of FIG, a mobile phone, smart TV 1, smart TV 2, smart TV 3 and smart TV 4 are located in the same local area network. The mobile phone displays a video playback interface, which includes a video display window 901 and a screen projection control 902. Smart TV 1, smart TV 2, smart TV 3 and smart TV 4 are in a waiting state. In response to detecting that a user clicks on control 902, the mobile phone can display the following: Figure 9 The GUI shown in (b) in FIG.

[0187] like Figure 9 In the GUI shown in (b), the mobile phone can display a prompt box 903, wherein the prompt box 903 includes device information of smart TV 1, smart TV 2, smart TV 3 and smart TV 4 in a to-be-discovered state in the local area network.

[0188] For example, when the mobile phone detects that the user selects an operation of the smart TV 2 , the mobile phone may send the image information in the video display window 901 to the smart TV 2 .

[0189] Figure 10 This is another set of GUIs provided in an embodiment of the present application.

[0190] like Figure 10 As shown in (a) of FIG, the living room includes smart TV 1, smart TV 2, smart TV 3 and smart TV 4. The mobile phone displays the mobile phone desktop. The mobile phone desktop includes icons of multiple applications, including clock, calendar, gallery, memo and smart life. In response to detecting input (such as click, etc.) for an APP (such as smart life) icon, the mobile phone can display the following Figure 10 The GUI shown in (b) in FIG.

[0191] In the embodiment of the present application, the mobile phone, smart TV 1, smart TV 2, smart TV 3 and smart TV 4 can be connected to the same router. Alternatively, there is a central device, such as a mobile phone, between the mobile phone, smart TV 1, smart TV 2, smart TV 3 and smart TV 4.

[0192] For example, a router can be used as an access point (AP) to provide a signal source for the network. Furthermore, a mobile phone, smart TV 1, smart TV 2, smart TV 3, and smart TV 4 can access the router as a station (STA). The router can communicate with each electronic device separately through a wired network or a wireless network. Exemplarily, a Wi-Fi link is established between each electronic device through a wireless fidelity (Wi-Fi) protocol to enable communication between devices. A specific implementation can be to establish a peer-to-peer (P2P) connection (or Wi-Fi Direct) between each electronic device, or to access the same router to enable communication between devices.

[0193] For example, a Wi-Fi P2P GO, or Group Owner, is created on a central device (e.g., a mobile phone). Other devices connect to this GO as P2P GCs, or Group Clients. These devices then form a one-to-many combination display and can communicate with each other.

[0194] In one embodiment, when Smart TV 1, Smart TV 2, Smart TV 3, and Smart TV 4 are powered on, they can be in a waiting-to-be-discovered state for a preset period of time (e.g., 10 minutes) from the time of power-on, and other devices in the local area network can discover Smart TV 1, Smart TV 2, Smart TV 3, and Smart TV 4. For example, when a mobile phone needs to cast a screen, the mobile phone can search for devices in the local area network, thereby prompting the user to cast the screen on Smart TV 1, Smart TV 2, Smart TV 3, or Smart TV 4.

[0195] like Figure 10As shown in (b) of FIG, the mobile phone can display the display interface of smart life. In response to detecting the user clicking the control 1001, the mobile phone can display a function list, wherein the function list includes functions such as discovering devices, creating smart devices, sharing devices, and connecting to third-party platforms.

[0196] In one embodiment, in response to detecting that a user clicks on the device discovery function 1002, the mobile phone may send a broadcast message to a device in the same local area network as the mobile phone, and the broadcast message is used to instruct the electronic device to enter a combined display state. In response to receiving the broadcast message, smart TV 1, smart TV 2, smart TV 3, and smart TV 4 may display a QR code through the display screen. The QR code displayed by each smart TV is used to indicate its address information (e.g., a media access control (MAC) address). Exemplarily, the QR code information displayed by smart TV 1 indicates that the address information of smart TV 1 is MAC address 1, the QR code information displayed by smart TV 2 indicates that the address information of smart TV 2 is MAC address 2, the QR code information displayed by smart TV 3 indicates that the address information of smart TV 3 is MAC address 3, and the QR code information displayed by smart TV 4 indicates that the address information of smart TV 4 is MAC address 4.

[0197] like Figure 10 As shown in (c) of FIG, the mobile phone can display another display interface of smart life. The display interface includes a prompt box 1003, wherein the prompt box 1003 includes a prompt message "It is detected that there are multiple electronic devices in the local area network. Do you want to display multiple electronic devices in combination?" In response to the mobile phone detecting that the user clicks the control 1004, the mobile phone can display the following Figure 10 The GUI shown in (d) in FIG.

[0198] In one embodiment, after the mobile phone sends a broadcast message, smart TV 1, smart TV 2, smart TV 3 and smart TV 4 can send a response to the mobile phone. If the mobile phone receives multiple electronic devices (for example, smart TV 1, smart TV 2, smart TV 3 and smart TV 4), the mobile phone can display the prompt box 1003.

[0199] like Figure 10 As shown in (d) in the figure, the mobile phone can start the camera and display a prompt message "Please place the electronic devices that need to be displayed in combination in the preview box below". The mobile phone can display the information of multiple devices collected by the mobile phone camera in the preview box 1005. When the mobile phone detects that the user clicks the control 1006, the mobile phone can display the following Figure 10 The GUI shown in (e) in FIG.

[0200] In one embodiment, when the mobile phone detects that the user clicks control 1006, the mobile phone can determine the address information of the multiple smart TVs based on the QR code information displayed on the multiple smart TVs in the preview box 1005. At the same time, the mobile phone can also determine the orientation information of each smart TV based on the image information in the preview box 1005. For example, the mobile phone can determine that the device with MAC address 1 is located in the upper left, the device with MAC address 2 is located in the upper right, the device with MAC address 3 is located in the lower left, and the device with MAC address 4 is located in the lower right.

[0201] like Figure 10 As shown in (e) of FIG, the mobile phone may display a prompt message "Detected that there are currently 4 electronic devices that need to be combined for display. Please select one electronic device as the master device." In response to the mobile phone detecting that the user selects device 1007 in the upper left corner and detects that the user clicks control 1008, the mobile phone may determine that the device with address information of MAC address 1 is the master device.

[0202] In one embodiment, when the mobile phone determines that the user selects smart TV 1 as the main control device, the mobile phone can send an indication message to smart TV 1, which is used to indicate the address information of other smart TVs (smart TV 2, smart TV 3 and smart TV 4) and the location information between other smart devices and smart TV 1.

[0203] In an embodiment of the present application, the instruction information sent by the mobile phone to the smart TV 1 can be used for image segmentation of the smart TV 1. After obtaining the instruction information, the smart TV 1 can determine which devices the user has combined for display and which device the segmented image should be sent to for display. For example, the smart TV 1 can know from the instruction information that the user has combined and displayed four devices and that the smart TV 1 is located in the upper left of the four devices, the device with address information of MAC address 2 is located in the upper right of the four devices, the device with address information of MAC address 3 is located in the lower left of the four devices, and the device with address information of MAC address 4 is located in the lower right of the four devices. Then, after obtaining the image information, the smart TV 1 can segment the image information into four image information (the upper left image, the upper right image, the lower left image, and the lower right image). The smart TV 1 can display the upper left image through the display screen, send the upper right image to the device with address information of MAC address 2 for display, send the lower left image to the device with address information of MAC address 3 for display, and send the lower right image to the device with address information of MAC address 4 for display.

[0204] In one embodiment, after receiving the indication information, the smart TV 1 can determine that the smart TV 1 is the master device, and the smart TV 1 can notify other smart TVs to close the device discovery (or, notify other smart devices to stop entering the waiting discovery state). After receiving the notification from the smart TV 1, the other smart TVs can close the device discovery.

[0205] As shown in (f) of FIG. 10B, the smart TV 1 can display a GUI as shown in (g) of FIG. 10B, which is a video playing interface including a video display window 1009 and a screen projection control 1010. In response to detecting a user's operation of clicking the control 1010, the smart TV 1 can display a GUI as shown in (h) of FIG. 10B. Figure 10 Figure 10

[0206] It should be understood that the smart TV 1 and the smart TV 2 shown in (f) of FIG. 10B and the smart TV 3 and the smart TV 4 shown in (a) to (e) of FIG. 10B can be the same smart TVs, or can be different smart TVs. Figure 10 Figure 10 It should be understood that the smart TV 1 and the smart TV 2 shown in (f) of FIG. 10B and the smart TV 3 and the smart TV 4 shown in (a) to (e) of FIG. 10B can be the same smart TVs, or can be different smart TVs.

[0207] As shown in (g) of FIG. 10B, the smart TV 1 can display a prompt box 1011, in which a list of devices that can be projected is included. Since the smart TV 2, the smart TV 3 and the smart TV 4 have closed the device discovery, the list of devices that can be projected only includes the smart TV 1. In response to detecting a user's operation of selecting the smart TV 1 for projection, the smart TV 1 can send the image information in the video display window 1009 to the smart TV 1. Figure 10 As shown in (h) of FIG. 10B, in response to a user's operation of selecting the smart TV 1, the smart TV 1 can send the image information in the video display window 1009 to the smart TV 1. After receiving the image information sent by the smart TV 1, the smart TV 1 can split the image information according to the orientation information between the smart TV 1 and other smart TVs. For example, the smart TV 1 can cut each frame of the image information into 4 frames, such as a top-left image 1012, a top-right image 1013, a bottom-left image 1014 and a bottom-right image 1015.

[0208] Figure 10

[0209] ​​​​​Smart TV 1 can send the upper right image 1013 to smart TV 2 based on the orientation information of smart TV 2 and the address information of smart TV 2, so that smart TV 2 can display image 1013; smart TV 1 can send the lower left image 1014 to smart TV 3 based on the orientation information of smart TV 3 and the address information of smart TV 3, so that smart TV 3 can display image 1014; smart TV 1 can send the lower right image 1015 to smart TV 4 based on the orientation information of smart TV 4 and the address information of smart TV 4, so that smart TV 4 can display image 1015; smart TV 1 can display the upper left image 1012.

[0210] In this embodiment, multiple small screens can be combined into a single large screen without requiring any additional hardware, and there are no requirements for screen installation, which helps save hardware costs. Users can select a single screen from multiple small screens as the master screen, which can then be used to split and distribute images, improving the user experience.

[0211] Figure 11 Another set of GUIs provided by an embodiment of the present application is shown.

[0212] like Figure 11 As shown in (a) of FIG, when the mobile phone detects that the user clicks the control 1101, the mobile phone can display a function list, wherein the function list includes the functions of discovering devices, large-screen combination display, sharing devices, and connecting to third-party platforms. When the mobile phone detects that the user clicks the large-screen combination display function 1102, the mobile phone can display the following Figure 11 The GUI shown in (b) in FIG.

[0213] In one embodiment, in response to detecting a user clicking on the large-screen combined display function 1102, the mobile phone may send a broadcast message to devices within the same local area network as the mobile phone, instructing the electronic devices to enter the combined display state. In response to receiving the broadcast message, Smart TV 1, Smart TV 2, Smart TV 3, and Smart TV 4 may display a QR code on their display screens, wherein the QR code displayed by each smart TV indicates its address information (e.g., MAC address).

[0214] like Figure 11As shown in (b) of FIG. 11, in response to the operation of the user selecting the large-screen combination display function 1102, the mobile phone can start the camera and display the prompt information "Please place the electronic devices that need to be combination displayed in the following preview frame". The mobile phone can display the information of the multiple devices captured by the camera of the mobile phone in the preview frame 1103. When the mobile phone detects the operation of the user clicking the control 1104, the mobile phone can determine the address information of the multiple smart TVs through the two-dimensional code information displayed on the multiple smart TVs in the preview frame 1103, and at the same time, the mobile phone can also determine the orientation information of each smart TV through the image information in the preview frame 1103.

[0215] It should be understood that the process after the mobile phone detects the operation of the user clicking the control 1104 can refer to the GUI shown in (e) to (h) of FIG. 11. Figure 10 For brevity, details are not repeated here.

[0216] Figure 12 Another set of GUIs provided by the embodiments of the present application is shown.

[0217] As shown in (a) of FIG. 12, the living room includes smart TV 1, smart TV 2, smart TV 3, smart TV 4 and smart TV 5. Figure 12 As shown in (b) of FIG. 12, when the mobile phone determines that the user wants to perform large-screen combination display, the mobile phone can start the camera and display the prompt information "Please place the electronic devices that need to be combination displayed in the following preview frame".

[0218] Figure 12 It should be understood that the process of the mobile phone determining that the user wants to perform large-screen combination display can refer to the GUI shown in (a) to (d) of FIG. 12. Alternatively, it can also refer to the GUI shown in (a) to (b) of FIG. 12.

[0219] It should be understood that the process after the mobile phone detects the operation of the user clicking the control 1104 can refer to the GUI shown in (e) to (h) of FIG. 11. Figure 10 For brevity, details are not repeated here. Figure 11

[0220] The mobile phone can display the information of the multiple devices captured by the camera of the mobile phone in the preview frame 1201. When the mobile phone detects the operation of the user clicking the control 1202, the mobile phone can determine the address information of the multiple smart TVs through the two-dimensional code information displayed on the multiple smart TVs in the preview frame 1201, and at the same time, the mobile phone can also determine the orientation information of each smart TV through the image information in the preview frame 1201.

[0221] It should be understood that the process after the mobile phone detects the operation of the user clicking the control 1104 can refer to the GUI shown in (e) to (h) of FIG. 11. Figure 10 For brevity, details are not repeated here.

[0222] As shown in (a) of FIG. 12, the living room includes smart TV 1, smart TV 2, smart TV 3, smart TV 4 and smart TV 5. Figure 12 ​​As shown in (c) of FIG. 12A, when the phone determines that the 5 devices in the preview frame 1201 are irregularly distributed, the phone can prompt the user with "5 electronic devices are detected to be combined for display, in order to ensure the display effect of the image, it is suggested that you select the device combination in the dashed frame for display". The phone can prompt the user to select the 4 devices in the dashed frame 1203 for combination display. When the phone detects that the user clicks the control 1204, the phone can combine the smart TV 1, the smart TV 2, the smart TV 3 and the smart TV 4 for display, and prompt the user to select one of them as the master device.

[0223] It should be understood that the process in which the phone prompts the user to select one of the devices as the master device can refer to the GUI shown in (e) of FIG. 11A, which will not be described herein again for brevity. Figure 10

[0224] It should also be understood that when the phone detects that the user selects the smart TV 1 as the master device, the phone can send indication information to the smart TV 1, and the description of the indication information can refer to the description in the above embodiments.

[0225] As shown in (d) of FIG. 12B, the GUI is a video playing interface, which includes a video display window 1205 and a screen projection control 1206. In response to detecting that the user clicks the control 1206, the phone can display the GUI shown in (e) of FIG. 12B. Figure 12 Figure 12

[0226] As shown in the GUI (e) of FIG. 12B, the phone can display a prompt box 1207, which includes a list of devices that can be projected by the phone. The list includes the smart TV 1 and the smart TV 5. Among them, the smart TV 1 further includes a prompt information "in combination display". Figure 12 In response to detecting that the user selects the smart TV 1 for projection, the phone can send the image information in the video display window 1205 to the smart TV 1.

[0227] As shown in (f) of FIG. 12B, in response to the user selecting the smart TV 1, the phone can send the image information in the video display window 1205 to the smart TV 1. After receiving the image information sent by the phone, the smart TV 1 can split the image information according to the orientation information between the smart TV 1 and other smart TVs. For example, the smart TV 1 can cut each frame of image in the image information into 4 frames of image, such as the upper left image 1208, the upper right image 1209, the lower left image 1210 and the lower right image 1211.

[0228] Figure 12 ​​​​​

[0229] The smart TV 1 can send the image 1209 on the upper right to the smart TV 2 according to the orientation information of the smart TV 2 and the address information of the smart TV 2, so that the smart TV 2 can display the image 1209; the smart TV 1 can send the image 1210 on the lower left to the smart TV 3 according to the orientation information of the smart TV 3 and the address information of the smart TV 3, so that the smart TV 3 can display the image 1210; the smart TV 1 can send the image 1211 on the lower right to the smart TV 4 according to the orientation information of the smart TV 4 and the address information of the smart TV 4, so that the smart TV 4 can display the image 1211; and the smart TV 1 can display the image 1208 on the upper left.

[0230] In one embodiment, in response to the user selecting the operation of combining the smart TV 1, the smart TV 2, the smart TV 3 and the smart TV 4 for display, the mobile phone can also instruct the smart TV 5 to enter the screen-off state, so as to avoid the influence of the smart TV 5 on the user when the smart TV 1 to the smart TV 4 display image information, and help to improve the user's experience when watching videos.

[0231] In the embodiments of the present application, when the plurality of small display screens are irregularly distributed, the mobile phone can prompt the user to select a suitable display screen distribution mode for device combination display, so as to ensure that the user can watch the best image effect when using the mobile phone to cast the screen, and help to improve the user's experience.

[0232] The GUIs shown in the above Figure 10 and Figure 12 The GUIs shown in the above Figure 13 The process that the smart TV 1 plays the image information displayed by the smart TV 1 after receiving the instruction information is introduced below. Figure 13 Another GUI provided by the embodiments of the present application is shown.

[0233] As Figure 13 shown, when the smart TV 1 needs to display a channel switching interface, the smart TV can perform image segmentation on the channel switching interface according to the instruction information sent by the mobile phone, to obtain image information 1301, image information 1302, image information 1303 and image information 1304, so as to display a part of the segmented image on the smart TV 1, and send the other segmented images to the smart TV 2, the smart TV 3 and the smart TV 4 for display. It should be understood that the process of displaying image information by the smart TV 1, the smart TV 2, the smart TV 3 and the smart TV 4 can refer to the description in the above embodiments, and will not be described here for brevity.

[0234] Figure 14Another set of GUIs provided by the embodiments of the present application is shown.

[0235] As shown in the GUI (a) in FIG. 14, Figure 14 As shown in the GUI (b) in FIG. 14, the display interface can add a display box 1401 for displaying the device information of the combined display device when the phone combines and displays the smart TV 1, the smart TV 2, the smart TV 3 and the smart TV 4. When the phone detects a long press operation of the user on the display box 1401, the phone can display the GUI (c) in FIG. 14, as shown in the GUI (b) in FIG. 14. Figure 3 Figure 14

[0236] As shown in the GUI (b) in FIG. 14, the display interface can add a display box 1401 for displaying the device information of the combined display device when the phone combines and displays the smart TV 1, the smart TV 2, the smart TV 3 and the smart TV 4. When the phone detects a long press operation of the user on the display box 1401, the phone can display the GUI (c) in FIG. 14, as shown in the GUI (b) in FIG. 14. Figure 14

[0237] As shown in the GUI (c) in FIG. 14, the display interface is another display interface of the smart life. In response to the operation of the user clicking the control 1402, the phone deletes the display box 1401 on the display interface. Figure 14

[0238] It should be noted that all or part of each of the above embodiments provided by the present application can be freely and arbitrarily combined with each other.

[0239] The combination display method provided by the embodiments of the present application is applicable to the following mobile devices and electronic devices.

[0240] Figure 15 ​​​​A mobile device 1500 is shown. The mobile device 1500 includes at least one processor 1510, a memory 1520, and a display screen 1530. The processor 1510 is coupled to the memory 1520 and the display screen 1530. The coupling can be a communication connection, an electrical connection, or other forms. Specifically, the memory 1520 is configured to store program instructions. The display screen 1530 is configured to display a user interface. The processor 1510 is configured to invoke the program instructions stored in the memory 1520, so that the mobile device 1500 performs the steps performed by the mobile device in the combined display method provided by the embodiments of the present application. It should be understood that the mobile device 1500 can be used to implement the combined display method provided by the embodiments of the present application, and the related features can be referred to the above, which will not be described here.

[0241] In some embodiments, when the display screen has a touch function, the display screen is also called a touch display screen. The operation on the touch display screen can be realized through virtual keys. When the display screen does not have a touch function, the display screen is also called a non-touch display screen. The operation on the non-touch display screen can be realized through physical keys.

[0242] The present application provides a computer program product including instructions, which, when executed on a mobile device, cause the mobile device to perform the steps performed by the mobile device in the combined display method provided by the embodiments of the present application.

[0243] The present application provides a computer readable storage medium including instructions, which, when executed on a mobile device, cause the mobile device to perform the steps performed by the mobile device in the combined display method provided by the embodiments of the present application.

[0244] Those skilled in the art can clearly understand that the embodiments of the present application can be implemented by hardware, or by a combination of hardware and software. When implemented by hardware and software, the above functions can be stored in a computer readable medium. Based on this understanding, the technical solutions of the embodiments of the present application or the whole or part of the technical solutions that make contributions to the prior art can be embodied in the form of a software product. The computer software product is stored in a storage medium, and includes a plurality of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor to execute all or part of the steps of the method described in the embodiments of the present application. The aforementioned storage medium includes a flash memory, a mobile hard disk, a read-only memory, a random access memory, a magnetic disk or an optical disk, and various media that can store program codes.

[0245] Figure 16An electronic device 1600 is shown. The electronic device 1600 includes at least one processor 1610, a memory 1620 and a display 1630. The processor 1610 is coupled to the memory 1620 and the display 1630. The coupling can be communicational, electrical or other forms. The memory 1620 is configured to store program instructions. The display 1630 is configured to display a user interface. The processor 1610 is configured to invoke the program instructions stored in the memory 1620, so that the electronic device 1600 performs the steps performed by the electronic device in the combination display method provided by the embodiments of the present application. It should be understood that the electronic device 1600 can be used to implement the combination display method provided by the embodiments of the present application, and the related features can be referred to the above, which will not be described here.

[0246] In some embodiments, when the display has a touch function, the display is also called a touch display. The operation on the touch display can be realized through virtual keys. When the display does not have a touch function, the display is also called a non-touch display. The operation on the non-touch display can be realized through physical keys.

[0247] The present application provides a computer program product containing instructions, which, when executed on an electronic device, causes the electronic device to perform the steps performed by the electronic device in the method provided by the embodiments of the present application.

[0248] The present application provides a computer readable storage medium comprising a computer program, which, when executed on an electronic device, causes the electronic device to perform the steps performed by the electronic device in the method provided by the embodiments of the present application.

[0249] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the above-described system, device and unit can refer to the corresponding process in the foregoing method embodiments, which will not be described here.

[0250] In the several embodiments provided by the present application, it should be understood that the disclosed system, device and method can be implemented in other ways. For example, the device embodiments described above are only schematic. The division of the units is only a logical function division. There can be another division manner for actual implementation, for example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the units shown or discussed can be indirect coupling or communication connection through some interface, device or unit, and can be electrical, mechanical or in other forms.

[0251] The units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed on multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the embodiment scheme.

[0252] In addition, the functional units in each embodiment of the present application can be integrated in one processing unit, or each unit can be physically present alone, or two or more units can be integrated in one unit.

[0253] The functions, if realized in the form of software functional units and sold or used as independent products, can be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the present application or the part of the present application that essentially contributes to the prior art or the part of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes a plurality of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and various program code storage media.

[0254] The above is only a specific embodiment of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art can easily think of changes or replacements within the technical scope disclosed in the present application, which should be covered within the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. A combined display system, characterized by The system comprises a mobile device, a first electronic device and a second electronic device located in the same local area network, the first electronic device comprises a first display screen, and the second electronic device comprises a second display screen; The mobile device is configured to broadcast a first message in response to a received first input, the first message being used to indicate that display is to be combined; The first electronic device is configured to display first information through the first display screen in response to the received first message, the first information being used to indicate address information of the first electronic device; The second electronic device is configured to display second information through the second display screen in response to the received first message, the second information being used to indicate address information of the second electronic device; The mobile device is further configured to acquire a first image, the first image comprising the first display screen and the second display screen, the first display screen displaying the first information, and the second display screen displaying the second information; The mobile device is further configured to select the first electronic device corresponding to the first display screen as a master device, and send a second message to the first electronic device, the second message comprising the first information, the second information, orientation information and size proportion relationship between the first display screen and the second display screen, and a correspondence relationship between the first information and the first display screen, which are acquired by the mobile device according to the first image, and the second message being used to indicate that the first electronic device is selected as the master device; The first electronic device is further configured to control the first display screen and the second display screen to combine display in response to the received second message. The control of the first display screen and the second display screen to combine display comprises: The first electronic device receives an image frame to be displayed, splits the image frame according to the orientation information and size proportion relationship between the first display screen and the second display screen, and the size of the first display screen, to obtain a first partial image and a second partial image, displays the first partial image on the first display screen, sends the second partial image to the second electronic device, and indicates that the second partial image is to be displayed on the second display screen.

2. The system of claim 1, wherein, The selection of the first electronic device corresponding to the first display screen as the master device comprises: The mobile device receives a user selection of the first electronic device corresponding to the first display screen; In response to the user selection, the mobile device records the first electronic device as the master device.

3. The system of claim 1, wherein, The selection of the first electronic device corresponding to the first display screen as the master device comprises: The mobile device randomly selects the first electronic device corresponding to the first display screen as the master device.

4. The system according to any one of claims 1-3, wherein The first electronic device and the second electronic device are also configured to keep a first state after starting up until a time length after starting up reaches a preset time length, the second message is received, a notification message is received, or a stop message is received; in the first state, the first electronic device and the second electronic device are configured to display the first information and the second information through the first display screen and the second display screen respectively after receiving the first message of the mobile device; The first electronic device is also configured to send a notification message to the second electronic device after receiving the second message of the mobile device, the notification message being used to instruct the second electronic device to stop being in the first state; The second electronic device is also configured to enter a second state after receiving the notification message; in the second state, the second electronic device is only controlled by the master device; The second electronic device is also configured to no longer display the second information through the second display screen after receiving the stop message.

5. The system of any of claims 1-3, wherein, The splitting of the image frame according to the orientation information and the size ratio relationship of the first display screen and the second display screen and the size of the first display screen comprises: Splitting the image frame according to the orientation information of the first display screen and the second display screen, the size of the first display screen and the size of the second display screen.

6. The system of claim 5, wherein, The image frame is from the screen projection data of the mobile device.

7. The system of any of claims 1-3, wherein, The mobile device is specifically configured to: Before obtaining the first image, prompting to take a picture of the first display screen and the second display screen that need to be combined for display; In response to the detected picture taking operation of the first display screen and the second display screen, obtaining the first image.

8. The system of any of claims 1-3, wherein, The first information is used to indicate the MAC address of the first electronic device, and the second information is used to indicate the MAC address of the second electronic device.

9. A combined display method, characterized by, The method is applied to a mobile device; the mobile device, the first electronic device and the second electronic device are located in the same local area network, the first electronic device comprises a first display screen, and the second electronic device comprises a second display screen; the method comprises: Receiving a first input; In response to the first input, broadcasting a first message; the first message is used to indicate that display is to be combined; Obtaining a first image, the first image comprising the first display screen and the second display screen, the first display screen displaying first information, and the second display screen displaying second information, the first information being used to indicate address information of the first electronic device, and the second information being used to indicate address information of the second electronic device; Selecting the first electronic device corresponding to the first display screen as a master device, and sending a second message to the first electronic device; the second message comprising the first information, the second information, orientation information between the first display screen and the second display screen, and a corresponding relationship between the first information and the first display screen, which are obtained by the mobile device according to the first image; the second message is also used to instruct the first electronic device to be selected as the master device; sending an image frame to the first electronic device, or sending a link address to the first electronic device.

10. The method of claim 9, wherein, The selecting the first electronic device corresponding to the first display screen as the master device comprises: The mobile device receives user selection of the first electronic device corresponding to the first display screen. In response to the user selection, the mobile device records the first electronic device as the master device.

11. The method of claim 9, wherein, The selecting the first electronic device corresponding to the first display screen as the master device comprises: The mobile device randomly selects the first electronic device corresponding to the first display screen as the master device.

12. The method according to any one of claims 9-11, characterized in that, The image frame is from the screen projection data of the mobile device.

13. A combined display method, characterized by, The method is applied to a first electronic device; the first electronic device, a second electronic device and a mobile device are located in the same local area network, the first electronic device comprises a first display screen, and the second electronic device comprises a second display screen; the method comprises: The first electronic device receives a first message, and the first message is used to indicate that display is to be combined; In response to the received first message, the first display screen displays first information; the first information is used to indicate address information of the first electronic device; The first electronic device receives a second message sent by the mobile device, and the second message comprises the first information, second information, orientation information between the first display screen and the second display screen, and a correspondence relationship between the first information and the first display screen, which are obtained by the mobile device according to a first image; the first image comprises the first display screen and the second display screen, the first display screen displays the first information, and the second display screen displays the second information; the second information is used to indicate address information of the second electronic device; the second message is also used to indicate that the first electronic device is selected as the master device; In response to the received second message, the first electronic device controls the first display screen and the second display screen to combine display; The first electronic device controls the first display screen and the second display screen to combine display, comprising: The first electronic device receives an image frame to be displayed, splits the image frame according to orientation information and size proportion relationship of the first display screen and the second display screen and a size of the first display screen, obtains a first part image and a second part image, displays the first part image on the first display screen, sends the second part image to the second electronic device, and indicates the second part image on the second display screen.

14. The method of claim 13, wherein, Before the first electronic device receives the first message, the method further comprises: The first electronic device keeps a first state after starting up until a time length after starting up reaches a preset time length or the second message is received; In the first state, the first electronic device is used to display the first information on the first display screen after receiving the first message of the mobile device.

15. The method according to claim 13 or 14, characterized in that, The method further comprises: After receiving the second message of the mobile device, the first electronic device sends a notification message to the second electronic device, the notification message being used to instruct the second electronic device to stop being in the first state.

16. A mobile device, comprising: comprising: a processor; a memory; and a computer program, wherein the computer program is stored in the memory and, when the computer program is executed by the processor, causes the mobile device to perform the method of any one of claims 9-12.

17. A first electronic device, comprising: comprising: a first display screen; a processor; a memory; and a computer program, wherein the computer program is stored in the memory and, when the computer program is executed by the processor, causes the first electronic device to perform the method of any one of claims 13-15.

18. A computer-readable storage medium having stored therein a computer program, characterized in that, when the computer program is run on the mobile device, causes the mobile device to perform the method of any one of claims 9-12; or, when the computer program is run on the first electronic device, causes the first electronic device to perform the method of any one of claims 13-15.

19. A computer program product, characterised in that, when the computer program product is run on the mobile device, causes the mobile device to perform the method of any one of claims 9-12; or, when the computer program product is run on the first electronic device, causes the first electronic device to perform the method of any one of claims 13-15.

Citation Information

Patent Citations

  • Method, system and mobile terminal for controlling display content in multi-display-equipment environment

    CN106598524A

  • Screen display control method and device for split terminal device and storage medium

    CN109271125A