A processing method, apparatus, device, and storage medium
By connecting external display devices and determining the display data of multiple screens, multi-screen projection output display is realized, which solves the problem of insufficient flexibility and diversity of multi-screen display in existing projection technologies and improves the user experience.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- LENOVO (BEIJING) LTD
- Filing Date
- 2022-08-31
- Publication Date
- 2026-05-26
AI Technical Summary
Existing screen mirroring technologies mainly project the display data from one device's screen onto the screen of another device, lacking the flexibility and versatility of multi-screen display and failing to meet the needs of various application scenarios.
By connecting an external display device and determining the target display data, which involves the display content of two or more screens, multi-screen projection output display can be achieved, supporting various display modes such as joint display and time-sharing display.
It expands the application scenarios of screen casting, improves the diversity and flexibility of screen casting, and enhances the user experience.
Smart Images

Figure CN115328426B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of processing technology, including but not limited to processing methods, apparatus, devices, and storage media. Background Technology
[0002] With the continuous development of display technology and screen projection technology, screen projection is becoming more and more widely used.
[0003] In typical screen mirroring scenarios, there are two devices: device A and device B. Device A and device B can communicate with each other. Device A includes a display screen, and device B includes a display screen. Device A can send the display data on its display screen to the display screen of device B for screen mirroring output.
[0004] The relevant technology operates on a one-to-one basis when projecting data, meaning that the display data from one device's screen is projected onto the screen of another device. Summary of the Invention
[0005] This application provides a processing method, apparatus, device, and storage medium. The solution of this application has the ability to project and display the display data of at least two displays, thereby expanding the application scenarios of projection, improving the diversity and flexibility of projection, and enhancing the user experience.
[0006] The technical solution of this application is implemented as follows:
[0007] Firstly, this application provides a processing method, the method comprising:
[0008] Connections include external display devices with display output modules;
[0009] Determine the target display data, which is used by the display output module to display the output content;
[0010] The target display data relates to the display content of the target display screen, and the number of the target display screens is greater than or equal to 2.
[0011] Secondly, this application provides a processing apparatus, the processing apparatus comprising:
[0012] A connection unit for connecting an external display device, including a display output module;
[0013] A determining unit is used to determine target display data, which is used by the display output module to display output content.
[0014] The target display data relates to the display content of the target display screen, and the number of the target display screens is greater than or equal to 2.
[0015] Thirdly, this application also provides an electronic device, including: a memory and a processor, wherein the memory stores a computer program that can run on the processor, and the processor executes the program to implement the above-described processing method.
[0016] Fourthly, this application also provides a storage medium on which a computer program is stored, which, when executed by a processor, implements the above-described processing method. Attached Figure Description
[0017] Figure 1 This is an optional structural schematic diagram of the processing method provided in the embodiments of this application;
[0018] Figure 2 An optional schematic diagram illustrating the processing result provided in an embodiment of this application;
[0019] Figure 3 Another optional flowchart illustrating the processing method provided in the embodiments of this application;
[0020] Figure 4 Another optional schematic diagram illustrating the processing result provided in the embodiments of this application;
[0021] Figure 5 This is another optional flowchart illustrating the processing method provided in the embodiments of this application;
[0022] Figure 6 A schematic flowchart illustrating another optional processing method provided in an embodiment of this application;
[0023] Figure 7 An optional schematic diagram illustrating the processing result provided in an embodiment of this application;
[0024] Figure 8 Another optional flowchart illustrating the processing method provided in the embodiments of this application;
[0025] Figure 9 Another optional schematic diagram illustrating the processing result provided in the embodiments of this application;
[0026] Figure 10 Another optional schematic diagram illustrating the processing result provided in the embodiments of this application;
[0027] Figure 11 A schematic flowchart of an optional processing apparatus provided in an embodiment of this application;
[0028] Figure 12 This is a schematic diagram of an optional structure of an electronic device provided in an embodiment of this application. Detailed Implementation
[0029] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the specific technical solutions of the application will be further described in detail below with reference to the accompanying drawings of the embodiments of this application. The following embodiments are used to illustrate this application, but are not intended to limit the scope of this application.
[0030] In the following description, references are made to “some embodiments,” which describe a subset of all possible embodiments. However, it is understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.
[0031] In the following description, the terms "first," "second," and "third" are used only to distinguish different objects and do not represent a specific order of objects, nor are they constituting a chronological order. It is understood that "first," "second," and "third" may be interchanged in a specific order or sequence where permitted, so that the embodiments of this application described herein can be implemented in an order other than that illustrated or described herein.
[0032] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing embodiments of this application only and is not intended to limit this application.
[0033] The terminology used in this disclosure is for the purpose of describing particular embodiments only and is not intended to limit the scope of other embodiments. It should be understood that the singular form includes plural indicators unless the context explicitly indicates otherwise. Unless otherwise defined, the terms and words (including technical or scientific terms) used in the following specification and claims have the same meaning as commonly understood by those skilled in the art. Terms as commonly defined in dictionaries may be interpreted as having the same or similar meaning in the context of related art. Unless otherwise defined, terms should not be interpreted as having an idealized or overly formal meaning. Where necessary, even terms as defined in this disclosure may not be interpreted as excluding embodiments of this disclosure.
[0034] The electronic devices according to various embodiments of this disclosure can be at least one of the following: for example, smartphones, tablet PCs, mobile phones, video phones, e-book readers, desktop PCs, laptop PCs, netbooks, workstations, servers, personal digital assistants (PDAs), portable multimedia players (PMPs), MP3 players, mobile medical devices, cameras, or wearable devices. According to various embodiments, wearable devices can be at least one of the following: accessories (e.g., watches, rings, bracelets, anklets, necklaces, glasses, contact lenses, or head-mounted devices (HMDs)), fabrics or clothing (e.g., electronic clothing), body attachments (e.g., skin pads or tattoos), or implantable devices (e.g., implantable circuitry).
[0035] According to some implementations, the electronic device can be a household appliance. For example, a household appliance can be at least one of the following: a television (TV), a digital multifunction disc (DVD) player, an audio player, a refrigerator, an air conditioner, a vacuum cleaner, an oven, a microwave oven, a washing machine, an air purifier, a set-top box, a home automation control panel, a security control panel, a TV box, an electronic dictionary, an electronic key, a camera, or an electronic photo frame.
[0036] According to other embodiments, the electronic device may be at least one of the following: medical device (e.g., portable medical instruments such as blood glucose meters, heart rate monitors, blood pressure monitors or thermometers; imaging devices; ultrasound devices, etc.), navigation device, global navigation satellite system (GNSS), event data recorder (EDR), flight data recorder (FDR), in-vehicle entertainment device, marine electronic device (e.g., marine navigation device, gyrocompass, etc.), avionics device, safety device, vehicle front unit, industrial robot or consumer robot, automated teller machine (ATM) in financial institutions, point of sale (POS) device in stores, or Internet of Things (IoT) device (e.g., light bulbs, various sensors, electricity or gas meters, sprinklers, fire alarm devices, thermostats, streetlights, ovens, sporting goods, hot water tanks, heaters or boilers).
[0037] According to some embodiments, the electronic device can be at least one of the following: furniture, part of a building / structure, electronic board, electronic signature receiving device, projector, or various measuring devices (e.g., water, electricity, gas, or electromagnetic wave measuring devices). According to various embodiments, the electronic device can be one or a combination of two or more of the above-mentioned devices. According to some embodiments, the electronic device can be a flexible electronic device. Furthermore, it will be apparent to those skilled in the art that the electronic device according to embodiments of this disclosure is not limited to the aforementioned devices, but encompasses new electronic devices that emerge with technological advancements.
[0038] This application provides processing methods, apparatus, devices, and storage media. In practical applications, the processing method can be implemented by a processing device, and the functional entities in the processing device can be collaboratively implemented by the hardware resources of the electronic device, such as computing resources like processors and communication resources (such as those used to support various communication methods like optical fiber and cellular).
[0039] In a first aspect, embodiments of this application provide a processing method applied to a target electronic device.
[0040] Figure 1 A flowchart illustrating one possible processing method is provided. (See reference) Figure 1 The processing method shown may include, but is not limited to, the following: Figure 1 S101 and S102 are shown.
[0041] S101, The target electronic device is connected to an external display device, including a display output module.
[0042] The target electronic device is an electronic device with a display screen and related data processing capabilities. For example, the target electronic device may include, but is not limited to: laptops, mobile phones, smart wearable devices (smart bracelets, smart glasses, etc.), computers (host plus monitor), flexible foldable devices, flexible stretchable devices, etc.
[0043] In one possible implementation, the target electronic device has a number of displays that are associated with and within the target range greater than or equal to 2.
[0044] The display output module is used to display data. This application does not specifically limit the display output module; it can be determined according to actual conditions. For example, the display output module may include, but is not limited to, a physical display screen or a projection module of a projector.
[0045] An external display device includes at least a display output module. This can be a monitor or a projector. Understandably, an external display device can also include any electronic device with a display output module, such as a PC, smart TV, or smart glasses (VR, AR, MR)—electronic devices with computing and processing capabilities.
[0046] This application does not limit the connection method between the target electronic device and the external display device, and can be configured according to the actual situation.
[0047] In one possible implementation, the target electronic device and the external display device are connected in a limited manner. For example, the target electronic device and the external display device can be connected via a display data cable. Exemplary display data cables may include, but are not limited to: Video Graphics Arcade (VGA) cables, Digital Visual Interface (DVI) cables, High Definition Multimedia Interface (HDMI) cables, and DisplayPort (DP) cables.
[0048] In another possible implementation, the target electronic device and the external display device are connected wirelessly. For example, the target electronic device and the external display device can be connected wirelessly. Exemplary wireless connection methods may include, but are not limited to, wireless communication (WiFi) connection, Bluetooth connection, and Near Field Communication (NFC) connection.
[0049] For example, when an external display device sends a connection establishment request to a target electronic device, S101 can be implemented as follows: Upon receiving the connection establishment request, the target electronic device establishes a wired or wireless connection with the external electronic device and sends a connection establishment completion response to the external display device. After receiving the connection establishment completion response, the external electronic device completes the connection between the target electronic device and the external display device. Alternatively, the target device can send a connection establishment request to the external display device, and a wireless transmission channel can be established based on the external display device's response to the request.
[0050] S102, The target electronic device determines the target display data.
[0051] The target display data is used by the display output module to display the output content.
[0052] The target display data relates to the display content of the target display screen, and the number of the target display screens is greater than or equal to 2.
[0053] The displayed content is the text or image information that needs to be shown. For example, the displayed content can be image A; or, the displayed content can be a text set B.
[0054] Display data refers to the data obtained by the graphics card after processing the display content. The display content can be image data, text data, application data, etc. The display data is the data obtained by the graphics card of the electronic device after processing the display content. For example, the display data can be a raster image or bitmap image of the monitor screen.
[0055] When the external display device receives display data, it does not require processing by the graphics card. It can directly display the corresponding display content by driving the display output module to display pixels based on the display data.
[0056] For example, the display data can be an array of color control signals obtained by the graphics card after processing the display content. Each color control signal in the array is used to drive the corresponding pixel in the display output module to display the target color.
[0057] The target display data pertains to the content or data displayed on the target screens. The number of target screens is greater than or equal to two.
[0058] In one possible implementation, the target display screen is a display screen that is associated with the target electronic device. For example, the target display screen can be a physical display screen present on the target electronic device, or a physical display screen located in an expansion module connected to the target electronic device.
[0059] In another possible implementation, the target display screen is a display screen determined based on a selection instruction among displays screens that satisfy an association relationship with the target electronic device.
[0060] This application does not limit the specific number of target displays, and can be configured according to actual needs. For example, there can be two or more target displays.
[0061] In one possible implementation, the target display data includes the display content of all target displays.
[0062] In another possible implementation, the target display data includes the display content of a valid target display screen that is in a valid state.
[0063] The effective state can be called the active state or the lit state, which is the target display screen in use.
[0064] The target display data is used to display the output content of the display data module. This application embodiment does not limit the specific display output method and can be configured according to actual conditions. For example, the display output method can be simultaneous display or time-sharing display.
[0065] In one possible implementation, the target display data is displayed in a common display manner.
[0066] Simultaneous display is used to display the target data simultaneously on the display output module. This application does not limit the specific method of simultaneous display; it can be determined according to actual needs. Simultaneous display may include, but is not limited to: simultaneous display of left and right areas, or simultaneous display of top and bottom areas, etc.
[0067] Optionally, the size and status of the display output module can be detected, and the system can determine whether to display both the left and right areas or both the top and bottom areas based on these parameters. For example, if the external display device is a mobile phone, and the phone is in portrait mode, the display mode can be configured to display both the top and bottom areas; if the phone is in landscape mode, the display mode can be configured to display both the left and right areas.
[0068] This application does not limit the number or size of the regions, and can determine them according to actual conditions. The number of regions is related to the number of target displays included in the target display data. The region size can be evenly distributed or non-evenly distributed.
[0069] In another possible implementation, the target display data is displayed in a time-sharing manner.
[0070] Time-division display is used to divide the target display data into different time periods for display on the display output module. For example, if the target display data includes the display data of target display screen 1 and target display screen 2, the external display device can display the display data of target display screen 1 at the first time period, and then display the display data of target display screen 2 at the second time period; after the second time period is close to the first time period, the display data of target display screen 1 is displayed again, and then the display data of target display screen 2 is displayed again, and so on, to achieve the purpose of time-division display.
[0071] This application does not limit the method by which the electronic device sends target display data to the external display device, and can determine it according to actual needs. For example, the target display data can be sent to the external display device simultaneously; or, the display data of target display screen 1 can be sent first, and then the display data of target display screen 2 can be sent. The sending order can be preset or random.
[0072] This application does not limit the specific order of the time-sharing display in its embodiments, and it can be determined according to the actual situation. For example, the time-sharing display can be based on the receiving order of the external display devices. That is, the devices that receive the data first are displayed first, and the devices that receive it later are displayed later. For example, the order of the time-sharing display can also be random.
[0073] S102 can be implemented as follows: the target electronic device determines at least two target displays and determines target display data based on the display data of the at least two target displays.
[0074] For example, the target electronic device determines all display data of the target display screen as target display data.
[0075] Here, S102, which determines the target display data, can be understood as two stages. In the first stage, the electronic device configures which target displays the target display data originates from; this is equivalent to the configuration stage. In the second stage, the electronic device determines the specific target display data to be displayed based on the display data on the specific target displays; this is equivalent to the display stage.
[0076] After the configuration phase, the electronic device becomes capable of displaying data from multiple target displays.
[0077] In one embodiment of this application, the electronic device is one that has two or more displays, such as a dual-screen computer (e.g., a laptop with physical displays on its B and C sides respectively), a dual-screen mobile phone (e.g., with physical displays on the front or back respectively), and further, at least one of the physical displays in the dual-screen mobile phone is a flexible display (capable of flexible deformation). That is, if the electronic device in this embodiment is connected to an external display device (e.g., a monitor) via a wired or wireless connection, target display data (i.e., including the display content of at least two displays) is determined based on the display content of the two or more displays already present in the electronic device. This target display data is sent to the external display device via the aforementioned wired or wireless connection channel to cause the screen of the external display device to display output. For example, if the external display device is a monitor, then the display driver of the monitor's display can control the display pixel display output based on the target display data, thereby causing the monitor's display to present a display image (i.e., display content). For example, if an electronic device based on an embodiment of this application is connected to an external display device (e.g., for screen mirroring), the electronic device can select one or more or all of the display content of the two or more display screens already present in the electronic device as the target display data.
[0078] The processing procedure provided in the embodiments of this application will be described below using Example A.
[0079] like Figure 2 As shown, the target electronic device 201 has two displays: a main display 2011 and an auxiliary display 2012. The content displayed on the main display 2011 is as follows: Figure 2 As shown, the content displayed on the auxiliary display screen 2012 is as follows: Figure 2 As shown.
[0080] The target electronic device 201 is connected to an external display device 202 including a display output module; the target electronic device 201 determines the target display data as the display data of the main display screen 2011 and the display data of the auxiliary display screen 2012; the purpose of configuring the target display data in the target electronic device 201 is to display the output content of the display output module.
[0081] Since the target display data is used to display the output content of the display output module, after this processing, the target electronic device has the ability to send the target display data (the display data of the main display screen 2011 and the display data of the auxiliary display screen 2012) to the external display device 202 so that the external display device 202 can perform output display.
[0082] Furthermore, the target electronic device 201 can send the target display data to the external display device 202, so that the display content of the external display device 202 can be displayed as follows: Figure 2 As shown.
[0083] The processing solution provided in this application includes: connecting an external display device including a display output module; determining target display data, wherein the target display data is used by the display output module to display output content; wherein the target display data relates to the display content of target screens, and the number of target screens is greater than or equal to two. In this application's solution, after the electronic device is connected to the external display device, the target display data of the electronic device is further determined; since the target display data includes the display data of at least two target screens, the electronic device has the ability to send the display data of at least two target screens to the external display device for output display. Therefore, this application's solution can project and output the display data of at least two screens, expanding the application scenarios of screen projection, improving the diversity and flexibility of screen projection, and enhancing the user experience.
[0084] Figure 3 A flowchart illustrating one possible processing method is provided. (See reference) Figure 3 The processing method shown may include, but is not limited to, the following: Figure 1 S301 to S304 are shown.
[0085] S301, The target electronic device is connected to an external display device, including a display output module.
[0086] The specific implementation process of S301 can be found in the detailed description of the target electronic device connecting to an external display device including a display output module in S101, which will not be repeated here.
[0087] S302, The target electronic device obtains the identification of the display screen that satisfies the association relationship.
[0088] Among them, the number of displays that satisfy the association relationship is greater than or equal to 2.
[0089] The "satisfaction of association relationship" here refers to the fulfillment of an association relationship with the target electronic device.
[0090] The association relationship is used to determine the target display screen. The specific content of the association relationship is not limited in this application embodiment, and can be determined according to the actual situation.
[0091] An identifier for a display screen is used to uniquely identify a single display screen. This application does not limit the specific form of the display screen identifier; it can be determined according to actual circumstances. For example, the display screen identifier can be a string of numbers, or a combination of numbers and letters, etc. In the case of a device with only one display screen, the display screen identifier can also be a device ID.
[0092] S302 can be implemented as follows: the target electronic device first determines the content of the association relationship, and then determines the identifier of the display screen that satisfies the association relationship among the display screens of the target electronic device and / or the display screens associated with the target electronic device, and / or the display screens within the target range of the target electronic device.
[0093] In one possible implementation, the display screen that satisfies the relational association can be identified as the target display screen.
[0094] S303. The target electronic device obtains the display data of each of the display screens that satisfy the association relationship based on the identifier of the display screen that satisfies the association relationship.
[0095] S303 can be implemented as follows: the electronic device accesses the at least two target displays for the identifiers of at least two displays that satisfy the association relationship, obtains the display data of each of the at least two target displays, and traverses all target displays to obtain the display data of all target displays.
[0096] Optionally, when acquiring display data of a target display screen, if the target display screen is inactive or not lit, the display data of the target display screen may not be acquired.
[0097] S304. The target electronic device determines target display data based on the display data of each of the aforementioned displays that satisfy the association relationship.
[0098] In one possible implementation, S304 can be implemented as follows: the target electronic device determines all display data of the target display screen as target display data.
[0099] In another possible implementation, S304 can be implemented as follows: the target electronic device determines the display data of the target display screen that is in a valid state among all the display data of the target display screen as the target display data.
[0100] The processing procedure provided in the embodiments of this application will be described below using Example B.
[0101] like Figure 4 As shown, the target electronic device 401 has two displays, namely a front flexible display 4011 and a rear display 4012.
[0102] The target electronic device 401 is connected to an external display device 402, which includes a display output module. The displays of the target electronic device 401 that satisfy the association relationship are identified as A112 and A113, where A112 points to the front flexible display screen 4011 and A113 points to the rear display screen 4012. The target electronic device 401 obtains the display data of the front flexible display screen 4011 and the display data of the rear display screen 4012 based on A112 and A113. The display content of the front flexible display screen 4011 is as follows: Figure 4 As shown, the content displayed on the rear display screen 4012 is as follows: Figure 4 As shown; thus, the target display data is determined to be the display data of the front flexible display screen 4011 and the display data of the rear display screen 4012; the purpose of configuring the target display data in the target electronic device 401 is to display the output content of the display output module.
[0103] Since the target display data is used to display the output content of the display output module, after this processing, the target electronic device 401 has the ability to send the target display data (the display data of the front flexible display screen 4011 and the display data of the rear display screen 4012) to the external display device 402 so that the external display device 402 can perform output display.
[0104] Furthermore, the target electronic device 401 can send the target display data to the external display device 402, so that the display content of the external display device 402 can be displayed as follows: Figure 4 As shown.
[0105] In this embodiment, the target display screen is determined based on the correlation relationship, thereby obtaining the target display data. The entire implementation process is logically clear and simple and convenient.
[0106] The following section explains the relationships between the related parties.
[0107] The relationship may include, but is not limited to, any one of the following situations 1 to 4.
[0108] Case 1: The display screen associated with the target display mode;
[0109] Case 2: Display screens associated with the same target electronic device;
[0110] Case 3: Display screens that represent the target usage mode of electronic devices;
[0111] Case 4: The display screen of the target electronic device and the display screen of another electronic device within the target range of the target electronic device.
[0112] The following describes the display screen associated with the target display mode in case 1.
[0113] In Case 1, there is a binding relationship between the electronic device and multiple displays in the target display mode, and the electronic device and multiple displays are in a non-copying mode.
[0114] For example, the target display mode is extended mode.
[0115] Example 1: The target electronic device is a laptop computer 1. Laptop computer 1 has a display screen 1 and an external display screen 2. The connection between laptop computer 1 and display screen 2 is an extension mode. Thus, the display screens that satisfy the association relationship include display screen 1 and display screen 2.
[0116] In Case 1, the association represents the display screen associated with the target display mode. This can cover the application scenarios of electronic devices in various target display modes (such as extended modes), thus expanding the application scope.
[0117] The following describes Case 2, which represents a display screen associated with the same target electronic device.
[0118] In scenario 2, the display screen of the same target electronic device can be understood as the objectively existing display screen of that target electronic device.
[0119] Example 2: The target electronic device is a laptop computer 2. Laptop computer 2 has a display screen 3 on the front, a display screen 4 on the back, and a small display screen 5 at the keyboard. Thus, the display screens that satisfy the association relationship include display screen 3, display screen 4, and display screen 5.
[0120] In scenario 2, the association represents the display screens associated with the same target electronic device. This can cover application scenarios where the same target electronic device is associated with multiple display screens, thus expanding the application scope.
[0121] The following section describes the display screen in case 3, which represents the electronic device in the target usage mode.
[0122] The target usage pattern is used to characterize the current usage pattern of the target electronic device.
[0123] In scenario 3, the electronic device has at least two displays in the target usage mode. This application does not specifically limit the target usage mode, which can be determined according to actual circumstances. For example, when the target electronic device includes a flexible display, the target usage mode may include a folded state and an unfolded state. When the target electronic device includes a push-pull screen, the target usage mode may include a pushed-open state and a pulled-up state.
[0124] Example 3: When the target electronic device is a push-pull mobile phone and the target usage mode is the push-open state, the display screens that satisfy the association relationship include the two display screens that can be seen in the push-open state.
[0125] In scenario 3, the association relationship represents the display screen associated with the target electronic device in the target usage mode. In this way, the application scenarios of the target electronic device under different usage modes can be covered, thus expanding the application scope.
[0126] The following describes Case 4, which represents the display screen of the target electronic device and the display screen of another electronic device within the target range of the target electronic device.
[0127] In scenario 4, the target range is used to determine the display screen that can be connected to the target electronic device. This application embodiment does not limit the specific radius of the target range; it can be determined according to actual circumstances.
[0128] Example 4: The target electronic device is mobile phone 1. Mobile phone 1 detects that mobile phone 2 and mobile phone 3 also exist within its target range. Thus, the displays that satisfy the association relationship include the display of mobile phone 1, the display of mobile phone 2, and the display of mobile phone 3.
[0129] In scenario 4, the association represents the display screen of the target electronic device and the display screen of another electronic device within the target range of the target electronic device. This can cover the application scenarios of other displays connected to the target electronic device within the target range, thus expanding the application scope.
[0130] Optionally, the target electronic device can also project the display data of other electronic devices within the target range. These other electronic devices can be those that do not have their own projection capabilities. The target electronic device acquires the display data from the screens of these other electronic devices and then uses its projection function to control the projection of the other electronic devices' screens, thus expanding the application scope of projection and enhancing the user experience.
[0131] Figure 5 A flowchart illustrating one possible processing method is provided. (See reference) Figure 5 The processing method shown may include, but is not limited to, the following: Figure 5 S501 to S503 are shown.
[0132] S501, The target electronic device determines the target display screen in response to the selection command.
[0133] The selection instructions include identifiers for at least two displays.
[0134] Understandably, the target display screen can also be determined based on the user's selection instructions.
[0135] For example, the target electronic device displays the identifiers of the displays that satisfy the association relationship. The user performs a selection operation based on the displayed identifiers of the displays that satisfy the association relationship. The selection operation is used to point to the identifiers of at least two target displays. In response to the selection operation, a selection instruction is generated, which includes the identifiers of at least two displays, thereby determining that at least two target displays are obtained.
[0136] The selection action can include, but is not limited to: clicking, touching, and typing.
[0137] S502, The target electronic device is connected to an external display device, including a display output module.
[0138] The specific implementation of S502 can be found in the detailed description of the target electronic device connecting to an external display device including a display output module in S101, which will not be repeated here.
[0139] S503. The target electronic device determines the target display data, which is used by the display output module to display the output content.
[0140] The target display data relates to the display content of the target display screen, and the number of the target display screens is greater than or equal to 2.
[0141] The specific implementation of S503 can be found in the detailed description of S102, where the target electronic device determines the target display data, and will not be repeated here.
[0142] In this embodiment, the process of determining the target display screen based on the selection instruction occurs before the target electronic device is connected to the external display device, that is, the target display screen is pre-configured based on the selection instruction.
[0143] By pre-configuring the identifier of the target display screen, the processing efficiency of the screen projection configuration can be improved and the configuration time can be reduced.
[0144] Figure 6 A flowchart illustrating one possible processing method is provided. (See reference) Figure 6 The processing method shown may include, but is not limited to, the following: Figure 6S601 to S603 are shown.
[0145] S601, The target electronic device is connected to an external display device, including a display output module.
[0146] The specific implementation of S601 can be found in the detailed description of S501, in which the target electronic device determines the target display screen in response to the selection command, and will not be repeated here.
[0147] S602, The target electronic device determines the target display screen in response to the selection command.
[0148] The selection instructions include identifiers for at least two displays.
[0149] The specific implementation of S602 can be found in the detailed description of the target electronic device connecting to an external display device including a display output module in S101, which will not be repeated here.
[0150] S603. The target electronic device determines the target display data, which is used by the display output module to display the output content.
[0151] The target display data relates to the display content of the target display screen, and the number of the target display screens is greater than or equal to 2.
[0152] The specific implementation of S603 can be found in the detailed description of S102, where the target electronic device determines the target display data, and will not be repeated here.
[0153] In this way, the identifier of the target display screen is determined based on the selection command only after the target electronic device is connected to the external display device. This allows the identifier of the target display screen to be adjusted according to the actual situation, resulting in high flexibility and strong applicability.
[0154] Understandably, the target electronic device can also trigger the execution of the target electronic device in response to the selection command based on the newly connected target display screen.
[0155] The processing procedure provided in the embodiments of this application is illustrated below using Example C.
[0156] like Figure 7 As shown, the target electronic device 701 has three displays: a front main display 7011, a front auxiliary display 7012, and a rear display 7013. The content displayed on the front main display 7011, the front auxiliary display 7012, and the rear display 7013 is as follows: Figure 7 As shown.
[0157] Specifically, in response to a selection command, the target electronic device determines that the target display screen includes the display content of the front main display screen 7011, the front auxiliary display screen 7012, and the rear display screen 7013; the target electronic device 701 connects to an external display device 702 including a display output module; the target electronic device 701 determines that the target display data is the display data of the front main display screen 7011, the display data of the front auxiliary display screen 7012, and the display data of the rear display screen 7013; the purpose of configuring the target display data in the target electronic device 201 is to use the display output module to display the output display content.
[0158] Since the target display data is used to display the output content of the display output module, after this processing, the target electronic device 701 has the ability to send the target display data (display data of the front main display screen 7011, display data of the front auxiliary display screen 7012, and display data of the rear display screen 7013) to the external display device 702 so that the external display device 702 can perform output display.
[0159] Furthermore, the target electronic device 701 can send the target display data to the external display device 702, so that the display content of the external display device 702 can be displayed as follows: Figure 7 As shown.
[0160] Figure 8 A flowchart illustrating one possible processing method is provided. (See reference) Figure 8 The processing method shown may include, but is not limited to, the following: Figure 8 S801 to S803 are shown.
[0161] S801, The target electronic device connects to an external display device, including a display output module.
[0162] The specific implementation process of S801 can be found in the detailed description of connecting the target electronic device to an external display device, including a display output module, in S101, which will not be repeated here.
[0163] S802, The target electronic device determines a valid target display screen that is in a valid state based on the identifier of the target display screen.
[0164] The number of target displays is greater than or equal to 2.
[0165] A valid target display screen is one that is active or lit up.
[0166] S802 can be implemented as follows: the target electronic device obtains all target displays based on the identifier of the target display, then detects the status of each target display, and determines the target display that is in a valid state as a valid target display.
[0167] It should be noted that there must be at least two target displays, and at least one valid target display.
[0168] S803. The target electronic device determines the target display data based on the identifier of the effective target display screen.
[0169] The target display data is used by the display output module to display the output content.
[0170] S803 can be implemented as follows: For each valid target display screen among all valid target display screens, the target electronic device determines the valid target display screen based on the identifier of the valid target display screen, and then reads the display data of the valid target display screen. The target electronic device traverses all valid target display screens and determines the display data of all valid target display screens as the target display data.
[0171] The processing procedure provided in the embodiments of this application will be described below using Example D.
[0172] like Figure 9 As shown, the target electronic device 901 has one display screen, designated as display screen 9011; the target electronic device 901 is externally connected to display screen 902, and the target electronic device 901 and display screen 902 are in an extended mode. The display content of display screen 9011 and display screen 902 is as follows... Figure 9 As shown.
[0173] Specifically, the target electronic device 901 is connected to an external display device 903, which includes a display output module; the target display screen is determined to include display screen 9011 and display screen 902; the target electronic device 901 determines the valid target display screen in a valid state as display screen 9011 based on the identifier of the target display screen, and determines the target display data as the display data of display screen 9011 based on the identifier of the valid target display screen; the purpose of configuring the target display data in the target electronic device 201 is to use the display output module to display the output content.
[0174] The target electronic device 901 can send target display data (display data of the display screen 9011) to the external display device 903, so that the display content of the external display device 903 can be displayed as shown. Figure 9 As shown.
[0175] Determining target display data based on the display data of valid target displays can avoid wasting resources when some target displays are in an invalid state but are still projected, thus improving resource utilization and user experience.
[0176] In some embodiments, the effective target display screen belongs to the target display screen.
[0177] The number of effective target displays changes dynamically, and the target display data changes dynamically accordingly.
[0178] The target display data includes the display data of all valid target displays. If the number of valid target displays changes dynamically, the target display data will change dynamically accordingly.
[0179] This application does not specifically limit the reasons for changes in the number of effective target displays, which can be determined according to actual conditions. For example, the reasons for changes in the number of effective target displays may include, but are not limited to: pushing and pulling a sliding screen, splicing displays, and connecting other displays within the target range of the target electronic device, etc.
[0180] For example, the target electronic device is a mobile phone with a push-pull function. In the pushed-open state, the phone has two displays; in the pulled-up state, the phone has one display. At time 1, when the phone is in the pushed-open state, the number of valid target displays is 2, and the target display data is the display data of the 2 valid target displays. At time 2, when the phone is in the pulled-up state, the number of valid target displays is 1, and the target display data is the display data of the 1 valid target display.
[0181] The processing procedure provided in the embodiments of this application will be described below using Example E.
[0182] Based on Example D, if the display screen of display screen 902 is lit, meaning the effective target display screens include display screen 902 and display screen 9011; then the target display data includes the display data of display screen 902 and the display data of display screen 9011; the corresponding display data on the external display device 903 is as follows: Figure 10 As shown.
[0183] The following describes the processing method provided in this application using four examples.
[0184] Example A: The target electronic device includes a flexible display screen. How to project the display screen after the flexible display screen is folded.
[0185] Specifically, the target electronic devices include flexible displays and rear displays.
[0186] When the flexible display screen is detected to be in a folded state, the display data of the flexible display screen and the display data of the rear display screen are projected together to an external display device.
[0187] When the flexible display screen is detected to be in an unfolded state, the projection of the display data from the flexible display screen and the display data from the rear display screen onto the external display device is stopped.
[0188] In this way, users can project their screens using the flexible screen.
[0189] Example B: How to perform screen projection when the target electronic device is connected to or spliced with a new display screen.
[0190] When casting, you can enable "Splicing Mode". In this mode, the target electronic device will not only cast its own display data but also detect if other devices with displays are nearby or have joined the splicing mode. This will result in several splicing modes: Splicing Mode 1 and Splicing Mode 2.
[0191] Splicing Mode 1: The target electronic device and the connected display screen are spliced together; that is, the target display data comes from the display data of the target electronic device's display screen and the display data of the connected display screen. Because they enter splicing mode at the same time, the display data of the target electronic device's display screen and the connected end display screen are spliced together and displayed on the external display device side.
[0192] Splicing Mode 2: Target electronic device splices with another electronic device: that is, the external display device displays the content of the target electronic device and detects the content of other electronic devices joining the splicing mode. At this time, the target electronic device will automatically switch its content and cooperate with the other devices that have joined the splicing for display.
[0193] Example C: How to perform screen projection when the number of displays changes during a push-pull operation of an electronic device.
[0194] For sliding screen devices, the top display screen can be pushed up at an angle or vertically, and there is another display screen below.
[0195] On one hand, the "push-pull" operation allows users to select whether the content of the target electronic device is projected onto the previous or next screen, or onto both screens simultaneously or together. Alternatively, the "push-pull" operation can be linked to the projection, meaning that pushing the device open displays the content on the lower screen or both screens simultaneously, while pulling it up displays the content on the upper screen.
[0196] On the other hand, when the push-pull screen is used as the target electronic device, the "push-pull" operation can be bound to the projection, that is, the screen will be automatically projected when it is pushed open and the projection will be canceled when it is pulled up.
[0197] On the other hand, when the push-pull screen is used as the target electronic device, the "push-pull" operation can be bound to the target display screen that needs to be displayed. That is, when it is pushed open, the display data of the two displays will be automatically projected, and when it is pulled up, the display data of the upper display screen will be projected.
[0198] In this way, the "push-pull" operation of the sliding screen is deeply integrated with the projection, making it very convenient for users to operate.
[0199] Example D: How to continue screen projection when splicing is separated.
[0200] When multiple displays are spliced together, the projected content inevitably includes data displayed on multiple displays. If the target electronic device can display data on multiple displays simultaneously, and one of the displays is separated, it will be adapted according to the user's choice of one of the following two modes: copy mode and host mode.
[0201] Copy mode: The projected content will be displayed in its entirety on both displays simultaneously.
[0202] Host mode: The projected content will be displayed on the main display screen, and will not be displayed on the other display screen.
[0203] When two devices are combined again, there are two modes: cross-screen mode and non-cross-screen mode.
[0204] Cross-screen mode: The two projected contents are merged into one and continue to be displayed across screens.
[0205] Non-cross-screen mode: The two projected contents are not merged, nor are they displayed across screens.
[0206] In this way, when the device cancels the splicing or merges again, the screen-projected content displayed across screens will be adapted according to the user's needs.
[0207] Secondly, to implement the above-mentioned processing method, an embodiment of this application provides a processing apparatus, which is described below in conjunction with... Figure 11 The structural diagram of the processing device shown is used for explanation.
[0208] like Figure 11 As shown, the processing device 110 includes a connection unit 1101 and a determination unit 1102.
[0209] Connection unit 1101 is used to connect an external display device including a display output module;
[0210] Determining unit 1102 is used to determine target display data, which is used by the display output module to display output content;
[0211] The target display data relates to the display content of the target display screen, and the number of the target display screens is greater than or equal to 2.
[0212] In some embodiments, the determining unit 1102 is further configured to:
[0213] Obtain the identifiers of the displays that satisfy the association relationship; wherein the number of displays that satisfy the association relationship is greater than or equal to 2;
[0214] Display data for each display screen that satisfies the association relationship is obtained based on the identifier of the display screen that satisfies the association relationship;
[0215] Target display data is determined based on the display data of each display screen that satisfies the association relationship.
[0216] In some embodiments, the association relationship includes any of the following:
[0217] The display screen associated with the target display mode;
[0218] Display screens representing the same target electronic device;
[0219] A display screen that represents the electronic device in the context of its target usage mode;
[0220] The display screen representing the target electronic device and the display screen of another electronic device within the target range of the target electronic device.
[0221] In some embodiments, the processing device 110 further includes a selection unit for: determining a target display screen in response to a selection instruction, the selection instruction including identifiers of at least two display screens.
[0222] In some embodiments, the determining unit 1102 is further configured to:
[0223] The number of valid target displays is greater than or equal to two, based on the identifier of the target display.
[0224] Target display data is determined based on the identifier of the valid target display screen; the target display data is used by the display output module to display the output content.
[0225] In some embodiments, the effective target display screen belongs to the target display screen.
[0226] The number of effective target displays changes dynamically, and the target display data changes dynamically accordingly.
[0227] It should be noted that the processing device provided in this application embodiment includes all the units included, which can be implemented by a processor in an electronic device; of course, it can also be implemented by specific logic circuits; in the implementation process, the processor can be a central processing unit (CPU), a microprocessor (MPU), a digital signal processor (DSP), or a field-programmable gate array (FPGA), etc.
[0228] The descriptions of the above device embodiments are similar to those of the above method embodiments, and have similar beneficial effects. For technical details not disclosed in the device embodiments of this application, please refer to the descriptions of the method embodiments of this application for understanding.
[0229] It should be noted that, in the embodiments of this application, if the above-described processing method is implemented as a software functional module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiments of this application, or the part that contributes to the related technology, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), magnetic disks, or optical disks. Thus, the embodiments of this application are not limited to any specific hardware and software combination.
[0230] Thirdly, to implement the above processing method, this application provides an electronic device, including a memory and a processor. The memory stores a computer program that can run on the processor, and when the processor executes the program, it implements the steps in the processing method provided in the above embodiments.
[0231] The following is combined with Figure 12 The electronic device 120 shown is illustrated with a structural diagram of the electronic device.
[0232] In one example, electronic device 120 can be the aforementioned electronic device. For example... Figure 12 As shown, the electronic device 120 includes: a processor 1201, at least one communication bus 1202, a user interface 1203, at least one external communication interface 1204, and a memory 1205. The communication bus 1202 is configured to enable communication between these components. The user interface 1203 may include a display screen, and the external communication interface 1204 may include standard wired and wireless interfaces.
[0233] The memory 1205 is configured to store instructions and applications executable by the processor 1201, and can also cache data to be processed or already processed by the processor 1201 and various modules in the electronic device (e.g., image data, audio data, voice communication data and video communication data), which can be implemented by flash memory or random access memory (RAM).
[0234] Fourthly, embodiments of this application provide a storage medium, namely a computer-readable storage medium, on which a computer program is stored, which, when executed by a processor, implements the steps in the processing method provided in the above embodiments.
[0235] It should be noted that the descriptions of the storage medium and device embodiments above are similar to the descriptions of the method embodiments above, and have similar beneficial effects. For technical details not disclosed in the storage medium and device embodiments of this application, please refer to the descriptions of the method embodiments of this application for understanding.
[0236] It should be understood that the phrase "one embodiment" or "an embodiment" throughout the specification means that a specific feature, structure, or characteristic related to the embodiment is included in at least one embodiment of this application. Therefore, "in one embodiment" or "in some embodiments" appearing throughout the specification do not necessarily refer to the same embodiment. Furthermore, these specific features, structures, or characteristics can be combined in any suitable manner in one or more embodiments. It should be understood that in the various embodiments of this application, the sequence numbers of the above-described processes do not imply a sequential order of execution; the execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application. The sequence numbers of the above-described embodiments are merely descriptive and do not represent the superiority or inferiority of the embodiments.
[0237] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.
[0238] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are merely illustrative. For example, the division of units is only a logical functional division, and in actual implementation, there may be other division methods, such as: multiple units or components can be combined, or integrated into another system, or some features can be ignored or not executed. In addition, the coupling, direct coupling, or communication connection between the various components shown or discussed can be through some interfaces, and the indirect coupling or communication connection between devices or units can be electrical, mechanical, or other forms.
[0239] The units described above as separate components may or may not be physically separate. The components shown as units may or may not be physical units. They may be located in one place or distributed across multiple network units. Some or all of the units may be selected to achieve the purpose of this embodiment according to actual needs.
[0240] In addition, each functional unit in the various embodiments of this application can be integrated into one processing unit, or each unit can be a separate unit, or two or more units can be integrated into one unit; the integrated unit can be implemented in hardware or in the form of hardware plus software functional units.
[0241] Those skilled in the art will understand that all or part of the steps of the above method embodiments can be implemented by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it performs the steps of the above method embodiments. The aforementioned storage medium includes various media that can store program code, such as mobile storage devices, read-only memory (ROM), magnetic disks, or optical disks.
[0242] Alternatively, if the integrated units described above are implemented as software functional modules and sold or used as independent products, they can also be stored in a computer-readable storage medium. Based on this understanding, the technical solutions of the embodiments of this application, or the parts that contribute to related technologies, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as mobile storage devices, ROMs, magnetic disks, or optical disks.
[0243] The above description is merely an embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.
Claims
1. A processing method applied to a target electronic device, the method comprising: The target electronic device is connected to an external display device, including a display output module. The target electronic device determines target display data, which is used by the display output module to display output content. The target display data relates to the display content of the target display screen, and the number of target display screens is greater than or equal to 2; the target display data is determined based on the valid target display screens among the target display screens, and the target display data changes dynamically based on the dynamically changing number of valid target display screens; the valid target display screens belong to the target display screen, and the change in the number of valid target display screens is a change in the number caused by non-screen projection operations; the target display screens and the target electronic device satisfy an association relationship.
2. The method according to claim 1, wherein determining the target display data includes: Obtain the identifiers of the displays that satisfy the association relationship; wherein the number of displays that satisfy the association relationship is greater than or equal to 2; Display data for each display screen that satisfies the association relationship is obtained based on the identifier of the display screen that satisfies the association relationship; Target display data is determined based on the display data of each display screen that satisfies the association relationship.
3. The method according to claim 2, wherein the association relationship includes any one of the following: The display screen associated with the target display mode; Display screens representing the same target electronic device; A display screen that represents the electronic device in the context of its target usage mode; The display screen representing the target electronic device and the display screen of another electronic device within the target range of the target electronic device.
4. The method according to claim 1, further comprising, before determining the target display data: A target display screen is determined in response to a selection instruction, the selection instruction including identifiers of at least two display screens.
5. The method according to claim 1, wherein determining the target display data includes: The valid target display screen is identified based on its identifier. The number of the target display screens is greater than or equal to 2; Target display data is determined based on the identifier of the valid target display screen; The target display data is used by the display output module to display the output content.
6. A processing apparatus, the apparatus being deployed on a target electronic device, the processing apparatus comprising: A connection unit is used for connecting the target electronic device to an external display device, including a display output module; The determining unit is used by the target electronic device to determine target display data, which is used by the display output module to display output content. The target display data relates to the display content of the target display screen, and the number of target display screens is greater than or equal to 2; the target display data is determined based on the valid target display screens among the target display screens, and the target display data changes dynamically based on the dynamically changing number of valid target display screens; the valid target display screens belong to the target display screen, and the change in the number of valid target display screens is a change in the number caused by non-screen projection operations; the target display screens and the target electronic device satisfy an association relationship.
7. A target electronic device, the target electronic device comprising a memory and a processor, the memory storing a computer program executable on the processor, the processor executing the program: The target electronic device is connected to an external display device, including a display output module. The target electronic device determines target display data, which is used by the display output module to display output content. in, The target display data relates to the display content of the target display screen, and the number of the target display screens is greater than or equal to 2; The target display data is determined based on the valid target displays among the target displays, and the target display data changes dynamically based on the dynamically changing number of valid target displays; the valid target displays belong to the target displays, and the change in the number of valid target displays is a change in the number caused by non-screen projection operations; The target display screen and the target electronic device are associated.
8. A storage medium having a computer program stored thereon, the computer program being executed by a processor in a target electronic device: The target electronic device is connected to an external display device, including a display output module. The target electronic device determines target display data, which is used by the display output module to display output content. in, The target display data relates to the display content of the target display screen, and the number of the target display screens is greater than or equal to 2; The target display data is determined based on the valid target displays among the target displays, and the target display data changes dynamically based on the dynamically changing number of valid target displays; the valid target displays belong to the target displays, and the change in the number of valid target displays is a change in the number caused by non-screen projection operations; The target display screen and the target electronic device are associated.