Display control method and electronic equipment

Abstract

The invention provides a display control method and electronic equipment, which can be applied to the technical field of terminal equipment. The method comprises the following steps: in response to an obtained target interaction operation, controlling target equipment to enter a target mode matched with the target interaction operation; determining a target display area based on the target mode to output target content in the target display area; wherein the target interaction operation comprises an operation acting on a target interaction area of the electronic equipment and / or an operation for triggering a communication port of the electronic equipment to generate state change, and the target equipment comprises or does not comprise the electronic equipment.

Description

Technical Field

[0001] The present disclosure relates to the field of terminal devices, and in particular to a display control method and an electronic device. Background Art

[0002] In operating systems such as Windows 11, Linux, Hongmeng or iOS, users often rely on system hotkeys or complex interface options to set the screen duplication or extension mode to adapt to the multi-screen working environment. However, with the increase in the number of devices and the diversification of screen layouts, this traditional setting method has become more and more cumbersome and difficult to understand intuitively. In order to improve the user experience, a more natural and intuitive gesture operation method is urgently needed, allowing users to quickly and accurately copy a specified desktop or expand content based on a specific desktop. Such a solution will greatly simplify the multi-screen management process, allowing users to use multiple display devices more efficiently and improve the convenience of work and life. Summary of the invention

[0003] In view of the above problems, the present disclosure provides a display control method and an electronic device.

[0004] According to a first aspect of the present disclosure, a display control method is provided, comprising: in response to obtaining a target interaction operation, controlling a target device to enter a target mode matching the target interaction operation; determining a target display area based on the target mode to output target content in the target display area; wherein the target interaction operation includes an operation acting on a target interaction area of ​​the electronic device and / or an operation triggering a state change of a communication port of the electronic device, and the target device includes or does not include the electronic device.

[0005] According to an embodiment of the present disclosure, in response to obtaining a target interactive operation, controlling a target device to enter a target mode that matches the target interactive operation includes at least one of the following: obtaining operation data generated by the target interactive operation, and controlling the target device to enter a target display mode that matches the operation data based on the operation data; obtaining type information of the target interactive operation, and controlling the target device to enter a target display mode that matches the type information based on the type information; obtaining source information of the target interactive operation, and controlling the target device to enter a target display mode that matches the source information based on the source information; determining an operated object of the target interactive operation, and controlling the target device to enter a target display mode that matches attribute information of the operated object based on the operated object; wherein the target device includes the electronic device itself and / or an external device connected to the electronic device; and the target content is generated from the electronic device or from an external device connected to the electronic device.

[0006] According to an embodiment of the present disclosure, controlling the target device to enter a target display mode matching the operation data based on the operation data includes at least one of the following: controlling the electronic device itself and / or an external device connected to the electronic device to enter a target display mode matching the touch operation data based on touch operation data generated by a touch operation acting on a touch area of ​​the target device; controlling the electronic device itself and / or an external device connected to the electronic device to enter a target display mode matching the gesture operation data based on gesture operation data acting on a spatial sensing area of ​​the electronic device; controlling the electronic device itself and / or an external device connected to the electronic device to enter a target display mode matching the gesture operation data based on connection operation data for changing the connection state of a communication port of the electronic device.

[0007] According to an embodiment of the present disclosure, controlling the target device to enter a target display mode matching the operation data based on the operation data includes at least one of the following: controlling the electronic device itself to enter any of a split-screen display mode, an extended display mode, a copy display mode or a display mode corresponding to the first touch operation data based on first touch operation data acting on a unique touch area of ​​the electronic device; controlling the electronic device itself to enter any of an extended display mode, a copy display mode, a full-screen display mode or a display mode based on second touch operation data acting on at least two touch areas of the electronic device, and / or controlling an external device connected to the electronic device to enter a host mode or a display mode; controlling the electronic device itself to enter any of a copy display mode, an extended display mode, a full-screen display mode, a split-screen display mode or a display mode based on third touch operation data acting on a first application window of the electronic device, and / or controlling an external device connected to the electronic device to enter a host mode or a display mode.

[0008] According to an embodiment of the present disclosure, controlling the target device to enter a target display mode matching the operation data based on the operation data includes at least one of the following: controlling the electronic device itself to enter any one of a copy display mode, an extended display mode, a full-screen display mode, a split-screen display mode, and a display mode based on at least one of a touch position, a touch area, a touch pressure, and a touch trajectory acting on a target touch area of ​​the electronic device, and / or controlling an external device connected to the electronic device to enter a host mode or a display mode; controlling the electronic device itself to enter any one of a copy display mode, an extended display mode, a full-screen display mode, a split-screen display mode, and a display mode based on at least one of an operation trajectory, a touch area, a touch pressure, or an operation position acting on a second application window of the electronic device, and / or controlling an external device connected to the electronic device to enter a host mode or a display mode; controlling the electronic device itself to enter any one of a copy display mode, an extended display mode, a full-screen display mode, a split-screen display mode, and a display mode based on the operation data and attribute information of the operated object, and / or controlling an external device connected to the electronic device to enter a host mode or a display mode.

[0009] According to an embodiment of the present disclosure, controlling the target device to enter a target display mode matching the operation data based on the operation data includes at least one of the following: controlling the electronic device itself to enter any of a copy display mode, an extended display mode, a full-screen display mode, a split-screen display mode, and a display mode based on gesture operation data acting on a spatial sensing area of ​​the electronic device, and / or controlling an external device connected to the electronic device to enter a host mode or a display mode; controlling the electronic device itself to enter any of a display mode, a copy display mode, an extended display mode, a full-screen display mode, or a split-screen display mode based on connection status change data between the electronic device and the external device, and / or controlling the external device to enter a display mode or a host mode.

[0010] According to an embodiment of the present disclosure, controlling a target device to enter a target mode matching the target interactive operation includes at least one of the following: controlling the electronic device and / or an external device connected to the electronic device to enter a corresponding target display mode based on the obtained target posture data and the operation data generated by the target interactive operation acting on the electronic device, wherein the target posture data includes posture and morphological data of the electronic device and / or the external device; controlling the electronic device and / or an external device connected to the electronic device to enter a corresponding target display mode based on device operation information of the electronic device and the operation data acting on the electronic device; controlling the electronic device and / or the external device to enter a corresponding target display mode based on the operation data acting on the electronic device and the number and / or type of external devices connected to the electronic device.

[0011] According to an embodiment of the present disclosure, determining a target display area based on the target mode to output target content in the target display area includes at least one of the following: when controlling the electronic device to enter a full-screen display mode, adjusting display layout information of two display areas of the electronic device to output a portion of the target content in the two display areas respectively; when controlling the electronic device to enter a copy display mode or an extended display mode, determining a first display area of ​​the electronic device as the target display area to output the target content in the first display area, the first display area being an area pointed to by first operation data generated by the target interactive operation; when controlling the electronic device to enter a split-screen display mode, determining a first split-screen area of ​​the electronic device as the target display area to output the target content in the first split-screen area, the first split-screen area being an area pointed to by second operation data generated by the target interactive operation; when controlling the second display area of ​​the electronic device to enter a display mode, determining a third display area or the second display area of ​​the electronic device as the target display area to output the target content.

[0012] According to an embodiment of the present disclosure, it also includes at least one of the following: determining the target content to be output based on the operation data generated by the target interaction operation; determining the target content to be output based on the operation data generated by the target interaction operation and the posture and form of the electronic device; determining the target content to be output based on the operation data generated by the target interaction operation and the source information of the target interaction operation.

[0013] A second aspect of the present disclosure provides an electronic device, comprising: a first screen and a second screen that are rotatably connected; a processor, disposed on a body where the first screen or the second screen is located; wherein the processor is capable of responding to a target interaction operation acting on the first screen and / or the second screen, controlling the electronic device to enter a target mode that matches the target interaction operation; and determining a target display area based on the target mode to output target content in the target display area; wherein the target display area includes at least a portion of the display area of ​​the first screen and / or the second screen. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] The above contents and other objects, features and advantages of the present disclosure will become more apparent through the following description of the embodiments of the present disclosure with reference to the accompanying drawings, in which:

[0015] Figure 1 The application scenario diagram of the display control method according to the embodiment of the present disclosure is schematically shown;

[0016] Figure 2A flow chart schematically shows a display control method according to an embodiment of the present disclosure;

[0017] Figure 3 Several matching methods for matching a target mode of a target device based on a target interaction operation according to an embodiment of the present disclosure are schematically shown;

[0018] Figure 4A A schematic diagram of an operation of entering a target display mode according to an embodiment of the present disclosure is schematically shown;

[0019] Figure 4B Another operation diagram of entering a target display mode according to an embodiment of the present disclosure is schematically shown;

[0020] Figure 4C Another operation diagram of entering a target display mode according to an embodiment of the present disclosure is schematically shown;

[0021] Figure 5A A schematic diagram schematically shows a method of controlling a device to enter a target display mode through a unique touch area according to an embodiment of the present disclosure;

[0022] Figure 5B A schematic diagram schematically shows a method of controlling a device to enter a target display mode through at least two touch control areas according to an embodiment of the present disclosure;

[0023] Figure 5C A schematic diagram schematically shows a method of controlling a device to enter a target display mode through an application window according to an embodiment of the present disclosure;

[0024] Figure 6 Schematically illustrates a method of confirming a target display mode based on target interactive operation matching combined with other information according to an embodiment of the present disclosure;

[0025] Figure 7 A block diagram of an electronic device suitable for implementing a display control method according to an embodiment of the present disclosure is schematically shown. DETAILED DESCRIPTION

[0026] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. However, it should be understood that these descriptions are exemplary only and are not intended to limit the scope of the present disclosure. In the following detailed description, for ease of explanation, many specific details are set forth to provide a comprehensive understanding of the embodiments of the present disclosure. However, it is apparent that one or more embodiments may also be implemented without these specific details. In addition, in the following description, descriptions of known structures and technologies are omitted to avoid unnecessary confusion of the concepts of the present disclosure.

[0027] The terms used herein are only for describing specific embodiments and are not intended to limit the present disclosure. The terms "comprise", "include", etc. used herein indicate the existence of the features, steps, operations and / or components, but do not exclude the existence or addition of one or more other features, steps, operations or components.

[0028] All terms (including technical and scientific terms) used herein have the meanings commonly understood by those skilled in the art unless otherwise defined. It should be noted that the terms used herein should be interpreted as having a meaning consistent with the context of this specification and should not be interpreted in an idealized or overly rigid manner.

[0029] When using expressions such as "at least one of A, B, and C, etc.", they should generally be interpreted according to the meaning of the expression commonly understood by those skilled in the art (for example, "a system having at least one of A, B, and C" should include but is not limited to a system having A alone, B alone, C alone, A and B, A and C, B and C, and / or A, B, C, etc.).

[0030] The acquisition, transmission, storage, use, and processing of data in the technical solution disclosed in this disclosure are in compliance with the relevant provisions of national laws and regulations.

[0031] It should be noted that in the embodiments of the present application, certain software, components, models and other existing solutions in the industry may be mentioned, and they should be regarded as exemplary. Their purpose is only to illustrate the feasibility of implementing the technical solution of the present application, but it does not mean that the applicant has or will necessarily use the solution.

[0032] In the technical solution of the present disclosure, the user information (including but not limited to user personal information, user image information, user device information, such as location information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved are all information and data authorized by the user or fully authorized by all parties, and the collection, storage, use, processing, transmission, provision, disclosure and application of the relevant data comply with relevant laws, regulations and standards, take necessary confidentiality measures, do not violate public order and good morals, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0033] Figure 1 The application scenario diagram of the display control method according to an embodiment of the present disclosure is schematically shown.

[0034] like Figure 1As shown, the application scenario 100 according to this embodiment may include application scenarios such as screen duplication and screen extension of an electronic device. The first screen 101 and the second screen 102 may be two screens of the same electronic device, or they may be screens of the first electronic device and the second electronic device, respectively. It is understandable that when the first screen 101 and the second screen 102 are screens of the first electronic device and the second electronic device, respectively, the first electronic device and the second electronic device may interact through a network communication link. The first screen 101 and the second screen 102 may be used to display images of one or more systems or applications of the electronic device to which they belong, respectively, and the image contents displayed by the first screen 102 and the second screen 102 may be different. When the user has a need for multi-screen display, the user copies or extends the image displayed on the first screen 101 to the second screen 102 through hot keys or command manipulation. If it is a copy mode, the content displayed on the first screen 101 will be mirrored to the second screen 102 in real time and completely, and the two screens display exactly the same content; if it is an extension mode, the first screen 101 and the second screen 102 will be used as independent display areas, displaying different contents respectively, and jointly providing users with a wider field of view and more efficient multi-tasking capabilities.

[0035] The traditional way of setting screen duplication or extension mode through system hotkeys or complex interface options has gradually revealed its limitations. These limitations are mainly reflected in the following aspects: First, the operation is complicated. Users need to be familiar with and master a series of system hotkeys or complex menu options, which has a high learning cost for non-technical users or beginners. Even for users who are familiar with the operation, they need to go through multiple steps each time they set up the screen, such as opening the control panel, selecting display settings, adjusting resolution and layout, etc. These steps are relatively cumbersome and time-consuming; second, the flexibility of screen projection is poor. Traditional settings usually provide limited screen layouts and setting options, which cannot meet the diverse needs of users. For example, some users may need special screen arrangements, but traditional settings may not provide these options; third, the device compatibility is poor. Traditional settings may not be able to support various types of displays and connection methods well, causing users to encounter obstacles when using; fourth, due to the complexity of the operation, in scenarios where screen modes or layouts need to be switched frequently (such as multitasking, conference presentations, etc.), traditional settings may reduce user work efficiency.

[0036] In order to address these limitations, an embodiment of the present disclosure provides a display control method, including: in response to obtaining a target interaction operation, controlling a target device to enter a target mode that matches the target interaction operation; determining a target display area based on the target mode to output target content in the target display area. The target interaction operation includes an operation that acts on a target interaction area of ​​an electronic device and / or an operation that triggers a state change in a communication port of an electronic device, and the target device may or may not include an electronic device. Based on this method, the operation of screen copying or screen expansion can be simplified, making it easier for users to understand the operation intent and improve the operation efficiency, thereby improving the user's operation experience.

[0037] The following will be based on Figure 1 The scene described by Figure 2~Figure 6 The display control method of the disclosed embodiment is described in detail.

[0038] Figure 2 The flowchart of the display control method according to the embodiment of the present disclosure is schematically shown.

[0039] like Figure 2 As shown, the display control method of this embodiment includes operations S210 to S220, and the transaction processing method can be executed sequentially.

[0040] In operation S210, in response to obtaining the target interaction operation, the target device is controlled to enter a target mode matching the target interaction operation.

[0041] The target interaction operation includes an operation acting on the target interaction area and / or an operation that triggers a state change in the communication port of the target device. The target interaction area can be the sensing area of ​​various sensors of the electronic device, such as a touchpad, a touch screen area, a camera, a radar, a TOF, etc. The target interaction operation can be an operation actively performed by the user. For example, the target interaction operation can be a touch operation, a press operation, a sliding operation, etc., which the user acts on the screen; the target interaction operation can also be a user's spatial gesture operation, which can be based on the acquisition of devices such as cameras and sensors, and recognized based on image recognition algorithms; the target interaction operation can also be a user's touch operation, a spatial gesture operation, and a combination of a key operation or a voice command, etc. The target interaction operation can also be a passively triggered operation, such as an operation to establish a connection between an electronic device and an external device, which can be an interconnection connection operation such as a projection connection, a Bluetooth connection, or a wifidirect connection operation, or an IO interface plug-in operation, or a pairing connection operation of a communication port.

[0042] In an embodiment of the present disclosure, before obtaining the target interaction operation of the user, the user's consent or authorization may be obtained. For example, before operation S210, a request to obtain the target interaction operation may be sent to the user through an electronic device. When the user agrees or authorizes that the target interaction operation can be obtained, operation S210 is performed based on the electronic device.

[0043] The target device includes or does not include the electronic device that performs operation S210. When the target device includes the electronic device, in response to the user's target interactive operation on the electronic device, the electronic device itself enters a target mode that matches the target interactive operation, or the electronic device and its external device both enter the corresponding target mode; when the target device does not include the electronic device, the target device may be an external electronic device that establishes a connection relationship with the electronic device, and in response to the user's target interactive operation on the electronic device, the electronic device generates a corresponding control instruction and sends it to the external device, so that the external device enters a target mode that matches the target interactive operation. It can be understood that the external device and the electronic device can be devices with the same operating system or devices with different operating systems. The number of target devices can be one or more, which is not limited here.

[0044] The target mode may include multiple display modes such as extended display mode, copy display mode, split-screen display mode, full-screen display mode, monitor mode, and system display mode. Among them, extended display mode refers to a display mode that extends a specified desktop to one or more screens; copy mode refers to a display mode that mirrors screen content from one screen to other screens; full-screen mode refers to a display mode that displays a display content through one screen or combines multiple screens into a large screen for common display; monitor mode refers to a display mode that controls the device to project the specified display content, that is, a mode that acts as a monitor display. Different target interaction operations can trigger the electronic device and / or an external device connected to the electronic device to enter different target modes.

[0045] In operation S220, a target display area is determined based on the target mode to output target content in the target display area.

[0046] The target display area of ​​the target device is different for different target modes. The target display area may be a display area used to output the target content. For example, if the target device enters a split-screen display mode, the target display area may be at least one split-screen area of ​​the target device; if the target device enters a full-screen display mode, the target display area may be determined as the entire display area of ​​the target device; if the target device enters a copy display mode or an extended display mode, the target display area may be a second screen area used to copy or extend the screen, and the second screen area may be the entire display area or a portion of the display area of ​​the target device, or may be extended to an external display screen connected to the target device.

[0047] According to the display control method provided by the embodiment of the present disclosure, by obtaining the user's target interaction operation, matching the corresponding target mode, corresponding to different target operations, the target device can quickly enter different target modes and output the response target content. The method is simple to operate and can be implemented by simply defining simple target interaction operations according to the user's personal preferences, which is convenient for users to understand and remember operation behaviors and saves users' learning costs; the method can flexibly match a variety of different target modes by configuring a variety of different target interaction operations, and realize a variety of display effects to cope with a variety of application scenarios; the method can be applied to display control between multiple devices, realize device control based on interactive operations, and then realize cross-device and cross-system display applications.

[0048] The detailed steps of operations S210 to S220 are described below.

[0049] Figure 3 Several matching methods for matching a target mode of a target device based on a target interaction operation according to an embodiment of the present disclosure are schematically shown.

[0050] like Figure 3 As shown, in operation S210, the method of controlling the target device to enter a target mode matching the target interactive operation includes at least one of S211 to S214.

[0051] In operation S211, operation data generated by a target interactive operation is obtained, and based on the operation data, a target device is controlled to enter a target display mode matching the operation data.

[0052] The target interaction operation may be an operation acting on the target interaction area of ​​the electronic device. In this case, the target interaction operation may be a touch operation, a press operation, a sliding operation, etc., which is performed by the user on the screen. The operation data generated by the target interaction operation may include touch operation data such as touch position, touch area, touch pressure, and touch trajectory. The target interaction operation may also be a spatial gesture operation of the user. In this case, the operation data generated by the target interaction operation may include spatial gestures and their motion data, etc. The target interaction operation may also be an operation that triggers a state change in the communication port of the target device. In this case, the operation data generated by the target interaction operation may include the port number, port position, port type, and / or signal generated by the port of the communication port, etc. In addition, the target interaction operation may be a combination of one or more of the above possible operations, or a combination of one or more of the above possible operations with other operations (such as issuing voice commands or key commands). The corresponding operation data may be the sum of the operation data generated by multiple operations. The specific target interaction operation and operation data can be defined according to actual needs, and are not specifically limited here.

[0053] After acquiring the target interactive operation, the electronic device can generate a control instruction based on the operation data generated by the target interactive operation, and send the control instruction to the target device, so that the target device enters the target mode according to the control instruction. The control instruction is generated based on the operation data, and different target interactive operations generate different operation data, generate different control instructions, and the target mode entered by the target device based on the control instruction is also different.

[0054] In some embodiments of the present disclosure, the target device may be the electronic device itself. Taking a laptop computer as an example, assuming that the laptop computer is currently in full-screen display mode, in response to a user performing a preset touch operation in a touch area, the operation data of the touch operation is identified, and the operation data may be a touch track; assuming that the pattern formed by the touch track is a straight line extending from top to bottom, indicating that the user wants to control the laptop computer to enter a left-right split-screen mode, the laptop computer generates a split-screen control instruction in response to the generation of the touch track, and switches the laptop computer to a split-screen display mode.

[0055] In other embodiments of the present disclosure, the target device may also be other devices that establish a communication connection with the electronic device, and the other device may be a device or display with an operating system, etc. For example, if the electronic device is a computer and the other device is an external display of the computer, the computer responds to the user's spatial gesture operation and obtains the operation data of the spatial gesture operation (including gesture action and action trajectory, etc.), and the spatial gesture operation may be an operation in which the user places his hand on the computer screen and then slides his hand onto the screen of the external display; the computer determines whether the spatial gesture operation acts on the computer and the external display based on the operation data of the spatial gesture operation, and determines whether the spatial gesture operation meets the preset gesture specification; when the computer determines that the spatial gesture operation meets the above requirements, it generates a control instruction to control the external display to enter the screen copy mode and project the display screen of the computer on the external display.

[0056] It should be noted that the description of the target interactive operation, operation data and controlling the target device to enter the target display mode based on the operation data in the above embodiments is only illustrative. In actual applications, the above content can have a variety of forms and combinations. The specific content is set and adjusted according to actual needs and is not specifically limited here.

[0057] In operation S212, type information of the target interactive operation is obtained, and based on the type information, the target device is controlled to enter a target display mode matching the type information.

[0058] The basic operation types of the target interactive operation can be divided into touch operation, spatial gesture operation, key operation and voice operation. Furthermore, the subdivided operation types of the touch operation can include one or more combinations of touch operation, press operation, sliding operation and the like acting on the screen. The subdivided operation types of the spatial gesture operation can include control operations for a single device and cross-device control operations. The operation types of the target interactive operation can also include a combination of touch operation, spatial gesture operation, key operation and voice operation.

[0059] In some embodiments of the present disclosure, it is possible to predefine different target display modes to match different type information of target interaction operations. For example, when the target interaction operation is a touch operation, the corresponding target display mode may be a full-screen display mode; when the target interaction operation is a spatial gesture operation, the corresponding target display mode may be an extended display mode; when the electronic device obtains the target interaction operation and identifies that the type information of the target interaction operation is a touch operation or a spatial gesture operation, based on the type information, the target device is controlled to enter a full-screen display mode or an extended display mode that matches the type information.

[0060] In some embodiments of the present disclosure, when the target interactive operation is one of touch operation, spatial gesture operation, key operation or voice operation, different target display modes can be matched according to the type information of the subdivided operation type of the target interactive operation. Taking the spatial gesture operation as an example, when the spatial gesture operation is a control operation for the electronic device itself, the type information of the operation can match the full-screen display mode or the split-screen display mode. The electronic device can combine the operation data of the spatial gesture operation (such as gesture form) to determine which of the full-screen display mode and the split-screen display mode the target display mode matched by the operation data of the current spatial operation gesture is, and control the target device to enter the corresponding target display mode based on the determined result.

[0061] In operation S213, source information of the target interactive operation is obtained, and based on the source information, the target device is controlled to enter a target display mode matching the source information.

[0062] The source information of the target interactive operation indicates which operation object the target interactive operation comes from, and the operation object may be a user. Since different users may have different operation habits, in order to enable users to quickly get started and get used to switching the target display mode through the target interactive operation, the operating system of the electronic device can determine the preference or habit of the operation object based on the user's portrait information, and then control the electronic device to enter the matching target display mode.

[0063] For example, suppose the electronic device is a tablet computer, and user A and user B are frequent users of the tablet computer. User A is accustomed to using the tablet computer in a top-bottom split screen mode, and user B is accustomed to using the tablet computer in a left-right split screen mode. When user A or user B respectively performs a touch operation for splitting the screen on the tablet computer, the tablet computer identifies the user and enters a top-bottom split screen display mode when facing user A, and enters a left-right split screen display mode when facing user B.

[0064] In operation S214, an operated object of the target interactive operation is determined, and based on the operated object, the target device is controlled to enter a target display mode that matches the attribute information of the operated object.

[0065] The operated objects of the target interactive operation include the electronic device itself and external devices. The corresponding target display mode can be determined in combination with the properties of the operated object. The properties of the operated object characterize the device type of the operated object. For example, the operated object can be a single-screen device, a dual-screen device, a device with an independent operating system, or a display, etc. For example, the operated object can be the electronic device itself, and the electronic device can be a dual-screen device. After determining that the electronic device itself is the operated object, the electronic device itself is controlled to enter copy mode, expansion mode, full-screen mode, split-screen mode, etc.; for another example, the operated object can be a laptop computer, a tablet computer, or a display connected to the electronic device, etc., then the laptop computer or tablet computer can be controlled to enter projection mode, monitor mode, etc.

[0066] According to operation S220, after controlling the target device to enter the target display mode, the electronic device determines a target display area on the target device based on the target device, and outputs target content in the target display area. The target content is generated by the electronic device or from an external device connected to the electronic device.

[0067] For example, in a scenario where the target device is the electronic device itself, the electronic device may be a dual-screen display device and perform replication or expansion between its own screens, the target display area may be at least a portion of the display area of ​​the first screen and / or the second screen of the dual-screen display device, and the target content may be the content displayed on the first screen and / or the second screen of the dual-screen display device itself; in a scenario where the target device is an external device of the electronic device, the electronic device may control the external device to enter a replication mode, an expansion mode, a monitor mode, or the like, so that the external device projects, expands, or monitors the electronic device. At this time, the target display area is the display area of ​​the external device, and the target content output by the target display area is the display content output by the electronic device, or the external device may control The electronic device is forced to enter a copy mode, an expansion mode, a monitor mode, etc., so that the electronic device can copy, expand or monitor the screen of an external device. At this time, the target display area is the display screen of the electronic device, and the target content output is generated from the external device. In the scenario where the target device is the electronic device and an external device of the electronic device, the electronic device and its external device can enter the system display mode together, and the display screens of the electronic device and the external device can be used to monitor multiple display screens of the system composed of the electronic device and external devices (including the screen display screens of the electronic device and the external device). In this mode, the display screens of the electronic device and the external device are both target display screens, and the target content output is the screen display content of the electronic device and the external device.

[0068] Figure 4A to Figure 4C The following schematic diagram shows an operation diagram of entering a target display mode according to an embodiment of the present disclosure. Figure 4A to Figure 4C The implementation method involved in operation S211 is further described.

[0069] like Figure 4A As shown, the target interactive operation may be a touch operation acting on the touch area of ​​the target device, and the target device may be an electronic device that executes the display control method of the present disclosure and / or an external device that establishes a communication connection with the electronic device. The touch data may include touch operation data such as touch position, touch area, touch pressure, and touch trajectory. When the electronic device obtains the touch operation generated by the user in the touch area of ​​the target device, the electronic device controls the electronic device itself and / or the external device connected to the electronic device to enter a target display mode that matches the touch operation data based on the touch operation data generated by the touch operation acting on the touch area of ​​the target device.

[0070] For example, when a user performs a sliding operation on the touch area of ​​a computer, the operation data of the sliding operation includes the sliding position, sliding trajectory, sliding direction, etc. When the sliding position of the sliding operation indicates that the user's finger slides from the middle position of the touch area to multiple edge positions of the touch area, and the electronic device determines that the sliding trajectory is a trajectory corresponding to entering the full-screen display mode, the computer is controlled to enter the full-screen display mode, and based on the sliding direction, the full-screen display format can be determined as horizontal or vertical.

[0071] like Figure 4B As shown, the target interactive operation may be a spatial gesture operation acting on a spatial sensing area of ​​the electronic device. The operation data of the spatial gesture operation includes gesture data, gesture change data, and gesture motion data. Based on the gesture operation data acting on the spatial sensing area of ​​the electronic device, the electronic device itself and / or an external device connected to the electronic device is controlled to enter a target display mode matching the gesture operation data.

[0072] Controlling the target display mode entered by the electronic device itself and / or an external device connected to the electronic device based on gesture operation data acting on the spatial sensing area of ​​the electronic device may include: controlling the electronic device itself to enter any of a copy display mode, an extended display mode, a full-screen display mode, a split-screen display mode, and a display mode based on gesture operation data acting on the spatial sensing area of ​​the electronic device, and / or controlling an external device connected to the electronic device to enter a host mode or a display mode.

[0073] In some embodiments of the present disclosure, the gesture operation data acting on the spatial sensing area of ​​the electronic device is used to control the electronic device to enter the target display mode. For example, the electronic device may be a dual-screen electronic device, and the spatial gesture operation may be as follows: Figure 4BThe control of the two screens of the dual-screen electronic device is shown to perform a selection operation of the copy display mode, the extended display mode, the full-screen display mode, the split-screen display mode, and the display mode. For example, the gesture data of the spatial gesture operation can be a gesture of the thumb and index finger opening, which indicates that the secondary screen of the electronic device is controlled to enter the copy display mode, which is used to copy the display content of the main screen. The display effect of the spatial gesture operation can be that the main screen and the secondary screen of the electronic device display the same content, or the main screen content of the electronic device is transferred to the secondary screen, and the main screen can be used to display other content in addition to the original display content (for example, the window that was originally covered or minimized on the main screen); the gesture change data of the spatial gesture operation can be the change data from pinching the thumb and index finger to opening, and the electronic device is controlled to form a dynamic effect of gradually expanding the screen in conjunction with the gesture data; the gesture movement data of the spatial gesture operation is, for example, the data of the upward or downward movement of the hand when performing the gesture operation, which indicates the expansion direction of the current expanded screen, for example, the upward movement of the hand indicates expansion from the lower screen to the upper screen. In particular, when the electronic device can be connected to other devices, the spatial gesture can control the electronic device to enter the display mode and use the electronic device as an extended display screen of the external device.

[0074] In some embodiments of the present disclosure, gesture operations acting on the spatial sensing area of ​​the electronic device are used to control an external device connected to the electronic device to enter a host mode or a display mode. When it is determined to control the external device to enter the host mode, the external device acts as a host system and the electronic device is used as an external display; when it is determined to control the external device to enter the display mode, the external device is used as an extended display of the electronic device. Figure 4B The two screens shown may also be screens of the electronic device and the external device respectively. Similar to the case where the dual-screen electronic device obtains operation data, based on the operation data of the spatial gesture operation, the electronic device can determine and control the external device to enter the target display mode. Figure 4C As shown, the target interactive operation can be an operation of establishing a connection or disconnecting a connection between an electronic device (a computer shown in the figure) and an external device (a tablet shown in the figure), and the operation data corresponding to the operation can be data for establishing a communication connection or operation data for disconnecting a connection. Based on the connection operation data for changing the connection state of the communication port of the electronic device, the electronic device itself and / or the external device connected to the electronic device is controlled to enter a target display mode matching the connection state.

[0075] For example, the target interactive operation for establishing a connection between an electronic device and an external device may be connection operations such as screen projection connection, Bluetooth connection, and line plugging. The operation data of the connection operation may include pairing information, screen projection format data, screen projection control signal, screen projection synchronization information, display parameters (such as resolution, refresh rate, etc.), etc., which can be used to control the electronic device and the external device to transmit screen projection data in accordance with the agreed screen projection format based on the screen projection control signal when determining that the screen projection pairing between the electronic device and the external device is successful, and synchronize the projection data between the electronic device and the external device based on the screen projection synchronization information. At the same time, the resolution and refresh rate of the projection on the external device can be controlled based on the display parameters.

[0076] For another example, the target interactive operation may be an operation of disconnecting the electronic device from the external device, and the operation data of the disconnection operation may include the disconnection reason (such as user-initiated disconnection, network failure, device failure, etc.), the status information of the device after the disconnection (for example, the external device will update its input source status to "no signal" or "idle"), etc. The disconnection reason can be provided to the electronic device and / or the external device for troubleshooting and other operations. When the disconnection reason is a non-fault reason (for example, the user actively disconnects), the external device can switch from the projection mode to the original display mode, such as the system display mode or full-screen mode of the device itself. When the disconnection reason is a fault reason, the external device can switch from the projection mode to, for example, the monitor mode. While the system of the external device monitors whether the connection relationship between the electronic device and the external device is being repaired or whether the relationship is re-established, the connection status generated during the re-establishment of the connection between the electronic device and the external device is displayed and monitored in the monitor mode. The connection status includes connection nodes and connection parameters, etc. The user can analyze and locate the faults that occurred during the connection process based on the nodes and connection parameters that cannot continue to establish the connection during the connection process.

[0077] Controlling the electronic device itself and / or an external device connected to the electronic device to enter a target display mode that matches the connection state based on connection operation data that changes the connection state of the communication port of the electronic device may include: controlling the electronic device itself to enter any of display mode, copy display mode, extended display mode, full screen display mode or split screen display mode based on the connection state change data between the electronic device and the external device, and / or controlling the external device to enter display mode or host mode. The control based on the connection state change data between the electronic device and the external device is similar to the aforementioned control based on touch data and gesture operation data, and both can be used as operation features to match the corresponding display mode. The embodiments of controlling the electronic device or external device to enter different target display modes are also similar to the aforementioned embodiments, and will not be repeated here.

[0078] Figure 5A to Figure 5CThe schematic diagrams of controlling the device to enter the target display mode through different touch areas according to the embodiments of the present disclosure are schematically shown. The following takes the operation data as touch data as an example to illustrate the operation based on different touch areas to control the electronic device or external device to enter different target display modes.

[0079] Figure 5A and Figure 5B Two situations in which a target device is controlled to enter a target display mode based on operation data are schematically shown. Based on operation data of at least one of the touch position, touch area, touch pressure, and touch trajectory of a target touch area of ​​the electronic device, the electronic device itself is controlled to enter any one of a copy display mode, an extended display mode, a full-screen display mode, a split-screen display mode, and a display mode, and / or an external device connected to the electronic device is controlled to enter a host mode or a display mode.

[0080] like Figure 5A As shown, the electronic device may be a device having a unique touch area, and the unique touch area may be, for example, a touch pad or touch display screen of a traditional notebook, tablet computer, etc. Based on the first touch operation data acting on the unique touch area of ​​the electronic device, the electronic device itself may be controlled to enter any of the split-screen display mode, extended display mode, copy display mode or display mode corresponding to the first touch operation data.

[0081] The first touch operation data may include touch operation data such as touch position, touch area, touch pressure, touch track, etc. Different first touch operation data can make the electronic device enter different display modes. For example, different touch positions can make the electronic device enter split-screen display mode or full-screen display mode, and different touch areas can make the electronic device enter copy display mode or extended display mode, etc. In particular, when the electronic device is connected to an external device, in response to a touch operation of sliding at a preset touch position (such as the edge of the touch area) in a unique touch area with a preset touch track (such as sliding from the edge of the touch area to the outside of the touch area), the electronic device can enter the display mode and use the electronic device as an extended display screen of the external device.

[0082] like Figure 5B As shown, the electronic device may be a dual-screen device, such as a dual-screen laptop computer, etc. The touch area of ​​the dual-screen device includes at least its two touch screens, and may also include its touch pad, an external touch screen, and an external touch pad, etc. Based on the second touch operation data acting on at least two touch areas of the electronic device, the electronic device itself may be controlled to enter any of an extended display mode, a copy display mode, a full-screen display mode, or a display mode, and / or an external device connected to the electronic device may be controlled to enter a host mode or a display mode.

[0083] The second touch operation data may include touch position, touch area, touch pressure, touch trajectory and other touch operation data. Different second touch operation data can make the electronic device or external device enter different display modes. For example, when the target device of the display control operation is an electronic device, the different touch areas, touch positions, touch pressures and touch trajectories formed by the touch operation on the dual screens can be combined to form different touch instructions, so that the electronic device can enter any one of the full-screen display mode, split-screen display mode, copy display mode, extended display mode or display mode.

[0084] like Figure 5B As shown, in the initial state, the B-side screen of the dual-screen electronic device can be used to display the picture 1, and the C-side screen can be used as a touchpad or keyboard. When the user touches the B-side screen and the C-side screen at the same time with the thumb and index finger, the area acting on the B-side screen is larger than the area acting on the C-side screen, and the two fingers remain motionless at the touch position for a certain period of time, the electronic device enters the copy display mode, and determines that the B-side screen is the main screen according to the size of the touch area, and copies the screen content of the B-side screen to the C-side screen; when the user touches the B-side screen and the C-side screen at the same time with the index finger and thumb, and makes a movement of sliding the index finger to the thumb, the electronic device is controlled to enter the full-screen display mode according to the touch positions of the two fingers and the sliding trajectory of the index finger, wherein the picture 1 of the B-side screen is expanded to the C-side screen according to the touch trajectory of the index finger touching the B-side screen, so that the B-side screen and the C-side screen of the electronic device are used as a whole screen to display and output the picture 1; when the user When the user touches the B-side screen and the C-side screen with the index finger and the thumb at the same time, if the touch pressure of the index finger is greater than the touch pressure of the thumb, and the touch positions of the index finger and the thumb remain unchanged, the electronic device enters the split-screen display mode, and determines to divide part of the screen content of screen 1 of the B-side screen of the electronic device to be displayed on the C-side screen, that is, screen 2 can be a part of the screen content divided from screen 1; when the user touches the B-side screen and the C-side screen with the index finger and the thumb at the same time, if the touch pressure of the index finger is greater than the touch pressure of the thumb, and the index finger slides to the touch position of the thumb, the electronic device enters the extended display mode, and determines that the B-side screen is the main screen and the C-side screen is the sub-screen according to the greater touch pressure of the index finger, and the screen of the main screen is expanded to the sub-screen, that is, screen 2 is the extended content of screen 1. In addition, when the user performs an action on the electronic device, such as sliding a single finger from the screen of the external device to the C-side screen, the electronic device enters the display mode and can select the C-side screen as an extended display screen of the external device according to the touch position where the finger stops sliding, that is, screen 2 displays the display content of the external device.

[0085] For another example, when the target device of the display control operation is an electronic device, based on the same target interaction operation or different target interaction operations, the second touch operation data acting on the dual screens is different, so that the dual screens enter different display modes respectively.

[0086] For another example, when the target device of the display control operation is an external device of the electronic device, according to the touch trajectory of the touch operation, for example, sliding from the in-screen area of ​​the electronic device to the out-screen area, it is determined to control the external device to enter the host mode, in which the external device acts as a host system and the electronic device acts as an external display mode; or sliding from the out-screen area of ​​the electronic device to the in-screen area, it is determined to control the external device to enter the display mode, that is, the external device acts as an extended display of the electronic device.

[0087] like Figure 5C As shown, the touch area of ​​the electronic device can be a first application window, which is an APP window for controlling the display mode of the electronic device. The APP window can display the current number and status of the display screen of the electronic device, and the display mode can be switched or adjusted by the interactive operation acting in the application window. Based on the third touch operation data acting on the first application window of the electronic device, the electronic device itself is controlled to enter any of the copy display mode, extended display mode, full screen display mode, split screen display mode, and display mode, and / or, the external device connected to the electronic device is controlled to enter the host mode or the display mode.

[0088] The third touch operation data may be at least one of the operation trajectory, touch area, touch pressure or operation position acting on the first application window or the second application window of the electronic device. The second application window may be the same window as the first application window, or it may be an APP window on an external device that displays the same content as the first application window. The operation trajectory may include screen motion trajectories such as sliding, dragging, and zooming. The touch area can be used to indicate whether the touch operation is clicking on the screen or selecting the screen displayed in the APP window. The difference in touch pressure can indicate the target display mode that the electronic device or external device enters. The operation position reflects whether the user clicks a button or operates the screen displayed in the APP window. The screen displayed on the first application window is a virtual image of the display screen of the electronic device and / or the external device, and the operation is more convenient than operating on a physical screen.

[0089] For example, Figure 5C In the image shown, screen A of the electronic device is pressed. When the touch time exceeds a preset value (e.g., 1 second), screen A is copied to generate screen A', and screen A' is dragged to screen B of the electronic device or screen C of the external device, and screen B of the electronic device or screen C of the external device is controlled to enter a copy display mode, and the display content of screen A is copied on screen B and screen C. Alternatively, screen A is copied to generate screen A', and screen A' is dragged to screen C of the external device, and screen C is controlled as an extended screen of the electronic device and displays the content of screen A.

[0090] On the basis of the above embodiments, the electronic device can also control the electronic device itself to enter any of the copy display mode, extended display mode, full screen display mode, split screen display mode, and display mode based on the operation data and the attribute information of the operated object, and / or control the external device connected to the electronic device to enter the host mode or display mode. Among them, the attribute information of the operated object represents the device type attribute of the operated object. For example, the operated object can be a display, an all-in-one computer, a tablet computer, etc. When the operated object is the electronic device itself, taking the electronic device as a display as an example, since the display does not have an operating system, it can generally be used as a display of an external device. When the operation data such as the operation trajectory, operation position, touch pressure or touch area of ​​the touch operation matches the preset control data of the display mode, the display can be controlled to enter the display mode for displaying the display content output by the external device. When the operated object is the electronic device itself, taking the electronic device as an all-in-one computer as an example, since the all-in-one computer has an independent operating system, it is possible to determine which target display mode to control the all-in-one computer or the external device to enter according to different operation trajectories. For example, when the all-in-one computer is originally in a split-screen display mode, the all-in-one computer is switched to a full-screen display mode according to the horizontal sliding trajectory of the touch operation; or, when the user's hand touches the display screen of the all-in-one computer and then moves to the external display screen, the all-in-one computer controls the external display screen to enter a copy display mode according to the operation trajectory.

[0091] Based on the above method of controlling the target device to enter a target mode matching the target interactive operation, the present disclosure further proposes a method of confirming the target display mode in combination with other information, including S610 to S630.

[0092] like Figure 6 As shown, according to Figure 3 The various types of operation data obtained by the target interactive operation shown can also be combined with other relevant auxiliary data to further accurately match the target display mode of the target device.

[0093] In operation S610, based on the obtained target posture data and the operation data generated by the target interactive operation acting on the electronic device, the electronic device and / or an external device connected to the electronic device is controlled to enter a corresponding target display mode, wherein the target posture data includes posture morphology data of the electronic device and / or the external device.

[0094] The target posture data can be the posture form of the electronic device or the external device, for example, when the display screen of the electronic device or the external device can be in a horizontal screen posture or a vertical screen posture, it can also present an elevation angle or a depression angle posture according to user needs. The target posture data can also be the relative posture form between the electronic device and the external device, for example, the external device is located above, below, to the left or to the right of the electronic device, or the electronic device is in a horizontal screen and the external device is in a vertical screen relative to the electronic device.

[0095] On the basis of determining which target display mode to control the electronic device and / or external device to enter based on the operation data of the target interactive operation, the display mode of the target display mode can be further determined in combination with the target posture data. For example, when the electronic device is in a horizontal screen posture, if the electronic device is controlled to enter a split-screen display mode based on the operation data, splitting the electronic device into left and right screens is more convenient for users to read, so the split-screen display mode can be determined to be a left-right split-screen mode in combination with the horizontal screen posture of the electronic device. For another example, when the electronic device and the external device are in an up-and-down position relationship, if the electronic device controls the external device to enter an extended display mode based on the operation data, the screen extension direction of the electronic device can be determined according to the position of the external device relative to the electronic device, and the extended display mode is an upward extended display mode or a downward extended display mode.

[0096] In operation S620, based on the device operation information of the electronic device and the operation data acting on the electronic device, the electronic device and / or an external device connected to the electronic device is controlled to enter a corresponding target display mode.

[0097] The device operation information of the electronic device includes the operation application information, operation mode, operation time, power, power consumption, etc. The operation application information of the electronic device may include application type, device type, technical support information, etc., which can be used to determine the category of the target display mode that the electronic device can currently enter or can control the external device to enter. The operation mode of the electronic device may include projection mode, full screen mode, power-on mode, standby mode, sleep mode, power-off mode, etc. The operation mode of the electronic device can be changed in combination with the operation data to enter the target display mode. When the electronic device and / or the external device enters the target display mode, the power consumption of the device will increase, accelerating the consumption of the device power. If the device is a battery-powered device, the increase in power consumption will shorten its operation time.

[0098] On the basis of determining which target display mode to control the electronic device and / or external device to enter based on the operation data of the target interactive operation, combined with the device operation information, the form and display effect of the target display mode of the target device can be determined. For example, if the electronic device is currently in a low-power state, when the electronic device is controlled to enter a split-screen display mode according to the operation data, the power consumption of the electronic device can be reduced by reducing the screen brightness, reducing the resolution, etc., that is, the electronic device is controlled to enter a low-power split-screen mode. For another example, if the current electronic device is in a high-speed operation state, if it is also necessary to control the external device to enter the display mode, the operating burden of the electronic device can be reduced by reducing the frame refresh rate of the external device, so that the external device enters a low-power, low-refresh rate display mode.

[0099] In operation S630, based on the operation data acting on the electronic device and the number and / or type of external devices connected to the electronic device, the electronic device and / or the external device are controlled to enter a corresponding target display mode.

[0100] In some embodiments of the present disclosure, when the number of external devices connected to the electronic device is 1, according to different operation data, the electronic device can control the electronic device and / or the external device to enter one of the following modes: copy display mode, extended display mode, full-screen display mode, split-screen display mode, host mode or display mode; when the number of external devices connected to the electronic device is greater than 1, if the same operation data is used to control multiple external devices, it can be assumed that the electronic device and the multiple external devices simultaneously enter the full-screen display mode or the extended display mode, thereby reducing the number of operations, reducing the difficulty of operations, and improving operation efficiency.

[0101] In some embodiments of the present disclosure, the types of external devices may include displays, computers, mobile phones, tablets, etc. If the external device is a display without an operating system, the electronic device can control the display to enter screen copy mode, screen extension mode and display mode according to operating data, but cannot control the display itself to enter split-screen mode and host mode; if the external device is a computer with an operating system, the electronic device can control the external device to enter different target display modes according to different operating data.

[0102] On the basis of the above embodiments, operation S220 of determining a target display area based on the target mode to output target content in the target display area may include operations S221 to S224.

[0103] In operation S221, when the electronic device is controlled to enter a full-screen display mode, display layout information of two display areas of the electronic device is adjusted to output a portion of the target content in the two display areas respectively.

[0104] In the case where the electronic device includes at least two screens, if the electronic device enters a full-screen display mode, such as a dual-screen display, the display layout of each screen can be adjusted to display a portion of the full-screen content on the display areas of the two screens, for example, the edge of the display area of ​​one screen can be dragged to reduce the area used to display the full-screen content to half of the original area, and the remaining area is used to display a virtual keyboard or other pages. Through this method, compared with displaying the full-screen content on one screen, the display area can be expanded, and more information can be displayed in the remaining area.

[0105] In operation S222, when controlling the electronic device to enter a copy display mode or an extended display mode, a first display area of ​​the electronic device is determined as a target display area to output target content in the first display area, where the first display area is an area pointed to by first operation data generated by a target interactive operation.

[0106] The first display area of ​​the electronic device may be a partial display area on a display screen, or may be one of the screens of a dual-screen device. When the electronic device enters the copy display mode or the extended display mode, the first display area is the area pointed to by the first operation data generated by the target interactive operation, for example, it may be an area with a larger touch area or touch pressure in a two-finger touch operation, or an area with a smaller touch area or touch pressure in a two-finger touch operation, or an area pointed to by touch data with an indication direction in a two-finger touch, such as an area to which the index finger slides or points. For example, when the dual-screen device enters the extended display mode, according to the position of the index finger touch included in the first operation data, the screen pointed to by the index finger is determined to be used for display expansion, and the target content of the expansion may be a screen image of another screen extended in the direction of the screen pointed to by the index finger. For another example, when the dual-screen device enters the copy display mode, according to the area of ​​the finger pressing on the dual screen included in the first operation data, it is determined that the screen with a larger touch area is the main screen, and the screen with a smaller touch area is determined to be the secondary screen, so that the secondary screen is determined as the target display area for copying the display content of the main screen.

[0107] In operation S223, when controlling the electronic device to enter the split-screen display mode, the first split-screen area of ​​the electronic device is determined as the target display area to output the target content in the first split-screen area, and the first split-screen area is the area pointed to by the second operation data generated by the target interactive operation.

[0108] The second operation data may include the touch area, touch pressure, touch duration, touch position, etc. of the finger. The first split screen area may be, for example, an area with a larger touch area or touch pressure in a two-finger touch operation, or an area with a smaller touch area or touch pressure in a two-finger touch operation, or an area represented by touch data indicating a direction in a two-finger touch. For example, when the electronic device enters a split screen display mode, based on the contact pressure between the two fingers and the screen in the second operation data, it is determined that the split screen area on the side with a larger contact pressure is larger, and the split screen is confirmed as the target display area to display the target content.

[0109] In operation S224, in a case where the second display area of ​​the electronic device is controlled to enter the display mode, the third display area or the second display area of ​​the electronic device is determined as a target display area to output target content.

[0110] In the case of controlling the second display area of ​​the electronic device to enter the display mode, when the target content comes from an external device, the second display area of ​​the electronic device can be determined as the target display area, and the display content of the external device can be displayed through the second display area; when the target content comes from the electronic device itself, the third display area of ​​the electronic device can be determined as the target display area, and the target content can be displayed through the third display area, and the display content of the external device can be displayed through the second display area, so that the electronic device can display its own content in the third display area while displaying the display content of the external device through the second display area.

[0111] In the above embodiment, the target content is output in the target display area in a manner including at least one of the following.

[0112] First, the target content to be output is determined based on the operation data generated by the target interactive operation.

[0113] In some embodiments of the present disclosure, different interactive operations can call up different applications. Therefore, different target contents of the output can be determined based on the different applications (or display modes) called up by the interactive operations. For example, two fingers acting on the screen of an electronic device can control the electronic device to enter a split-screen display mode. According to the size of the touch area of ​​the two fingers, the split-screen area on the side of the screen with a larger touch area is set larger, and the split-screen area on the side of the screen with a smaller touch area is set smaller, that is, the amount of split-screen output content is adjusted according to the size of the touch area. For another example, both hands act on two touch display screens to make a cross action, and according to the gesture data of the cross operation, the two screens can be controlled to exchange display content.

[0114] Secondly, the target content to be output is determined based on the operation data generated by the target interactive operation and the posture and form of the electronic device.

[0115] In some embodiments of the present disclosure, the electronic device can determine the target display mode that the electronic device enters based on the operation data of the target interactive operation, and determine the output form of the original output content in combination with the posture of the electronic device, such as the horizontal screen posture, the vertical screen posture, the elevation posture, etc., that is, determine the target content to be output. For example, if the electronic device is in an elevation posture, its screen is not facing the user, and is presented to the user in a trapezoidal form with a narrow upper end and a wide lower end. After determining that the electronic device has entered the target display mode, in order to facilitate the user to read the screen content, the output image form can be adjusted based on the elevation posture of the electronic device, and it can be adjusted to a rectangular form to form the target content and displayed to the user. For another example, if the electronic device is in a vertical screen posture, when the electronic device is controlled to enter a split-screen display mode according to the operation data, the electronic device can be controlled to split the screen up and down according to the characteristics of its vertical screen, thereby determining the display content above and below the screen of the electronic device.

[0116] Third, the target content to be output is determined based on the operation data generated by the target interactive operation and the source information of the target interactive operation.

[0117] In some embodiments of the present disclosure, the electronic device can determine which user is the operation object according to the source of the target interactive operation, and then determine some habits or preferences of the user, and determine the content to be output in combination with the user habits or preferences. For example, if the user is accustomed to selecting the left split screen to display the desktop and the right split screen to display the application interface in the split-screen display mode, when the electronic device is controlled to enter the split-screen display mode according to the operation data, it can be determined that the left split screen displays the left content and the right split screen is used to display the current application interface.

[0118] It should be noted that determining the target content to be output in the target display area and controlling the target device to enter the target display mode are performed synchronously, that is, after the electronic device obtains the target interactive operation, while controlling the target device to enter the target display mode according to the operation data, the target content to be output is determined according to the operation data, so as to realize content synchronization while achieving mode switching.

[0119] On the basis of the above embodiments, in some embodiments of the present disclosure, the electronic device can also be controlled by touch operation or spatial gesture operation to achieve display control effects such as sliding, page turning or brightness control of the screen display content. For example, the electronic device is a mobile phone, and the up / down waving action is performed in front of the camera of the mobile phone or the up / down sliding operation is performed on the mobile phone screen with a finger to achieve the display effect of sliding the mobile phone screen up / down, or the left / right waving action is performed in front of the camera of the mobile phone or the left / right sliding of the finger on the mobile phone screen is performed to achieve the left / right page turning effect of the mobile phone, or, in the form of a combined gesture, after the volume or brightness adjustment function is turned on by the first gesture, the volume or brightness is adjusted by the second gesture such as sliding up or down. In addition, the display screen of the electronic device can be controlled to turn off or on by setting a specific gesture operation. For example, by tapping the touch area of ​​the laptop with the hand, when the number of taps reaches 3, the display screen of the laptop is turned off; when the laptop is in the off state, the display screen is turned on by touching the touch area with the palm of the hand. Through rich gesture operations, the display control operation of the electronic device is simplified.

[0120] Based on the above display control method, the present disclosure also provides an electronic device for implementing the display control method. Figure 7 The device is described in detail.

[0121] Figure 7 A block diagram of an electronic device suitable for implementing a display control method according to an embodiment of the present disclosure is schematically shown.

[0122] like Figure 7 As shown, the electronic device 700 according to the disclosed embodiment includes a first screen, a second screen and a processor 701. The first screen and the second screen are rotatably connected, and the processor is arranged on the body where the first screen or the second screen is located. The processor 701 can be used to control the electronic device to enter a target mode matching the target interaction operation in response to a target interaction operation acting on the first screen and / or the second screen; and determine a target display area based on the target mode to output target content in the target display area; wherein the target display area includes at least a portion of the display area in the first screen and / or the second screen.

[0123] Processor 701, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 702 or the program loaded from the storage part 708 to the random access memory (RAM) 703. The processor 701 may include, for example, a general-purpose microprocessor (such as a CPU), an instruction set processor and / or a related chipset and / or a special-purpose microprocessor (for example, an application-specific integrated circuit (ASIC)), etc. The processor 701 may also include an on-board memory for caching purposes. The processor 701 may include a single processing unit or multiple processing units for performing different actions of the method flow according to the embodiment of the present disclosure.

[0124] In RAM 703, various programs and data required for the operation of electronic device 700 are stored. Processor 701, ROM 702 and RAM 703 are connected to each other via bus 704. Processor 701 performs various operations of the method flow according to the embodiment of the present disclosure by executing the program in ROM 702 and / or RAM 703. It should be noted that the program can also be stored in one or more memories other than ROM 702 and RAM 703. Processor 701 can also perform various operations of the method flow according to the embodiment of the present disclosure by executing the program stored in the one or more memories.

[0125] According to an embodiment of the present disclosure, the electronic device 700 may further include an input / output (I / O) interface 705 for outputting display data to the first screen and the second screen. The input / output (I / O) interface 705 is also connected to the bus 704. The electronic device 700 may further include one or more of the following components connected to the input / output (I / O) interface 705: an input portion 706 including a keyboard, a mouse, etc.; an output portion 707 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage portion 708 including a hard disk, etc.; and a communication portion 709 including a network interface card such as a LAN card, a modem, etc. The communication portion 709 performs communication processing via a network such as the Internet. The drive 710 is also connected to the input / output (I / O) interface 705 as needed. A removable medium 711, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 710 as needed, so that the computer program read therefrom is installed into the storage portion 708 as needed.

[0126] The present disclosure also provides a computer-readable storage medium, which may be included in the device / apparatus / system described in the above embodiments; or may exist independently without being assembled into the device / apparatus / system. The above computer-readable storage medium carries one or more programs, and when the above one or more programs are executed, the method according to the embodiment of the present disclosure is implemented.

[0127] According to an embodiment of the present disclosure, the computer-readable storage medium may be a non-volatile computer-readable storage medium, for example, it may include but is not limited to: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, an apparatus or a device. For example, according to an embodiment of the present disclosure, the computer-readable storage medium may include the ROM 702 and / or RAM 703 described above and / or one or more memories other than ROM 702 and RAM 703.

[0128] The embodiment of the present disclosure also includes a computer program product, which includes a computer program, and the computer program contains program code for executing the method shown in the flowchart. When the computer program product is run in a computer system, the program code is used to enable the computer system to implement the display control method provided by the embodiment of the present disclosure.

[0129] The above functions defined in the system / device of the embodiment of the present disclosure are performed when the computer program is executed by the processor 701. According to the embodiment of the present disclosure, the system, device, module, unit, etc. described above can be implemented by a computer program module.

[0130] In one embodiment, the computer program may rely on tangible storage media such as optical storage devices, magnetic storage devices, etc. In another embodiment, the computer program may also be transmitted and distributed in the form of signals on a network medium, and downloaded and installed through the communication part 709, and / or installed from the removable medium 711. The program code contained in the computer program may be transmitted using any appropriate network medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0131] In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 709, and / or installed from the removable medium 711. When the computer program is executed by the processor 701, the above functions defined in the system of the embodiment of the present disclosure are performed. According to the embodiment of the present disclosure, the system, device, means, module, unit, etc. described above can be implemented by a computer program module.

[0132] According to an embodiment of the present disclosure, the program code for executing the computer program provided by the embodiment of the present disclosure can be written in any combination of one or more programming languages. Specifically, these computing programs can be implemented using high-level process and / or object-oriented programming languages, and / or assembly / machine languages. Programming languages ​​include, but are not limited to, Java, C++, python, "C" language or similar programming languages. The program code can be executed entirely on the user computing device, partially on the user device, partially on the remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device can be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computing device (for example, using an Internet service provider to connect through the Internet).

[0133] The flow charts and block diagrams in the accompanying drawings illustrate the possible architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flow chart or block diagram can represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flow chart, and the combination of the boxes in the block diagram or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0134] It will be appreciated by those skilled in the art that the features described in the various embodiments of the present disclosure may be combined and / or combined in a variety of ways, even if such combinations or combinations are not explicitly described in the present disclosure. In particular, without departing from the spirit and teachings of the present disclosure, the features described in the various embodiments of the present disclosure may be combined and / or combined in a variety of ways. All of these combinations and / or combinations fall within the scope of the present disclosure.

[0135] The embodiments of the present disclosure are described above. However, these embodiments are only for illustrative purposes and are not intended to limit the scope of the present disclosure. Although the embodiments are described above, this does not mean that the measures in the various embodiments cannot be used in combination to advantage. Without departing from the scope of the present disclosure, those skilled in the art may make a variety of substitutions and modifications, which should all fall within the scope of the present disclosure.

Claims

1. A display control method, comprising: In response to obtaining the target interaction operation, controlling the target device to enter a target mode matching the target interaction operation; Determine a target display area based on the target mode to output target content in the target display area; The target interaction operation includes an operation acting on a target interaction area of ​​the electronic device and / or an operation triggering a state change of a communication port of the electronic device, and the target device includes or does not include the electronic device.

2. The method according to claim 1, wherein: In response to obtaining the target interaction operation, controlling the target device to enter a target mode matching the target interaction operation includes at least one of the following: Obtaining operation data generated by the target interactive operation, and controlling the target device to enter a target display mode matching the operation data based on the operation data; obtaining type information of the target interactive operation, and controlling the target device to enter a target display mode matching the type information based on the type information; Obtaining source information of the target interactive operation, and controlling the target device to enter a target display mode matching the source information based on the source information; Determining an operated object of the target interactive operation, and controlling a target device to enter a target display mode matching attribute information of the operated object based on the operated object; Wherein, the target device includes the electronic device itself and / or an external device connected to the electronic device; The target content is generated from the electronic device or from an external device connected to the electronic device.

3. The method according to claim 2, wherein: Controlling the target device to enter a target display mode matching the operation data based on the operation data includes at least one of the following: Based on the touch operation data generated by the touch operation on the touch area of ​​the target device, the electronic device itself and / or an external device connected to the electronic device is controlled to enter a target display mode matching the touch operation data; Based on the gesture operation data acting on the spatial sensing area of ​​the electronic device, control the electronic device itself and / or an external device connected to the electronic device to enter a target display mode matching the gesture operation data; Based on the connection operation data for changing the connection state of the communication port of the electronic device, the electronic device itself and / or an external device connected to the electronic device is controlled to enter a target display mode matching the connection state.

4. The method according to claim 2 or 3, wherein: Controlling the target device to enter a target display mode matching the operation data based on the operation data includes at least one of the following: Based on the first touch operation data acting on the only touch area of ​​the electronic device, the electronic device is controlled to enter any one of a split-screen display mode, an extended display mode, a copy display mode or a display mode corresponding to the first touch operation data; Based on the second touch operation data acting on at least two touch areas of the electronic device, the electronic device is controlled to enter any one of an extended display mode, a copy display mode, a full-screen display mode or a display mode, and / or an external device connected to the electronic device is controlled to enter a host mode or a display mode; Based on the third touch operation data acting on the first application window of the electronic device, the electronic device itself is controlled to enter any one of the copy display mode, extended display mode, full-screen display mode, split-screen display mode, and display mode, and / or an external device connected to the electronic device is controlled to enter the host mode or display mode.

5. The method according to claim 4, wherein: Controlling the target device to enter a target display mode matching the operation data based on the operation data includes at least one of the following: Based on at least one of a touch position, a touch area, a touch pressure, and a touch track acting on a target touch area of ​​the electronic device, controlling the electronic device itself to enter any one of a copy display mode, an extended display mode, a full-screen display mode, a split-screen display mode, and a display mode, and / or controlling an external device connected to the electronic device to enter a host mode or a display mode; Based on at least one of an operation track, a touch area, a touch pressure or an operation position of a second application window acting on the electronic device, controlling the electronic device itself to enter any one of a copy display mode, an extended display mode, a full-screen display mode, a split-screen display mode, and a display mode, and / or controlling an external device connected to the electronic device to enter a host mode or a display mode; Based on the operation data and the attribute information of the operated object, the electronic device itself is controlled to enter any one of the copy display mode, extended display mode, full-screen display mode, split-screen display mode, and display mode, and / or an external device connected to the electronic device is controlled to enter the host mode or display mode.

6. The method according to claim 2 or 3, wherein: Controlling the target device to enter a target display mode matching the operation data based on the operation data includes at least one of the following: Based on the gesture operation data acting on the space sensing area of ​​the electronic device, the electronic device is controlled to enter any one of a copy display mode, an extended display mode, a full-screen display mode, a split-screen display mode, and a display mode, and / or an external device connected to the electronic device is controlled to enter a host mode or a display mode; Based on the connection status change data between the electronic device and the external device, the electronic device itself is controlled to enter any one of the display mode, copy display mode, extended display mode, full screen display mode or split screen display mode, and / or the external device is controlled to enter the display mode or host mode.

7. The method according to claim 1 or 2, wherein: Controlling the target device to enter a target mode matching the target interaction operation includes at least one of the following: Based on the obtained target posture data and the operation data generated by the target interactive operation acting on the electronic device, control the electronic device and / or an external device connected to the electronic device to enter a corresponding target display mode, wherein the target posture data includes posture morphology data of the electronic device and / or the external device; Based on the device operation information of the electronic device and the operation data acting on the electronic device, controlling the electronic device and / or an external device connected to the electronic device to enter a corresponding target display mode; Based on the operation data acting on the electronic device and the number and / or type of external devices connected to the electronic device, the electronic device and / or the external device are controlled to enter a corresponding target display mode.

8. The method according to claim 1, wherein: Determining a target display area based on the target mode to output target content in the target display area includes at least one of the following: In the case of controlling the electronic device to enter a full-screen display mode, adjusting display layout information of two display areas of the electronic device to respectively output a portion of the target content in the two display areas; In the case of controlling the electronic device to enter the copy display mode or the extended display mode, determining a first display area of ​​the electronic device as the target display area to output target content in the first display area, the first display area being an area pointed to by first operation data generated by the target interactive operation; In the case of controlling the electronic device to enter the split-screen display mode, determining a first split-screen area of ​​the electronic device as the target display area to output target content in the first split-screen area, the first split-screen area being the area pointed to by the second operation data generated by the target interactive operation; In case of controlling the second display area of ​​the electronic device to enter the display mode, the third display area or the second display area of ​​the electronic device is determined as the target display area to output the target content.

9. The method according to claim 1, further comprising at least one of the following: Determining target content to be output based on the operation data generated by the target interactive operation; Determining target content to be output based on the operation data generated by the target interactive operation and the posture of the electronic device; The target content to be output is determined based on the operation data generated by the target interaction operation and the source information of the target interaction operation.

10. An electronic device comprising: Rotate the connected first and second screens; A processor, disposed in the body where the first screen or the second screen is located; in, The processor can be used to: In response to a target interaction operation on the first screen and / or the second screen, controlling the electronic device to enter a target mode matching the target interaction operation; and Determine a target display area based on the target mode to output target content in the target display area; The target display area includes at least a partial display area of ​​the first screen and / or the second screen.

Images