Equipment control method and device and electronic equipment

Abstract

The invention provides an equipment control method and device and electronic equipment, and the method comprises the steps: obtaining the posture information of the electronic equipment, and the posture information at least comprises the posture information of at least two display screens, capable of relatively rotating, of the electronic equipment; and in response to a target trigger event, controlling display output of a first display screen in the at least two display screens based on the attitude information, and controlling display output of a second display screen in the at least two display screens based on the control information for the first display screen.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a device control method, apparatus and electronic device. Background Art

[0002] More and more multi-display electronic devices are launched on the market to meet the needs of users in certain work scenarios, such as dual-screen folding phones, triple-screen folding phones, double-sided screen laptops, etc. In multi-display electronic devices, by default, all displays are used as standard screens and are always on for a long time. Due to the different usage frequencies of different displays, the most frequently used display is the main display, and the remaining displays are sub-displays. Therefore, if the sub-display is in the standard screen state for a long time, it will consume a lot of power and cause a waste of resources. To address this problem, one solution is to set the sub-display to a low-power display state. The disadvantage is that this state can only be turned on manually by the user, and the state cannot be switched intelligently, which brings inconvenience to the user and reduces the user experience. In some scenarios, the low-power display state of the sub-display will still cause unnecessary power consumption. Summary of the invention

[0003] The present application provides a device control method, apparatus, and electronic device.

[0004] According to a first aspect of the present application, there is provided a device control method, comprising:

[0005] Obtaining posture information of an electronic device, wherein the posture information at least includes position information of at least two display screens of the electronic device that can rotate relative to each other;

[0006] In response to a target trigger event, controlling a display output of a first display screen among the at least two display screens based on the gesture information; and

[0007] The display output of a second display screen among the at least two display screens is controlled based on the control information for the first display screen.

[0008] In one possible implementation, in response to the target triggering event, controlling the display output of the first display screen among the at least two display screens based on the gesture information includes:

[0009] Determine a first display screen from the at least two display screens based on the posture information and / or the target trigger event;

[0010] The display output of the first display screen is controlled based on the target trigger event and the posture information to provide different operation response functions.

[0011] In one possible implementation, the target triggering event is generated by at least one of the following:

[0012] In response to the electronic device running the target application, generating the target trigger event;

[0013] In response to obtaining an interactive operation acting on a display screen of the electronic device, generating the target trigger event;

[0014] In response to obtaining interaction data acting on a sensing area of ​​the electronic device, generating the target trigger event;

[0015] In response to detecting a change in the communication connection between the electronic device and the target device, generating the target trigger event;

[0016] In response to the usage scenario of the electronic device being adjusted from a current first usage scenario to a target usage scenario, the usage scenario includes at least one of a usage environment, a usage object, a usage mode, and a usage configuration parameter of the electronic device.

[0017] In one possible implementation, determining the first display screen from the at least two display screens based on the posture information and / or the target trigger event includes at least one of the following:

[0018] When the electronic device is in a first posture, determining a display screen having a first posture parameter among the at least two display screens as the first display screen;

[0019] When the electronic device is in the second posture, determining a display screen facing away from the target user among the at least two display screens as the first display screen;

[0020] When the electronic device is in a third posture, determining a display screen in an idle state among the at least two display screens as the first display screen;

[0021] In response to the electronic device running the target application, determining a display screen different from the display screen where the first application window of the target application is located among the at least two display screens as the first display screen;

[0022] In response to obtaining an interactive operation acting on the electronic device, taking the display screen on which the interactive operation acts as the first display screen, or taking the target display screen directed by the interactive operation as the first display screen;

[0023] In response to obtaining interaction data acting on a sensing area of ​​the electronic device, determining a display screen pointed to by the interaction data as the first display screen;

[0024] In response to a change in the communication connection with the target device, determining a display screen having a first positional relationship with the target communication interface as the first display screen;

[0025] In response to the electronic device switching to the target usage scenario, a display screen matching the target usage scenario among the at least two display screens is determined as the first display screen. Determining the first display screen from the at least two display screens based on the posture information and / or the target trigger event includes at least one of the following:

[0026] When the electronic device is in a first posture, determining a display screen having a first posture parameter among the at least two display screens as the first display screen;

[0027] When the electronic device is in the second posture, determining a display screen facing away from the target user among the at least two display screens as the first display screen;

[0028] When the electronic device is in a third posture, determining a display screen in an idle state among the at least two display screens as the first display screen;

[0029] In response to the electronic device running the target application, determining a display screen different from the display screen where the first application window of the target application is located among the at least two display screens as the first display screen;

[0030] In response to obtaining an interactive operation acting on the electronic device, taking the display screen on which the interactive operation acts as the first display screen, or taking the target display screen directed by the interactive operation as the first display screen;

[0031] In response to obtaining interaction data acting on a sensing area of ​​the electronic device, determining a display screen pointed to by the interaction data as the first display screen;

[0032] In response to a change in the communication connection with the target device, determining a display screen having a first positional relationship with the target communication interface as the first display screen;

[0033] In response to the electronic device switching to a target usage scenario, a display screen among the at least two display screens that matches the target usage scenario is determined as the first display screen.

[0034] In one possible implementation, controlling the display output of the first display screen based on the target trigger event and the posture information includes:

[0035] The display output parameters and / or the display output content of the first display screen are controlled based on the source information of the target trigger event and the posture information.

[0036] In one possible implementation, controlling the display output parameters and / or the display output content of the first display screen based on the source information of the target trigger event and the posture information includes at least one of the following:

[0037] Controlling the first display screen to provide a target input control that matches the source information and the gesture information;

[0038] Controlling the first display screen to display a target application window or target content source data matching the source information and the posture information;

[0039] Controlling an input control provided by the first display screen to adjust from a current first display parameter to a target display parameter that matches the source information and the posture information, the target display parameter being different from the first display parameter;

[0040] Controlling the first display screen to adjust from providing a first set of input controls to providing a target set matching the source information and the gesture information, wherein the number and / or type of input controls in the target set are different from the first set;

[0041] The first display screen is controlled to switch from a current first display output parameter to a target display output parameter matching the source information and the posture information, wherein the target display output parameter is different from the first display output parameter.

[0042] In one possible implementation, controlling the display output of the first display screen based on the target trigger event and the posture information includes at least one of the following:

[0043] When the electronic device is in a first posture, in response to the electronic device starting to run a first application, controlling a first display screen that does not display an application window of the first application to enter a screen-off state and providing a touchpad function or a writing pad function in a target screen area of ​​the first display screen, where the target screen area is the entire area or a partial area of ​​the first display screen;

[0044] When the electronic device is in the first posture, in response to the electronic device moving an application window of a second application on the second display screen to the first display screen in the screen-off state, controlling the first display screen to display the application window of the second application;

[0045] When the electronic device is in a first posture, in response to obtaining a target operation trajectory acting on a first display screen in a display state, controlling the first display screen to enter a screen-off state, providing a touchpad function in a target screen area of ​​the first display screen, or moving an application window displayed on the first display screen to a second display screen;

[0046] When the electronic device is in a second posture, in response to a target object entering a first sensing area of ​​the electronic device, controlling the first display screen to display first content data or second content data from the second display screen, wherein the first content data is the same as current content of the first display screen, and the second content data is different from the first content data;

[0047] When the electronic device is in the second posture, in response to the target object leaving the first sensing area of ​​the electronic device, controlling the first display screen to enter a screen-off state;

[0048] When the electronic device is in the third posture, the first display screen is controlled to provide a touchpad function, a writing board function or display associated content of the content currently displayed on the second display screen in its target screen area based on the change parameters of the communication connection between the electronic device and the external device.

[0049] In one possible implementation, controlling the display output of the second display screen among the at least two display screens based on the control information for the first display screen includes at least one of the following:

[0050] generating an associated instruction for the control instruction of the first display screen, and controlling the display output of the second display screen based on the associated instruction;

[0051] A response result of the first display screen is obtained, and a display output of the second display screen is controlled based on the response result.

[0052] According to a second aspect of the present application, there is provided a device control apparatus, comprising:

[0053] An acquisition module, used to obtain posture information of an electronic device, wherein the posture information at least includes position information of at least two display screens of the electronic device that can rotate relative to each other;

[0054] A first control module, configured to control a display output of a first display screen among the at least two display screens based on the posture information in response to a target trigger event;

[0055] The second control module is used to control the display output of a second display screen among the at least two display screens based on the control information for the first display screen.

[0056] According to a third aspect of the present application, an electronic device is provided, comprising a first body and a second body, wherein a first display screen is disposed on a first surface of the first body, and a second display screen is disposed on a second surface of the second body, and the first body and the second body can rotate relative to each other so that the electronic device has different postures;

[0057] The electronic device further includes a processor and a memory arranged in the first body and / or the second body; wherein,

[0058] The memory stores instructions executable by the processor, and the instructions are executed by the processor to enable the at least one processor to perform the following operations:

[0059] Obtaining posture information of the electronic device, wherein the posture information at least includes position information of the first display screen and the second display screen;

[0060] In response to a target triggering event, controlling a display output of the first display screen based on the gesture information; and,

[0061] The display output of the second display screen is controlled based on the control information for the first display screen.

[0062] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present application, nor is it intended to limit the scope of the present application. Other features of the present application will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0063] By reading the detailed description below with reference to the accompanying drawings, the above and other purposes, features and advantages of the exemplary embodiments of the present application will become easily understood. In the accompanying drawings, several embodiments of the present application are shown in an exemplary and non-limiting manner, wherein:

[0064] In the drawings, the same or corresponding reference numerals represent the same or corresponding parts.

[0065] Figure 1 The following is a schematic diagram showing the implementation process of the device control method of the embodiment of the present application. Figure 1 ;

[0066] Figure 2 Schematic diagrams showing various working modes of electronic devices in embodiments of the present application;

[0067] Figure 3 The following is a schematic diagram showing the implementation process of the device control method of the embodiment of the present application. Figure 2 ;

[0068] Figure 4 A schematic diagram showing the composition structure of the device control device according to an embodiment of the present application is shown;

[0069] Figure 5 A schematic diagram of the structure of an electronic device according to an embodiment of the present application is shown. DETAILED DESCRIPTION

[0070] In order to make the purpose, features, and advantages of the present application more obvious and easy to understand, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present application.

[0071] like Figure 1 As shown, the embodiment of the present application provides a device control method, including:

[0072] Step 101: obtaining posture information of an electronic device, wherein the posture information at least includes posture information of at least two display screens of the electronic device that can rotate relative to each other;

[0073] Step 102: In response to a target triggering event, controlling a display output of a first display screen among the at least two display screens based on the gesture information; and

[0074] Step 103: Control the display output of a second display screen among the at least two display screens based on the control information for the first display screen.

[0075] In an embodiment of the present application, in step 101, the electronic device may be a dual-screen folding mobile phone, a triple-screen folding mobile phone, a double-sided screen laptop computer, a double-folding screen laptop computer, a triple-folding screen laptop computer, or other device with multiple display screens. The electronic device includes at least two bodies, and two adjacent bodies are rotatably connected, for example, by a hinge. Each body includes at least one display screen, so that at least two display screens of the electronic device can achieve relative rotation as the body in which they are located rotates.

[0076] The posture information of an electronic device can characterize the posture and form of the electronic device. The posture of an electronic device may include the placement tilt angle of the electronic device, which can be measured by a sensor (such as a G-Sensor) inside the electronic device. For example, when the electronic device is placed on a horizontal desktop, the tilt angle is 0°. When the electronic device is placed on an inclined bracket, the tilt angle is the angle between the bracket bearing surface and the horizontal plane, such as 30°. The form of an electronic device may include the working form of the electronic device. For example, a dual-screen laptop computer has at least three forms: notebook form, book form, and tent form. The working form of an electronic device is determined by the relative position relationship between display screens. For example, Figure 2The schematic diagram of the structure of a dual-screen laptop computer in different working modes is shown. In the notebook mode, the first display screen 10 and the second display screen 20 are in an up-down position relationship; in the book mode, the first display screen 10 and the second display screen 20 are in a left-right position relationship; in the tent mode, the first display screen 10 and the second display screen 20 are in a front-to-back position relationship, and the first display screen 10 and the second display screen 20 are facing opposite directions.

[0077] The relative position relationship between the display screens is determined by the position information of at least two display screens, and the position information may include the position information and posture information of at least two display screens, wherein the position information may specifically include the position relationship between the display screen and the desktop or the bearing surface structure, and the posture information may specifically include the angle between the display screens, the placement direction, etc. For example, when the angle between the first display screen and the second display screen is in the first angle range, such as 0°-130°, and the first display screen and the second display screen are both placed in landscape mode, and one of the display screens is parallel to the desktop or the bearing structure, it is an up-down position relationship; when the angle between the first display screen and the second display screen is in the second angle range, such as 90°-180°, and the first display screen and the second display screen are both placed in portrait mode, and the first display screen and the second display screen are not parallel to the desktop or the bearing structure, it is a left-right position relationship; when the angle between the first display screen and the second display screen is in the third angle range, such as 270°-330°, that is, the first display screen and the second display screen face opposite directions, and the first display screen and the second display screen are both placed in landscape mode, and the first display screen and the second display screen are not parallel to the desktop or the bearing structure, it is a front-back position relationship.

[0078] In step 102, in response to a target trigger event, the display output of the first display screen of at least two display screens is controlled based on the gesture information in step 101. The target trigger event may include an interactive operation performed by a user on the display screen, such as a user's gesture trajectory, a character string input, etc.; it may also include specific data automatically detected by the electronic device, such as detected object data, voice data, spatial gesture data, etc.; it may also include a change in the connection relationship between the electronic device and other devices, such as connecting or disconnecting with an external device, or receiving media content from an external device, or sharing hardware resources with an external device, etc.

[0079] The target trigger event can trigger the control of the first display screen. The first display screen can be any display screen in the electronic device, or a display screen with a lower frequency of use in the electronic device. The display output of the first display screen can be divided into different display output contents and / or different display output states according to energy consumption and function. The display output state includes a screen-off state or a screen-on state. In different display output states, the first display screen can support different functional services, such as ① the screen is off (power off or not), and no functional services are supported; ② the screen is off (power off), and the touch function is supported, as a touchpad; ③ the screen is not off, and it is used as a copy screen or an extended screen; ④ the screen is not off, and it is used as a virtual keyboard + touchpad.

[0080] In step 103, the display output of the second display screen among the at least two display screens is controlled based on the control information for the first display screen in step 102. The control information for the first display screen may include a control result for the first display screen, that is, a response result of the first display screen; it may also include a control instruction for the first display screen, such as an instruction to control the first display screen to switch to a touch panel, etc. The display output of the second display screen may include a display mode, display content, and layout mode of the second display screen, etc.

[0081] The scheme of steps 101-103 is explained below by taking a double-sided screen laptop as an example. The double-sided screen laptop includes a first body and a second body, the first body and the second body are rotatably connected, the first body includes a C surface and a D surface, wherein the C surface is provided with a display screen, and the second body includes an A surface and a B surface, wherein the B surface is provided with a display screen.

[0082] In Example 1, the posture information of the electronic device is obtained, wherein the posture information of the two display screens of the electronic device may be that the angle between the B-side screen and the C-side screen is 120°, the B-side screen and the C-side screen are both placed horizontally, and the electronic device is placed on a horizontal desktop, wherein the first body is a supporting body in contact with the horizontal desktop, that is, the C-side screen is located below the B-side screen, and the working form of the electronic device is a notebook form. In the notebook form, the first display screen may be a C-side screen parallel to the bearing surface, and the second display screen is a B-side screen.

[0083] In scenario 1.1), the target trigger event is a user sliding the palm on the first display screen, indicating that the user does not need the display function of the first display screen at this time. In response to the target trigger event, based on the notebook form corresponding to the gesture information, the first display screen is controlled to remain powered on without screen backlight, and the first display screen supports touch function and can be used as a touchpad to receive the user's touch command to control the display object of the second display screen.

[0084] If the first display screen and the second display screen are originally displayed in the extended mode or the duplicate mode, based on the control information of the first display screen switching to the touchpad, the second display screen is controlled to switch to the single display mode. In the extended mode, the first display screen displays at least one first window, and the second display screen displays at least one second window. Based on the control information of the first display screen switching to the touchpad, it is also possible to set the first window to be closed, the first window to be displayed in full screen on the second display screen, the first window to be minimized on the second display screen, or the first window and the second window to be displayed in split screen on the second display screen according to actual needs.

[0085] In scenario 1.2), the target trigger event is that the user uses eight fingers to click on the first display screen at the same time, indicating the user's editing or typing needs. In response to the target trigger event, based on the notebook form corresponding to the gesture information, the first display screen is controlled to display a virtual touchpad and a virtual keyboard at low brightness, so as to receive the user's touch command and / or key command to control the display object of the second display screen.

[0086] If the first display screen and the second display screen are originally displayed in the extended mode or the copied mode, the second display screen is controlled to switch to the single display mode based on the control information of the virtual touchpad and the virtual keyboard displayed on the first display screen. In the extended mode, the first display screen displays at least one first window, and the second display screen displays at least one second window. Based on the control information of the virtual touchpad and the virtual keyboard displayed on the first display screen, the first window can be closed, the first window can be displayed in full screen on the second display screen, the first window can be minimized on the second display screen, or the first window and the second window can be displayed in split screen on the second display screen according to actual needs.

[0087] In scenario 1.3), the target trigger event is that the user quickly slides and releases on the second display (throwing gesture), or the user moves the window to any boundary in the second display, or the user turns on the waterfall screen function, indicating that the user needs to expand the display. In response to the target trigger event, based on the notebook form corresponding to the posture information, the first display is controlled as an extended screen to display the thrown object, or the moved window, or the lower half of the window displayed on the second display is displayed in waterfall screen mode. Based on the control information of the first display as an extended screen, the second display is controlled to be in extended mode and as the main display. Among them, when using the throwing function, only the window displayed on the second display can be displayed on the first display, or all windows opened on the second display can be displayed on the first display.

[0088] In scenario 1.4), the target trigger event is that the electronic device automatically detects that the second display screen is in the state of audio and video playback, and the user is more than a first threshold value away from the electronic device, such as 1 meter, indicating that the user is in a state of watching a movie without operating the electronic device. In response to the target trigger event, based on the notebook form corresponding to the posture information, the first display screen is controlled to be off and no functional services are supported. Based on the control information of the first display screen stopping working, the second display screen is controlled to switch to single display mode.

[0089] In scenario 1.5), the target trigger event is the electronic device being disconnected from the external mouse, indicating that the user has lost control of the mouse. In response to the target trigger event, based on the notebook form corresponding to the posture information, the first display screen is controlled to remain powered on while the screen is off, the first display screen has no screen backlight, supports touch function, and can be used as a touchpad to receive the user's touch command to control the display object of the second display screen. Based on the response result of the first display screen as a touchpad to the user's touch command, the display output of the second display screen is controlled, for example, a cursor corresponding to the user's touch position on the first display screen is displayed on the second display screen.

[0090] In Example 2, the posture information of the electronic device is obtained. The posture information of the two display screens of the electronic device can be that the angle between the B-side screen and the C-side screen is 180°, the B-side screen and the C-side screen are both placed vertically, and the electronic device is placed on an inclined bracket, that is, the B-side screen and the C-side screen are in a left-right position relationship, and the working form of the electronic device is a book form. In the book form, the first display screen can be any display screen, for example, the right display screen with fewer display tasks, and the second display screen can be another left display screen with more display tasks.

[0091] In scenario 2.1), the target trigger event is that the electronic device automatically detects that a window has been opened on the second display screen, and the first display screen has no display task, indicating that the user only needs the display function of the second display screen. In response to the target trigger event, based on the book form corresponding to the posture information, the first display screen is controlled to be off, and no functional services are supported. Based on the control information of the first display screen stopping working, the display parameters of the second display screen are controlled. For example, after the fill light function of the right display screen is lost, the display brightness of the second display screen is appropriately increased to optimize the user viewing experience.

[0092] In scenario 2.2), the target trigger event is that the electronic device automatically detects that a window has been opened on the second display screen, there is no display task on the first display screen, and the electronic device is not connected to a mouse device, indicating that the user may need the mouse function. In response to the target trigger event, based on the book form corresponding to the posture information, the first display screen is controlled to remain powered on when the screen is off, the first display screen has no screen backlight, supports touch function, and can be used as a touchpad to receive user touch commands to control the display object of the second display screen. If the first display screen and the second display screen are originally displayed in expansion mode or copy mode, based on the control information of the first display screen switching to the touchpad, the display mode of the second display screen is controlled to be single display mode.

[0093] In Example 3, the posture information of the electronic device is obtained. The posture information of the two display screens of the electronic device can be that the angle between the B-side screen and the C-side screen is 330°, the B-side screen and the C-side screen are both placed horizontally, and the electronic device is placed on a horizontal desktop, that is, the B-side screen and the C-side screen are in a front-to-back position relationship, the B-side screen and the C-side screen face opposite directions, and the working form of the electronic device is a tent form. In the tent form, the first display screen can be any display screen, for example, the B-side screen of the display screen facing away from the user, and the second display screen can be another C-side screen facing the user.

[0094] In scenario 3.1), the target trigger event is that the electronic device automatically detects that there are no other users in front of the first display screen using a TOF sensor (distance measurement sensor), indicating that the first display screen does not need to display content. In response to the target trigger event, based on the tent shape corresponding to the posture information, the first display screen is controlled to be off and no functional services are supported. Based on the control information of the first display stopping working, the second display screen is controlled to be in single display mode.

[0095] In scenario 3.2), the target trigger event is that the electronic device automatically detects the presence of other users in front of the first display screen using a TOF Sensor (distance measuring sensor), indicating that the first display screen needs to display content. In response to the target trigger event, based on the tent form corresponding to the posture information, the first display screen is controlled to display the screen of the second display screen in copy mode, and the screen is rotated 180°. Based on the control information that the first display screen is set to copy mode, the second display screen is controlled to be in extended mode and serve as the main display.

[0096] The embodiment of the present application obtains the posture information of the electronic device, and the posture information at least includes the posture information of at least two display screens of the electronic device that can rotate relative to each other; in response to the target trigger event, the display output of the first display screen among the at least two display screens is controlled based on the posture information; and the display output of the second display screen among the at least two display screens is controlled based on the control information for the first display screen. Thus, on the one hand, the present application controls the display output of the display screen according to the posture information of the electronic device and the target trigger event, enriches the working mode of the display screen, and can meet the user's use needs in different working scenarios. For example, the display screen can provide a touchpad function in the off-screen state to meet the user's low power consumption and touch requirements; the display screen can be used as a touch screen to provide a human-computer interaction interface for the user; the display screen can also be used only as a display to provide a display function, etc. On the other hand, the device control method of the present application provides a richer and more intelligent control logic for an electronic device with at least two display screens that can rotate relative to each other, and can intelligently set the working mode of the display screen in different working scenarios, avoiding frequent manual operations of the user, greatly improving the user experience, and at the same time avoiding the waste of additional resources caused by the mismatch between the working mode of the display screen and the user's working scenario.

[0097] In one example of the present disclosure, Figure 3 As shown, step 102 controls the display output of the first display screen among the at least two display screens based on the posture information in response to the target trigger event, including:

[0098] Step 201: determining a first display screen from the at least two display screens based on the posture information and / or the target triggering event;

[0099] Step 202: Control the display output of the first display screen based on the target trigger event and the posture information to provide different operation response functions.

[0100] In one embodiment, the first display screen can be determined from the at least two display screens based on the posture information. For example, the first display screen to be controlled is determined based on the working form of the electronic device. In the notebook form, the display screen that is convenient for user input or operation can be determined as the first display screen. The laptop computer usually places the first body where the C and D surfaces are located on the bearing surface, so the first display screen can be determined to be the C surface; then, based on the target trigger event, such as the electronic device automatically detecting that there is no display window on the first display screen, and the number of windows opened on the second display screen is less than the first preset threshold, for example, the first preset threshold can be 2, and the notebook form characterized by the posture information, the first display screen can be controlled to remain powered on when the screen is off, the first display screen has no screen backlight, and supports touch function, so as to provide touch response function as a touchpad.

[0101] In the tent form, the display screen facing away from the main user can be determined as the first display screen; then based on a target trigger event, such as the electronic device automatically detecting the presence of a second user in front of the first display screen, and the tent form represented by posture information, the first display screen can be controlled to be in copy mode and used as a copy display screen without supporting touch function, so as to provide a simple display function to the second user.

[0102] In the tent form, the display screen facing away from the main user can also be determined as the first display screen; then based on the target trigger event, such as the user's specific voice command, and the tent form represented by the posture information, the first display screen can be controlled to the extended mode and used as an extended touch screen to provide interactive response functions to the second user as a touch interaction interface.

[0103] In the book form, a display screen that is closer to the user or at a preset angle to the user can be determined as the first display screen; then based on target trigger events, such as the electronic device automatically detecting that a mouse device is not connected and the first display screen has no display window, and the tent form represented by posture information, the first display screen can be controlled to remain powered on while being off, the first display screen has no screen backlight, and supports touch function, so as to provide touch response function as a touchpad.

[0104] In another embodiment, the first display screen can be determined from the at least two display screens based on the target trigger event. When the target trigger event is an interactive operation performed by a user on a display screen, the display screen operated by the user can be determined as the first display screen; then, based on the target trigger event, such as an interactive operation performed by a user using eight fingers to click on the first display screen at the same time, and the notebook form represented by the posture information, the first display screen can be controlled to remain powered on when the screen is off, the first display screen has no screen backlight, and supports touch function, so as to provide a touch response function as a touchpad.

[0105] When the target trigger event is specific data automatically monitored by the electronic device, the display screen on the main body equipped with a monitoring sensor or a plug-in interface can be determined as the first display screen; then based on the target trigger event, such as the electronic device detecting the presence of a second user in front of the first display screen and the tent form represented by the posture information through the ranging sensor provided on the main body where the first display screen is located, the first display screen can be controlled to be in copy mode and used as a copy display screen, without supporting the touch function, so as to provide the second user with a simple display function.

[0106] When the target trigger event is an operation by the user on the target application window, the display screen where the target application window is not located can be determined as the first display screen; then based on the target trigger event, such as the interactive operation of the user dragging the target application window to the boundary on the second display screen, and the book form represented by the posture information, the first display screen can be controlled to be in expansion mode and used as an extended touch screen to display the target application window and provide interactive response functions as a touch interaction interface.

[0107] In another embodiment, the first display screen can be determined from the at least two display screens based on the posture information and the target trigger event. For example, in the tent form, the C-side screen faces the main user, and the B-side screen faces away from the main user. When the target trigger event is that the electronic device automatically detects the presence of a second user in front of the display screen, the B-side screen facing away from the main user on the second body can be determined as the first display screen based on the tent mode and the second body provided with a distance measuring sensor; then, based on the target trigger event and the posture information, the first display screen is controlled to be in copy mode and as a copy display screen, and does not support touch function, so as to provide a simple display function to the second user.

[0108] In tent mode, when the target trigger event is an interactive operation of the main user on the C-screen, for example, after the main user has fully reported his work to the second user, the second user needs to edit the report results. The main user double-clicks on the C-screen with four fingers at the same time. At this time, based on the tent mode and the target trigger event, the C-screen facing the main user can be determined as the first display screen; then, based on the target trigger event and posture information, the first display screen is controlled to be a copy display screen, providing the main user with a display function to display the editing content of the second user; based on the control information of the first display screen as a copy screen, the second display screen is controlled to be in copy mode and as the main touch screen, and can be used as a touch interaction interface to provide an interactive response function to the second user, such as receiving and displaying the editing input of the second user.

[0109] In an example of the present disclosure, the target trigger event is generated by at least one of the following:

[0110] 1) generating the target trigger event in response to the electronic device running the target application;

[0111] The target application may include an application or application process that needs to call an input control, such as an application that needs to enter a login account and password or face login, an application that needs to perform string input, such as office software, code editing software, an application that needs to perform anti-peeping operations or HID (Human Interface Device) detection, and an application that needs to perform interactive input operations, such as games, fitness applications, etc. The target trigger event may be a call to an input control. For example, when an electronic device is monitored to run any one or more of the above applications, it can be sorted in chronological order or priority, so as to call an input control that matches the application requirements, such as calling a virtual keyboard, or turning on a camera or radar, or calling them up at the same time, etc. The target application may also include drawing applications and game applications. For example, the posture information of the electronic device is obtained to characterize the notebook form, the first display screen is the C-side screen, and the second display screen is the B-side screen; when a drawing application or a game application is run on the second display screen, a target trigger event for calling a drawing board or a touchpad is generated; in response to the target trigger event, the first display screen is controlled to switch to a drawing board or a touchpad based on the posture information.

[0112] 2) generating the target trigger event in response to obtaining an interactive operation acting on a display screen of the electronic device;

[0113] Interaction operations on the display screen of the electronic device may include gesture trajectories, string input, window throwing, palm sliding, multi-finger trajectories, and the like.

[0114] 3) generating the target trigger event in response to obtaining the interaction data acting on the sensing area of ​​the electronic device;

[0115] The interactive data of the sensing area of ​​the electronic device may include object data, voice data, spatial gesture data, etc. automatically detected by the device. The sensing area may include the sensing area of ​​a TOF (Time of flight) ranging sensor, a camera detection area, a microphone detection area, etc.

[0116] 4) generating the target trigger event in response to detecting a change in the communication connection between the electronic device and the target device;

[0117] The target device can be another electronic device connected via a cable, or an electronic device communicating via a wireless connection. Changes in the communication connection can be establishing or disconnecting a communication connection, receiving media content from an external device, or sharing hardware resources with an external device, etc.

[0118] 5) In response to a usage scenario of the electronic device being adjusted from a current first usage scenario to a target usage scenario, the usage scenario includes at least one of a usage environment, a usage object, a usage mode, and a usage configuration parameter of the electronic device.

[0119] The usage environment may include office environment, meeting environment, home environment, entertainment scene, learning environment, etc.

[0120] The number of user objects can be unique or non-unique. In the case of uniqueness, privacy and security can be ignored when controlling the display output of the display screen; in the case of non-uniqueness, security issues need to be considered when controlling the display output of the display screen. For example, when controlling the first display screen to display a virtual keyboard, the corresponding virtual keyboard can be smaller than the regular size, and the key positions can be rearranged to meet the anti-peeping requirements. When controlling the display output of the display screen, such as switching the dual screen to copy mode or expansion mode, the habits or preferences of the user objects can be further combined.

[0121] The usage modes may include single-screen mode, dual-screen mode, horizontal screen mode, vertical screen mode, etc. When controlling the display output of the display screen, the corresponding usage mode may be switched based on historical usage data, such as the error rate of the user in different modes.

[0122] The usage configuration parameters may include whether to disable the touchpad, whether to enable the touchpad, the area size of the touchpad, etc. The usage status and / or display layout of other input controls in the target usage scenario may be determined based on the usage configuration parameters.

[0123] When the usage scenario of the electronic device is adjusted from the current first usage scenario to the target usage scenario, the target triggering event may be to determine the usage mode and usage configuration parameters of the target usage scenario according to the usage environment and the usage object.

[0124] In an example of the present disclosure, step 201 determines the first display screen from the at least two display screens based on the posture information and / or the target trigger event, including at least one of the following:

[0125] 1) when the electronic device is in a first posture, determining a display screen having a first posture parameter among the at least two display screens as the first display screen;

[0126] Taking a double-sided screen laptop as an example, the first posture may be a notebook form, and the display screen with the first posture parameter may be a display screen parallel to the bearing surface, such as a display screen parallel to the desktop, or a display screen parallel to the support surface of the stand. The first posture parameter may include the position and posture parameters of the display screen.

[0127] 2) when the electronic device is in the second posture, determining the display screen facing away from the target user among the at least two display screens as the first display screen;

[0128] Taking a double-sided screen laptop as an example, the second posture can be a tent shape, and the target user can be the current user of the electronic device. When there is only one user, the display screen used by the target user can be determined by detecting the resource occupancy of the display screen, and then the display screen not used by the target user can be determined to be the display screen facing away from the target user, and it can be determined as the first display screen. When there are multiple users, the display screen facing away from the target user among at least two display screens can be determined by face recognition, and it can be determined as the first display screen.

[0129] 3) when the electronic device is in a third posture, determining a display screen in an idle state among the at least two display screens as the first display screen;

[0130] Taking a double-sided screen laptop as an example, the third posture may be a book form, and a display screen in an idle state, that is, a display screen that currently does not display any application window or content, is determined as the first display screen.

[0131] 4) in response to the electronic device running the target application, determining a display screen different from the display screen where the first application window of the target application is located among the at least two display screens as the first display screen;

[0132] The target application can be a single-screen single-window application or a multi-screen multi-window application. The first application window can be the main window of the target application, such as a window that displays the main application interface content. The display screen different from the display screen where the first application window is located among the at least two display screens is determined as the first display screen. When responding to the target trigger event and controlling the display output of the first display screen based on the posture information, the auxiliary window of the target application, such as the drawing window of the raw image application, the props or auxiliary function option window of the game, etc., can be displayed on the determined first display screen.

[0133] 5) in response to obtaining an interactive operation acting on the electronic device, using the display screen on which the interactive operation acts as the first display screen, or using the target display screen directed by the interactive operation as the first display screen;

[0134] The display screen on which the interactive operation is performed can be the display screen where the operation track is located, such as a palm sliding operation on the C-side screen in the notebook form, and the C-side screen is used as the first display screen. The target display screen pointed to by the interactive operation, for example, in the notebook form, a downward throwing gesture operation is performed on the B-side screen, and the operation points to the C-side screen below, and the C-side screen is used as the first display screen.

[0135] 6) in response to obtaining interaction data acting on a sensing area of ​​the electronic device, determining a display screen pointed to by the interaction data as the first display screen;

[0136] The display screen pointed to by the interactive data may include a display screen pointed to by gestures, voices or other interactive data. For example, in the notebook form, in response to obtaining downward gesture data acting on the detection area of ​​the camera, the C-side screen located below is determined as the first display screen. For example, in the book mode, in response to obtaining voice data acting on the detection area of ​​the microphone, such as "turn off the left screen", the left screen targeted by the voice data is determined as the first display screen.

[0137] 7) in response to a change in the communication connection with the target device, determining a display screen having a first positional relationship with the target communication interface as the first display screen;

[0138] The display screen having a first positional relationship with the target communication interface may be the display screen where the target communication interface is located or the display screen where it is not located. The target communication interface may be an actual physical IO (input and output) port, such as a USB (universal serial bus) interface, HDMI (high-definition multimedia interface), DP (display port), Thunderbolt or TYPE-C, etc., or a communication interface of a wireless communication mode. In this case, the main consideration is the positional relationship between the display screen and the set wireless communication module.

[0139] 8) In response to the electronic device switching to a target usage scenario, determining a display screen among the at least two display screens that matches the target usage scenario as the first display screen.

[0140] Switching the electronic device to the target usage scenario may include changes in the user, the usage environment, the usage mode, the usage configuration parameters, etc. The display screen that the user is used to or prefers after the change may be determined as the first display screen; or the display screen that matches the usage environment after the change may be determined as the first display screen, etc.

[0141] According to actual needs, the above solutions can be reasonably selected or combined.

[0142] For example, when the electronic device is in the first posture, representing the notebook form, the C-side screen has the first posture parameter, and the electronic device starts to run the target application, such as a video playback application, and the display screen where the first application window of the target application is located is the C-side screen. According to the posture information, the C-side screen should be determined as the first display screen, and according to the target trigger event, the B-side screen should be determined as the first display screen. When the above schemes overlap and the results are different, the actual needs should be considered. As we all know, the video playback application is mainly used to display information, and in the first posture, the C-side screen with the first posture parameter is parallel to the bearing surface, closer to the user, and convenient for the user to operate and control, while the B-side screen is more suitable for displaying functions. Therefore, according to the functional requirements of the target application, combined with the correspondence between the posture parameters and the functional requirements, the display screen with the posture parameters corresponding to the functional requirements of the target application is determined as the first display screen, that is, the B-side screen is determined as the first display screen.

[0143] For another example, when the electronic device is in the second posture, representing a tent shape, the C-side screen faces the main user, and the B-side screen faces away from the main user. According to the posture information, the B-side screen that should face away from the main user is determined as the first display screen; in response to changes in the communication connection with the target device, for example, the electronic device receives media content from an external device through a specific interface, and the interface of a laptop is generally set on the first body where the C-side screen is located. The first display screen may be the C-side screen where the interface is located, or it may be the B-side screen where the interface is not located. At this time, considering that the main user should actively establish a communication connection between the electronic device and the external device, and the main user has a need to view the received media content, the C-side screen facing the main user is determined as the first display screen.

[0144] In an example of the present disclosure, step 202 controls the display output of the first display screen based on the target trigger event and the posture confidence, including:

[0145] The display output parameters and / or the display output content of the first display screen are controlled based on the source information of the target trigger event and the posture information.

[0146] The source information of the target trigger event refers to the operation information, sensing information or detection information that generates the target trigger event, such as detection of the electronic device running the target application, the user's gesture trajectory on the display screen, string input and other interactive operations, the interaction data monitored by the sensing area of ​​the electronic device, detection of changes in the communication connection between the electronic device and the target device, detection of changes in the usage scenario of the electronic device, etc.

[0147] Display output parameters refer to parameters that affect the display effect of the display screen, and may include display output brightness, display output status, display output mode, display refresh rate, etc. Display output content may include displayed application windows, virtual function components such as a virtual keyboard, a virtual touchpad, etc.

[0148] Taking a double-sided screen laptop as an example, the posture information characterizes that the device is in notebook form, and the target trigger event is that the user sends a waterfall screen gesture command to the sensing area of ​​the electronic device. Based on the posture information and the target trigger event, the C-side screen is determined to be the first display screen. Based on the source information of the target trigger event (waterfall screen gesture command) and the shown posture information (characterizing the notebook form), the display output parameters of the first display screen are controlled to be completely consistent with those of the second display screen, the display output content of the first display screen is controlled to be continuous with the display output content of the second display screen, and the first display screen and the second display screen jointly display a window.

[0149] In an example of the present disclosure, controlling the display output parameters and / or display output content of the first display screen based on the source information of the target trigger event and the posture information includes at least one of the following:

[0150] 1) controlling the first display screen to provide a target input control that matches the source information and the gesture information;

[0151] For example, in the notebook form of a double-sided screen laptop computer, the source information of the target trigger event is that the electronic device is connected to a capacitive pen via Bluetooth, and the capacitive pen can be used for drawing or taking notes. In this case, the C-side screen is determined to be the first display screen based on the target trigger event and posture information, and the first display screen is controlled to provide a touchpad or writing board function.

[0152] For example, in the tent form of a double-sided screen laptop computer, the source information of the target trigger event is that the main user performs an interactive operation on the C-side screen facing the main user. According to the target trigger event and posture information, the B-side screen pointed to by the interactive operation is determined to be the first display screen, and the information collection device of the first display screen is controlled to start, for example, the camera of the B-side screen is controlled to collect images.

[0153] 2) controlling the first display screen to display a target application window or target content source data matching the source information and the posture information;

[0154] For example, in the book form of a double-sided screen notebook, the source information of the target trigger event is that the electronic device receives media information from an external device, such as a picture, document or video. Based on the posture information, it is determined that the idle display screen among at least two display screens is the first display screen, and the first display screen is controlled to display the media information from the external device.

[0155] For example, in the tent form of a double-sided screen notebook, the source information of the target trigger event is that the target user moves the target application window to any boundary on the display screen facing the target user. Based on the target trigger event and posture information, the display screen facing away from the target user is determined to be the first display screen, and the first display screen is controlled to switch to extended mode, and the target application window from the second display screen is displayed.

[0156] 3) controlling the input control provided by the first display screen to adjust from the current first display parameter to a target display parameter matching the source information and the posture information, the target display parameter being different from the first display parameter;

[0157] The input controls provided by the first display screen may include a virtual keyboard, a virtual touchpad, and may also include parameter configuration interfaces of information collection devices such as microphones, cameras, sensors, and input controls in application windows, etc. The display parameters of the input controls may include display layout (display position, position relationship), display size, display color, display skin, display style, font, type of edge curve, etc. For example, when the electronic device is in book mode, the source information of the target trigger event is that the user object in the usage scenario has changed. Based on the source information and posture information of the target trigger event, the display style and font of the first display screen may be adjusted to match the source information and posture information according to the habits and preferences of the user object after the change.

[0158] 4) controlling the first display screen to adjust from providing a first set of input controls to providing a target set matching the source information and the gesture information, wherein the number and / or type of input controls in the target set are different from the first set;

[0159] The set of input controls provided may include a touch display area and / or a sensor detection area, that is, at least one of a virtual touchpad area, a virtual keyboard area, a pressure sensing area, a camera acquisition area, a radar detection area, a TOF ranging detection area, or a microphone pickup area. The first display screen is controlled to adjust from the first set of input controls provided to the target set provided to match the source information and the posture information. Interactive controls of different types and / or different data can be called according to different scenarios. For example, the virtual keyboard can be further divided into a number area, a letter area, a symbol area, a function key area, etc., and part or all of the area can be displayed based on different scenarios; for example, only one touchpad can be displayed, or an application window + touchpad, or a touchpad + virtual keyboard light can be displayed. The display size of the touchpad can also be set according to different scenarios. It can cover the entire first display screen, or occupy the position of the default or specified area, etc.

[0160] 5) Controlling the first display screen to switch from a current first display output parameter to a target display output parameter that matches the source information and the posture information, wherein the target display output parameter is different from the first display output parameter.

[0161] The display output parameters may include display brightness, refresh rate, resolution, window display skin, window style or theme color, etc. For example, in the notebook form of the electronic device, the first display screen is the C-side screen, which is in the display state, with normal display brightness, normal refresh rate, and bright theme color. The source information of the target trigger event may be an 8-finger single-click interaction operation performed by the user on the first display screen. Based on the source information and gesture information of the target trigger event, the first display screen is controlled to display a virtual keyboard and a virtual touchpad, the display brightness is lowered, the refresh rate is reduced, and the theme color is dimmed.

[0162] In an example of the present disclosure, step 202, controlling the display output of the first display based on the target trigger event and the gesture information, includes at least one of the following:

[0163] 1) When the electronic device is in a first posture, in response to the electronic device starting to run a first application, controlling a first display screen that does not display an application window of the first application to enter a screen-off state and providing a touchpad function or a writing pad function in a target screen area of ​​the first display screen, wherein the target screen area is the entire area or a partial area of ​​the first display screen;

[0164] Taking a double-sided screen laptop as an example, the first posture can represent the notebook form, and the first application can be any application or any application that requires a touchpad or writing board, such as a raw image application, or a game application, etc. According to the display state, the display screen that does not display the application window of the first application is determined as the first display screen, and in response to the electronic device starting to run the first application, the first display screen is controlled to enter the screen-off state, and a touchpad function or a writing board function is provided in the target screen area of ​​the first display screen. The target screen area can be the entire area of ​​the first display screen, that is, the entire first display screen is used as a touchpad or writing board; the target screen area can also be a partial area of ​​the first display screen, such as the center area, the upper left corner area, the center lower area, etc.

[0165] In response to the electronic device starting to run the first application, the first display screen can also be controlled to enter a low display energy consumption state, and a touchpad function or a writing board function can be provided in the target screen area of ​​the first display screen, that is, the first display screen displays a virtual touchpad or a virtual writing board at low brightness. When the user draws or writes on the first display screen, the user's writing track can also be displayed, such as increasing the display output brightness at the writing track, or setting a visible color for the writing track.

[0166] 2) when the electronic device is in the first posture, in response to the electronic device moving the application window of the second application on the second display screen to the first display screen in the screen-off state, controlling the first display screen to display the application window of the second application;

[0167] Taking a double-sided screen laptop as an example, the first posture can represent the notebook form. According to the display state, the display screen in the screen-off state is determined as the first display screen. In response, the electronic device moves the application window of the second application on the second display screen to the first display screen in the screen-off state, such as performing a throwing operation on the application window in the second display screen, controlling the first display screen to light up, displaying the application window of the second application, and adjusting the display output parameters of the first display screen according to the display output parameters of the second display screen.

[0168] 3) when the electronic device is in a first posture, in response to obtaining a target operation trajectory acting on a first display screen in a display state, controlling the first display screen to enter a screen-off state, providing a touchpad function in a target screen area of ​​the first display screen, or moving an application window displayed on the first display screen to a second display screen;

[0169] Taking a double-sided screen laptop as an example, the first gesture can characterize the notebook form, and the display screen on which the interactive operation acts is determined to be the first display screen. The target operation trajectory can be a palm slide, a multi-finger slide or other gesture trajectory, etc. Different gesture trajectories can control the first display screen to have different display outputs. For example, in response to obtaining a 3-finger slide trajectory acting on the first display screen in a display state, the first display screen is controlled to enter a screen-off state, and the application window originally displayed on the first display screen is moved to the second display screen. For example, in response to obtaining a palm slide trajectory acting on the first display screen in a display state, the first display screen is controlled to enter a screen-off state, and a touchpad function is provided in the target screen area of ​​the first display screen.

[0170] 4) when the electronic device is in the second posture, in response to the target object entering the first sensing area of ​​the electronic device, controlling the first display screen to display first content data or second content data from the second display screen, wherein the first content data is the same as the current content of the first display screen, and the second content data is different from the first content data;

[0171] Taking a double-sided screen laptop as an example, the second posture can represent a tent shape. The display screen facing away from the main user of the electronic device is determined to be the first display screen based on the posture information. In response to the target object entering the first sensing area of ​​the electronic device, the target object may be a temporary user different from the main user. The first sensing area may be the sensing area of ​​a sensor built into the body where the first display screen is located. That is, in response to the presence of a temporary user in front of the first display screen, the first display screen is controlled to display the first content data or the second content data from the second display screen. The first content data is the same data as the current content of the first display screen, and the second content data is different from the first content data. If the first display screen is controlled to display the first content data, that is, the first display screen is controlled to switch to the copy mode and serve as the copy screen to display the mirror data of the second display screen. If the first display screen is controlled to display the second content data, that is, the first display screen is controlled to switch to the extended mode and serve as the extended screen to display the extended data of the second display screen.

[0172] 5) When the electronic device is in the second posture, in response to the target object leaving the first sensing area of ​​the electronic device, controlling the first display screen to enter a screen-off state;

[0173] Taking a double-sided screen laptop as an example, the second posture can represent a tent shape. According to the body where the sensor is located, the display screen on the body is determined to be the first display screen. In response to the target object leaving the first sensing area of ​​the electronic device, that is, there is no user in front of the first display screen, the first display screen is controlled to be in a screen-off state to avoid display power consumption when no one is around.

[0174] 6) When the electronic device is in the third posture, based on the changing parameters of the communication connection between the electronic device and the external device, the first display screen is controlled to provide a touchpad function, a writing board function or display related content of the content currently displayed on the second display screen in its target screen area.

[0175] Taking a double-sided screen laptop as an example, the third posture can represent the book form, and the display screen that is in an idle state with at least two displays can be determined as the first display screen based on the posture information. The target trigger event is detecting a change in the communication connection between the electronic device and the external device. For example, the electronic device is disconnected from the external mouse. The first display screen can be controlled to provide a touchpad function or a writing board function in its target screen area; for example, when the electronic device establishes a connection with the external mouse, the first display screen can be controlled to display the associated content of the current content of the second display screen, that is, the first display screen and the second display screen display continuous content, that is, the reading mode in the book form.

[0176] In an example of the present disclosure, step 103 controls the display output of the second display screen among the at least two display screens based on the control information for the first display screen, including at least one of the following:

[0177] 1) generating an associated instruction for the control instruction of the first display screen, and controlling the display output of the second display screen based on the associated instruction;

[0178] An association instruction refers to an instruction that is required to be associated and executed by the second display screen and is needed to control the first display screen to perform a corresponding response action. The association instruction may include an instruction for displaying an application window from the first display screen on the second display screen, an instruction for establishing a connection relationship between the second display screen and the first display screen as an input component, a switching instruction for switching the display mode of the second display window, an adjustment instruction for adjusting the display output parameters of the second display window, etc.

[0179] For example, in the notebook form of a double-sided screen laptop computer, the first display screen is determined to be the C-side screen and the second display screen is the B-side screen based on the posture information, and the target trigger event is the user performing a palm sliding operation on the first display screen. After the first display screen is controlled to switch to a touchpad based on the target trigger event and the posture information, an associated instruction for the switching control instruction for the first display screen is generated. For example, the associated instruction may be to establish a mapping relationship between the coordinates of the first display screen and the second display screen; based on the associated instruction, the display output of the second display screen is controlled so that when the user touches the first display screen, a cursor at a corresponding position is displayed on the second display screen.

[0180] 2) Obtaining a response result of the first display screen, and controlling a display output of the second display screen based on the response result.

[0181] The response result of the first display screen refers to the execution result of the first display screen, such as entering the screen off state or the screen on state, switching to a touch pad or a writing pad. Controlling the display output of the second display screen based on the response result means that after completing the control of the first display screen, the second display screen can be controlled to adaptively adjust part of the content.

[0182] For example, in the tent form of a double-sided screen laptop computer, the first display screen is determined to be the display screen facing away from the target user based on the posture information, and the second display screen is the display screen facing the user. The target trigger event is the user performing an upward operation of the first window on the second display screen. After the first display screen is controlled to switch to the extended mode and display the first window from the second display screen based on the target trigger event and the posture information, an associated instruction for the switching control instruction for the first display screen is generated. For example, the associated instruction can set the display size of the second window on the second display screen. Based on the associated instruction, the display output of the second display screen is controlled. The second display screen can be controlled to display the second window in full screen based on the associated instruction.

[0183] The present application also provides a device control device, such as Figure 4 As shown, including:

[0184] An acquisition module 301 is used to obtain posture information of an electronic device, wherein the posture information at least includes position information of at least two display screens of the electronic device that can rotate relative to each other;

[0185] A first control module 302, configured to control the display output of a first display screen among the at least two display screens based on the gesture information in response to a target trigger event;

[0186] The second control module 303 is configured to control the display output of a second display screen among the at least two display screens based on the control information for the first display screen.

[0187] The embodiment of the present application obtains the posture information of the electronic device, and the posture information at least includes the posture information of at least two display screens of the electronic device that can rotate relative to each other; in response to the target trigger event, the display output of the first display screen among the at least two display screens is controlled based on the posture information; and the display output of the second display screen among the at least two display screens is controlled based on the control information for the first display screen. Thus, on the one hand, the present application controls the display output of the display screen according to the posture information of the electronic device and the target trigger event, enriches the working mode of the display screen, and can meet the user's use needs in different working scenarios. For example, the display screen can provide a touchpad function in the off-screen state to meet the user's low power consumption and touch requirements; the display screen can be used as a touch screen to provide a human-computer interaction interface for the user; the display screen can also be used only as a display to provide a display function, etc. On the other hand, the device control method of the present application provides a richer and more intelligent control logic for an electronic device with at least two display screens that can rotate relative to each other, and can intelligently set the working mode of the display screen in different working scenarios, avoiding frequent manual operations of the user, greatly improving the user experience, and at the same time avoiding the waste of additional resources caused by the mismatch between the working mode of the display screen and the user's working scenario.

[0188] In some embodiments, the first control module 302 includes:

[0189] a determining unit, configured to determine a first display screen from the at least two display screens based on the posture information and / or the target triggering event;

[0190] A control unit is used to control the display output of the first display screen based on the target trigger event and the posture information to provide different operation response functions.

[0191] In some embodiments, the target trigger event is generated by at least one of the following:

[0192] In response to the electronic device running the target application, generating the target trigger event;

[0193] In response to obtaining an interactive operation acting on a display screen of the electronic device, generating the target trigger event;

[0194] In response to obtaining interaction data acting on a sensing area of ​​the electronic device, generating the target trigger event;

[0195] In response to detecting a change in the communication connection between the electronic device and the target device, generating the target trigger event;

[0196] In response to the usage scenario of the electronic device being adjusted from a current first usage scenario to a target usage scenario, the usage scenario includes at least one of a usage environment, a usage object, a usage mode, and a usage configuration parameter of the electronic device.

[0197] In some embodiments, the determining unit is configured to implement at least one of the following:

[0198] When the electronic device is in a first posture, determining a display screen having a first posture parameter among the at least two display screens as the first display screen;

[0199] When the electronic device is in the second posture, determining a display screen facing away from the target user among the at least two display screens as the first display screen;

[0200] When the electronic device is in a third posture, determining a display screen in an idle state among the at least two display screens as the first display screen;

[0201] In response to the electronic device running the target application, determining a display screen different from the display screen where the first application window of the target application is located among the at least two display screens as the first display screen;

[0202] In response to obtaining an interactive operation acting on the electronic device, taking the display screen on which the interactive operation acts as the first display screen, or taking the target display screen directed by the interactive operation as the first display screen;

[0203] In response to obtaining interaction data acting on a sensing area of ​​the electronic device, determining a display screen pointed to by the interaction data as the first display screen;

[0204] In response to a change in the communication connection with the target device, determining a display screen having a first positional relationship with the target communication interface as the first display screen;

[0205] In response to the electronic device switching to the target usage scenario, a display screen matching the target usage scenario among the at least two display screens is determined as the first display screen. Determining the first display screen from the at least two display screens based on the posture information and / or the target trigger event includes at least one of the following:

[0206] When the electronic device is in a first posture, determining a display screen having a first posture parameter among the at least two display screens as the first display screen;

[0207] When the electronic device is in the second posture, determining a display screen facing away from the target user among the at least two display screens as the first display screen;

[0208] When the electronic device is in a third posture, determining a display screen in an idle state among the at least two display screens as the first display screen;

[0209] In response to the electronic device running the target application, determining a display screen different from the display screen where the first application window of the target application is located among the at least two display screens as the first display screen;

[0210] In response to obtaining an interactive operation acting on the electronic device, taking the display screen on which the interactive operation acts as the first display screen, or taking the target display screen directed by the interactive operation as the first display screen;

[0211] In response to obtaining interaction data acting on a sensing area of ​​the electronic device, determining a display screen pointed to by the interaction data as the first display screen;

[0212] In response to a change in the communication connection with the target device, determining a display screen having a first positional relationship with the target communication interface as the first display screen;

[0213] In response to the electronic device switching to a target usage scenario, a display screen among the at least two display screens that matches the target usage scenario is determined as the first display screen.

[0214] In some embodiments, the control unit is specifically configured to control display output parameters and / or display output content of the first display screen based on the source information of the target trigger event and the posture information.

[0215] In some embodiments, controlling the display output parameters and / or the display output content of the first display screen based on the source information of the target trigger event and the posture information includes at least one of the following:

[0216] Controlling the first display screen to provide a target input control that matches the source information and the gesture information;

[0217] Controlling the first display screen to display a target application window or target content source data matching the source information and the posture information;

[0218] Controlling an input control provided by the first display screen to adjust from a current first display parameter to a target display parameter that matches the source information and the posture information, the target display parameter being different from the first display parameter;

[0219] Controlling the first display screen to adjust from providing a first set of input controls to providing a target set matching the source information and the gesture information, wherein the number and / or type of input controls in the target set are different from the first set;

[0220] The first display screen is controlled to switch from a current first display output parameter to a target display output parameter matching the source information and the posture information, wherein the target display output parameter is different from the first display output parameter.

[0221] In some embodiments, the control unit is configured to implement at least one of the following:

[0222] When the electronic device is in a first posture, in response to the electronic device starting to run a first application, controlling a first display screen that does not display an application window of the first application to enter a screen-off state and providing a touchpad function or a writing pad function in a target screen area of ​​the first display screen, where the target screen area is the entire area or a partial area of ​​the first display screen;

[0223] When the electronic device is in the first posture, in response to the electronic device moving an application window of a second application on the second display screen to the first display screen in the screen-off state, controlling the first display screen to display the application window of the second application;

[0224] When the electronic device is in a first posture, in response to obtaining a target operation trajectory acting on a first display screen in a display state, controlling the first display screen to enter a screen-off state, providing a touchpad function in a target screen area of ​​the first display screen, or moving an application window displayed on the first display screen to a second display screen;

[0225] When the electronic device is in a second posture, in response to a target object entering a first sensing area of ​​the electronic device, controlling the first display screen to display first content data or second content data from the second display screen, wherein the first content data is the same as current content of the first display screen, and the second content data is different from the first content data;

[0226] When the electronic device is in the second posture, in response to the target object leaving the first sensing area of ​​the electronic device, controlling the first display screen to enter a screen-off state;

[0227] When the electronic device is in the third posture, the first display screen is controlled to provide a touchpad function, a writing board function or display associated content of the content currently displayed on the second display screen in its target screen area based on the change parameters of the communication connection between the electronic device and the external device.

[0228] In some embodiments, the second control module 303 is used to implement at least one of the following:

[0229] generating an associated instruction for the control instruction of the first display screen, and controlling the display output of the second display screen based on the associated instruction;

[0230] A response result of the first display screen is obtained, and a display output of the second display screen is controlled based on the response result.

[0231] According to an embodiment of the present application, the present application also provides an electronic device and a readable storage medium.

[0232] Figure 5 A schematic block diagram of an example electronic device 800 that can be used to implement an embodiment of the present application is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workbenches, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present application described and / or required herein.

[0233] like Figure 5 As shown, the device 800 includes a computing unit 801, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 802 or a computer program loaded from a storage unit 808 into a random access memory (RAM) 803. In the RAM 803, various programs and data required for the operation of the device 800 can also be stored. The computing unit 801, the ROM 802, and the RAM 803 are connected to each other via a bus 804. An input / output (I / O) interface 805 is also connected to the bus 804.

[0234] A number of components in the device 800 are connected to the I / O interface 805, including: an input unit 806, such as a keyboard, a mouse, etc.; an output unit 807, such as various types of displays, speakers, etc.; a storage unit 808, such as a disk, an optical disk, etc.; and a communication unit 809, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 809 allows the device 800 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0235] The computing unit 801 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 801 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The computing unit 801 performs the various methods and processes described above, such as the device control method. For example, in some embodiments, the device control method may be implemented as a computer software program, which is tangibly contained in a machine-readable medium, such as a storage unit 808. In some embodiments, part or all of the computer program may be loaded and / or installed on the device 800 via the ROM 802 and / or the communication unit 809. When the computer program is loaded into the RAM 803 and executed by the computing unit 801, one or more steps of the device control method described above may be performed. Alternatively, in other embodiments, the computing unit 801 may be configured to perform the device control method in any other appropriate manner (e.g., by means of firmware).

[0236] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0237] The program code for implementing the method of the present application can be written in any combination of one or more programming languages. These program codes can be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that the program code, when executed by the processor or controller, implements the functions / operations specified in the flow chart and / or block diagram. The program code can be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0238] In the context of the present application, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0239] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0240] The systems and techniques described herein may be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), and the Internet.

[0241] A computer system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The relationship of client and server is generated by computer programs running on respective computers and having a client-server relationship with each other. The server may be a cloud server, a server of a distributed system, or a server combined with a blockchain.

[0242] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps recorded in this application can be executed in parallel, sequentially or in different orders, as long as the expected results of the technical solution of this application can be achieved, and this document does not limit this.

[0243] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include at least one of the features. In the description of this application, the meaning of "plurality" is two or more, unless otherwise clearly and specifically defined.

[0244] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A device control method, comprising: Obtaining posture information of the electronic device, the posture information at least including position information of at least two display screens of the electronic device that can rotate relative to each other; In response to a target triggering event, controlling a display output of a first display screen among the at least two display screens based on the gesture information; as well as, The display output of a second display screen among the at least two display screens is controlled based on the control information for the first display screen.

2. The method according to claim 1, wherein in response to the target trigger event, controlling the display output of the first display screen among the at least two display screens based on the gesture information comprises: Determine a first display screen from the at least two display screens based on the posture information and / or the target trigger event; The display output of the first display screen is controlled based on the target trigger event and the posture information to provide different operation response functions.

3. The method according to claim 1 or 2, wherein: The target trigger event is generated by at least one of the following: In response to the electronic device running the target application, generating the target trigger event; In response to obtaining an interactive operation acting on a display screen of the electronic device, generating the target trigger event; In response to obtaining interaction data acting on a sensing area of ​​the electronic device, generating the target trigger event; In response to detecting a change in the communication connection between the electronic device and the target device, generating the target trigger event; In response to the usage scenario of the electronic device being adjusted from a current first usage scenario to a target usage scenario, the usage scenario includes at least one of a usage environment, a usage object, a usage mode, and a usage configuration parameter of the electronic device.

4. The method according to claim 2, wherein: Determining a first display screen from the at least two display screens based on the posture information and / or the target trigger event includes at least one of the following: When the electronic device is in a first posture, determining a display screen having a first posture parameter among the at least two display screens as the first display screen; When the electronic device is in the second posture, determining a display screen facing away from the target user among the at least two display screens as the first display screen; When the electronic device is in a third posture, determining a display screen in an idle state among the at least two display screens as the first display screen; In response to the electronic device running the target application, determining a display screen different from the display screen where the first application window of the target application is located among the at least two display screens as the first display screen; In response to obtaining an interactive operation acting on the electronic device, taking the display screen on which the interactive operation acts as the first display screen, or taking the target display screen directed by the interactive operation as the first display screen; In response to obtaining interaction data acting on a sensing area of ​​the electronic device, determining a display screen pointed to by the interaction data as the first display screen; In response to a change in the communication connection with the target device, determining a display screen having a first positional relationship with the target communication interface as the first display screen; In response to the electronic device switching to a target usage scenario, a display screen among the at least two display screens that matches the target usage scenario is determined as the first display screen.

5. The method according to claim 2 or 4, wherein: Controlling the display output of the first display screen based on the target trigger event and the posture information includes: The display output parameters and / or the display output content of the first display screen are controlled based on the source information of the target trigger event and the posture information.

6. The method according to claim 5, wherein: Controlling the display output parameters and / or the display output content of the first display screen based on the source information of the target trigger event and the posture information includes at least one of the following: Controlling the first display screen to provide a target input control that matches the source information and the gesture information; Controlling the first display screen to display a target application window or target content source data matching the source information and the posture information; Controlling an input control provided by the first display screen to adjust from a current first display parameter to a target display parameter that matches the source information and the posture information, the target display parameter being different from the first display parameter; Controlling the first display screen to adjust from providing a first set of input controls to providing a target set matching the source information and the gesture information, wherein the number and / or type of input controls in the target set are different from the first set; The first display screen is controlled to switch from a current first display output parameter to a target display output parameter matching the source information and the posture information, wherein the target display output parameter is different from the first display output parameter.

7. The method according to claim 2 or 4, wherein: Controlling the display output of the first display screen based on the target trigger event and the posture information includes at least one of the following: When the electronic device is in a first posture, in response to the electronic device starting to run a first application, controlling a first display screen that does not display an application window of the first application to enter a screen-off state and providing a touchpad function or a writing pad function in a target screen area of ​​the first display screen, where the target screen area is the entire area or a partial area of ​​the first display screen; When the electronic device is in the first posture, in response to the electronic device moving an application window of a second application on the second display screen to the first display screen in the screen-off state, controlling the first display screen to display the application window of the second application; When the electronic device is in a first posture, in response to obtaining a target operation trajectory acting on a first display screen in a display state, controlling the first display screen to enter a screen-off state, providing a touchpad function in a target screen area of ​​the first display screen, or moving an application window displayed on the first display screen to a second display screen; When the electronic device is in a second posture, in response to a target object entering a first sensing area of ​​the electronic device, controlling the first display screen to display first content data or second content data from the second display screen, wherein the first content data is the same as current content of the first display screen, and the second content data is different from the first content data; When the electronic device is in the second posture, in response to the target object leaving the first sensing area of ​​the electronic device, controlling the first display screen to enter a screen-off state; When the electronic device is in the third posture, the first display screen is controlled to provide a touchpad function, a writing board function or display associated content of the content currently displayed on the second display screen in its target screen area based on the change parameters of the communication connection between the electronic device and the external device.

8. The method according to claim 1, wherein: Controlling the display output of the second display screen among the at least two display screens based on the control information for the first display screen includes at least one of the following: generating an associated instruction for the control instruction of the first display screen, and controlling the display output of the second display screen based on the associated instruction; A response result of the first display screen is obtained, and a display output of the second display screen is controlled based on the response result.

9. A device control apparatus, comprising: An acquisition module, used to obtain posture information of an electronic device, wherein the posture information at least includes position information of at least two display screens of the electronic device that can rotate relative to each other; A first control module, configured to control a display output of a first display screen among the at least two display screens based on the posture information in response to a target trigger event; The second control module is used to control the display output of a second display screen among the at least two display screens based on the control information for the first display screen.

10. An electronic device, comprising a first body and a second body, wherein a first display screen is disposed on a first surface of the first body, and a second display screen is disposed on a second surface of the second body, and the first body and the second body can rotate relative to each other so that the electronic device has different postures; The electronic device further includes a processor and a memory arranged in the first body and / or the second body; wherein, The memory stores instructions that can be executed by the processor, and the instructions are executed by the processor to enable the processor to perform the following operations: Obtaining posture information of the electronic device, wherein the posture information at least includes position information of the first display screen and the second display screen; In response to a target triggering event, controlling a display output of the first display screen based on the posture information; as well as, The display output of the second display screen is controlled based on the control information for the first display screen.

Images