Display control method and electronic equipment

Abstract

The invention provides a display control method and electronic equipment, and relates to the technical field of computers. The display control method comprises the following steps: in response to a target event, determining a position relationship between a target operation body and electronic equipment; determining a target interaction control set matched with the target event based on the position relationship; controlling the target interaction area to output a target interaction control set according to the target display parameters; wherein the target interaction control set can respond to target operation from the target operation body to generate target data interacting with the electronic equipment.

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, and in particular to a display control method and an electronic device. Background Art

[0002] When users use virtual interactive controls, such as virtual keyboards and virtual touchpads, to input on electronic devices, since the virtual interactive controls do not have the tactile feel or touch identifiers of physical interactive controls, such as the virtual keyboard does not have the touch identifiers of the "F" and "J" keys on the physical keyboard, the user needs to constantly look at the virtual interactive controls to interact with the electronic device. However, when the user pays attention to the virtual interactive controls and the display screen at the same time, the interaction efficiency and accuracy will be reduced, affecting the user's interaction experience. In addition, when the user touches the virtual interactive controls, the interaction will be directly triggered, which makes it impossible for the user to place his hands naturally on the virtual interactive controls when resting or thinking, thereby increasing the user's discomfort. Summary of the Invention

[0003] The present disclosure provides a display control method and an electronic device.

[0004] According to a first aspect of the present disclosure, a display control method is provided, comprising: determining a positional relationship between a target operating body and an electronic device in response to a target event; determining a target interaction control set matching the target event based on the positional relationship; controlling a target interaction area to output the target interaction control set with target display parameters; wherein the target interaction control set can generate target data for interacting with the electronic device in response to a target operation from the target operating body.

[0005] In one possible embodiment, determining the positional relationship between the target operating body and the electronic device includes: obtaining sensing data of the target operating body by a target sensing component of the electronic device, and determining the positional relationship between the target operating body and a target interaction component of the electronic device based on the sensing data; and / or, the target event is generated from at least one of the following: in response to detecting that a user's finger and / or palm is placed on the touch display screen of the electronic device; in response to detecting that a user's limb enters the image acquisition area of the electronic device; in response to detecting that the target input device has a first positional relationship with the touch display screen of the electronic device; in response to obtaining a first instruction to call up a virtual keyboard and / or virtual touchpad of the electronic device; in response to obtaining a first operation trajectory acting on the touch display screen and / or touchpad of the electronic device; in response to obtaining a second operation trajectory acting on the spatial interaction area of the electronic device.

[0006] In one possible implementation manner, determining the positional relationship between the target operating body and the target interactive component of the electronic device based on the sensing data includes at least one of the following: obtaining configuration information of the target interactive component, and determining the positional relationship based on the sensing data and the configuration information; obtaining touch data of the user's fingers and / or palm sensed by the touch sensing electrodes of the touch display screen of the electronic device, and determining the coordinate positions of the fingers and / or palm on the touch display screen based on the touch data; obtaining pressure data of the user's fingers and / or input pen sensed by the pressure sensor of the pressure screen of the electronic device, and determining the coordinate positions of the user's fingers and / or input pen on the pressure screen based on the pressure data; obtaining image data of the user's limbs captured by the image sensor of the three-dimensional display screen of the electronic device, and determining the relative position between the user's limbs and the three-dimensional display screen based on the image data.

[0007] In one possible implementation, determining the target interactive control set that matches the target event based on the positional relationship includes at least one of the following: determining the type of interactive control enabled by the electronic device in response to the target event based on source information of the target event, and determining the target interactive control set from the enabled interactive controls based on the positional relationship; and / or determining the target interactive control set based on the positional relationship and attribute information of the target operating body.

[0008] In one possible embodiment, a target interactive control set is determined from enabled interactive controls based on the positional relationship, including at least one of the following: when a user's finger and / or palm is detected to be placed on a touch display screen of an electronic device, at least part of a virtual keyboard and / or virtual touchpad is enabled as the target interactive control set based on the sensed coordinate position of the user's finger and / or palm on the touch display screen; when a target input device is detected to have a first positional relationship with the touch display screen of the electronic device, interactive controls matching the attribute information of the target input device are enabled as the target interactive control set based on the first positional relationship; when an instruction or operation trajectory for invoking the virtual keyboard and / or virtual touchpad of the electronic device is obtained, at least part of the keys of the virtual keyboard and / or at least part of the area of the virtual touchpad is used as the target interactive control set; when a user's limb is detected to enter an image acquisition area of the electronic device, at least part of the three-dimensional interactive controls of the electronic device is used as the target interactive control set based on the relative position between the user's limb and the electronic device.

[0009] In one possible implementation, controlling the target interaction area to output the target interaction control set with target display parameters includes: determining display layout parameters and display appearance parameters between the interaction controls in the target interaction control set based on the positional relationship; and displaying and outputting the target interaction control set to the target display screen and / or target interaction area in the virtual display area of the electronic device based on the display layout parameters and display appearance parameters.

[0010] In one possible implementation, the determining of the display layout parameters and display appearance parameters between the interactive controls in the target interactive control set based on the positional relationship includes at least one of the following: determining the display layout parameters and display appearance parameters between each part of the target virtual keyboard and / or target virtual touchpad based on the coordinate positions of the user's fingers and / or palm on the touch display screen of the electronic device, wherein the display appearance parameters of the first and second keys in the virtual keyboard are different from those of other keys; determining the display layout parameters and display appearance parameters between each part of any one of the target virtual keyboard, target virtual touchpad, target virtual writing board, and target virtual drawing board based on the first positional relationship between the target input device and the touch display screen of the electronic device; determining the display layout parameters and display appearance parameters between the target three-dimensional interactive controls of the electronic device based on the relative position between the target limb and the electronic device.

[0011] In one possible embodiment, a display control method also includes at least one of the following: detecting a degree of matching between a first key and a second key in a virtual keyboard of an electronic device and a first finger and a second finger of a target user, and adjusting the display layout parameters and / or display appearance parameters of the virtual keyboard based on the degree of matching; adjusting the display layout parameters and / or display appearance parameters of the virtual keyboard in response to obtaining a third operation trajectory acting on the virtual keyboard of the electronic device; and controlling the virtual keyboard to update or not update the display position on the touch display screen of the electronic device based on the interactive operation data between the user's finger and the virtual keyboard of the electronic device.

[0012] According to a second aspect of the present disclosure, an electronic device is provided, comprising a first body and a second body, wherein a first display screen is provided on a first surface of the first body, and a second display screen is provided on a second surface of the second body, and the first body and the second body can rotate relative to each other so that the electronic device has different postures; the electronic device also comprises a processor and a memory arranged on the first body and / or the second body; wherein the memory stores instructions executable by the processor, and the instructions are executed by the processor so that the processor can perform at least one of the following operations: determining a positional relationship between a target operating body and the second display screen in response to a target event; determining a target interactive control set matching the target event based on the positional relationship; controlling a target interactive area in the second display screen to output the target interactive control set with target display parameters; wherein the target interactive control set can generate target data for interacting with the electronic device in response to a target operation from the target operating body.

[0013] In one possible embodiment, the target control set includes at least a portion of a virtual keyboard, and the processor is further capable of performing at least one of the following operations: when the second display screen displays a target virtual keyboard that matches the user's finger and / or palm, controlling the first display screen to map and display at least a portion of the target virtual keyboard and / or the operation data of the target virtual keyboard triggered by the user's finger; in response to obtaining a third operation trajectory acting on the virtual keyboard, adjusting the display layout parameters and / or display appearance parameters of the virtual keyboard; obtaining spatial environment data and usage scenario data of the electronic device, and adjusting the display layout parameters and / or display appearance parameters of the virtual keyboard based on the spatial environment data and / or usage scenario data.

[0014] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become readily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] The above and other objects, features and advantages of the exemplary embodiments of the present disclosure will become readily understood by reading the detailed description below with reference to the accompanying drawings, in which several embodiments of the present disclosure are shown by way of example and not limitation, wherein:

[0016] In the drawings, the same or corresponding reference numerals denote the same or corresponding parts.

[0017] Figure 1 A flow chart of a display control method according to an embodiment of the present disclosure is shown. Figure 1 ;

[0018] Figure 2 A flow chart of a display control method according to an embodiment of the present disclosure is shown. Figure 2 ;

[0019] Figure 3 A flow chart of a display control method according to an embodiment of the present disclosure is shown. Figure 3 ;

[0020] Figure 4 A schematic diagram showing a display control method according to an embodiment of the present disclosure Figure 1 ;

[0021] Figure 5 A schematic diagram showing a display control method according to an embodiment of the present disclosure Figure 2 ;

[0022] Figure 6 A schematic diagram showing a display control method according to an embodiment of the present disclosure Figure 3 ;

[0023] Figure 7 A schematic diagram showing a display control method according to an embodiment of the present disclosure Figure 4 ;

[0024] Figure 8 A schematic diagram showing a display control method according to an embodiment of the present disclosure Figure 5 ;

[0025] Figure 9 A schematic diagram showing a display control method according to an embodiment of the present disclosure Figure 6 ;

[0026] Figure 10 A schematic diagram showing a display control method according to an embodiment of the present disclosure Figure 7 ;

[0027] Figure 11 A schematic diagram showing a display control method according to an embodiment of the present disclosure Figure 8 ;

[0028] Figure 12 A schematic diagram showing a display control method according to an embodiment of the present disclosure Figure 9 ;

[0029] Figure 13 The structure of an electronic device according to an embodiment of the present disclosure is shown. Figure 1 ;

[0030] Figure 14 The structure of an electronic device according to an embodiment of the present disclosure is shown. Figure 2 . DETAILED DESCRIPTION

[0031] To make the purposes, features, and advantages of the present disclosure more apparent and understandable, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present disclosure, not all of them. All other embodiments obtained by those skilled in the art based on the embodiments of the present disclosure without creative work shall fall within the scope of protection of the present disclosure.

[0032] Figure 1 A flow chart of a display control method according to an embodiment of the present disclosure is shown. Figure 1 ,like Figure 1 As shown, a display control method includes:

[0033] Step S101 : In response to a target event, determining a positional relationship between a target operating object and an electronic device.

[0034] In this embodiment, a target event is an event that can trigger an interactive control in an electronic device. Target events can include: detecting a user's finger on the touch screen of an electronic device or within the interactive space of an electronic device; detecting a stylus pen hovering within the sensing distance of the touch screen of an electronic device; detecting that trigger conditions of a virtual keyboard, virtual touchpad, or specific sensor are met. Specific sensors can include cameras and time-of-flight radars (TOF) of electronic devices. Trigger conditions can include triggering a specific physical key, detecting a specific touch gesture, detecting a specific spatial gesture trajectory, triggering a specific virtual control, etc.; detecting a voice command that triggers an interactive control in an electronic device, etc. Target operators are objects that can interact with interactive controls in an electronic device. Target operators can include a user's finger, a stylus pen, a smart ring, etc. The positional relationship between the target operating body and the electronic device can be: the positional relationship between the user's finger and the touch screen of the electronic device, including the position of the user's finger on the touch screen, whether the user touches with both hands or one hand, etc.; the positional relationship between the user's finger and a specific sensor of the electronic device; the positional relationship between the stylus and the touch screen of the electronic device, including the position of the stylus on the touch screen, the floating position of the stylus on the touch screen, etc.

[0035] Step S102: determining a target interactive control set that matches the target event based on the position relationship.

[0036] In this embodiment, the target interaction control set can generate target data for interacting with the electronic device in response to a target operation from a target operator. The target interaction control set may include: at least one of: a virtual keyboard, a virtual touchpad, a virtual drawing board, a virtual handwriting board, a camera, and a TOF radar, or a combination of keys on a target keyboard, a combination of controls on a virtual touchpad, a combination of a handwriting area and controls on a virtual handwriting board, etc. The target interaction control set can generate target data by determining input data as target data, for example, directly using data typed through a virtual keyboard or image data drawn through a virtual drawing board as target data. The target interaction control set can also generate target data by processing input data to obtain target data, for example, converting handwriting through a writing board into a standard string, generating a standard string or standard image from handwriting or drawing sketches using a generative artificial intelligence model, or converting a spatial gesture trajectory into a standard string through a camera or image processing device.

[0037] In this embodiment, based on the positional relationship between the target operating body and the electronic device, a target interactive control set matching the target event can be determined. For example, if the target operating body is a user finger, and the user finger is located at a specific position on the touch screen of the electronic device, the target interactive control set may include a key combination in the virtual keyboard, such as displaying only letter keys, or displaying letter keys + number keys, or displaying complete keyboard keys; if the target operating body is a user finger and a stylus, the user finger is located at a first specific position on the touch screen of the electronic device, and the stylus is located at a second specific position on the touch screen of the electronic device, the target interactive control set may include at least some controls in the virtual keyboard and the virtual handwriting board, wherein the first specific position is different from the second characteristic position. For example, the first specific position may be the left side of the touch screen of the electronic device, and the second specific position may be the right side of the touch screen of the electronic device.

[0038] Step S103: Control the target interactive area to output the target interactive control set with the target display parameters.

[0039] In this embodiment, the target interaction area is an area capable of displaying a target interaction control set. The target interaction area may be the C-side touch screen of a dual-screen notebook, the 3D interaction area of an electronic device (such as the interaction area of a naked-eye 3D display screen), and the extended reality (XR) projection area of an electronic device, etc.; the target display parameters are the display parameters of the target interaction control set, including display position, display layout, display font size, display color, line thickness, display size, transparency, and refresh rate, etc., wherein the display position may be determined based on the positional relationship between the target operating body and the electronic device, such as determining the position of the virtual keyboard based on the position of the user's finger on the touch screen. After determining the target interactive control set, it is necessary to control the target interactive area to output the target interactive control set with the target display parameters. For example, if the target interactive control set is a set of at least part of the keys of the virtual keyboard, the C-side touch screen of the dual-screen notebook is controlled to display at least part of the virtual keyboard in the middle of the screen, and the user can interact with the dual-screen notebook based on the displayed virtual keyboard part; if the target interactive control set is a virtual keyboard and a virtual handwriting tablet, the C-side touch screen of the dual-screen notebook is controlled to display the virtual keyboard on the left side of the screen, and the virtual handwriting tablet is displayed on the left side of the screen. The user can use the left hand to input through the virtual keyboard and use the right hand to input by hand through the virtual handwriting tablet.

[0040] In the present disclosure, in response to a target event, the positional relationship between the target operating body and the electronic device is determined, and then a target interactive control set matching the target event is determined based on the positional relationship, and the target interactive area is controlled to output the target interactive control set with target display parameters. The target interactive control set that needs to be triggered can be accurately determined, and the positional relationship between the target operating body and the electronic device can be used to determine the display position of the target interactive control set, so that the position of the target interactive control set automatically adapts to the position of the target operating body, such as the position of the virtual keyboard automatically adapts to the position of the user's finger. When the user interacts with the electronic device through the target interactive control set, he does not need to pay attention to the target interactive control set, but only needs to pay attention to the display screen, thereby improving the interaction efficiency and interaction accuracy, and ensuring the user's interactive experience.

[0041] In another embodiment, the “target event” in step S101 is generated from at least one of the following:

[0042] In response to detecting that a user's finger and / or palm is placed on the touch display screen of the electronic device. If it is detected that a user's finger and / or palm is placed on the touch display screen of the electronic device, then the target event is triggered.

[0043] In response to detecting a user's limb entering an image capture area of the electronic device. The user's limb entering the image capture area of the electronic device may include the user's finger entering a signal capture area of a camera, a time-of-flight radar, or the like of the electronic device. If the user's limb is detected entering the image capture area of the electronic device, then the target event is triggered.

[0044] In response to detecting that a target input device has a first positional relationship with the touch display screen of the electronic device. The target input device may be a stylus, touchpad, smart ring, drawing board, or writing tablet, and the first positional relationship may be hovering or covering. For example, if the stylus is hovering within a target distance above the touch display screen, it is considered that the target input device has the first positional relationship with the touch display screen of the electronic device. If the target input device is detected to have the first positional relationship with the touch display screen of the electronic device, then the target event is triggered.

[0045] In response to obtaining a first instruction to invoke a virtual keyboard and / or virtual touchpad of an electronic device. The first instruction may be triggered by a user pressing a specific key on the electronic device, or by a user clicking a specific button on a display screen of the electronic device with a mouse. If the first instruction to invoke the virtual keyboard and / or virtual touchpad of the electronic device is obtained, then a target event is triggered, and in this case, the target interactive control set matching the target event is the virtual keyboard and / or virtual touchpad.

[0046] In response to obtaining a first operation trajectory on a touch screen and / or touchpad of an electronic device. In one example, a trajectory operation on the touch screen and / or touchpad of the electronic device can trigger the electronic device to enter a mode for activating a virtual keyboard / virtual touchpad or other interactive controls. Therefore, if the first operation trajectory on the touch screen and / or touchpad of the electronic device is obtained, it is confirmed that a target event has been triggered. For example, if a user draws a circular trajectory on the touch screen of the electronic device with a finger, it is considered that the target event has been triggered.

[0047] In response to obtaining a second operation trajectory acting on the spatial interaction area of the electronic device. In one example, a trajectory operation in the spatial interaction area around the electronic device can trigger the electronic device to enter a mode that calls up a virtual keyboard / virtual trackpad or other interactive controls. Therefore, if the second operation trajectory acting on the spatial interaction area of the electronic device is obtained, it proves that the target event has been triggered. For example, if a user wears a smart ring on their finger and draws a circular trajectory in the spatial interaction area around the electronic device, it is considered that the target event has been triggered.

[0048] In another embodiment, the step S101 of “determining the positional relationship between the target operating object and the electronic device” includes:

[0049] The sensing data of the target operating body by the target sensing component of the electronic device is obtained, and the positional relationship between the target operating body and the target interactive component of the electronic device is determined based on the sensing data.

[0050] In this embodiment, the target sensing component is a component of the electronic device that can sense user operations. The target sensing component can be a touch sensing capacitor, a pressure sensor, a touch sensor, a camera, a time-of-flight radar, etc. The sensing data can be sensing capacitance data, pressure data, touch sensor data, image data, or point cloud data, etc. Based on the sensing data of the target sensing component on the target operating object, the positional relationship between the target operating object and the target interactive component of the electronic device can be determined. The target interactive component can be a touch screen, a camera, a time-of-flight radar, etc. of the electronic device. For example, if the target operating object is a user's finger, the sensing capacitance data of the touch sensing capacitor under the touch screen of the electronic device to the user's finger can be obtained, thereby determining the positional relationship between the user's finger and the touch screen of the electronic device.

[0051] In another embodiment, “determining the positional relationship between the target operating object and the target interactive component of the electronic device based on the sensing data” includes at least one of the following:

[0052] The configuration information of the target interactive component is obtained, and the positional relationship is determined based on the sensing data and the configuration information. The configuration information of the target interactive component includes the size of the target interactive component, the read / write refresh rate, the response rate, the acquisition range or the sensing distance, etc. Based on the sensing data of the target operating body by the target sensing component and the configuration information of the target interactive component, the positional relationship between the target operating body and the target interactive component of the electronic device can be determined. For example, the coordinate data of the user's finger on the touch screen of the electronic device can be determined based on the sensing capacitance data of the user's finger on the touch screen of the electronic device and the size of the touch screen of the electronic device. The sensing capacitance data of the user's finger on the touch screen of the electronic device can represent the position of the user's finger relative to the touch screen of the electronic device. Combined with the size of the touch screen, the coordinate data of the user's finger on the touch screen of the electronic device can be accurately determined.

[0053] Obtaining touch data of a user's finger and / or palm sensed by touch sensing electrodes of a touch display screen of an electronic device, and determining the coordinate position of the finger and / or palm on the touch display screen based on the touch data. The touch data of the user's finger and / or palm sensed by the touch sensing electrodes of the touch display screen includes a touch capacitance value. Based on the touch data, the contact point of the user's finger and / or palm with the touch display screen can be determined, and the position of the touch point relative to the touch screen of the electronic device can be further determined based on the arrangement information of the touch electrodes.

[0054] Obtain pressure data from a user's finger and / or stylus, sensed by a pressure sensor on the pressure screen of the electronic device, and determine the coordinate position of the user's finger and / or stylus on the pressure screen based on the pressure data. If the user's finger and / or stylus touches the pressure screen of the electronic device, the pressure sensor on the pressure screen will sense corresponding pressure data. Based on the pressure data and the arrangement of the pressure sensors on the pressure screen, the position of the touch relative to the pressure screen of the electronic device can be determined.

[0055] Image data of a user's limb captured by an image sensor of a 3D display of an electronic device is obtained, and the relative position between the user's limb and the 3D display is determined based on the image data. In one example, the 3D display may be a glasses-free 3D display. The relative position between the user's limb and the 3D display can be determined using 2D image data of the user's limb captured by the image sensor, or 3D image data combined with depth data. Based on this relative position, a spatial region can be determined to display a corresponding 3D interactive interface.

[0056] Figure 2 A flow chart of a display control method according to an embodiment of the present disclosure is shown. Figure 2 ,like Figure 2 As shown, a display control method includes:

[0057] Step S201 : In response to a target event, determining a positional relationship between a target operating object and an electronic device.

[0058] The specific implementation details of step S201 are similar to those of step S101 and will not be repeated here.

[0059] Step S202: determine the type of interactive control enabled by the electronic device in response to the target event based on the source information of the target event, and determine the target interactive control set from the enabled interactive controls based on the position relationship; and / or determine the target interactive control set based on the position relationship and the attribute information of the target operating body.

[0060] In this embodiment, the source information of the target event may be detecting that a user's finger and / or palm is placed on the touch display screen of the electronic device, detecting that a user's limb enters the image acquisition area of the electronic device, detecting that the target input device has a first positional relationship with the touch display screen of the electronic device, obtaining a first instruction to call up the virtual keyboard and / or virtual touchpad of the electronic device, obtaining a first operation trajectory acting on the touch display screen and / or touchpad of the electronic device, and obtaining a second operation trajectory acting on the spatial interaction area of the electronic device, etc. Different source information may correspond to different enabled interactive controls. For example, if the source information of the target event is detecting that a user's finger and / or palm is placed on the touch display screen of the electronic device, then the corresponding enabled interactive controls It can be a virtual keyboard, a virtual touchpad and a virtual drawing board; if the source information of the target event is detection of the user's limbs entering the image acquisition area of the electronic device, the corresponding enabled interactive control can be a virtual 3D interactive interface in the 3D interactive area, etc. Based on the positional relationship between the target operating body and the electronic device, the target interactive control set can be determined from the enabled interactive controls. For example, if the enabled interactive controls can be a virtual keyboard, a virtual touchpad and a virtual drawing board, and the user's fingers are in the center area of the touch screen, it can be determined that the target interactive control set includes the virtual keyboard; if part of the user's fingers are in the center area of the touch screen and part of the user's fingers are in the lower center area of the touch screen, it can be determined that the target interactive control set includes the virtual keyboard and the virtual touchpad.

[0061] In one example, the positional relationship between the target operating body and the electronic device may include whether the target operating body is at the edge of the touch screen, whether the target operating body is the user's left hand or right hand, the interaction distance between the target operating body and the touch screen, and the operation range of the target operating body on the touch screen. Based on the positional relationship between the target operating body and the electronic device, the display mode of the target interactive control set can also be determined. The display mode includes whether to display all, the display format, and whether to display all interfaces or all controls in the 3D interactive display interface, etc. For example, for a virtual keyboard, if the target operating body is only the user's left hand, the virtual keyboard is displayed based on the nine-square display format; if the target operating body includes the user's left and right hands, it is determined to display the virtual keyboard based on the 26-key display format and display the numeric keys.

[0062] In this embodiment, the attribute information of the target operating body includes the category of the target operating body, such as whether the target operating body is a finger, a stylus, a smart ring or a smart glove, etc. The types and quantities of interactive controls that can be called by target operating bodies with different attribute information may be different. For example, if the target operating body is the user's right hand, the interactive control may be a nine-square virtual keyboard or a virtual touchpad. If the target operating body is a stylus, the interactive control may be a virtual handwriting board or a virtual drawing board. At the same time, based on the positional relationship between the target operating body and the electronic device and the attribute information of the target operating body, the target interactive control set can be accurately determined. For example, if the target operating body is the user's right hand, the interactive control may be a nine-square virtual keyboard or a virtual touchpad, and the user's right hand is located in the lower middle position of the touch screen of the electronic device, then it can be accurately determined that the target interactive control includes the virtual touchpad.

[0063] Step S203: Control the target interactive area to output the target interactive control set with the target display parameters.

[0064] The specific implementation details of step S203 are similar to those of step S103 and will not be repeated here.

[0065] In another embodiment, the “determining a target interactive control set from enabled interactive controls based on the position relationship” in step S202 includes at least one of the following:

[0066] When it is detected that a user's finger and / or palm is placed on the touch display screen of the electronic device, at least part of the virtual keyboard and / or virtual touchpad is enabled as a target interactive control set based on the sensed coordinate positions of the user's finger and / or palm on the touch display screen. The coordinate positions of the user's finger and / or palm on the touch display screen can be sensed based on a touch sensor and / or a pressure sensor, and the corresponding target interactive control set is determined based on the coordinate positions of the user's finger and / or palm on the touch display screen. For example, if one hand of the user is in the middle of the touch screen of the electronic device and the other hand is in the lower middle position of the touch screen of the electronic device, it can be accurately determined that the target interactive controls include the virtual keyboard and the virtual touchpad.

[0067] When it is detected that a target input device and a touch screen display of an electronic device have a first positional relationship, interactive controls that match the attribute information of the target input device are enabled as a target interactive control set based on the first positional relationship. The target input device may be a stylus, a physical keyboard or touchpad, a mobile phone or tablet connected to the electronic device, or other devices; the first positional relationship may be that the stylus is suspended within a certain distance above the touch screen display of the electronic device, the physical keyboard / touchpad covers the touch screen, or the mobile phone or tablet covers the touch screen, etc.; different attribute information of the target input device matches different interactive controls. For example, the interactive controls that match the stylus may be a drawing application, a handwriting-to-text application, etc.; the interactive controls that match the physical keyboard may be a virtual touchpad, i.e., the user interacts through a physical keyboard combined with a virtual touchpad; the interactive controls that match the physical touchpad may be a virtual keyboard, i.e., the user interacts through a virtual keyboard combined with a physical touchpad; and the interactive controls that correspond to the mobile phone or tablet device may be applications that interact with the mobile phone or tablet device, such as wireless charging applications or services.

[0068] In the case of obtaining an instruction or operation track for calling up the virtual keyboard and / or virtual touchpad of an electronic device, at least some of the keys of the virtual keyboard and / or at least some of the areas of the virtual touchpad are used as a target interactive control set. Among them, the electronic device can be triggered to enter a mode for calling up the virtual keyboard / virtual touchpad or other interactive controls by a track operation on the touch display screen and / or touchpad of the electronic device. Therefore, if an instruction or operation track for calling up the virtual keyboard and / or virtual touchpad of an electronic device is obtained, the virtual keyboard and / or virtual touchpad can be directly used as a target interactive control set. For example, if the user's finger draws a circular track on the touch screen, the virtual keyboard is used as the target interactive control. If the user's finger clicks three times on the same position on the touch screen, the virtual touchpad is used as the target interactive control.

[0069] When a user's limb is detected entering the image capture area of the electronic device, at least a portion of the electronic device's 3D interactive controls are targeted as a set of target interactive controls based on the relative position of the user's limb and the electronic device. Specifically, the distance between the user's limb and the electronic device or camera can be used to control whether all controls in the 3D interactive controls are displayed, or only controls for remote or near-end operations are displayed. For example, controls controlling overall display changes of the 3D content may be displayed when the user's limb is far from the electronic device or camera, while controls controlling partial display changes of the 3D content may be displayed when the user's limb is close to the electronic device or camera.

[0070] Figure 3 A flow chart of a display control method according to an embodiment of the present disclosure is shown. Figure 3 ,like Figure 3As shown, a display control method includes:

[0071] Step S301 : In response to a target event, determining a positional relationship between a target operating object and an electronic device.

[0072] Step S302: determining a target interactive control set that matches the target event based on the position relationship.

[0073] The specific implementation details of step S301-step S302 are similar to those of step S101-step S102 and will not be repeated here.

[0074] Step S303, determining the display layout parameters and display appearance parameters between the interactive controls in the target interactive control set based on the position relationship; and outputting the target interactive control set display to the target interactive area in the target display screen and / or virtual display area of the electronic device based on the display layout parameters and display appearance parameters.

[0075] In this embodiment, the display layout parameters and display appearance parameters of the interactive controls in the target interactive control set can be determined based on the positional relationship between the target operating body and the electronic device. The display layout parameters include the display position of each interactive control and the positional relationship between different interactive controls. The display appearance parameters include display color, weight, font, whether the display is dynamic or static, transparency, etc. In one example, the display layout parameters and display appearance parameters of a virtual keyboard can be determined based on the relative position between the user's fingers and the touch screen. For example, the positions of the user's two index fingers can be determined as the positions of "F" and "J" on the virtual keyboard, thereby determining the display positions of all keys on the virtual keyboard and determining that the borders of the "F" and "J" keys are displayed in bold. In another example, the display layout parameters and display appearance parameters of 3D virtual interactive controls can be determined based on the distance between the user's limb and the camera. For example, when the distance between the user's limb and the electronic device or camera is far, the display positions of the 3D virtual interactive controls are dispersed and the display size is large. When the distance between the user's limb and the electronic device or camera is close, the display positions of the 3D virtual interactive controls are concentrated and the display size is large.

[0076] In this embodiment, the target interactive control set can be displayed and outputted to a target interactive area within a target display screen and / or a virtual display area of the electronic device based on the display layout parameters and the display appearance parameters. The target interactive area can be the entire area or a portion of the touch display screen, the pressure display screen, or the 3D display screen. For example, based on the display layout parameters and the display appearance parameters, a virtual keyboard can be displayed on the left side of the touch display screen with the borders of the "F" and "J" keys of the virtual keyboard bolded, or a 3D virtual interactive control can be displayed in the center area of the 3D display screen.

[0077] In another embodiment, the “determining display layout parameters and display appearance parameters between interactive controls in the target interactive control set based on the position relationship” in step S303 includes at least one of the following:

[0078] Determining display layout parameters and display appearance parameters of various components of a target virtual keyboard and / or target virtual touchpad based on the coordinate positions of a user's finger and / or palm on a touchscreen display of the electronic device, wherein the display appearance parameters of a first key and a second key in the virtual keyboard are different from those of other keys. The first key and the second key in the virtual keyboard may be the "F" and "J" keys of the virtual keyboard. The display layout parameters and display appearance parameters between the various parts of the target virtual keyboard and / or target virtual touchpad can be determined based on the coordinate positions of the user's fingers and / or palm on the touch display screen of the electronic device. For example, the positions of the user's two index fingers on the touch display screen of the electronic device can be determined as the positions of "F" and "J" in the virtual keyboard, and the display positions of all the keys of the virtual keyboard can be determined in combination with the key layout information of the virtual keyboard, and the borders of the "F" and "J" keys can be determined to be displayed in bold, thereby facilitating the user to locate the "F" and "J" keys and improving the user's interaction efficiency and interaction accuracy; the display layout parameters of the virtual keyboard can also be determined based on the positions of the user's two index fingers on the touch display screen of the electronic device and the distance between the touch points corresponding to different fingers of the user. For example, if the distance between the touch points corresponding to different fingers of the user is large, it is determined that the key size of the virtual keyboard is large and the distance between the keys is large.

[0079] Determine the display layout parameters and display appearance parameters between each part of any one of the target virtual keyboard, target virtual touchpad, target virtual writing pad, and target virtual drawing pad based on a first positional relationship between the target input device and the touch display screen of the electronic device. The target input device may be a stylus, a physical keyboard or touchpad, a mobile phone or tablet connected to the electronic device, or other devices; the first positional relationship may be that the stylus is suspended within a certain distance above the touch display screen of the electronic device, the physical keyboard / touchpad covers the touch display screen, or the mobile phone or tablet covers the touch display screen, etc. Determine the display layout parameters and display appearance parameters between each part of any one of the target virtual keyboard, target virtual touchpad, target virtual writing pad, and target virtual drawing pad based on the first positional relationship between the target input device and the touch display screen of the electronic device. For example, if the physical keyboard covers the touch display screen, determine the display position of the corresponding target virtual touchpad to be the area of the touch display screen that is not covered by the physical keyboard.

[0080] The display layout parameters and display appearance parameters of the target three-dimensional interactive controls of the electronic device are determined based on the relative position between the target limb and the electronic device. For example, when the distance between the user's limb and the electronic device or camera is far, the display positions of the 3D virtual interactive controls are determined to be dispersed and the display size is large. When the distance between the user's limb and the electronic device or camera is close, the display positions of the 3D virtual interactive controls are determined to be concentrated and the display size is large.

[0081] In another embodiment, a display control method further includes at least one of the following:

[0082] The electronic device detects a degree of match between a first key and a second key on a virtual keyboard and a first finger and a second finger of a target user, and adjusts display layout parameters and / or display appearance parameters of the virtual keyboard based on the degree of match. The first key and the second key correspond to the first finger and the second finger of the target user, respectively. The first key and the second key can be the "F" and "J" keys of the virtual keyboard, and the first finger and the second finger can be the user's left index finger and the right index finger. The degree of match between the first key and the second key and the first finger and the target user's first finger and the second finger includes the proportion of the "F" and "J" keys of the virtual keyboard covered by the user's left index finger and the right index finger. Based on the degree of match, adaptive adjustment of the overall size or partial size of the virtual keyboard, such as proportional scaling or non-proportional scaling, can be determined. For example, if the proportion of the "F" and "J" keys covered by the user's left index finger and the right index finger is greater than 90%, the virtual keyboard is considered to be too small and may be subject to accidental touches. Therefore, the virtual keyboard can be proportionally enlarged so that the proportion of the "F" and "J" keys covered by the user's left index finger and the right index finger is between 60% and 80%.

[0083] In response to obtaining a third operation trajectory acting on the virtual keyboard of the electronic device, the display layout parameters and / or display appearance parameters of the virtual keyboard are adjusted. The third operation trajectory can be an outward or inward movement of two fingers, and the virtual keyboard can be enlarged or reduced based on the third operation trajectory.

[0084] Based on the interactive operation data between the user's finger and the virtual keyboard of the electronic device, the virtual keyboard is controlled to update or not update its display position on the touch screen of the electronic device. The interactive operation data represents the historical input operation of the user's finger on the virtual keyboard. If the interactive operation data shows that the user's finger or palm has not left the virtual keyboard or the user's finger or palm has input action on the virtual keyboard within a certain period of time, then there is no need to update the display position of the virtual keyboard on the touch screen of the electronic device. If the user's finger or palm has not input action on the virtual keyboard within a certain period of time, the display position of the virtual keyboard needs to be re-determined. When the camera of the electronic device is in the open permission, it can determine whether the user has left the screen. If the user has left the screen range and the user re-awakens the virtual keyboard, the display position of the virtual keyboard needs to be re-determined to adapt to the movement of the user's finger or palm, thereby ensuring the adaptability and accuracy of the virtual keyboard.

[0085] In another embodiment, a display control method further includes at least one of the following:

[0086] In response to the target operating body and the key on the virtual keyboard touching an area greater than a first threshold and the duration of the touch being less than a second threshold, the key on the virtual keyboard is triggered for input. That is, if the area of the user's finger touching the key on the virtual keyboard is greater than the first threshold and the duration of the touch being less than the second threshold, it is confirmed that the user has input into the key, thereby triggering input into the key. For example, if the area of the user's finger touching the "A" key on the virtual keyboard is greater than 70% and the touch is retained for less than 2 seconds, input into the "A" key is triggered.

[0087] In response to the touch area between the target operating body corresponding to the target key and the target key being greater than a first threshold and the touch dwelling duration being greater than a second threshold, touch input on the virtual keyboard is suspended for the touch dwelling duration. The target keys may be the "F" and "J" keys on the virtual keyboard. If the touch area of the "F" and "J" keys by both the user's left and right index fingers exceeds 70% and the touch dwelling duration is greater than 2 seconds, it is considered that the user is resting their hand on the virtual keyboard. At this time, touch input on the virtual keyboard is suspended, preventing the user from continuing to input the corresponding key while their hand is resting on the virtual keyboard, thereby improving the user experience.

[0088] In order to facilitate the understanding of a display control method in the present disclosure, the following is based on Figure 4-Figure 7 A display control method in the present disclosure is explained:

[0089] Figure 4 A schematic diagram showing a display control method according to an embodiment of the present disclosure Figure 1 ; Figure 5 A schematic diagram showing a display control method according to an embodiment of the present disclosure Figure 2; Figure 6 A schematic diagram showing a display control method according to an embodiment of the present disclosure Figure 3 ; Figure 7 A schematic diagram showing a display control method according to an embodiment of the present disclosure Figure 4 Taking the target interactive control as a virtual keyboard as an example, the display appearance parameters of the virtual keyboard can be as follows: Figure 4 , the borders of the "F" and "J" keys are displayed in bold to facilitate the user to locate the "F" and "J" keys, thereby improving the user's interaction efficiency and interaction accuracy; if the touch sensor and / or pressure sensor senses that both hands of the user are on the touch screen, the positions of the two index fingers of the user on the touch screen of the electronic device are determined as the positions of "F" and "J" in the virtual keyboard, and the display positions of all the keys of the virtual keyboard are determined in combination with the key layout information of the virtual keyboard, so as to display the virtual keyboard, such as Figure 5 As shown, after the position of the virtual keyboard automatically adapts to the position of the user's finger, the electronic device can also vibrate or emit a prompt sound to remind the user that the virtual keyboard is ready; if the touch sensor and / or pressure sensor senses that only the user's left hand is on the touch screen, the position of the user's left index finger on the touch screen of the electronic device can be determined as the position of "F" in the virtual keyboard, and the display positions of all the keys of the virtual keyboard can be determined in combination with the key layout information of the virtual keyboard, so that the virtual keyboard can be displayed on the left side of the touch screen, which can adapt to shrinking the virtual keyboard to facilitate the user's left-hand operation, such as Figure 6 As shown; if the touch sensor and / or pressure sensor senses that only the user's right hand is on the touch screen, the position of the user's right index finger on the touch screen of the electronic device can be determined as the position of "J" in the virtual keyboard, and the display positions of all keys of the virtual keyboard can be determined in combination with the key layout information of the virtual keyboard, so that the virtual keyboard can be displayed on the right side of the touch screen, which can adapt to shrinking the virtual keyboard to facilitate the user's right-hand operation, such as Figure 7 shown.

[0090] In order to facilitate the understanding of a display control method in the present disclosure, the following is based on Figures 8-12 A display control method in the present disclosure is explained:

[0091] Figure 8 A schematic diagram showing a display control method according to an embodiment of the present disclosure Figure 5 ; Figure 9 A schematic diagram showing a display control method according to an embodiment of the present disclosure Figure 6 ; Figure 10 A schematic diagram showing a display control method according to an embodiment of the present disclosure Figure 7 ; Figure 11 A schematic diagram showing a display control method according to an embodiment of the present disclosure Figure 8 ; Figure 12 A schematic diagram showing a display control method according to an embodiment of the present disclosure Figure 9 . Take the target interactive control as a virtual keyboard as an example, Figure 8 As shown, the user places his hand on the touch screen of the electronic device, and the touch screen detects the position relationship between the user's finger and the touch screen; Figure 9 As shown, the touch screen detects the positional relationship between the user's left and right index fingers and the touch screen, and determines the positional relationship between the user's left and right index fingers and the touch screen as the positions of the "F" and "J" keys in the virtual keyboard respectively; Figure 10 As shown in FIG, if the user has small hands, the electronic device determines the positions of other keys in the virtual keyboard based on the positions of the "F" and "J" keys in the virtual keyboard and the distance between adjacent fingers of the user. That is, the electronic device can determine a small virtual keyboard adapted to the user's palm based on the size of the user's palm, such as Figure 10 The distance between the left and right edges of the virtual keyboard and the left and right edges of the touch screen is large, which proves that the virtual keyboard is small; Figure 11 As shown in FIG, if the user has a large hand, the electronic device determines the positions of other keys in the virtual keyboard based on the positions of the "F" and "J" keys in the virtual keyboard and the distance between adjacent fingers of the user. That is, the electronic device can determine a large virtual keyboard adapted to the user's palm based on the size of the user's palm, such as Figure 11 The distance between the left and right edges of the virtual keyboard and the left and right edges of the touch screen is small, which proves that the virtual keyboard is large; Figure 12 As shown, if the user is not satisfied with the virtual keyboard determined by the electronic device, the user can shrink or enlarge the virtual keyboard by retracting or extending the index finger and thumb to ensure the accuracy of the virtual keyboard, such as Figure 12 The small virtual keyboard on the left side of the center panel can be adjusted to a large virtual keyboard on the right side by extending the user's index finger and thumb. The large virtual keyboard on the right side can also be adjusted to a small virtual keyboard on the left side by retracting the user's index finger and thumb. The electronic device can also record the user's commonly used virtual keyboard size and subsequently adapt the keyboard to the appropriate size based on the user's commonly used virtual keyboard size, further improving the user experience.

[0092] Figure 13 The structure of an electronic device according to an embodiment of the present disclosure is shown. Figure 1 ,like Figure 13 As shown, an electronic device includes a first body 10 and a second body 20. The first surface of the first body 10 is provided with a first display screen 11, and the second surface of the second body 20 is provided with a second display screen 21. The first body 10 and the second body 20 can rotate relative to each other so that the electronic device has different postures;

[0093] The electronic device further includes a processor and a memory provided in the first body 10 and / or the second body 20; wherein the memory stores instructions executable by the processor, and the instructions are executed by the processor to enable the processor to perform at least one of the following operations:

[0094] In response to the target event, determining a positional relationship between the target operating body and the second display screen 21;

[0095] Determine a target interactive control set that matches the target event based on the position relationship;

[0096] Controlling the target interactive area in the second display screen 21 to output a target interactive control set according to target display parameters;

[0097] The target interaction control set can generate target data for interacting with the electronic device in response to a target operation from a target operator.

[0098] In another embodiment, the target control set includes at least a portion of a virtual keyboard, and the processor is further capable of performing at least one of the following operations:

[0099] When the second display screen 21 displays a target virtual keyboard that matches the user's finger and / or palm, the first display screen 11 is controlled to mirror and display at least a portion of the target virtual keyboard and / or the user's finger-triggered operation data for the target virtual keyboard. The mirrored display can be displayed with varying degrees of transparency. This prevents the user from looking down at the second display screen 21, allowing the user input process to be displayed directly on the first display screen 11, facilitating user input and improving input efficiency.

[0100] In response to obtaining a third operation trajectory acting on the virtual keyboard, the display layout parameters and / or display appearance parameters of the virtual keyboard are adjusted. The third operation trajectory can be an outward or inward movement of two fingers, and the virtual keyboard can be enlarged or reduced based on the third operation trajectory.

[0101] The spatial environment data and usage scenario data of the electronic device are obtained, and the display layout parameters and / or display appearance parameters of the virtual keyboard are adjusted based on the spatial environment data and / or usage scenario data. The spatial environment data may include indoor or outdoor, light and dark, etc., and the usage scenario data may include normal text input, privacy data input, etc. The display layout parameters and / or display appearance parameters of the virtual keyboard may be adjusted based on the spatial environment data and usage scenario data of the electronic device. For example, if the electronic device is used for privacy data input, the key layout of the virtual keyboard needs to be readjusted and the keys of the virtual keyboard need to be shuffled; if the electronic device is in a relatively dark environment, the brightness of the virtual keyboard may be reduced to facilitate user viewing.

[0102] According to an embodiment of the present disclosure, the present disclosure also provides an electronic device and a readable storage medium.

[0103] Figure 14 A schematic block diagram of an example electronic device 800 that can be used to implement embodiments of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital assistants, cellular phones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are provided as examples only and are not intended to limit the implementation of the present disclosure described and / or claimed herein.

[0104] like Figure 14 As shown, the device 800 includes a computing unit 801, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 802 or a computer program loaded from a storage unit 808 into a random access memory (RAM) 803. Various programs and data required for the operation of the device 800 can also be stored in the RAM 803. The computing unit 801, the ROM 802, and the RAM 803 are connected to each other via a bus 804. An input / output (I / O) interface 805 is also connected to the bus 804.

[0105] Various components in device 800 are connected to I / O interface 805, including an input unit 806, such as a keyboard, mouse, etc.; an output unit 807, such as various types of displays, speakers, etc.; a storage unit 808, such as a magnetic disk, optical disk, etc.; and a communication unit 809, such as a network card, modem, wireless communication transceiver, etc. The communication unit 809 allows device 800 to exchange information / data with other devices via a computer network such as the Internet and / or various telecommunication networks.

[0106] The computing unit 801 can be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 801 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units that run machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The computing unit 801 performs the various methods and processes described above, such as a display control method. For example, in some embodiments, a display control method can be implemented as a computer software program that is tangibly contained in a machine-readable medium, such as a storage unit 808. In some embodiments, part or all of the computer program can be loaded and / or installed on the device 800 via the ROM 802 and / or the communication unit 809. When the computer program is loaded into the RAM 803 and executed by the computing unit 801, one or more steps of the display control method described above can be performed. Alternatively, in other embodiments, the computing unit 801 can be configured to perform a display control method by any other appropriate means (e.g., by means of firmware).

[0107] Various embodiments of the systems and techniques described herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), system-on-chip systems (SOCs), programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include being implemented in one or more computer programs that are executable and / or interpreted on a programmable system that includes at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0108] The program code for implementing the method of the present disclosure can be written in any combination of one or more programming languages. These program codes can be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device so that when the program code is executed by the processor or controller, the functions / operations specified in the flow chart and / or block diagram are implemented. The program code can be executed entirely on the machine, partially on the machine, as a stand-alone software package, partially on the machine and partially on a remote machine, or entirely on a remote machine or server.

[0109] In the context of the present disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in conjunction with an instruction execution system, device or equipment. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0110] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying a location to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0111] The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network (LAN), a wide area network (WAN), and the Internet.

[0112] A computer system may include a client and a server. The client and server are generally remote from each other and typically interact through a communication network. The client-server relationship arises through computer programs running on the respective computers and having a client-server relationship with each other. The server may be a cloud server, a server in a distributed system, or a server integrated with a blockchain.

[0113] It should be understood that the various forms of the processes shown above can be used to reorder, add, or delete steps. For example, the steps described in this disclosure can be performed in parallel, sequentially, or in a different order, as long as the desired results of the technical solutions disclosed in this disclosure can be achieved. This is not a limitation herein.

[0114] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features being referred to. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. Throughout the present disclosure, "plurality" means two or more, unless otherwise specifically defined.

[0115] The above description is merely a specific embodiment of the present disclosure, but the scope of protection of the present disclosure is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this disclosure should be included in the scope of protection of the present disclosure. Therefore, the scope of protection of the present disclosure should be based on the scope of protection of the claims.

Claims

1. A display control method, comprising: In response to the target event, determining a positional relationship between the target operating object and the electronic device; Determine a target interactive control set matching the target event based on the position relationship; Controlling the target interactive area to output the target interactive control set with target display parameters; The target interaction control set can generate target data for interacting with the electronic device in response to a target operation from the target operator.

2. The method according to claim 1, wherein Determining the positional relationship between the target operating object and the electronic device includes: Obtaining sensing data of the target operating body by a target sensing component of the electronic device, and determining a positional relationship between the target operating body and a target interactive component of the electronic device based on the sensing data; and / or, The target event is generated from at least one of the following: In response to detecting that a user's finger and / or palm is placed on a touch display screen of the electronic device; In response to detecting that a user's limb enters an image capture area of the electronic device; In response to detecting that the target input device has a first positional relationship with the touch display screen of the electronic device; In response to obtaining a first instruction to invoke a virtual keyboard and / or a virtual touchpad of the electronic device; In response to obtaining a first operation trajectory acting on a touch display screen and / or a touch pad of the electronic device; In response to obtaining a second operation trajectory acting on the spatial interaction area of the electronic device.

3. The method according to claim 2, wherein: Determining a positional relationship between the target operating object and a target interactive component of the electronic device based on the sensing data includes at least one of the following: Obtaining configuration information of the target interactive component, and determining the positional relationship based on the sensing data and the configuration information; Obtaining touch data of a user's finger and / or palm sensed by touch sensing electrodes of a touch display screen of an electronic device, and determining the coordinate position of the finger and / or palm on the touch display screen based on the touch data; Obtaining pressure data of a user's finger and / or input pen sensed by a pressure sensor of a pressure screen of an electronic device, and determining a coordinate position of the user's finger and / or input pen on the pressure screen based on the pressure data; Image data of a user's limb collected by an image sensor of a three-dimensional display screen of an electronic device is obtained, and a relative position between the user's limb and the three-dimensional display screen is determined based on the image data.

4. The method according to any one of claims 1 to 3, wherein determining a target interactive control set matching the target event based on the position relationship comprises at least one of the following: determining, based on the source information of the target event, a type of interactive control enabled by the electronic device in response to the target event, and determining a target interactive control set from the enabled interactive controls based on the positional relationship; and / or, A target interactive control set is determined based on the position relationship and the attribute information of the target operating object.

5. The method according to claim 4, wherein Determining a target interactive control set from the enabled interactive controls based on the positional relationship includes at least one of the following: When a user's finger and / or palm is detected to be placed on a touch display screen of the electronic device, enabling at least a portion of a virtual keyboard and / or a virtual touchpad as the target interactive control set based on the sensed coordinate positions of the user's finger and / or palm on the touch display screen; In a case where it is detected that the target input device has a first positional relationship with the touch display screen of the electronic device, enabling, based on the first positional relationship, interactive controls that match the attribute information of the target input device as the target interactive control set; When an instruction or operation trace for invoking a virtual keyboard and / or a virtual touchpad of an electronic device is obtained, at least part of the keys of the virtual keyboard and / or at least part of the area of the virtual touchpad is used as the target interactive control set; When it is detected that a user's limb enters the image acquisition area of the electronic device, at least part of the three-dimensional interactive controls of the electronic device is used as the target interactive control set based on the relative position between the user's limb and the electronic device.

6. The method according to claim 1 or 5, wherein: Controlling the target interactive area to output the target interactive control set with target display parameters includes: Determining display layout parameters and display appearance parameters between the interactive controls in the target interactive control set based on the positional relationship; The target interactive control set is displayed and outputted to a target interactive area in a target display screen and / or a virtual display area of the electronic device based on the display layout parameters and the display appearance parameters.

7. The method according to claim 6, wherein determining the display layout parameters and display appearance parameters between the interactive controls in the target interactive control set based on the positional relationship comprises at least one of the following: Determine the display layout parameters and display appearance parameters between various parts of the target virtual keyboard and / or target virtual touchpad based on the coordinate positions of the user's fingers and / or palms on the touch display screen of the electronic device, wherein: The display appearance parameters of the first and second keys in the virtual keyboard are different from those of other keys; Determining display layout parameters and display appearance parameters between respective parts of any one of a target virtual keyboard, a target virtual touchpad, a target virtual writing pad, and a target virtual drawing pad based on a first positional relationship between the target input device and the touch display screen of the electronic device; Display layout parameters and display appearance parameters between target three-dimensional interactive controls of the electronic device are determined based on the relative position between the target limb and the electronic device.

8. The method according to claim 7, further comprising at least one of the following: detecting a degree of matching between a first key and a second key in a virtual keyboard of the electronic device and a first finger and a second finger of a target user, and adjusting a display layout parameter and / or a display appearance parameter of the virtual keyboard based on the degree of matching; In response to obtaining a third operation trajectory acting on a virtual keyboard of the electronic device, adjusting display layout parameters and / or display appearance parameters of the virtual keyboard; Based on the interactive operation data between the user's finger and the virtual keyboard of the electronic device, the virtual keyboard is controlled to update or not update the display position on the touch display screen of the electronic device.

9. An electronic device comprising a first body and a second body, wherein a first display screen is provided on a first surface of the first body and a second display screen is provided on a second surface of the second body, and the first body and the second body are capable of relative rotation so that the electronic device has different postures; The electronic device further includes a processor and a memory provided in the first body and / or the second body; wherein, The memory stores instructions that are executable by the processor, and the instructions are executed by the processor to enable the processor to perform at least one of the following operations: In response to a target event, determining a positional relationship between a target operating body and the second display screen; Determine a target interactive control set matching the target event based on the position relationship; Controlling the target interactive area in the second display screen to output the target interactive control set according to target display parameters; The target interaction control set can generate target data for interacting with the electronic device in response to a target operation from the target operator.

10. The electronic device according to claim 9, wherein the target control set includes at least part of a virtual keyboard, and the processor is further capable of performing at least one of the following operations: When the second display screen displays a target virtual keyboard matching the user's finger and / or palm, controlling the first display screen to map and display at least a portion of the target virtual keyboard and / or operation data of the user's finger triggering the target virtual keyboard; In response to obtaining a third operation trajectory acting on the virtual keyboard, adjusting display layout parameters and / or display appearance parameters of the virtual keyboard; The spatial environment data and usage scenario data of the electronic device are obtained, and the display layout parameters and / or display appearance parameters of the virtual keyboard are adjusted based on the spatial environment data and / or usage scenario data.

Images