Shoulder key control method, graphical interface and related device

By detecting the device shape in terminal electronic devices and using shoulder keys to control the display screen of the folded screen, the problem of limitations in the application scenario of shoulder keys is solved, and flexible operation and convenient interaction are achieved in different forms.

CN119065573APending Publication Date: 2024-12-03HUAWEI TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202310648313.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-06-01
Publication Date
2024-12-03

AI Technical Summary

Technical Problem

The application scenarios of shoulder keys in terminal electronic devices are relatively limited and can only be used to realize fixed functions and lack scalability.

Method used

By detecting different device forms in electronic devices, using shoulder keys to control different display screens of folded screens, expanding the application scenarios of shoulder keys, including controlling the display screen and application windows in the semi-folded, fully expanded and folded states. , adjust the brightness, volume, focal length and other parameters of the display screen.

Benefits of technology

It realizes flexible operation through shoulder keys under different device forms, expands the application scenarios of shoulder keys, and improves the convenience of interaction between users and electronic devices.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119065573A_ABST
    Figure CN119065573A_ABST
Patent Text Reader

Abstract

The invention discloses a shoulder key control method, a graphical interface and a related device.The method is applied to electronic equipment comprising a folding screen, a first shoulder key and a second shoulder key, the folding screen comprises a first display screen and a second display screen, the first shoulder key is located on the side edge of the first display screen, and the second shoulder key is located on the side edge of the second display screen. If the electronic equipment detects that the folding screen is in the semi-folding state, the electronic equipment can respectively control the first display screen and the second display screen through the first shoulder key and the second shoulder key. Visibly, different display screens can be controlled without shoulder keys in combination with the device form of the electronic device, the application scene of the shoulder keys is expanded, and more convenient operation is provided for interaction between a user and the electronic device.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of terminals, and in particular to a shoulder key control method, a graphical interface and related devices. Background Art

[0002] Shoulder keys are shoulder keys, which first appeared as keys on game controllers, and later gradually became keys on the side of mobile phones, tablets and other terminal electronic devices. In terminal electronic devices, the shoulder keys can be used to turn off the screen, turn on the screen, turn on and off the phone, and so on. It can be seen that shoulder keys are widely used in terminal electronic devices. But at the same time, it can also be seen that the application of shoulder keys in terminal electronic devices is very limited, and can only be used to realize some fixed functions.

[0003] Therefore, how to expand the application scenarios of shoulder keys is a problem that needs to be solved urgently. Summary of the invention

[0004] The present application provides a shoulder key control method, a graphical interface and related devices, which realize the combination of the device form of the electronic device, control different display screens through different shoulder keys, and expand the application scenarios of the shoulder keys.

[0005] In a first aspect, the present application provides a shoulder key control method, which is applied to an electronic device including a folding screen, a first shoulder key and a second shoulder key, the folding screen including a first display screen and a second display screen, the first shoulder key is located on the side of the first display screen, and the second shoulder key is located on the side of the second display screen, the method comprising: the electronic device detects that the folding screen is in a semi-folded state; the electronic device detects a first operation acting on the first shoulder key, controls the first display screen, and does not control the second display screen; the electronic device detects a second operation acting on the second shoulder key, controls the second display screen, and does not control the first display screen.

[0006] The method provided in the first aspect can be implemented in combination with the device form of the electronic device. When the electronic device is in a semi-folded state, different display screens can be controlled by different shoulder keys, thereby expanding the application scenarios of the shoulder keys and providing more convenient operation for the interaction between the user and the electronic device.

[0007] In combination with the first aspect, in one implementation, the method also includes: the electronic device detects that the folding screen is in a fully unfolded state; the electronic device detects a third operation acting on the first shoulder key and / or the second shoulder key, and controls the folding screen.

[0008] That is to say, when the electronic device is in the fully unfolded state, the electronic device can control the folding screen formed by combining the first display screen and the second display screen through the first shoulder key and / or the second shoulder key.

[0009] In combination with the first aspect, in one implementation, the method also includes: the electronic device detects that the folding screen is in a fully expanded state, and multiple application windows are displayed on the folding screen; the electronic device detects a fourth operation acting on the first shoulder key, and controls a first application window among the multiple application windows; the electronic device detects a fifth operation acting on the second shoulder key, and controls a second application window among the multiple application windows.

[0010] It can be seen that when the electronic device is in a fully expanded state and displays multiple application windows, the electronic device can control the content in different application windows through different shoulder keys.

[0011] In combination with the first aspect, in one implementation method, the electronic device controls the first application window, specifically including: the electronic device adjusts the corresponding adjustment object in the first application window; the electronic device controls the second application window, specifically including: the electronic device adjusts the corresponding adjustment object in the second application window; wherein the adjustment object includes any one of the following: display brightness, volume, focal length, page sliding progress, video playback progress, focal length, aperture value, exposure or shutter time.

[0012] That is to say, the electronic device can adjust the corresponding adjustment object in the application window by operating the shoulder keys, thereby facilitating the user's operation.

[0013] In combination with the first aspect, in one implementation, the electronic device also includes: a third display screen, the third display screen is located on the back of the first display screen or the second display screen, and the method also includes: the electronic device detects that the folding screen is in a folded state, wherein the first display screen and the second display screen in the folded state are face to face; the electronic device detects a sixth operation acting on the first shoulder key and / or the second shoulder key, and controls the third display screen.

[0014] That is to say, when the electronic device is an inward-folding folding screen device, when the electronic device is in the folded state, the electronic device can control the third display screen through the first shoulder key and / or the second shoulder key.

[0015] In combination with the first aspect, in one implementation, the method also includes: the electronic device detects that the folding screen is in a folded state, wherein the first display screen and the second display screen in the folded state are back to back in contact with each other; the electronic device detects a seventh operation acting on the first shoulder key and / or the second shoulder key, and controls the first display screen or the second display screen.

[0016] That is to say, when the electronic device is an outward-folding folding screen device, when the electronic device is in a folded state, the electronic device can control the first display screen or the second display screen through the first shoulder key and / or the second shoulder key.

[0017] In combination with the first aspect, in one implementation method, the control includes adjusting the corresponding adjustment object in the display screen controlled by the electronic device; wherein the adjustment object includes any one of the following: display screen brightness, volume, focal length, page sliding progress, video playback progress, focal length, aperture value, exposure or shutter time.

[0018] In combination with the first aspect, in one implementation, the adjustment object is related to a page displayed on a display screen controlled by the electronic device.

[0019] Exemplarily, when the page displayed on the display screen controlled by the electronic device is a video playback page, the adjustment object may refer to the video playback progress or the video volume; when the page displayed on the display screen controlled by the electronic device is a photo taking page, the adjustment object may refer to the focal length, aperture value, exposure or shutter time; when the page displayed on the display screen controlled by the electronic device is a long page, the adjustment object may refer to the page sliding progress; when the page displayed on the display screen controlled by the electronic device is other pages other than the above pages, the adjustment object may refer to the display screen brightness or the device volume, etc.

[0020] In combination with the first aspect, in one implementation, the control includes displaying a precision adjustment interface on a display screen controlled by the electronic device; the method also includes: the electronic device detects an eighth operation acting on the precision adjustment interface; the electronic device adjusts the precision of the first shoulder key and / or the second shoulder key.

[0021] That is, the user can quickly open the precision adjustment interface by operating the shoulder keys, and the user can adjust the precision of the shoulder keys through the precision adjustment interface.

[0022] In combination with the first aspect, in one implementation, when the folding screen is in a fully expanded state, the first shoulder key and the second shoulder key are physically spliced ​​together, and the third operation is used to adjust the corresponding adjustment object in the folding screen; when the first shoulder key and the second shoulder key are touch keys, the third operation includes a sliding operation within the range of the touch screen where the first shoulder key and the second shoulder key are spliced ​​together; when the first shoulder key and the second shoulder key are mechanical keys, the third operation includes pressing or sliding operations at the first end of the first shoulder key or the second end of the second shoulder key.

[0023] That is, when the electronic device is in the fully unfolded state, the first shoulder key and the second shoulder key can be physically spliced ​​together, and when the first shoulder key and the second shoulder key are used as one shoulder key, the distance of the user's sliding can include the range of the touch screen where the first shoulder key and the second shoulder key are spliced ​​together, or the range of the user's shoulder key can include the first shoulder key and the second shoulder key. In this way, the user's operable range on the shoulder key is expanded, making it more convenient for the user to control the electronic device through the shoulder key.

[0024] In combination with the first aspect, in one implementation, the first shoulder key is located at an edge of the first side of the first display screen that is connected to the second display screen, and the second shoulder key is located at an edge of the first side of the second display screen that is connected to the first display screen.

[0025] In combination with the first aspect, in one implementation, the first shoulder key and the second shoulder key have different shoulder key precisions.

[0026] Among them, in some application scenarios, when the shoulder key precision of the first shoulder key and the second shoulder key is different, the user can make coarse-grained adjustments to the adjustment object through one shoulder key, and make fine-grained adjustments to the adjustment object through another shoulder key, which facilitates the user to control the adjustment of the adjustment object more flexibly.

[0027] In combination with the first aspect, in one implementation, if the folding screen is in a semi-folded state, the shoulder key precision of the first shoulder key and the second shoulder key is different; if the folding screen is in a fully unfolded state or a folded state, the shoulder key precision of the first shoulder key and the second shoulder key is the same.

[0028] That is to say, in combination with the device form of the electronic device, the precision of each shoulder key can be the same or different for different device forms, so that users can use the precision adjustment objects of the shoulder keys in different device forms to expand the application scenarios of the shoulder keys.

[0029] In a second aspect, an embodiment of the present application provides an electronic device, comprising a memory, one or more processors, and one or more programs; when the one or more processors execute the one or more programs, the electronic device implements the method described in the first aspect or any one of the implementation methods in the first aspect.

[0030] In a third aspect, an embodiment of the present application provides a computer-readable storage medium, comprising instructions, which, when executed on an electronic device, causes the electronic device to execute a method as described in the first aspect or any one of the implementations of the first aspect.

[0031] In a fourth aspect, an embodiment of the present application provides a computer program product. When the computer program product runs on a computer, it enables the computer to execute the method described in the first aspect or any one of the implementations of the first aspect.

[0032] For the beneficial effects of the second to fourth aspects, reference may be made to the description of the beneficial effects in the first aspect, and this application will not go into details here. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] Figure 1 A schematic diagram of folding a device inward or outward provided in an embodiment of the present application;

[0034] Figure 2A schematic diagram of the device configuration of an electronic device in a vertically folded configuration provided by an embodiment of the present application;

[0035] Figure 3 A schematic diagram of the device configuration of an electronic device in a horizontally folded configuration provided by an embodiment of the present application;

[0036] Figure 4A-4B A user interface related to adjusting the brightness of a display screen after the electronic device 100 provided in an embodiment of the present application detects a sliding operation acting on a shoulder key;

[0037] Figure 5A-Figure 5B The electronic device 100 provided in the embodiment of the present application is configured to adjust the video playback progress after detecting a sliding operation on a shoulder key;

[0038] Figure 6A-6D When the electronic device 100 provided in the embodiment of the present application is in a fully expanded state and displays multiple application pages at the same time, a user interface involved in an operation performed by a user on a shoulder key is detected;

[0039] Figure 7 A user interface provided in an embodiment of the present application when the electronic device 100 is in an unfolded state and the electronic device 100 detects a designated operation acting on a shoulder key;

[0040] Figure 8 A schematic diagram of the mapping relationship between the shoulder key precision and the adjustment range of the adjustment object provided in the embodiment of the present application;

[0041] Figure 9A-9B A user interface related to adjusting the brightness of a display screen after the electronic device 100 provided in an embodiment of the present application detects a sliding operation acting on a shoulder key;

[0042] Figure 10A-10B The electronic device 100 provided in the embodiment of the present application is configured to adjust the video playback progress after detecting a sliding operation on a shoulder key;

[0043] Fig.11 A user interface provided in an embodiment of the present application when the electronic device 100 is in a semi-folded state and the electronic device 100 detects a designated operation acting on a shoulder key;

[0044] Fig.12 An overall flow chart of the shoulder key control method provided in an embodiment of the present application;

[0045] Fig.13 A flow chart of a method for adjusting an adjustment object indicated on a display screen by using a shoulder key provided in an embodiment of the present application;

[0046] Fig.14A flow chart of a method for opening a precision adjustment interface through a shoulder key provided in an embodiment of the present application;

[0047] Fig.15 A schematic flow chart of another shoulder key control method provided in an embodiment of the present application;

[0048] Fig.16 A schematic diagram of the hardware structure of an electronic device 100 provided in an embodiment of the present application;

[0049] Fig.17 A circuit structure diagram of the shoulder key provided in an embodiment of the present application;

[0050] Fig.18 A software structure block diagram of the electronic device 100 provided in an embodiment of the present application. DETAILED DESCRIPTION

[0051] The technical solutions in the embodiments of the present application will be described clearly and in detail below in conjunction with the accompanying drawings. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in the text is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.

[0052] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as suggesting or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features, and in the description of the embodiments of the present application, unless otherwise specified, "plurality" means two or more.

[0053] The term "user interface (UI)" in the following embodiments of the present application refers to a medium interface for interaction and information exchange between an application or operating system and a user, which realizes the conversion between the internal form of information and the form acceptable to the user. The user interface is a source code written in a specific computer language such as Java and extensible markup language (XML). The interface source code is parsed and rendered on an electronic device, and finally presented as content that can be recognized by the user. The commonly used form of user interface is a graphical user interface (GUI), which refers to a user interface related to computer operation displayed in a graphical manner. It can be a visual interface element such as text, icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, etc. displayed on the display screen of an electronic device.

[0054] An embodiment of the present application provides a shoulder key control method, which is applied in an electronic device comprising a folding screen, shoulder key 1 and shoulder key 2, wherein the folding screen comprises display screen 1 and display screen 2, shoulder key 1 is located on the side of display screen 1, and shoulder key 2 is located on the side of display screen 2. If the electronic device detects that the folding screen is in a semi-folded state, the electronic device can control display screen 1 and display screen 2 respectively through shoulder key 1 and shoulder key 2.

[0055] It can be seen that the shoulder key control method provided in the embodiment of the present application combines the shoulder key with the device form of an electronic device including a folding screen, expands the application of the shoulder key, and enables the user to control different display screens of the device simply by operating different shoulder keys, thereby providing convenience for the user to operate the electronic device.

[0056] Furthermore, if the electronic device detects that the folding screen is in a fully unfolded state, the electronic device can control the folding screen composed of the display screen 1 and the display screen 2 through the shoulder key 1 and / or the shoulder key 2.

[0057] Furthermore, the electronic device may also include a display screen 3. If the electronic device detects that the folding screen is in a folded state, the electronic device may control the display screen 3 via the shoulder key 1 and / or the shoulder key 2. If the electronic device is an inward-folding folding screen device, the display screen 3 may be located on the back of the display screen 1 and / or the display screen 2. If the electronic device is an outward-folding folding screen device, the display screen 3 is the display screen 1 and / or the display screen 2.

[0058] In general, the shoulder key control method provided in the embodiment of the present application enables the shoulder key to have different functions when the electronic device is in different device forms, which facilitates users to control the electronic device more flexibly through the shoulder key when using the electronic device in different device forms.

[0059] The following introduces the device form of the electronic device mentioned in the embodiments of the present application.

[0060] The electronic device provided in the embodiment of the present application can be an outward folding screen device or an inward folding screen device. The outward folding screen device folds the electronic device by folding outwards, and the inward folding screen device folds the electronic device by folding inwards.

[0061] Among them, the outward folding and the inward folding can be distinguished from the direction in which the electronic device is folded when the electronic device is in the fully unfolded state. For a detailed description of the fully unfolded state, please refer to the following Figure 2 The content of (a) in .

[0062] For example, Figure 1 A schematic diagram of folding a device inwards and outwards provided in an embodiment of the present application.

[0063] in, Figure 1 (a) in the figure shows a schematic diagram of an electronic device in a fully unfolded state. Figure 1 (b) in the figure shows a schematic diagram of the electronic device being folded outward. Figure 1 (c) in the figure shows a schematic diagram of the electronic device being folded inward.

[0064] like Figure 1 As shown in (b) in the figure, outward folding means that when a user folds the device, the two display screens facing the user are folded toward the side facing away from the user, so that the two display screens are folded back to back. In this way, a larger display area for displaying images in the electronic device can be reduced to a smaller display area.

[0065] like Figure 1 As shown in (c) in the figure, inward folding means that when the user folds the device, the two display screens facing the user are further folded toward the side facing the user, so that the two display screens facing the user are folded face to face. In this way, a larger display area used for displaying images in the electronic device can be replaced with another smaller display area.

[0066] Figure 2 and Figure 3 Taking the inward-folding screen device as an example, various device forms involved in the electronic device provided in the embodiments of the present application are illustrated.

[0067] The device form of the electronic device is the form of the folding screen included in the electronic device, which may include: fully unfolded state, half-folded state, and folded state. In addition, the embodiment of the present application does not limit the folding method of the electronic device. The shoulder key control method provided in the embodiment of the present application is applicable to both outward folding folding screen devices and inward folding folding screen devices.

[0068] Figure 2The figure shows various possible device forms of an electronic device in a vertical folded state. The electronic device may include a display screen 1, a display screen 2, a display screen 3, a shoulder key 1, and a shoulder key 2. The shoulder key 1 is located on the side of the display screen 1, the shoulder key 2 is located on the side of the display screen 2, the display screen 1 and the display screen 2 are placed up and down, and the display screen 1 and the display screen 2 form a folding screen of the electronic device.

[0069] Figure 2 (a) in FIG. 1 shows the fully unfolded state of the electronic device. Figure 2 As shown in (a), in the fully unfolded state, display screen 1 and display screen 2 face the user, and the angle between display screen 1 and display screen 2 is 180°, that is, the plane where display screen 1 is located and the plane where display screen 2 is located are in the same horizontal plane.

[0070] In the fully unfolded state, the electronic device can simultaneously display images on the display screen 1 and the display screen 2. In this way, the user can view images from the display screen 1 and the display screen 2 at the same time.

[0071] Figure 2 (b) in FIG. 4 shows a semi-folded state of the electronic device. Figure 2 As shown in (b), in the semi-folded state, there is a certain angle between the plane where the display screen 1 is located and the plane where the display screen 2 is located, and the angle is greater than 0° and less than 180°.

[0072] In the half-folded state, the electronic device can display images only on display screen 1 or display screen 2. In this way, the user can only view images from display screen 1 or display screen 2. Alternatively, the electronic device can simultaneously display different images on display screen 1 and display screen 2. In this way, the user can selectively view images from display screen 1 or display screen 2 from the two display screens.

[0073] Figure 2 (c) in FIG. 4 shows the folded state of the electronic device. Figure 2 As shown in (c), in the folded state, the angle formed by the plane where the display screen 1 is located and the plane where the display screen 2 is located is 0°, and the display screen 1 and the display screen 2 are folded face to face.

[0074] In the folded state, the display screen 1 and the display screen 2 no longer face the user, and the electronic device can display images through the display screen 3. The display screen 3 can be located on the back of the display screen 1 or the back of the display screen 2.

[0075] It is understandable that in other embodiments of the present application, the fully unfolded state may also be referred to as the unfolded state, the semi-folded state may also be referred to as the hovering state, the semi-folded state, etc., and the folded state may also be referred to as the fully folded state. The embodiments of the present application do not limit the names of the device forms. In addition, it is also understandable that the electronic device may not include the display screen 3. Then, when the electronic device is in the folded state, the electronic device does not display a picture.

[0076] In addition, it should be noted that, in the embodiment of the present application, the shoulder key 1 and the shoulder key 2 can be located on the same side of the display screen and on the hinge of the electronic device (such as Figure 2 The shoulder keys 1 and 2 are located at the edge of the display screen 1 and the display screen 2, respectively. The shoulder keys 1 and 2 are located at the edge of the display screen 2 and the display screen 1. In this way, the shoulder keys 1 and 2 can be spliced ​​and separated as the electronic device is unfolded and folded.

[0077] Specifically, when the electronic device is in the fully unfolded state, see Figure 2 In (a), shoulder key 1 and shoulder key 2 can be spliced ​​together to be used as a shoulder key. In the process of folding the electronic device inward, see Figure 2 In (b), shoulder key 1 and shoulder key 2 can be separated as the folding screen folds inward, and shoulder key 1 and shoulder key 2 are used as two independent shoulder keys. After the electronic device is folded, in the folded state, shoulder key 1 and shoulder key 2 can be spliced ​​together and used as one shoulder key.

[0078] It can be seen that in Figure 2 In the device forms shown in (a)-(c), when the electronic device is in a fully unfolded state, display screen 1 and display screen 2 can be controlled by shoulder key 1 and / or shoulder key 2, wherein shoulder key 1 and shoulder key 2 can be combined into one shoulder key for use; when the electronic device is in a semi-folded state, shoulder key 1 can be used to control display screen 1, and shoulder key 2 can be used to control display screen 2; when the electronic device is in a folded state, display screen 3 can be controlled by shoulder key 1 and / or shoulder key 2, wherein shoulder key 1 and shoulder key 2 can be combined into one shoulder key for use.

[0079] Figure 3 The figure shows various possible device forms of an electronic device in a horizontally folded form. The electronic device may include a display screen 1, a display screen 2, a display screen 3, a shoulder key 1, and a shoulder key 2. The shoulder key 1 is located on the side of the display screen 1, the shoulder key 2 is located on the side of the display screen 2, the display screen 1 and the display screen 2 are placed on the left and right, and the display screen 1 and the display screen 2 form a folding screen of the electronic device.

[0080] Figure 3 (a) in the figure shows the fully unfolded state of the electronic device. Figure 3(b) shows the electronic device in a semi-folded state. Figure 3 (c) in the figure shows the folded state of the electronic device.

[0081] For details about the fully unfolded state, half-folded state, and folded state, please refer to the above Figure 2 The relevant content in will not be repeated here.

[0082] The difference is that in the horizontal folded state, the shoulder key 1 and the shoulder key 2 are respectively located in the display screen 1 and the display screen 2 away from the hinge (such as Figure 3 In this case, the shoulder key 1 and the shoulder key 2 can be spliced ​​together when the electronic device is in a folded state.

[0083] Specifically, when the electronic device is in the fully unfolded state, see Figure 3 In (a), shoulder button 1 and shoulder button 2 can be used as one shoulder button. In the process of folding the electronic device inward, see Figure 3 In (b), shoulder key 1 and shoulder key 2 can be used as two independent shoulder keys. Further optionally, after the electronic device is folded, in the folded state, shoulder key 1 and shoulder key 2 can be spliced ​​together and used as one shoulder key.

[0084] It can be seen that similar to Figure 2 Description in Figure 3 In the device forms shown in (a)-(c), when the electronic device is in a fully unfolded state, display screen 1 and display screen 2 can be controlled by shoulder key 1 and / or shoulder key 2; when the electronic device is in a semi-folded state, shoulder key 1 can be used to control display screen 1, and shoulder key 2 can be used to control display screen 2; when the electronic device is in a folded state, display screen 3 can be controlled by shoulder key 1 and / or shoulder key 2, wherein shoulder key 1 and shoulder key 2 can be combined into one shoulder key for use.

[0085] It should be understood that for an outward folding screen device, the electronic device may also have the above-mentioned Figure 2 The electronic device may also have the fully unfolded state, half-folded state, and folded state described in the horizontally folded state. Figure 3 The fully unfolded state, half-folded state, and folded state described in .

[0086] The difference is that during the outward folding process, the electronic device folds outward, and when the electronic device is folded, that is, in the folded state, the display screen 1 and the display screen 2 are back to back, and one of the display screens 1 and 2 can face the user, while the other one faces away from the user. Figure 2 (c) is for reference. When the outward-folding screen device is in a folded state, the display screen 3 shown in the electronic device may refer to the display screen 1 or the display screen 2.

[0087] Taking display screen 1 as an example, if the electronic device displays the picture through display screen 1 when it is in a folded state, then the display screen 1 can be controlled by shoulder key 1 and / or shoulder key 2. Taking display screen 2 as an example, if the electronic device displays the picture through display screen 2 when it is in a folded state, then the display screen 2 can be controlled by shoulder key 1 and / or shoulder key 2.

[0088] In the embodiment of the present application, the shoulder key may be of the following types:

[0089] 1) Touch buttons

[0090] When the shoulder key is a touch key, the electronic device can trigger the corresponding function by detecting the user's operation on the shoulder key. For example, the operation can be a touch operation, which can include: single click, double click, triple click, slide, long press, etc.

[0091] 2) Mechanical buttons

[0092] When the shoulder key is a mechanical key, the electronic device can trigger the corresponding function by detecting the user's operation on the shoulder key. For example, the operation can be a pressing operation, which can include single-click, double-click, triple-click, long-press, slide, etc.

[0093] The following example uses the shoulder buttons as touch buttons. Figure 4A-4B , Figure 5A-Figure 5B , Figure 6A-6D , Figure 7 , Figure 8 , Figure 9A-9B , Figure 10A-10B , Fig.11 The user interface involved in operating the shoulder keys of the electronic device 100 is described.

[0094] The electronic device 100 may refer to the above Figure 2 The electronic device 100 may include a display screen 1, a display screen 2, a display screen 3, a shoulder key 1 and a shoulder key 2, the shoulder key 1 is located on the side of the display screen 1, and the shoulder key 2 is located on the side of the display screen 2. The physical form of the electronic device 100 may correspond to Figure 2 , I will not go into details here.

[0095] in, Figure 4A-4B , Figure 5A-Figure 5B , Figure 6A-6D , Figure 7 The user interface shown may refer to the user interface displayed when the electronic device 100 is in the fully expanded state. For a detailed description of the fully expanded state, please refer to the aforementioned Figure 2 The relevant content of (a) in .

[0096] Figure 4A-4BThe figure shows a user interface related to adjusting the brightness of the display screen after the electronic device 100 detects a sliding operation on the shoulder key.

[0097] Figure 4A The electronic device 100 is shown opening a gallery application and displaying a user interface 10 , where the user interface 10 is used to display pictures in the gallery application.

[0098] Understandably, Figure 4A-4B Taking the gallery application as an example, the process of adjusting the brightness of the display screen based on the user's operations on the shoulder keys when the electronic device 100 displays the page of the gallery application is described. In other embodiments of the present application, the electronic device 100 can also adjust the brightness of the display screen based on the user's operations on the shoulder keys when displaying other pages, and the embodiments of the present application are not limited to this.

[0099] In addition, it is worth mentioning that when the electronic device 100 is in the unfolded state, the electronic device 100 combines the display screen 1 and the display screen 2 into one display screen for displaying images. Figure 4A It can be seen that the electronic device 100 displays the user interface 10 in a folding screen formed by the display screen 1 and the display screen 2 .

[0100] like Figure 4A As shown, when the electronic device 100 detects a user operation on the shoulder key, such as a sliding operation from top to bottom, in response to the operation, the electronic device 100 can display a brightness indicator bar 101 in the user interface 10, and the brightness indicator bar 101 indicates the brightness of the current display screen. In addition, the electronic device 100 adjusts the brightness of the display screen and the brightness indicator bar 101 according to the sliding distance of the sliding operation, that is, displays Figure 4B User interface 10 is shown.

[0101] like Figure 4B As shown, compared to Figure 4A , the brightness value indicated by the brightness indicator bar 101 is larger, and the picture displayed in the user interface 10 is brighter.

[0102] In addition, it should be noted that in the fully expanded state, the electronic device 100 can use the shoulder key 1 and the shoulder key 2 as one shoulder key to control the display screen 1 and the display screen 2 combined display screen. Figure 4A-4B In the user interface shown, the user can adjust the brightness of the display screen by sliding the shoulder key. In this case, when the electronic device 100 uses the shoulder key 1 and the shoulder key 2 as one shoulder key, the sliding range of the sliding operation performed by the user on the shoulder key can be the sliding range where the shoulder key 1 is located, or the sliding range where the shoulder key 2 is located, or Figure 4A-4BThe slide range shown includes the shoulder key 1 and the shoulder key 2. That is, in the fully expanded state, the electronic device 100 can detect the slide operation acting on the shoulder key 1 and / or the shoulder key 2, and adjust the brightness of the display screen 1 and the display screen 2 combined.

[0103] Figure 5A-Figure 5B The figure shows the relevant user interface for adjusting the video playback progress after the electronic device 100 detects a sliding operation on the shoulder key.

[0104] Figure 5A The electronic device 100 is shown opening a multimedia application and displaying a user interface 20 , which includes a video playback page for playing videos.

[0105] In addition, it is worth mentioning that when the electronic device 100 is in the unfolded state, the electronic device 100 combines the display screen 1 and the display screen 2 into one display screen for displaying images. Figure 5A It can be seen that the electronic device 100 displays the user interface 20 on the combined display screen of the display screen 1 and the display screen 2 .

[0106] like Figure 5A As shown, the user interface 20 may include: a video playing window 201 and a playing progress bar 202. The video playing window 201 is used to display the playing video screen, and the playing progress bar 202 is used to indicate the progress of the video played in the video playing window 201.

[0107] When the electronic device 100 detects a user operation on the shoulder key, such as a sliding operation from top to bottom, in response to the operation, the electronic device 100 can adjust the progress of the video played in the video playback page and display Figure 5B User interface 20 is shown.

[0108] like Figure 5B As shown, compared to Figure 5A , the video screen displayed in the video playback window 201 has changed, and the playback progress indicated by the playback progress bar 202 has moved backward.

[0109] In addition, it should be noted that similar to Figure 4A-4B According to the description in FIG. 1 , in the fully expanded state, the electronic device 100 can use the shoulder key 1 and the shoulder key 2 as one shoulder key, and the sliding range of the sliding operation acting on the shoulder key detected by the electronic device 100 can include the key range of the shoulder key 1 and the shoulder key 2. That is, in the fully expanded state, the electronic device 100 can detect the sliding operation acting on the shoulder key 1 and / or the shoulder key 2, and adjust the progress of the video displayed on the display screen combined with the display screen 1 and the display screen 2.

[0110] It can be seen that the above Figure 4A-4B , Figure 5A-Figure 5B It shows that when the electronic device 100 is in a fully expanded state and only displays one application page, the electronic device 100 can be controlled based on the user's operation on the shoulder button 1 and the shoulder button 2 combined shoulder button.

[0111] Figure 6A-6D The diagram shows the user interface involved in detecting the operation of the user on the shoulder keys when the electronic device 100 is in the fully expanded state and multiple application pages are displayed simultaneously.

[0112] Fig. 6A The user interface 30 involved in the electronic device 100 simultaneously displaying a page of a gallery application and a video playback page of a multimedia application is shown. The user interface 30 may include: a first window 301 and a second window 302. The first window 301 is used to display the video playback page of the multimedia application, and the second window 302 is used to display the page of the gallery application.

[0113] It is understandable that the embodiment of the present application does not limit the display format of the pages of multiple applications when the electronic device 100 displays the pages of multiple applications at the same time. For example, the electronic device 100 can display the application pages in the form of a full screen, or in the form of a floating window, or in the form of a split screen.

[0114] For example, in Fig. 6A In the user interface 30 shown in (a), the electronic device 100 can display the page of the gallery application in full screen form and display the video playback page of the multimedia application in a floating window form.

[0115] For example, in Fig. 6A In the user interface 30 shown in (b) in FIG. 1 , the electronic device 100 can display the page of the gallery application and the video playback page of the multimedia application in split screen.

[0116] by Fig. 6A Taking (b) in FIG. 1 as an example, when the electronic device 100 detects a user operation on a shoulder key, for example Fig. 6A In response to the downward sliding operation on the shoulder key 1 shown in (b) of FIG. 1 , the electronic device 100 can adjust the progress of the video played in the first window 301 and display Figure 6B The user interface 30 is shown.

[0117] For details about adjusting the progress of the video, please refer to the above Figure 5A-Figure 5B The relevant content in will not be repeated here.

[0118] When the electronic device 100 detects a user operation on the shoulder button, for example Figure 6CIn response to the downward sliding operation on the shoulder key 2, the electronic device 100 can adjust the brightness of the display area of ​​the second window 302 and display Fig.6D The user interface 30 is shown.

[0119] For details about the adjustment of the brightness, please refer to the above Figure 4A-4B The relevant content in will not be repeated here.

[0120] In some embodiments, when the electronic device 100 is in a fully expanded state and multiple application pages are displayed simultaneously, the shoulder key 1 and / or the shoulder key 2 can also be used to control an application page in one of the application windows. For example, the application window can be a focus window, which refers to the window that the user focused on last time, or the layer where the focus window is located is located above the layer where other windows are located. Fig. 6A Taking the user interface 30 shown in (a) as an example, assuming that the first window 301 is the focus window, the adjustment operation performed by the user on the shoulder key 1 and / or the shoulder key 2, such as a sliding operation, can be used to adjust the video playback progress in the first window 301.

[0121] from Figure 6A-6D It can be seen that in the fully expanded state, if the electronic device 100 displays multiple application windows, the electronic device 100 can use the shoulder key 1 and the shoulder key 2 as independent shoulder keys to control different application windows.

[0122] Figure 7 The figure shows a user interface 40 displayed by the electronic device 100 after detecting a designated operation on the shoulder key when the electronic device 100 is in the unfolded state. The user interface 40 is a precision adjustment interface through which the user can adjust the precision of the shoulder key.

[0123] The shoulder key accuracy is used to indicate the adjustment range of the adjustment object by the user's adjustment operation on the shoulder key. For example, the adjustment operation may refer to the aforementioned Figure 4A-4B , Figure 6C-D The sliding operation shown in the figure may refer to the brightness of the display screen, or the adjustment operation may refer to the aforementioned Figure 5A-Figure 5B , Figure 6A-6B The sliding operation shown in the figure can refer to the video playback progress. For a detailed description of the accuracy of the shoulder key, please refer to the following Figure 8 The description of will not be expanded here.

[0124] Exemplarily, the designated operation may refer to a double-click operation, a triple-click operation, a long-press operation, etc. The embodiment of the present application does not limit the designated operation.

[0125] In addition, in the expanded state, the designated operation acting on the shoulder key may refer to an operation acting on the shoulder key 1 and the shoulder key 2 combined. In this case, the electronic device 100 can determine whether to display the user interface 40 by detecting whether there is a designated operation acting on the shoulder key 1 and / or the shoulder key 2.

[0126] Exemplarily, the precision adjustment interface may be an interface in a settings application. In addition to detecting a specified operation on a shoulder key and opening the precision adjustment interface, the electronic device 100 may also detect a user's operation of opening the settings application and display the precision adjustment interface in the settings application.

[0127] like Figure 7 As shown, the user interface 40 may include an adjustment option 401. The adjustment option 401 may be used to adjust the precision of the shoulder button 1 and the shoulder button 2 at the same time.

[0128] Exemplarily, the adjustment option 401 may include an adjustment mark 401A, and the adjustment mark 401A is used to indicate the precision of the shoulder key 1 and the shoulder key 2. Further, the electronic device 100 may detect a left-right sliding operation of the user on the adjustment mark 401A, and in response to the operation, adjust the precision of the shoulder key 1 and the shoulder key 2. Wherein, when the electronic device 100 detects a left sliding operation on the adjustment mark 401A, in response to the operation, the precision of the shoulder key 1 and the shoulder key 2 is reduced, and correspondingly, when the electronic device 100 detects a right sliding operation on the adjustment mark 401A, in response to the operation, the precision of the shoulder key 1 and the shoulder key 2 is increased.

[0129] It is understandable that the electronic device 100 can also detect a sliding operation on the shoulder key 1 and / or the shoulder key 2, and adjust the precision indicated by the adjustment option 401. The embodiment of the present application does not limit the interactive method for the user to adjust the precision of the shoulder keys.

[0130] Optionally, the user interface 40 further includes: an adjustment option 402. The adjustment option 402 can be used to adjust the precision of the shoulder button 1 and the shoulder button 2 respectively.

[0131] Exemplarily, the adjustment options 402 may include: a first option 402A and a second option 402B. The first option 402A is used to indicate the accuracy of the shoulder key 1, and the electronic device 100 can detect the adjustment operation on the first option 402A to adjust the accuracy of the shoulder key 1. The second option 402B is used to indicate the accuracy of the shoulder key 2, and the electronic device 100 can detect the adjustment operation on the second option 402B to adjust the accuracy of the shoulder key 2.

[0132] It can be seen from the adjustment option 402 that the precision of shoulder key 1 and shoulder key 2 can be adjusted separately, and the precision of shoulder key 1 and shoulder key 2 can be different. In a specific example, the precision of shoulder key 2 can be higher than the precision of shoulder key 1, and shoulder key 1 and shoulder key 2 can both be used to adjust the playback progress of a video. At this time, the user can use shoulder key 1 to make a coarse-grained adjustment to the playback progress, and use shoulder key 2 to make a fine-grained adjustment to the playback progress.

[0133] In some optional embodiments, the precision of the shoulder key 1 and the shoulder key 2 indicated in the adjustment option 402 may be valid when the electronic device 100 is in a semi-folded state. In this way, when the electronic device 100 is in a semi-folded state, the shoulder key 1 and the shoulder key 2 may have different precisions. Alternatively, in some other optional embodiments, the precision of the shoulder key 1 and the shoulder key 2 indicated in the adjustment option 402 may be valid when the electronic device 100 is in a fully expanded state and multiple application windows are displayed. In this way, when the electronic device 100 is in a fully expanded state and multiple application windows are displayed, the shoulder key 1 and the shoulder key 2 may have different precisions. In addition, when the shoulder key 1 and the shoulder key 2 are combined into one shoulder key for use, for example, when the electronic device 100 is in a fully expanded state and only one application window is displayed, the precision indicated in the adjustment option 401 is valid. In this way, when the shoulder key 1 and the shoulder key 2 are used together, the precision of the shoulder key 1 and the shoulder key 2 is the same.

[0134] The shoulder key accuracy is described in detail below.

[0135] As for the shoulder buttons as touch buttons, Figure 8 A schematic diagram showing the mapping relationship between the shoulder key precision and the adjustment amplitude of the adjustment object under a sliding operation acting on the shoulder key for a certain sliding distance is shown.

[0136] Exemplarily, the adjustment object may refer to one or more of objects such as volume, brightness, video playback progress, focal length, page sliding progress, aperture value, exposure, shutter time, and the like.

[0137] from Figure 8 It can be seen that under a sliding operation of a certain sliding distance acting on the shoulder key, if the precision of the shoulder key is low, the adjustment range of the adjustment object is large, and if the precision of the shoulder key is high, the adjustment range of the adjustment object is small. In other words, the lower the precision of the shoulder key, the coarser the adjustment of the adjustment object by the sliding operation acting on the shoulder key, and the higher the precision of the shoulder key, the finer the adjustment of the adjustment object by the sliding operation acting on the shoulder key.

[0138] Taking volume as an example, suppose Figure 8The progress bar before and after the adjustment is a volume progress bar, and the sliding operation on the shoulder key can be used to adjust the volume. Then, for the sliding operation on the shoulder key with the same sliding distance, the higher the shoulder key precision, the smaller the volume adjustment amplitude, and the lower the shoulder key precision, the larger the volume adjustment amplitude. For example, when the sliding operation is used to increase the volume, if the volume before adjustment is the same, the volume after adjustment when the shoulder key precision is lower is higher than the volume after adjustment when the shoulder key precision is higher.

[0139] In the internal implementation, the electronic device 100 may pre-store a mapping relationship between the shoulder key precision and the adjustment amplitude of the adjustment object under a certain sliding distance. Assuming that the shoulder key precision has five numerical levels of 1-5, and the adjustment object has a numerical adjustment range of 0-100, the adjustment amplitude may refer to the numerical change interval of the adjustment object under a certain sliding distance. Exemplarily, the electronic device 100 may pre-store a mapping relationship as shown in Table 1 below.

[0140] Table 1

[0141] Shoulder button accuracy 1 2 3 4 5 Adjustment range 10 8 6 4 2

[0142] As can be seen from Table 1, the greater the shoulder key precision, the smaller the adjustment range of the adjustment object, and the smaller the shoulder key precision, the larger the adjustment range of the adjustment object. Assuming that a certain sliding distance is 1 mm, the shoulder key precision is 1, and the adjustment range is 10, if the electronic device 100 detects that the sliding distance acting on the shoulder key is 3 mm, the value of the adjustment object changes by 10*3=30, for example, the volume increases by 30.

[0143] It can be understood that Table 1 is only an illustrative example, and the shoulder key accuracy, the numerical adjustment range of the adjustment object, the adjustment amplitude and the sliding distance may have other numerical values. The embodiments of the present application are not limited to this, and Table 1 does not constitute a limitation on the embodiments of the present application.

[0144] Understandably, Figure 8 Taking the shoulder key as a touch key as an example, the mapping relationship between the shoulder key precision and the adjustment range of the adjustment object under the sliding operation acting on the shoulder key is described. If the shoulder key is a mechanical key, for the adjustment object with a numerical adjustment range, the user can change the value of the adjustment object by clicking or long pressing the shoulder key. In this case, the mapping relationship between different shoulder key precisions and the adjustment range of the adjustment object under the operation acting on the shoulder key can still be determined.

[0145] Assuming that a click operation on the shoulder key can trigger the adjustment of the adjustment object, in a continuous click process, the more clicks there are, the greater the value change of the adjustment object. In one click operation, if the precision of the shoulder key is low, the adjustment range of the adjustment object is large, and if the precision of the shoulder key is high, the adjustment range of the adjustment object is small.

[0146] Assuming that a long press operation on the shoulder key can trigger the adjustment of the adjustment object, during a long press process, the longer the long press operation is pressed, the greater the value change of the adjustment object. Among them, under a certain unit pressing time, if the accuracy of the shoulder key is low, the adjustment range of the adjustment object is large, and if the accuracy of the shoulder key is high, the adjustment range of the adjustment object is small.

[0147] from Figure 7 and Figure 8 It can be seen that in the fully expanded state, the electronic device 100 can display a precision adjustment interface on the combined display screen of display screen 1 and display screen 2 by acting on shoulder key 1 and / or designated operations of the shoulder key. The user can customize the shoulder key precision through the precision adjustment interface. In this way, when the user needs to fine-tune the progress bar, the shoulder key precision can be increased; when the user needs to make a fast and large progress bar, the shoulder key precision can be reduced, thereby providing a better user experience for the user to adjust parameter values ​​through the shoulder keys.

[0148] Figure 9A-9B , Figure 10A-10B The user interface shown may be a user interface displayed when the electronic device 100 is in a semi-folded state. For a detailed description of the semi-folded state, please refer to the aforementioned Figure 2 The relevant content of (b) in .

[0149] Figure 9A-9B The figure shows a user interface related to adjusting the brightness of the display screen after the electronic device 100 detects a sliding operation on the shoulder key.

[0150] Fig.9A The electronic device 100 is shown opening a gallery application and displaying a user interface 50 , where the user interface 50 is used to display pictures in the gallery application.

[0151] In addition, it is worth mentioning that when the electronic device 100 is in a semi-folded state, the electronic device 100 can display images independently on the display screen 1 and the display screen 2. In this case, the electronic device 100 can display the image on the display screen 1 or the display screen 2. Fig.9A User interface 50 is shown.

[0152] like Fig.9A As shown, when the electronic device 100 detects a user operation on the shoulder key, such as a sliding operation from left to right, in response to the operation, the electronic device 100 can adjust the brightness of the display area where the user interface 50 is located, and display Fig. 9B User interface 50 is shown.

[0153] like Fig. 9B As shown, compared to Fig.9A, the picture displayed in the user interface 50 is brighter.

[0154] Understandably, Figure 9A-9B The brightness adjustment process shown is similar to Figure 4A-4B The brightness adjustment process shown is similar. Figure 9A-9B For details not elaborated in the Figure 4A-4B The contents in will not be repeated here.

[0155] In addition, Figure 4A-4B The difference is, Figure 9A-9B The sliding operation on the shoulder key is an operation on the shoulder key 1 or the shoulder key 2 in the electronic device 100. Specifically, if the electronic device 100 displays the user interface 50 through the display screen 1, the sliding operation on the shoulder key is a sliding operation on the shoulder key 1; if the electronic device 100 displays the user interface 50 through the display screen 2, the sliding operation on the shoulder key is a sliding operation on the shoulder key 2.

[0156] Figure 10A-10B The figure shows the relevant user interface for adjusting the video playback progress after the electronic device 100 detects a sliding operation on the shoulder key.

[0157] Fig. 10A The electronic device 100 is shown opening a multimedia application and displaying a user interface 60 , where the user interface 60 is used to display a video playback page, where the video playback page is used to play a video.

[0158] In addition, it is worth mentioning that when the electronic device 100 is in a semi-folded state, the electronic device 100 can display images independently on the display screen 1 and the display screen 2. In this case, the electronic device 100 can display the image on the display screen 1 or the display screen 2. Fig. 10A User interface 60 is shown.

[0159] like Fig. 10A As shown, when the electronic device 100 detects a user operation on the shoulder key, such as a sliding operation from left to right, in response to the operation, the electronic device 100 can adjust the progress of the video played in the video playback page and display Fig. 10B User interface 60 is shown.

[0160] like Fig. 10B As shown, compared to Fig. 10A , the progress of the page played in the video playback page moved backwards.

[0161] Understandably, Figure 10A-10B The video progress adjustment process shown is the same as Figure 5A-Figure 5B The process of adjusting the video progress is similar. Figure 10A-10B For details not elaborated in the Figure 5A-Figure 5B The contents in will not be repeated here.

[0162] In addition, Figure 5A-Figure 5B The difference is, Figure 10A-10B The sliding operation on the shoulder key is an operation on the shoulder key 1 or the shoulder key 2 in the electronic device 100. Specifically, if the electronic device 100 displays the user interface 60 through the display screen 1, the sliding operation on the shoulder key is a sliding operation on the shoulder key 1; if the electronic device 100 displays the user interface 60 through the display screen 2, the sliding operation on the shoulder key is a sliding operation on the shoulder key 2.

[0163] from Figure 9A-9B , Figure 10A-10B It can be seen that when the electronic device 100 is in a semi-folded state, the electronic device 100 can display images through the display screen 1 or the display screen 2, and control the display screen 1 through the shoulder key 1, and control the display screen 2 through the shoulder key 2.

[0164] in addition, Figure 9A-9B , Figure 10A-10B Only the user interface displayed by the electronic device 100 when one of the display screens displays a picture in the semi-folded state is described. It can be understood that the other display screen may also display a picture, or be in an off state, or in a low brightness state, and the embodiments of the present application do not limit this.

[0165] Fig.11 The figure shows a user interface 70 displayed by the electronic device 100 after detecting a designated operation on the shoulder key when the electronic device 100 is in a semi-folded state. The user interface 70 is a precision adjustment interface through which the user can adjust the precision of the shoulder key.

[0166] For a detailed description of the user interface 70, please refer to the aforementioned Figure 7 For details about the accuracy of the shoulder keys, please refer to the previous Figure 8 The relevant content in will not be repeated here.

[0167] It should be noted that when the electronic device 100 is in a semi-folded state, the electronic device 100 can display the user interface 70 through the display screen 1 or the display screen 2, and the content contained in the user interface 70 can be the same as the content in the user interface 40 displayed when the electronic device 100 is in a fully unfolded state, or the content in the user interface 70 can be a part of the user interface 40. For example, the user interface 70 can only include Figure 7 One of the first option 402A or the second option 402B is shown, and the adjustment option 401 is not included.

[0168] That is, when the electronic device 100 displays the precision adjustment interface only through the display screen 1 or the display screen 2, the precision adjustment interface only provides the user with an option to adjust the precision of one of the shoulder keys. Figure 7 The first option 402A shown does not include the second option 402B and the adjustment option 401, so that the user can only adjust the accuracy of the shoulder key 1. For another example, if the electronic device 100 only displays the accuracy adjustment interface through the display screen 2, the accuracy adjustment interface may include Figure 7 The second option 402B shown does not include the first option 402A and the adjustment option 401 , so that the user can adjust the accuracy of the shoulder key 2 only.

[0169] In addition, if the precision adjustment interface is displayed on display screen 1, the designated operation acting on the shoulder key detected by the electronic device 100 may be the designated operation acting on the shoulder key 1; if the precision adjustment interface is displayed on display screen 2, the designated operation acting on the shoulder key detected by the electronic device 100 may be the designated operation acting on the shoulder key 2. That is, when the electronic device 100 is in a semi-folded state, the electronic device 100 may detect the designated operation acting on one of the shoulder keys, and display the precision adjustment interface on the display screen on the side where the shoulder key is located.

[0170] In addition, when the electronic device 100 is in the folded state, the electronic device 100 can display images through the display screen 3. For a detailed description of the folded state, please refer to the aforementioned Figure 2 The relevant contents in (c) will not be repeated here.

[0171] In this case, similar to Figure 9A-9B , Figure 10A-10B , Fig.11 In the user interface shown, the electronic device 100 can detect a sliding operation on the shoulder key and adjust the brightness of the display screen or the playback progress of the video, or detect a specified operation on the shoulder key and display the accuracy adjustment interface. Figure 9A-9B , Figure 10A-10B , Fig.11 The difference is that when the electronic device 100 displays a picture through the display screen 3, the electronic device 100 can combine the shoulder key 1 and the shoulder key 2 into one shoulder key for controlling the display screen 3. That is to say, the sliding operation acting on the shoulder key may include a sliding operation acting on the shoulder key 1 and / or the shoulder key 2, and the designated operation acting on the shoulder key may include a designated operation acting on the shoulder key 1 and / or the shoulder key 2.

[0172] Understandably, Figure 4A-4B , Figure 5A-Figure 5B , Figure 6A-6D , Figure 9A-9B , Figure 10A-10B Only the scene in which the electronic device 100 adjusts the brightness by acting on the shoulder key when displaying the gallery page, and the scene in which the video playback progress is adjusted by acting on the shoulder key when displaying the video playback page is shown. In other embodiments of the present application, the electronic device 100 may also have other scenes in which objects are adjusted by the shoulder key, and the adjustment objects may include: display brightness, volume, focal length, page sliding progress, video playback progress, focal length, aperture value, exposure or shutter time, etc., which are not limited in the embodiments of the present application. For example, when the electronic device 100 displays the settings page, the brightness can be adjusted by acting on the shoulder key, or, when the electronic device 100 displays the music playback page, the volume can be adjusted by acting on the shoulder key. The embodiments of the present application do not limit this.

[0173] In some embodiments, the object adjusted by the shoulder key can be set by the user. For example, the user can set different adjustment objects for different pages. For example, the user can set that when the electronic device 100 displays the gallery page, the adjustment operation acting on the shoulder key can be used to adjust the brightness, and when the electronic device 100 displays the music playback page, the adjustment operation acting on the shoulder key can be used to adjust the volume.

[0174] In some embodiments, the adjustment operation acting on the shoulder key can also be set by the user. For example, the user can set the adjustment operation to a sliding operation, so that when the electronic device 100 detects a sliding operation acting on the shoulder key, the electronic device 100 can be triggered to adjust the corresponding adjustment object on the display screen. For another example, the user can also set the adjustment operation to a click operation, so that when the electronic device 100 detects a click operation acting on the shoulder key, the electronic device 100 can be triggered to adjust the corresponding adjustment object on the display screen.

[0175] Fig.12 This is an overall flow chart of the shoulder key control method provided in an embodiment of the present application.

[0176] like Fig.12 As shown, the shoulder key control method may include:

[0177] S101. The electronic device 100 obtains the device form.

[0178] The electronic device 100 is a folding screen device, and the electronic device 100 may include a display screen 1, a display screen 2, a display screen 3, a shoulder key 1, and a shoulder key 2, wherein the display screen 1 and the display screen 2 constitute a folding screen of the electronic device 100. The shoulder key 1 is located on one side of the display screen 1, and the shoulder key 2 is located on one side of the display screen 2.

[0179] It should be noted that, for an outward-folding screen, display screen 3 may refer to display screen 1 or display screen 2; for an inward-folding screen, display screen 3 is located on the back of display screen 1 or display screen 2.

[0180] In the embodiment of the present application, display screen 1 can also be called the first display screen, display screen 2 can also be called the second display screen, display screen 3 can also be called the third display screen, shoulder key 1 can also be called the first shoulder key, and shoulder key 2 can also be called the second shoulder key.

[0181] The device form describes the form of the folding screen of the electronic device 100 at different opening and closing angles. The device form of the electronic device 100 may include: a fully unfolded state, a half-folded state, and a folded state.

[0182] For example, the electronic device 100 may determine the device form of the electronic device 100 by using a sensor such as a magnetic sensor or a gyroscope sensor.

[0183] For a detailed description of the device form of the electronic device 100, please refer to the aforementioned Figure 1-Figure 3 The relevant content in will not be repeated here.

[0184] According to the different device forms of the electronic device 100 , the electronic device 100 may respectively execute steps S102 , S104 and S109 .

[0185] S102. If the device state is a semi-folded state, the electronic device 100 controls the display screen 1 and the display screen 2 to display images independently.

[0186] For example, if the electronic device 100 is in a semi-folded state, the device form of the electronic device 100 can be as follows: Figure 2 (b) or Figure 3 As shown in (b) in .

[0187] The independent display of screens on display screen 1 and display screen 2 means that the electronic device 100 independently displays the display contents on display screen 1 and display screen 2, and the display contents on display screen 1 and display screen 2 do not affect each other.

[0188] In this case, the electronic device 100 can display the picture only on display screen 1, and display screen 2 is in an off state or a low brightness state, or the electronic device 100 can display the picture only on display screen 2, and display screen 1 is in an off state or a low brightness state, or the contents of different applications can be displayed on display screen 1 and display screen 2 respectively, or different pages of the same application can be displayed respectively.

[0189] For example, the picture displayed by the electronic device 100 on the display screen 1 may refer to Figure 9A-9B The user interface 50 shown, or Figure 10A-10BThe user interface 60 shown, or Fig.11 The user interface 70 shown in the figure, the screen displayed by the electronic device 100 on the display screen 2 may refer to Figure 10A-10B The user interface 60 shown, or Figure 9A-9B The user interface 50 shown, or Fig.11 User interface 70 is shown.

[0190] S103. The electronic device 100 controls the display screen 1 via the shoulder key 1 and controls the display screen 2 via the shoulder key 2.

[0191] Among them, shoulder key 1 and shoulder key 2 can be touch keys or mechanical keys, and the embodiment of the present application does not limit the type of shoulder keys.

[0192] The electronic device 100 controls the display screen 1 via the shoulder key 1 means that the electronic device 100 detects that the user operation (for example, the first operation) acting on the shoulder key 1 is used to control the display screen 1. Correspondingly, the electronic device 100 controls the display screen 2 via the shoulder key 2 means that the electronic device 100 detects that the user operation (for example, the second operation) acting on the shoulder key 2 is used to control the display screen 2.

[0193] For example, see Figure 9A-9B If the user interface 50 is a picture displayed on the display screen 1, the user can adjust the brightness of the display screen 1 by sliding the shoulder key 1. If the user interface 50 is a picture displayed on the display screen 2, the user can adjust the brightness of the display screen 2 by sliding the shoulder key 2.

[0194] For example, see Figure 10A-10B If the user interface 60 is a picture displayed on the display screen 1, the user can adjust the playback progress of the video played on the display screen 1 by sliding the shoulder button 1. If the user interface 60 is a picture displayed on the display screen 1, the user can adjust the playback progress of the video played on the display screen 2 by sliding the shoulder button 1.

[0195] For details about the specific application of the electronic device 100 controlling the display screen through the shoulder keys, please refer to the subsequent Fig.13 and Fig.14 The contents shown will not be elaborated here.

[0196] S104. If the device state is in the fully unfolded state, the electronic device 100 combines the display screen 1 and the display screen 2 into one display screen to display the picture.

[0197] For example, if the electronic device 100 is in a fully unfolded state, the device form of the electronic device 100 can be as follows: Figure 2 (a) or Figure 3 As shown in (a) in .

[0198] Among them, display screen 1 and display screen 2 are combined into one display screen display screen, which means that electronic device 100 regards display screen 1 and display screen 2 as one display screen including display area of ​​display screen 1 and display screen 2, and electronic device 100 can send the display content to be displayed to the display area where display screen 1 and display screen 2 are located for display.

[0199] In this case, the electronic device 100 can display pictures on the display screen 1 and the display screen 2 at the same time, and cancel the pictures displayed on the display screen 1 and the display screen 2 at the same time.

[0200] For example, the screen displayed by the electronic device 100 on the combined display screen of the display screen 1 and the display screen 2 may refer to Figure 4A-4B The user interface 10 shown, or Figure 5A-Figure 5B The user interface 20 shown or Figure 6A-6D The user interface 30 shown, or Figure 7 User interface 40 is shown.

[0201] S105. The electronic device 100 controls the combined display screen of the display screen 1 and the display screen 2 through the shoulder key 1 and / or the shoulder key 2.

[0202] The electronic device 100 controls the combined display screen of display screen 1 and display screen 2 through shoulder key 1 and / or shoulder key 2, which means that the user operation (for example, the third operation) acting on shoulder key 1 and / or shoulder key 2 detected by the electronic device 100 is used to control the combined display screen, i.e., the folding screen.

[0203] Furthermore, the electronic device 100 may further subdivide how to control the content in the display screen through the shoulder key 1 and the shoulder key 2 according to the number of application windows displayed in the combined display screen, and details may refer to subsequent steps S106-S108.

[0204] For details about the specific application of the electronic device 100 controlling the display screen through the shoulder keys, please refer to the subsequent Fig.13 and Fig.14 The contents shown will not be elaborated here.

[0205] S106. The electronic device 100 determines whether only one application window is displayed on the combined display screen.

[0206] The electronic device 100 determines whether only one application window is displayed in the combined display screen, that is, determines whether only one application window is displayed in the display area where the display screen 1 and the display screen 2 are located.

[0207] If the electronic device 100 determines that only one application window is displayed on the combined display screen, the electronic device 100 executes step S107 ; otherwise, if the electronic device 100 determines that multiple application windows are displayed on the combined display screen, the electronic device 100 executes step S108 .

[0208] Among them, when multiple application windows are displayed in the combined display screen, these multiple application windows may include full-screen displayed windows, floating displayed windows, split-screen displayed windows, etc. The embodiment of the present application does not limit the window form of the application window.

[0209] S107. The electronic device 100 uses shoulder key 1 and shoulder key 2 as one shoulder key to control the content in the application window.

[0210] If only one application window is displayed in the combined display screen, the electronic device 100 can regard the shoulder key 1 and the shoulder key 2 as one shoulder key to control the content in the application window. For example, the electronic device 100 can detect the user operation on the shoulder key 1 and / or the shoulder key 2, adjust the progress of the page displayed in the application window, adjust the progress and brightness of the video played in the application window, etc.

[0211] Among them, the shoulder key 1 and the shoulder key 2 can be used as one shoulder key in the following two situations;

[0212] 1) Shoulder button 1 and shoulder button 2 have the same function

[0213] In this case, whether the electronic device 100 detects an operation on the shoulder key 1 or detects an operation on the shoulder key 2, it is used to implement the same function.

[0214] In this way, if the user wants to adjust the brightness of the display screen by sliding the shoulder key, the user can adjust the brightness of the display screen by sliding the shoulder key 1 or the shoulder key 2. At this time, the user does not need to distinguish between the shoulder keys to control the electronic device 100, and the same function can be achieved by operating any shoulder key.

[0215] 2) Shoulder button 1 and shoulder button 2 are physically spliced ​​together, and the spliced ​​shoulder button is regarded as a shoulder button with a larger key range.

[0216] In some embodiments, the shoulder key 1 and the shoulder key 2 can be spliced ​​and separated following the change of the device form of the electronic device 100. When the electronic device 100 is in a fully unfolded state, the shoulder key 1 and the shoulder key 2 can be spliced ​​together. When the shoulder key 1 and the shoulder key 2 are spliced ​​together, the shoulder key 1 and the shoulder key 2 can be regarded as one shoulder key.

[0217] Users can regard the spliced ​​shoulder keys as shoulder keys with a larger key range.

[0218] For example, if the shoulder key is a touch key, the electronic device 100 can detect a sliding operation on the shoulder key to perform a corresponding function, such as adjusting the progress of a video. For a shoulder key before splicing, such as shoulder key 1 or shoulder key 2, the sliding distance that the user can slide is the key length of the shoulder key 1 or shoulder key 2. For the shoulder key after splicing, such as the shoulder key spliced ​​by shoulder key 1 and shoulder key 2, the sliding distance that the user can slide is the key length of the spliced ​​shoulder key 1 and shoulder key 2.

[0219] For another example, if the shoulder key is a mechanical key, and the electronic device 100 can detect click operations acting on both ends of the shoulder key, respectively, to increase or decrease the value of the adjustment object, such as the volume. For a shoulder key before splicing, such as shoulder key 1 or shoulder key 2, the user can increase the volume by clicking on one end of the shoulder key 1 or shoulder key 2, and decrease the volume by clicking on the other end of the shoulder key 1 or shoulder key 2. For the shoulder keys after splicing, such as the shoulder keys spliced ​​by shoulder key 1 and shoulder key 2, the user can increase the volume by clicking on one end of the spliced ​​shoulder key, such as one end of shoulder key 1, and decrease the volume by clicking on the other end of the spliced ​​shoulder key, such as the other end of shoulder key 2.

[0220] For example, see Figure 4A-4B The electronic device 100 can detect a sliding operation on the range where the shoulder key 1 and the shoulder key 2 are located, and adjust the brightness of the screen in the user interface 10.

[0221] For example, see Figure 5A-Figure 5B The electronic device 100 can detect a sliding operation on the range where the shoulder key 1 and the shoulder key 2 are located, and adjust the progress of the video played in the user interface 20.

[0222] In this way, compared to using shoulder key 1 or shoulder key 2 to control electronic device 100, using the spliced ​​shoulder key to control electronic device 100 allows the user to have a wider physical control range for the shoulder key. Taking the shoulder key as a touch key as an example, when the user needs to adjust the video playback progress by sliding on the shoulder key, if the change in the video playback progress that the user wants to change is large, the narrow physical control range may require the user to repeat multiple sliding operations on the shoulder key to adjust the video playback progress to the position the user wants. For the shoulder key with a wider physical control range after splicing, the user only needs one sliding operation to adjust the video playback progress to the position the user wants, which shortens the user's adjustment time, helps the user quickly change the value of the adjustment object, and improves the user's experience.

[0223] S108. The electronic device 100 controls the contents in different application windows through shoulder key 1 and shoulder key 2 respectively.

[0224] When multiple application windows are displayed on the combined display screen, the electronic device 100 can control different application windows respectively through different shoulder keys. For example, assuming that the electronic device 100 displays multiple application windows on the folding screen, the user operation (e.g., the fourth operation) detected by the electronic device 100 acting on the shoulder key 1 is used to control one of the multiple application windows (e.g., the first application window), and the user operation (e.g., the fifth operation) detected by the electronic device 100 acting on the shoulder key 2 is used to control another application window (e.g., the second application window) among the multiple application windows.

[0225] Wherein, a shoulder key is used to control an application window to be a window that has a corresponding relationship with the shoulder key. The electronic device 100 can determine the corresponding relationship between the shoulder key and the application window in the following manner:

[0226] 1) The electronic device 100 can determine the correspondence between the shoulder key and the application window according to the position of the application window

[0227] Exemplarily, the electronic device 100 may determine the application window closest to the shoulder key as the application window that has a corresponding relationship with the shoulder key.

[0228] For example, see Fig. 6A In (b), the user interface 30 includes a first window 301 and a second window 302. The window closest to the shoulder key 1 is the first window 301, and the window closest to the shoulder key 2 is the second window 302. Therefore, the shoulder key 1 is used to control the first window 301, and the shoulder key 2 is used to control the second window 302.

[0229] 2) The electronic device 100 can determine the correspondence between the shoulder keys and the application windows according to the upper and lower layer relationships between the application windows.

[0230] Exemplarily, the electronic device 100 may assign corresponding relationships to the shoulder keys in sequence according to the application windows arranged from top to bottom in the layer.

[0231] For example, see Fig. 6A In (a), the user interface 30 includes a first window 301 and a second window 302. The first window 301 is located above the layer where the second window 302 is located. The electronic device 100 can assign the application window corresponding to the shoulder key 1 as the first window 301, and the application window corresponding to the shoulder key 2 as the second window 302. Therefore, the shoulder key 1 is used to control the first window 301, and the shoulder key 2 is used to control the second window 302.

[0232] It is understandable that the electronic device 100 can also determine the correspondence between the shoulder key and the application window in other ways to control the application window through the shoulder key, and the embodiment of the present application is not limited to this.

[0233] In some implementations, when the electronic device 100 displays multiple application windows, the electronic device 100 may also combine the shoulder key 1 and the shoulder key 2 into one shoulder key for controlling the content in one of the multiple application windows. For example, the controlled application window may be a focus window.

[0234] S109. If the device state is the folded state, the electronic device 100 controls the display screen 3 to display a picture.

[0235] For example, if the electronic device 100 is in a folded state, the device form of the electronic device 100 can be as follows: Figure 2 (c) or Figure 3 As shown in (c) in .

[0236] It should be noted that if the electronic device 100 is an inward-folding screen device, the display screen 3 is a display screen different from the display screen 1 or the display screen 2; if the electronic device 100 is an outward-folding screen device, the display screen 3 is the display screen 1 or the display screen 2.

[0237] S110. The electronic device 100 uses the shoulder key 1 and the shoulder key 2 as one shoulder key to control the display screen 3.

[0238] The electronic device 100 can control the display screen 3 by detecting the user operation acting on the shoulder key 1 and / or the shoulder key 2. In the embodiment of the present application, if the electronic device 100 is an inward folding screen device, the user operation can also be referred to as the sixth operation, and if the electronic device 100 is an outward folding screen device, the user operation can also be referred to as the seventh operation.

[0239] For details about the specific application of the electronic device 100 controlling the display screen through the shoulder keys, please refer to the subsequent Fig.13 and Fig.14 The contents shown will not be elaborated here.

[0240] Among them, the electronic device 100 treats shoulder key 1 and shoulder key 2 as one shoulder key in the following two situations: 1) shoulder key 1 and shoulder key 2 have the same function; 2) shoulder key 1 and shoulder key 2 are physically spliced ​​together, and the spliced ​​shoulder key is regarded as a shoulder key with a larger key range.

[0241] For the specific description of treating shoulder key 1 and shoulder key 2 as one shoulder key, please refer to the relevant content of the aforementioned step S107, which will not be repeated here.

[0242] From steps S101-S110, it can be seen that the electronic device 100 can combine multiple shoulder keys into one shoulder key to control the display screen, or control each display screen independently through each shoulder key, so that the application scenarios of the shoulder keys can be expanded, so that the user can realize more functions through the shoulder keys, and the user's operation is convenient.

[0243] Combine the following Fig.13 , Fig.14 Describe the specific application scenarios of shoulder buttons.

[0244] Fig.13 A flow chart of a method for adjusting an adjustment object indicated in a display screen through shoulder keys provided in an embodiment of the present application.

[0245] S201. The electronic device 100 detects an adjustment operation on a shoulder key.

[0246] The shoulder key may refer to the shoulder key 1 and / or the shoulder key 2 in the electronic device 100 .

[0247] The adjustment operation is used to adjust the value of the adjustment object. For example, when the shoulder key is a touch key, the adjustment operation may refer to a sliding operation or a long press operation, etc., and when the shoulder key is a mechanical key, the adjustment operation may refer to a click operation or a long press operation or a sliding operation, etc.

[0248] The embodiment of the present application does not limit the operation method of the adjustment operation.

[0249] S202. The electronic device 100 adjusts the adjustment object indicated in the display screen according to the adjustment operation.

[0250] For example, the adjustment object may refer to any one or more of volume, brightness, video playback progress, focal length, page sliding progress, and the like.

[0251] In some implementations, the electronic device 100 may also adjust the adjustment object indicated in the display screen in combination with the shoulder key precision. For example, the higher the shoulder key precision, the smaller the adjustment amplitude of the adjustment operation on the adjustment object, and the lower the shoulder key precision, the larger the adjustment amplitude of the adjustment operation on the adjustment object.

[0252] That is to say, the electronic device 100 can adjust the volume, brightness, video playback progress, focal length, page sliding progress, etc. according to the adjustment operation acting on the shoulder key under a certain shoulder key accuracy.

[0253] The shoulder key accuracy can be the accuracy preset by the electronic device 100, or can be the accuracy adjusted by the user through the accuracy adjustment page. For example, the electronic device 100 can open the accuracy adjustment interface by detecting the user's specified operation on the shoulder key. Fig.14 , I won’t expand on this here.

[0254] In addition, combined with the above Fig.12 When the electronic device 100 is in different device forms, the shoulder keys mentioned in step S201 and the display screen mentioned in step S202 may be in the following situations:

[0255] 1) The electronic device 100 is in a semi-folded state

[0256] If the electronic device 100 is in a semi-folded state, the electronic device 100 can control the display screen 1 and the display screen 2 via the shoulder key 1 and the shoulder key 2 respectively.

[0257] Therefore, when the electronic device 100 is in the semi-folded state, if the adjustment operation applied to the shoulder key in step S201 is an adjustment operation applied to shoulder key 1, the display screen mentioned in step S202 is display screen 1. That is, the user can adjust the adjustment object indicated in display screen 1 by initiating an adjustment operation to shoulder key 1. Correspondingly, if the adjustment operation applied to the shoulder key in step S201 is an adjustment operation applied to shoulder key 2, the display screen mentioned in step S202 is display screen 2. That is, the user can adjust the adjustment object indicated in display screen 2 by initiating an adjustment operation to shoulder key 2.

[0258] 2) The electronic device 100 is in a fully unfolded state

[0259] If the electronic device 100 is in the fully unfolded state, the electronic device 100 can control the combined display screen of the display screen 1 and the display screen 2 through the shoulder key 1 and / or the shoulder key 2.

[0260] Therefore, when the electronic device 100 is in the fully unfolded state, the adjustment operation acting on the shoulder key in step S201 is an adjustment operation acting on the shoulder key 1 and / or the shoulder key 2, and the display screen mentioned in step S202 includes the display screen 1 and the display screen 2. In other words, the user can adjust the adjustment objects indicated in the display screen 1 and the display screen 2 by initiating an adjustment operation on the shoulder key 1, or the shoulder key 2, or the shoulder key 1 and the shoulder key 2.

[0261] Among them, in the fully expanded state, the shoulder buttons and the display screen can also exist in the following two situations:

[0262] a) Only one application window is displayed on the display area where display screen 1 and display screen 2 are located

[0263] In this case, the adjustment operation acting on shoulder key 1, or the adjustment operation acting on shoulder key 2, or the adjustment operation acting on the shoulder key combined with shoulder key 1 and shoulder key 2 is used to adjust the adjustment object indicated in the application window.

[0264] b) Multiple application windows are displayed on the display area where display screen 1 and display screen 2 are located

[0265] In this case, the adjustment operation acting on the shoulder key 1 and the adjustment operation acting on the shoulder key 2 can be used to adjust the adjustment object indicated in different application windows. Alternatively, the adjustment operation acting on the shoulder key 1 and / or the shoulder key 2 can be used to adjust the adjustment object indicated in one of the multiple application windows. Exemplarily, the application window can refer to the focus window.

[0266] 3) The electronic device 100 is in a folded state

[0267] If the electronic device 100 is in the folded state, the electronic device 100 can control the display screen 3 via the shoulder key 1 and / or the shoulder key 2 .

[0268] Therefore, when the electronic device 100 is in the folded state, the adjustment operation acting on the shoulder key in step S201 is an adjustment operation acting on the shoulder key 1 and / or the shoulder key 2, and the display screen mentioned in step S202 is the display screen 3. In other words, the user can adjust the adjustment object indicated on the display screen 3 by initiating an adjustment operation on the shoulder key 1, or the shoulder key 2, or the shoulder key 1 and the shoulder key 2.

[0269] In addition, the adjustment object is related to the picture displayed by the electronic device 100. Specifically, the electronic device 100 can determine the adjustment object indicated on the display screen according to the picture displayed on the display screen.

[0270] In some embodiments, the electronic device 100 can determine the adjustment object of the adjustment operation by judging whether the screen displayed on the display screen includes the specified page. Exemplarily, if the displayed screen includes the specified page, the adjustment operation acting on the shoulder key is used to adjust the adjustment object corresponding to the specified page, and if the displayed screen does not include the specified page, the adjustment operation acting on the shoulder key is used to adjust the preset adjustment object in the display screen.

[0271] The designated page may refer to a page preset by the electronic device 100, for example, the designated page may include: a video playback page, a long page, a photo taking page, etc. The adjustment object corresponding to the video playback page may refer to the video playback progress, the video volume, etc., the adjustment object corresponding to the long page may refer to the page sliding progress, and the adjustment object corresponding to the photo taking page may refer to the focal length, the aperture value, the exposure, the shutter time, etc. The preset adjustment object is an object applicable to any page displayed on the electronic device 100, such as brightness, volume, etc.

[0272] That is to say, if the electronic device 100 displays a designated page, the adjustment operation on the shoulder key can be used to adjust the adjustment object in the designated page. For example, if the electronic device 100 displays a video playback page, the adjustment operation on the shoulder key is used to adjust the video playback progress. If the electronic device 100 displays a long page, the adjustment operation on the shoulder key is used to adjust the page sliding progress. If the electronic device 100 displays a photo taking page, the adjustment operation on the shoulder key is used to adjust the focal length, etc.; otherwise, the adjustment operation on the shoulder key can be used to adjust the brightness of the picture, or the volume of the device.

[0273] Fig.14 A flow chart of a method for opening a precision adjustment interface through shoulder keys provided in an embodiment of the present application.

[0274] S301. The electronic device 100 detects a designated operation on a shoulder key.

[0275] The shoulder key may refer to shoulder key 1 and / or shoulder key 2. The designated operation may refer to a double-click operation, a triple-click operation, a long-press operation, etc. The embodiment of the present application does not limit the operation mode of the designated operation.

[0276] S302. The electronic device 100 obtains the device form.

[0277] Exemplarily, the electronic device 100 may determine the device form of the electronic device 100 through a magnetic sensor or a gyroscope sensor.

[0278] According to the different device forms of the electronic device 100 , the electronic device 100 may respectively execute steps S303 , S304 and S305 .

[0279] S303. If the device is in a semi-folded state, the electronic device 100 displays a precision adjustment interface on the display screen corresponding to the shoulder key.

[0280] The precision adjustment interface displays an option of shoulder key precision, which is used to indicate the shoulder key precision. The electronic device 100 can also detect the user's adjustment operation on the option to adjust the shoulder key precision.

[0281] Exemplarily, the precision adjustment interface may refer to Fig.11 User interface 70 is shown.

[0282] That is to say, when the electronic device 100 is in a semi-folded state, if the electronic device 100 detects a designated operation acting on shoulder key 1, the electronic device 100 displays the precision adjustment interface on display screen 1; if the electronic device 100 detects a designated operation acting on shoulder key 2, the electronic device 100 displays the precision adjustment interface on display screen 2.

[0283] S304. If the device state is in the fully unfolded state, the electronic device 100 displays a precision adjustment interface on the combined display screen of display screen 1 and display screen 2.

[0284] The precision adjustment interface displays an option of shoulder key precision, which is used to indicate the shoulder key precision. The electronic device 100 can also detect the user's adjustment operation on the option to adjust the shoulder key precision.

[0285] Exemplarily, the precision adjustment interface may refer to Figure 7 User interface 40 is shown.

[0286] That is to say, when the electronic device 100 is in the fully expanded state, the action detected by the electronic device 100 and the specified operation of the shoulder key 1 and / or the shoulder key 2 are used to trigger the electronic device 100 to display the precision adjustment interface on the combined display screen of the display screen 1 and the display screen 2.

[0287] S305 . If the device state is a folded state, the electronic device 100 displays a precision adjustment interface on the display screen 3 .

[0288] The precision adjustment interface displays an option of shoulder key precision, which is used to indicate the shoulder key precision. The electronic device 100 can also detect the user's adjustment operation on the option to adjust the shoulder key precision.

[0289] Exemplarily, the precision adjustment interface may refer to Fig.11 User interface 70 is shown.

[0290] Among them, the precision adjustment interface mentioned in steps S303, S304 and S305 may include options for simultaneously adjusting the precision of shoulder key 1 and shoulder key 2, may also include options for adjusting the precision of shoulder key 1 alone, and may also include options for adjusting shoulder key 2 alone.

[0291] For example, see Figure 7 The user interface 40 includes: an adjustment option 401, which can be used to adjust the accuracy of shoulder key 1 and shoulder key 2 at the same time. The user interface 40 also includes: a first option 402A, a second option 402B, the first option 402A can be used to adjust the accuracy of shoulder key 1, and the second option 402B can be used to adjust the accuracy of shoulder key 2.

[0292] In some embodiments, the precision adjustment interface displayed by the electronic device 100 in different device forms may be different. Compared with the electronic device 100 in other device forms, since the display range that can be viewed by the user in the fully expanded state is the largest, the content contained in the precision adjustment interface displayed by the electronic device 100 in the fully expanded state may be more than the content contained in the precision adjustment interface displayed when the electronic device 100 is in the folded state or the semi-folded state.

[0293] For example, in the semi-folded state, the precision adjustment interface displayed by the electronic device 100 may include only options for adjusting the precision of shoulder key 1 or shoulder key 2, or only options for adjusting the precision of shoulder key 1 and shoulder key 2 at the same time.

[0294] S306. The electronic device 100 detects an adjustment operation performed on the accuracy adjustment interface.

[0295] The adjustment operation may be used to adjust the accuracy of the shoulder key. The adjustment operation may be a touch operation or a voice command, which is not limited in the present embodiment. In the present embodiment, the adjustment operation may also be referred to as the eighth operation.

[0296] Exemplarily, the precision adjustment interface may include an option for shoulder key precision, and the adjustment operation may specifically be an adjustment operation acting on the option.

[0297] For example, Figure 7 For example, this operation can be applied to Figure 7 The left swipe operation or the right swipe operation shown acts on the adjustment mark 401A.

[0298] S307. The electronic device 100 adjusts the shoulder key accuracy, where the shoulder key accuracy indicates the adjustment range of the adjustment operation on the adjustment object.

[0299] In response to the adjustment operation, the electronic device 100 may increase the accuracy of the shoulder key 1 and / or the shoulder key 2 , or decrease the accuracy of the shoulder key 1 and / or the shoulder key 2 .

[0300] Among them, the greater the shoulder key precision, the smaller the adjustment range of the adjustment object, and the smaller the shoulder key precision, the greater the adjustment range of the shoulder key object.

[0301] In a specific application, after the electronic device 100 adjusts the shoulder key accuracy, if the electronic device 100 receives an adjustment operation acting on the shoulder key again, the electronic device 100 can change the value of the adjustment object according to the adjusted adjustment amplitude. Figure 8 Related content in

[0302] In this way, the user can dynamically adjust the shoulder key accuracy according to their needs. For example, if the user wants to change the volume significantly, the user can reduce the shoulder key accuracy, so that the user can easily increase or decrease the volume significantly through the adjustment operation. For another example, if the user wants to accurately adjust to a certain playback progress of the video, the user can increase the shoulder key accuracy, so that the user can make a more detailed adjustment to the video playback progress, ensuring that the user adjusts to the specified playback progress as much as possible.

[0303] Fig.15 A flowchart of another shoulder key control method provided in an embodiment of the present application.

[0304] like Fig.15 As shown, the shoulder key control method may include but is not limited to the following steps:

[0305] S401. The electronic device 100 detects a user operation on a shoulder key.

[0306] Among them, Fig.15 In the shoulder key control method shown, the electronic device 100 may not be an electronic device. For example, the electronic device 100 may be a mobile phone, a tablet, a computer, or the like.

[0307] The electronic device 100 may include one or more shoulder keys, which may be touch keys or mechanical keys.

[0308] S402. The electronic device 100 determines whether the user operation is a designated operation.

[0309] Among them, the specified operation can be used to trigger the electronic device 100 to display the accuracy adjustment interface. Exemplarily, the specified operation can be a click operation, a double-click operation, a triple-click operation, a long press operation, etc. The embodiment of the present application does not limit the operation method of the specified operation.

[0310] When the electronic device 100 determines that the user operation is a designated operation, the electronic device 100 may execute step S403 , otherwise the electronic device 100 may execute step S406 .

[0311] S403. The electronic device 100 displays a precision adjustment interface.

[0312] The precision adjustment interface may display an option of shoulder key precision, which may be used to indicate the shoulder key precision. The electronic device 100 may detect the adjustment operation acting on the option and adjust the shoulder key precision.

[0313] S404. The electronic device 100 detects an adjustment operation performed on the accuracy adjustment interface.

[0314] The adjustment operation is used to adjust the accuracy of the shoulder key. The adjustment operation may be a touch operation or a voice command, which is not limited in the present embodiment.

[0315] For example, the precision adjustment interface may include an option for shoulder key precision, which may include a progress bar for shoulder key precision and an adjustment mark on the progress bar. The adjustment operation may be a sliding operation on the adjustment mark on the progress bar.

[0316] S405. The electronic device 100 adjusts the shoulder key accuracy, where the shoulder key accuracy indicates the adjustment range of the adjustment operation on the adjustment object.

[0317] In response to the adjustment operation, the electronic device 100 can increase or decrease the shoulder key accuracy, wherein the higher the shoulder key accuracy, the smaller the adjustment range of the adjustment operation on the adjustment object, and the lower the shoulder key accuracy, the larger the adjustment range of the adjustment operation on the adjustment object.

[0318] For a detailed description of the shoulder key accuracy, please refer to the above Fig.14 The relevant content in will not be repeated here.

[0319] S406. The electronic device 100 determines whether the operation is an adjustment operation.

[0320] The adjustment operation is used to change the value of the adjustment object. Exemplarily, the adjustment operation may refer to a click operation, a slide operation, a long press operation, etc. The embodiment of the present application does not limit the operation mode of the adjustment operation.

[0321] When the electronic device 100 determines that the operation is an adjustment operation, the electronic device 100 may execute step S407.

[0322] It is understandable that the embodiment of the present application does not limit the execution order of step S402 and step S406. For example, the electronic device 100 may first determine whether the user operation is an adjustment operation, and if not, then determine whether the user operation is a specified operation. For another example, the electronic device 100 may simultaneously determine whether the user operation is an adjustment operation or a specified operation.

[0323] S407. The electronic device 100 determines whether a designated page is displayed on the display screen.

[0324] The designated page may refer to a page preset by the electronic device 100 , for example, the designated page may include: a video playback page, a long page, a photo taking page, and the like.

[0325] When the electronic device 100 determines that the designated page is displayed on the display screen, the electronic device 100 executes step S408 , otherwise, the electronic device 100 specifies step S409 .

[0326] In some implementations, if the electronic device 100 displays multiple application windows, the electronic device 100 may further combine the multiple application windows and select an application window therefrom to determine whether a designated page is displayed in the selected application window.

[0327] Among them, these multiple application windows may include windows displayed in full screen, windows displayed in full screen, and windows displayed in split screen. The embodiment of the present application does not limit the display form of the application window.

[0328] In addition, the application window selected by the electronic device 100 may exist in the following situations:

[0329] 1) The application window is the focus window

[0330] That is, when the electronic device 100 displays multiple application windows, the adjustment operation performed by the user on the shoulder key is used to adjust the corresponding adjustment object in the application window currently being focused on by the user among the multiple application windows.

[0331] 2) The application window is the last window opened by the user

[0332] That is, when the electronic device 100 displays multiple application windows, the adjustment operation performed by the user on the shoulder key is used to adjust the corresponding adjustment object in the application window last opened by the user among the multiple application windows.

[0333] It is understandable that there may be other situations in which the application window selected by the electronic device 100 is selected, and the embodiment of the present application does not limit this.

[0334] S408. The electronic device 100 adjusts the adjustment object corresponding to the designated page.

[0335] Among them, the adjustment object corresponding to the video playback page may refer to the video playback progress, video volume, etc., the adjustment object corresponding to the long page may refer to the page sliding progress, and the adjustment object corresponding to the photo page may refer to the focal length, aperture value, exposure value, shutter time, etc. The preset adjustment object is a parameter applicable to any page displayed on the electronic device 100, such as brightness, volume, etc.

[0336] In some implementations, the electronic device 100 may adjust the adjustment object corresponding to the designated page according to the accuracy of the shoulder keys.

[0337] The shoulder key accuracy may be the shoulder key accuracy preset by the electronic device 100, or may be the shoulder key accuracy adjusted by the user in step S405. The higher the shoulder key accuracy, the smaller the adjustment range of the adjustment object, and the lower the shoulder key accuracy, the larger the adjustment range of the adjustment object.

[0338] S409. The electronic device 100 adjusts a preset adjustment object in the display screen.

[0339] The preset adjustment object may refer to brightness, volume of the device, etc.

[0340] In some implementations, the electronic device 100 can adjust a preset adjustment object in the display screen according to the precision of the shoulder keys.

[0341] The shoulder key accuracy may be the shoulder key accuracy preset by the electronic device 100, or may be the shoulder key accuracy adjusted by the user in step S405. The higher the shoulder key accuracy, the smaller the adjustment range of the preset adjustment object, and the lower the shoulder key accuracy, the larger the adjustment range of the preset adjustment object.

[0342] That is, it can be seen from steps S407-S409 that if the electronic device 100 displays a designated page, the user can use the shoulder keys to adjust the adjustment object in the designated page, such as adjusting the playback progress of a video, adjusting the focal length of a photo, etc. Otherwise, if the electronic device 100 does not display a designated page, the user can use the shoulder keys to adjust the brightness of the screen, the volume of the device, etc. This improves the utilization rate of the shoulder keys and increases the application scenarios of the shoulder keys.

[0343] It is understandable that for the contents not described in detail in steps S401-S409, please refer to the aforementioned Fig.13 , Fig.14 The contents in will not be repeated here.

[0344] Fig.16 A schematic diagram of the hardware structure of the electronic device 100 is shown.

[0345] The electronic device 100 may be a mobile phone, a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a cellular phone, a personal digital assistant (PDA), an augmented reality (AR) device, a virtual reality (VR) device, an artificial intelligence (AI) device, a wearable device, an in-vehicle device, a smart home device and / or a smart city device. The embodiments of the present application do not impose any special restrictions on the specific type of the electronic device.

[0346] The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0347] It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0348] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0349] In some embodiments, the processor 110 may be used to control the display screen to display images according to the device form of the electronic device 100, and determine the display screen that is affected by the user's operation according to the operation initiated by the user through the shoulder key.

[0350] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.

[0351] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0352] The charging management module 140 is used to receive charging input from a charger. In some wired charging embodiments, the charging management module 140 can receive charging input from a wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 can receive wireless charging input through a wireless charging coil of the electronic device 100. While the charging management module 140 is charging the battery 142, it can also power the electronic device through the power management module 141.

[0353] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the display screen 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle number, and battery health status (leakage, impedance).

[0354] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0355] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0356] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, etc. the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1.

[0357] The modem processor may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays an image or video through a display screen 194.

[0358] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, demodulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0359] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0360] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0361] The display screen 194 is used to display images, videos, etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194 , where N is a positive integer greater than 1.

[0362] In some embodiments, the electronic device 100 may include two display screens 194, such as display screen 1 and display screen 2. In this case, the electronic device 100 may be an outward folding screen device. Alternatively, the electronic device 100 may include three display screens 194, such as display screen 1, display screen 2, and display screen 3. In this case, the electronic device 100 may be an inward folding screen device. For a detailed description of the outward folding screen device and the inward folding screen device, please refer to the aforementioned Figure 1 Related content.

[0363] The electronic device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.

[0364] The ISP is used to process data fed back by the camera 193 .

[0365] The camera 193 is used to capture still images or videos. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0366] Digital signal processors are used to process digital signals. In addition to processing digital image signals, they can also process other digital signals.

[0367] Video codecs are used to compress or decompress digital video.

[0368] NPU is a neural-network (NN) computing processor. It can quickly process input information by drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, and can also continuously self-learn.

[0369] The internal memory 121 may include one or more random access memories (RAM) and one or more non-volatile memories (NVM).

[0370] The random access memory can be directly read and written by the processor 110, and can be used to store executable programs (such as machine instructions) of the operating system or other running programs, and can also be used to store user and application data.

[0371] The non-volatile memory may also store executable programs and user and application data, etc., and may be loaded into the random access memory in advance for direct reading and writing by the processor 110 .

[0372] The external memory interface 120 can be used to connect to an external non-volatile memory to expand the storage capacity of the electronic device 100. The external non-volatile memory communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as music and videos are stored in the external non-volatile memory.

[0373] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0374] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals.

[0375] The speaker 170A, also called a "speaker", is used to convert an audio electrical signal into a sound signal. The electronic device 100 can listen to music or listen to a hands-free call through the speaker 170A.

[0376] The receiver 170B, also called a "earpiece", is used to convert audio electrical signals into sound signals. When the electronic device 100 receives a call or voice message, the voice can be received by placing the receiver 170B close to the human ear.

[0377] Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals.

[0378] The earphone jack 170D is used to connect a wired earphone.

[0379] The pressure sensor 180A is used to sense pressure signals and can convert pressure signals into electrical signals. In some embodiments, the pressure sensor 180A can be set on the display screen 194. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure based on the change in capacitance. When a touch operation acts on the display screen 194, the electronic device 100 detects the intensity of the touch operation based on the pressure sensor 180A. The electronic device 100 can also calculate the position of the touch based on the detection signal of the pressure sensor 180A.

[0380] The gyro sensor 180B can be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (ie, x, y, and z axes) can be determined by the gyro sensor 180B. The gyro sensor 180B can be used for anti-shake shooting.

[0381] The air pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device 100 calculates the altitude through the air pressure value measured by the air pressure sensor 180C to assist positioning and navigation.

[0382] The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip leather case. In some embodiments, when the electronic device 100 is a flip phone, the electronic device 100 can detect the opening and closing of the flip cover according to the magnetic sensor 180D. Then, according to the detected opening and closing state of the leather case or the opening and closing state of the flip cover, the flip cover can be automatically unlocked.

[0383] In some embodiments, when the electronic device 100 is an electronic device, the electronic device 100 can determine the device form through the magnetic sensor 180D. The device form may include: fully unfolded state, half-folded state, and folded state. For example, the electronic device 100 is an inward folding screen. For details about the device form of the electronic device 100, please refer to the aforementioned Figure 2 and Figure 3 Related content.

[0384] The acceleration sensor 180E can detect the magnitude of the acceleration of the electronic device 100 in all directions (generally three axes). When the electronic device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the electronic device and is applied to applications such as horizontal and vertical screen switching and pedometers.

[0385] The distance sensor 180F is used to measure the distance. The electronic device 100 can measure the distance by infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 can use the distance sensor 180F to measure the distance to achieve fast focusing.

[0386] The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 100 emits infrared light outward through the light emitting diode. The electronic device 100 uses the photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100. When insufficient reflected light is detected, the electronic device 100 can determine that there is no object near the electronic device 100.

[0387] The ambient light sensor 180L is used to sense the brightness of the ambient light. The electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the sensed brightness of the ambient light. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures.

[0388] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application locks, fingerprint photography, fingerprint call answering, etc.

[0389] The temperature sensor 180J is used to detect temperature. In some embodiments, the electronic device 100 uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold, the electronic device 100 reduces the performance of a processor located near the temperature sensor 180J to reduce power consumption and implement thermal protection.

[0390] The touch sensor 180K is also called a "touch control device". The touch sensor 180K can be set on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also called a "touch control screen". The touch sensor 180K is used to detect a touch operation acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194.

[0391] The bone conduction sensor 180M can obtain vibration signals. In some embodiments, the bone conduction sensor 180M can obtain vibration signals of vibrating bones of the human body. The bone conduction sensor 180M can also contact the human body's pulse to receive blood pressure beating signals.

[0392] The key 190 includes a power key, a volume key, etc. The key 190 may be a mechanical key or a touch key. The electronic device 100 may receive key input and generate key signal input related to user settings and function control of the electronic device 100.

[0393] In some embodiments, if the button 190 is located on the side of the display screen 194, the button 190 can also be called a shoulder button. The electronic device 100 can include a shoulder button 1 and a shoulder button 2, wherein the shoulder button 1 is located on one side of the display screen 1 and the shoulder button 2 is located on one side of the display screen 2.

[0394] Furthermore, the shoulder key 1 and the shoulder key 2 can be spliced ​​and separated following the change of the device form of the electronic device 100. When the shoulder key 1 and the shoulder key 2 are spliced ​​together, the shoulder key 1 and the shoulder key 2 can be regarded as one shoulder key, and when the shoulder key 1 and the shoulder key 2 are separated, the shoulder key 1 and the shoulder key 2 can be used independently.

[0395] For example, taking the shoulder button as a touch button, Fig.17 The circuit structure diagram of the shoulder keys is shown as an example.

[0396] like Fig.17As shown, the circuit structure of the shoulder key may include: a touch screen, an integrated circuit (IC), and a touch screen algorithm (TSA) module.

[0397] The touch screen is used to detect the touch operation of the user on or near it. The touch IC can generate the original data of the touch operation according to the touch operation. The original data includes the capacitance value, which is the capacitance change generated when the user touches the touch screen. The touch IC sends the original data to the TSA module. The TSA module can calculate the operation data according to the original data. The operation data may include: operation type, position, sliding distance, etc. The operation type may refer to a click operation, a double-click operation, a triple-click operation, a long press operation, a sliding operation, etc. The position refers to the position of the user's touch operation on the shoulder key, and the sliding distance refers to the sliding distance of the sliding operation on the shoulder key when the user's touch operation is a sliding operation.

[0398] Furthermore, the electronic device 100 may send the operation data to the processor 110 so that the processor 110 triggers a corresponding function according to the operation initiated by the user.

[0399] Understandably, Fig.17 The circuit structure of the shoulder key is only introduced as an example. In other embodiments of the present application, the shoulder key may also include more or fewer components, and the embodiments of the present application are not limited to this.

[0400] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects.

[0401] Indicator 192 may be an indicator light, which may be used to indicate charging status, power changes, messages, missed calls, notifications, etc.

[0402] The SIM card interface 195 is used to connect a SIM card.

[0403] The electronic device 100 may be a portable terminal device equipped with iOS, Android, Microsoft or other operating systems, such as a mobile phone, a tablet computer, a wearable device, etc., and may also be a non-portable terminal device such as a laptop computer with a touch-sensitive surface or a touch panel, a desktop computer with a touch-sensitive surface or a touch panel. The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present invention takes the Android system of the layered architecture as an example to exemplify the software structure of the electronic device 100.

[0404] Fig.18 It is a software structure block diagram of the electronic device 100 according to an embodiment of the present application.

[0405] The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system library, and the kernel layer.

[0406] The application layer can include a series of application packages.

[0407] like Fig.18 As shown, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc.

[0408] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0409] like Fig.18 As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

[0410] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0411] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0412] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.

[0413] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including connecting, hanging up, etc.).

[0414] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0415] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.

[0416] Android Runtime includes core libraries and virtual machines. Android runtime is responsible for scheduling and management of the Android system.

[0417] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.

[0418] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0419] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0420] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0421] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0422] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0423] A 2D graphics engine is a drawing engine for 2D drawings.

[0424] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

[0425] The following is an illustrative description of the workflow of the software and hardware of the electronic device 100 in conjunction with capturing a photo scene.

[0426] When the touch sensor 180K receives a touch operation, the corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the touch operation into a raw input event (including touch coordinates, timestamp of the touch operation, and other information). The raw input event is stored in the kernel layer. The application framework layer obtains the raw input event from the kernel layer and identifies the control corresponding to the input event. For example, if the touch operation is a touch single-click operation and the control corresponding to the single-click operation is the control of the camera application icon, the camera application calls the interface of the application framework layer to start the camera application, and then starts the camera driver by calling the kernel layer to capture static images or videos through the camera 193.

[0427] It should be understood that each step in the above method embodiment can be completed by an integrated logic circuit of hardware in a processor or by instructions in the form of software. The method steps disclosed in the embodiments of the present application can be directly embodied as being executed by a hardware processor, or by a combination of hardware and software modules in a processor.

[0428] The present application also provides an electronic device, which may include: a memory and a processor. The memory may be used to store a computer program; the processor may be used to call the computer program in the memory, so that the electronic device executes the method executed by the electronic device 100 in any of the above embodiments.

[0429] The present application also provides a chip system, which includes at least one processor for implementing the functions involved in the method performed by the electronic device 100 in any of the above embodiments.

[0430] In one possible design, the chip system also includes a memory, which is used to store program instructions and data, and the memory is located inside or outside the processor.

[0431] The chip system may be composed of the chip, or may include the chip and other discrete devices.

[0432] Optionally, the processor in the chip system may be one or more. The processor may be implemented by hardware or by software. When implemented by hardware, the processor may be a logic circuit, an integrated circuit, etc. When implemented by software, the processor may be a general-purpose processor implemented by reading software code stored in a memory.

[0433] Optionally, the memory in the chip system may also be one or more. The memory may be integrated with the processor or may be separately arranged with the processor, which is not limited in the embodiments of the present application. Exemplarily, the memory may be a non-transient processor, such as a read-only memory ROM, which may be integrated with the processor on the same chip or may be arranged on different chips respectively. The embodiments of the present application do not specifically limit the type of memory and the arrangement of the memory and the processor.

[0434] Exemplarily, the chip system can be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on chip (SoC), a central processor unit (CPU), a network processor (NP), a digital signal processor (DSP), a microcontroller unit (MCU), a programmable logic device (PLD) or other integrated chips.

[0435] The present application also provides a computer program product, which includes: a computer program (also referred to as code, or instruction), which, when executed, enables a computer to execute a method executed by any one of the electronic devices 100 in any of the above embodiments.

[0436] The present application also provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program (also referred to as code or instruction). When the computer program is executed, the computer executes any method executed by the electronic device 100 in any of the above embodiments.

[0437] It should be understood that the processor in the embodiment of the present application can be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method embodiment can be completed by the hardware integrated logic circuit or software instructions in the processor. The above processor can be a general processor, a digital signal processor (digitalsignal processor, DSP), an application specific integrated circuit (AP 800plication specific integrated circuit, ASIC), a field programmable gate array (field programmable gate array, FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods, steps and logic block diagrams disclosed in the embodiments of the present application can be implemented or executed. The general processor can be a microprocessor or the processor can also be any conventional processor. The steps of the method disclosed in the embodiment of the present application can be directly embodied as a hardware decoding processor to perform, or the hardware and software modules in the decoding processor are combined to perform. The software module can be located in a mature storage medium in the field such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware.

[0438] In addition, an embodiment of the present application further provides a device. The device may be a component or a module, and the device may include one or more processors and a memory connected to each other. The memory is used to store a computer program. When the computer program is executed by one or more processors, the device executes the method in each of the above method embodiments.

[0439] Among them, the device, computer-readable storage medium, computer program product or chip provided in the embodiments of the present application are used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be repeated here.

[0440] The various implementation modes of the present application can be combined arbitrarily to achieve different technical effects.

[0441] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) mode. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state disk (SSD)), etc.

[0442] Those skilled in the art can understand that to implement all or part of the processes in the above-mentioned embodiments, the processes can be completed by computer programs to instruct related hardware, and the programs can be stored in computer-readable storage media. When the programs are executed, they can include the processes of the above-mentioned method embodiments. The aforementioned storage media include: ROM or random access memory RAM, magnetic disk or optical disk and other media that can store program codes.

[0443] In short, the above description is only an embodiment of the technical solution of the present invention, and is not intended to limit the protection scope of the present invention. Any modification, equivalent replacement, improvement, etc. made according to the disclosure of the present invention shall be included in the protection scope of the present invention.

Claims

1. A shoulder key control method, characterized in that: The method is applied to an electronic device including a folding screen, a first shoulder key and a second shoulder key, wherein the folding screen includes a first display screen and a second display screen, the first shoulder key is located on a side of the first display screen, and the second shoulder key is located on a side of the second display screen, and the method includes: The electronic device detects that the folding screen is in a semi-folded state; The electronic device detects a first operation applied to the first shoulder key, controls the first display screen, and does not control the second display screen; The electronic device detects a second operation applied to the second shoulder key, controls the second display screen, and does not control the first display screen.

2. The method according to claim 1, characterized in that The method further comprises: The electronic device detects that the folding screen is in a fully unfolded state; The electronic device detects a third operation acting on the first shoulder key and / or the second shoulder key, and controls the folding screen.

3. The method according to claim 1 or 2, characterized in that: The method further comprises: The electronic device detects that the folding screen is in a fully unfolded state, and a plurality of application windows are displayed on the folding screen; The electronic device detects a fourth operation acting on the first shoulder key, and controls a first application window among the multiple application windows; The electronic device detects a fifth operation applied to the second shoulder key and controls a second application window among the multiple application windows.

4. The method according to claim 3, characterized in that The electronic device controlling the first application window specifically includes: The electronic device adjusts the corresponding adjustment object in the first application window; The electronic device controlling the second application window specifically includes: The electronic device adjusts the corresponding adjustment object in the second application window; The adjustment object includes any one of the following: display brightness, volume, focal length, page sliding progress, video playing progress, focal length, aperture value, exposure or shutter time.

5. The method according to any one of claims 1 to 4, characterized in that: The electronic device further includes: a third display screen, the third display screen is located on the back of the first display screen or the second display screen, and the method further includes: The electronic device detects that the folding screen is in a folded state, wherein the first display screen and the second display screen in the folded state are face-to-face attached; The electronic device detects a sixth operation acting on the first shoulder key and / or the second shoulder key, and controls the third display screen.

6. The method according to any one of claims 1 to 5, characterized in that: The method further comprises: The electronic device detects that the folding screen is in a folded state, wherein the first display screen and the second display screen in the folded state are in back-to-back contact with each other; The electronic device detects a seventh operation acting on the first shoulder key and / or the second shoulder key, and controls the first display screen or the second display screen.

7. The method according to any one of claims 1 to 6, characterized in that: The controlling includes adjusting a corresponding adjustment object in a display screen controlled by the electronic device; The adjustment object includes any one of the following: display brightness, volume, focal length, page sliding progress, video playing progress, focal length, aperture value, exposure or shutter time.

8. The method according to claim 7, characterized in that The adjustment object is related to a page displayed on a display screen controlled by the electronic device.

9. The method according to any one of claims 1 to 6, characterized in that: The controlling includes displaying a precision adjustment interface on a display screen controlled by the electronic device; the method also includes: The electronic device detects an eighth operation acting on the accuracy adjustment interface; The electronic device adjusts the accuracy of the first shoulder key and / or the second shoulder key.

10. The method according to claim 2, characterized in that When the folding screen is in a fully unfolded state, the first shoulder key and the second shoulder key are physically spliced ​​together, and the third operation is used to adjust a corresponding adjustment object in the folding screen; When the first shoulder key and the second shoulder key are touch keys, the third operation includes a sliding operation within a range where the touch screen where the first shoulder key and the second shoulder key are spliced ​​together is located; When the first shoulder key and the second shoulder key are mechanical keys, the third operation includes a pressing or sliding operation at a first end of the first shoulder key or a second end of the second shoulder key.

11. The method according to any one of claims 1 to 10, characterized in that: The first shoulder key is located at an edge of a first side of the first display screen that is connected to the second display screen, and the second shoulder key is located at an edge of the first side of the second display screen that is connected to the first display screen.

12. An electronic device, characterized in that: The electronic device comprises a memory, one or more processors, and one or more programs; when the one or more processors execute the one or more programs, the electronic device implements the method as claimed in any one of claims 1 to 11.

13. A computer-readable storage medium comprising instructions, characterized in that: When the instructions are executed on an electronic device, the electronic device is caused to execute the method according to any one of claims 1 to 11.

14. A computer program product, characterized in that When the computer program product is run on a computer, the computer is enabled to execute the method according to any one of claims 1 to 11.