Shoulder-button control method, graphical interface, and related apparatus
By detecting the folded screen status in the terminal electronic device and using shoulder keys to control different display screens or application windows, the problem of limitations in shoulder key application scenarios is solved, and flexible operation and convenient interaction under different device forms are achieved.
Patent Information
- Application Number
- PCT/CN2024/093848
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-06-01
- Filing Date
- 2024-05-17
- Publication Date
- 2024-12-05
AI Technical Summary
The application scenarios of shoulder keys in terminal electronic devices are relatively limited and can only be used to achieve fixed functions and lack scalability.
By detecting different states of folded screens in electronic devices, using shoulder keys to control different display screens or application windows, expanding the application scenarios of shoulder keys, including the display screen and application in semi-folded, fully expanded and folded states. The window is independently or jointly controlled to adjust the brightness, volume, focal length and other parameters of the display.
It realizes flexible operation through shoulder keys under different device forms, expands the application scenarios of shoulder keys, improves the convenience of interaction between users and electronic devices, and enhances operation flexibility and user experience.
Smart Images

Figure CN2024093848_05122024_PF_FP_ABST
Abstract
Description
Shoulder key control method, graphic interface and related device
[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office of China on June 1, 2023, with application number 202310648313.7, and priority to the Chinese patent application entitled “Shoulder key control method, graphical interface and related devices”, all contents of which are incorporated by reference into this application. Technical Field
[0002] The present application relates to the field of terminals, and in particular to a shoulder key control method, a graphical interface, and related devices. Background Art
[0003] Shoulder buttons are shoulder buttons. They first appeared as buttons on game controllers and later gradually became used as buttons on the side of terminal electronic devices such as mobile phones and tablets. In terminal electronic devices, these shoulder buttons can be used to realize functions such as turning the phone screen off, on, turning it on, and off. It can be seen that shoulder buttons are widely used in terminal electronic devices. However, it can also be seen that the application of shoulder buttons in terminal electronic devices is very limited and can only be used to realize some fixed functions.
[0004] Therefore, how to expand the application scenarios of shoulder keys is an urgent problem to be solved.
[0005] Summary of the Invention
[0006] The present application provides a shoulder key control method, a graphical interface, and related devices, which realize the combination of the device form of the electronic device, control different display screens through different shoulder keys, and expand the application scenarios of the shoulder keys.
[0007] In a first aspect, the present application provides a shoulder key control method, which is applied to an electronic device including a folding screen, a first shoulder key and a second shoulder key, the folding screen including a first display screen and a second display screen, the first shoulder key is located on the side of the first display screen, and the second shoulder key is located on the side of the second display screen, the method including: the electronic device detects that the folding screen is in a semi-folded state; the electronic device detects a first operation acting on the first shoulder key, controls the first display screen, and does not control the second display screen; the electronic device detects a second operation acting on the second shoulder key, controls the second display screen, and does not control the first display screen.
[0008] The method provided in the first aspect can be implemented in combination with the device form of the electronic device. When the electronic device is in a semi-folded state, different display screens can be controlled by different shoulder keys, thereby expanding the application scenarios of the shoulder keys and providing more convenient operations for the user to interact with the electronic device.
[0009] In combination with the first aspect, in one implementation, the method also includes: the electronic device detects that the folding screen is in a fully unfolded state; the electronic device detects a third operation acting on the first shoulder key and / or the second shoulder key, and controls the folding screen.
[0010] That is to say, when the electronic device is in the fully unfolded state, the electronic device can control the folding screen formed by combining the first display screen and the second display screen through the first shoulder key and / or the second shoulder key.
[0011] In combination with the first aspect, in one implementation, the method also includes: the electronic device detects that the folding screen is in a fully expanded state and multiple application windows are displayed on the folding screen; the electronic device detects a fourth operation acting on the first shoulder key, and controls the first application window among the multiple application windows; the electronic device detects a fifth operation acting on the second shoulder key, and controls the second application window among the multiple application windows.
[0012] It can be seen that when the electronic device is in a fully expanded state and displays multiple application windows, the electronic device can control the content in different application windows through different shoulder keys.
[0013] In combination with the first aspect, in one implementation method, the electronic device controls the first application window, specifically including: the electronic device adjusts the corresponding adjustment object in the first application window; the electronic device controls the second application window, specifically including: the electronic device adjusts the corresponding adjustment object in the second application window; wherein the adjustment object includes any one of the following: display brightness, volume, focal length, page sliding progress, video playback progress, focal length, aperture value, exposure or shutter time.
[0014] That is to say, the electronic device can adjust the corresponding adjustment object in the application window by operating the shoulder keys, thereby facilitating the user's operation.
[0015] In combination with the first aspect, in one implementation, the electronic device also includes: a third display screen, the third display screen is located on the back of the first display screen or the second display screen, and the method also includes: the electronic device detects that the folding screen is in a folded state, wherein the first display screen and the second display screen in the folded state are face to face; the electronic device detects a sixth operation acting on the first shoulder key and / or the second shoulder key, and controls the third display screen.
[0016] That is to say, when the electronic device is an inward-folding folding screen device, when the electronic device is in the folded state, the electronic device can control the third display screen through the first shoulder key and / or the second shoulder key.
[0017] In combination with the first aspect, in one implementation, the method also includes: the electronic device detects that the folding screen is in a folded state, wherein the first display screen and the second display screen in the folded state are back to back; the electronic device detects a seventh operation acting on the first shoulder key and / or the second shoulder key, and controls the first display screen or the second display screen.
[0018] That is to say, when the electronic device is an outward-folding folding screen device, when the electronic device is in the folded state, the electronic device can control the first display screen or the second display screen through the first shoulder key and / or the second shoulder key.
[0019] In combination with the first aspect, in one implementation, the control includes adjusting the corresponding adjustment object in the display screen controlled by the electronic device; wherein the adjustment object includes any one of the following: display screen brightness, volume, focal length, page sliding progress, video playback progress, focal length, aperture value, exposure or shutter time.
[0020] In combination with the first aspect, in one implementation, the adjustment object is related to a page displayed on a display screen controlled by the electronic device.
[0021] Exemplarily, when the page displayed on the display screen controlled by the electronic device is a video playback page, the adjustment object may refer to the video playback progress or video volume; when the page displayed on the display screen controlled by the electronic device is a photo taking page, the adjustment object may refer to the focal length, aperture value, exposure or shutter time; when the page displayed on the display screen controlled by the electronic device is a long page, the adjustment object may refer to the page sliding progress; when the page displayed on the display screen controlled by the electronic device is a page other than the above pages, the adjustment object may refer to the display screen brightness or device volume, etc.
[0022] In combination with the first aspect, in one implementation, the control includes displaying a precision adjustment interface on a display screen controlled by the electronic device; the method also includes: the electronic device detects an eighth operation acting on the precision adjustment interface; and the electronic device adjusts the precision of the first shoulder key and / or the second shoulder key.
[0023] That is, the user can quickly open the precision adjustment interface by operating the shoulder keys, and the user can adjust the precision of the shoulder keys through the precision adjustment interface.
[0024] In combination with the first aspect, in one implementation, when the folding screen is in a fully expanded state, the first shoulder key and the second shoulder key are physically spliced together, and the third operation is used to adjust the corresponding adjustment object in the folding screen; when the first shoulder key and the second shoulder key are touch keys, the third operation includes a sliding operation within the range of the touch screen where the first shoulder key and the second shoulder key are spliced together; when the first shoulder key and the second shoulder key are mechanical keys, the third operation includes pressing or sliding operations at the first end of the first shoulder key or the second end of the second shoulder key.
[0025] That is, when the electronic device is in the fully extended state, the first and second shoulder buttons can be physically connected together. When the first and second shoulder buttons are used as a single shoulder button, the user's sliding distance can include the area of the touch screen where the first and second shoulder buttons are connected, or the user's shoulder button range can include the first and second shoulder buttons. This expands the user's operable range on the shoulder buttons, making it more convenient for the user to control the electronic device using the shoulder buttons.
[0026] In combination with the first aspect, in one implementation, the first shoulder key is located at an edge of the first side of the first display screen that connects to the second display screen, and the second shoulder key is located at an edge of the first side of the second display screen that connects to the first display screen.
[0027] In combination with the first aspect, in one implementation, the first shoulder key and the second shoulder key have different shoulder key precisions.
[0028] Among them, in some application scenarios, when the shoulder key precision of the first shoulder key and the second shoulder key is different, the user can use one shoulder key to make coarse-grained adjustments to the adjustment object and use another shoulder key to make fine-grained adjustments to the adjustment object, which facilitates the user to control the adjustment of the adjustment object more flexibly.
[0029] In combination with the first aspect, in one implementation, if the folding screen is in a semi-folded state, the shoulder key precision of the first shoulder key and the second shoulder key is different; if the folding screen is in a fully expanded state or a folded state, the shoulder key precision of the first shoulder key and the second shoulder key is the same.
[0030] That is to say, in combination with the device form of the electronic device, the accuracy of each shoulder key can be the same or different for different device forms, so that users can use the accuracy adjustment objects of the shoulder keys in different device forms to expand the application scenarios of the shoulder keys.
[0031] In a second aspect, an embodiment of the present application provides an electronic device comprising a memory, one or more processors, and one or more programs; when the one or more processors execute the one or more programs, the electronic device implements the method described in the first aspect or any one of the implementation methods of the first aspect.
[0032] In a third aspect, an embodiment of the present application provides a computer-readable storage medium comprising instructions, which, when executed on an electronic device, causes the electronic device to execute the method described in the first aspect or any one of the implementations of the first aspect.
[0033] In a fourth aspect, an embodiment of the present application provides a computer program product, which, when executed on a computer, enables the computer to execute the method described in the first aspect or any one of the implementations of the first aspect.
[0034] For the beneficial effects of the second to fourth aspects, reference may be made to the description of the beneficial effects in the first aspect, and this application will not go into details here. BRIEF DESCRIPTION OF THE DRAWINGS
[0035] FIG1 is a schematic diagram of folding a device inward or outward according to an embodiment of the present application;
[0036] FIG2 is a schematic diagram of an electronic device in a vertically folded configuration according to an embodiment of the present application;
[0037] FIG3 is a schematic diagram of an electronic device in a horizontally folded configuration according to an embodiment of the present application;
[0038] 4A-4B are user interfaces related to adjusting the brightness of the display screen of the electronic device 100 according to an embodiment of the present application after detecting a sliding operation on a shoulder key;
[0039] 5A-5B are user interfaces related to adjusting the video playback progress of the electronic device 100 according to an embodiment of the present application after detecting a sliding operation on a shoulder button;
[0040] 6A-6D illustrate user interfaces associated with detecting a user's operation on a shoulder button when the electronic device 100 according to an embodiment of the present application is in a fully expanded state and simultaneously displays multiple application pages;
[0041] FIG7 is a user interface displayed by the electronic device 100 when the electronic device 100 is in the unfolded state after detecting a designated operation on a shoulder key, provided by an embodiment of the present application;
[0042] FIG8 is a schematic diagram of a mapping relationship between shoulder key precision and adjustment range of an adjustment object provided by an embodiment of the present application;
[0043] 9A-9B are user interfaces related to adjusting the brightness of the display screen after detecting a sliding operation on a shoulder key of the electronic device 100 according to an embodiment of the present application;
[0044] 10A-10B are user interfaces related to adjusting the video playback progress of the electronic device 100 according to an embodiment of the present application after detecting a sliding operation on a shoulder button;
[0045] FIG11 is a user interface displayed by the electronic device 100 when the electronic device 100 is in a semi-folded state after detecting a designated operation on a shoulder key, according to an embodiment of the present application;
[0046] FIG12 is an overall flow chart of the shoulder key control method provided in an embodiment of the present application;
[0047] FIG13 is a flow chart of a method for adjusting an adjustment object indicated on a display screen using shoulder keys according to an embodiment of the present application;
[0048] FIG14 is a flow chart of a method for opening a precision adjustment interface through a shoulder key according to an embodiment of the present application;
[0049] FIG15 is a flow chart of another shoulder key control method provided in an embodiment of the present application;
[0050] FIG16 is a schematic diagram of the hardware structure of the electronic device 100 provided in an embodiment of the present application;
[0051] FIG17 is a circuit diagram of a shoulder key according to an embodiment of the present application;
[0052] FIG18 is a software structure block diagram of the electronic device 100 provided in an embodiment of the present application. DETAILED DESCRIPTION
[0053] The following is a clear and detailed description of the technical solutions in the embodiments of the present application in conjunction with the accompanying drawings. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in the text is only a description of the association relationship between related objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.
[0054] In the following, the terms "first" and "second" are used for descriptive purposes only and should not be understood to imply or suggest relative importance or implicitly indicate the number of the technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the embodiments of this application, unless otherwise specified, "plurality" means two or more.
[0055] The term "user interface (UI)" in the following embodiments of this application refers to a medium interface for interaction and information exchange between an application or operating system and a user, which realizes the conversion between the internal form of information and the form acceptable to the user. The user interface is a source code written in a specific computer language such as Java and extensible markup language (XML). The interface source code is parsed and rendered on an electronic device and finally presented as content that the user can recognize. The commonly used form of user interface is graphical user interface (GUI), which refers to a user interface related to computer operations that is displayed in a graphical manner. It can be a visual interface element such as text, icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, etc. displayed on the display screen of an electronic device.
[0056] An embodiment of the present application provides a shoulder key control method, which is applied in an electronic device including a folding screen, shoulder key 1 and shoulder key 2, wherein the folding screen includes display screen 1 and display screen 2, shoulder key 1 is located on the side of display screen 1, and shoulder key 2 is located on the side of display screen 2. If the electronic device detects that the folding screen is in a semi-folded state, the electronic device can control display screen 1 and display screen 2 respectively through shoulder key 1 and shoulder key 2.
[0057] It can be seen that the shoulder key control method provided in the embodiment of the present application combines the shoulder key with the device form of an electronic device including a folding screen, expands the application of the shoulder key, and enables the user to control different display screens of the device only by operating different shoulder keys, providing convenience for the user to operate the electronic device.
[0058] Furthermore, if the electronic device detects that the folding screen is in a fully unfolded state, the electronic device can control the folding screen composed of the display screen 1 and the display screen 2 through the shoulder key 1 and / or the shoulder key 2.
[0059] Furthermore, the electronic device may also include a display screen 3. If the electronic device detects that the folding screen is in a folded state, the electronic device may control the display screen 3 through the shoulder key 1 and / or the shoulder key 2. If the electronic device is an inward-folding folding screen device, the display screen 3 may be located on the back of the display screen 1 and / or the display screen 2. If the electronic device is an outward-folding folding screen device, the display screen 3 is the display screen 1 and / or the display screen 2.
[0060] In general, the shoulder key control method provided in the embodiment of the present application enables the shoulder key to have different functions when the electronic device is in different device forms, which facilitates users to control the electronic device more flexibly through the shoulder key when using the electronic device in different device forms.
[0061] The following describes the device form of the electronic device mentioned in the embodiments of the present application.
[0062] The electronic device provided in the embodiments of the present application can be an outward-folding folding screen device or an inward-folding folding screen device. The outward-folding folding screen device folds the electronic device by folding outward, while the inward-folding folding screen device folds the electronic device by folding inward.
[0063] The outward folding and inward folding can be distinguished from each other by the direction in which the electronic device is folded when the electronic device is in the fully unfolded state. Detailed description of the fully unfolded state can be found in the following FIG2 (a).
[0064] For example, FIG1 is a schematic diagram of folding the device inward and outward provided in an embodiment of the present application.
[0065] FIG1(a) shows a schematic diagram of the electronic device in a fully unfolded state, FIG1(b) shows a schematic diagram of the electronic device when folded outward, and FIG1(c) shows a schematic diagram of the electronic device when folded inward.
[0066] As shown in Figure 1(b), outward folding refers to folding the two user-facing displays toward the side facing away from the user, so that the two displays are folded back to back. This allows the larger display area of the electronic device to be reduced to a smaller display area.
[0067] As shown in Figure 1 (c), when the user folds the device, the two user-facing displays are further folded toward the user-facing side, so that the two user-facing displays are folded face to face. This allows the larger display area of the electronic device to be replaced with a smaller display area.
[0068] Figures 2 and 3 take the inward-folding screen device as an example to illustrate the various device forms involved in the electronic device provided in the embodiments of the present application.
[0069] The device form of the electronic device refers to the form of the foldable screen included in the electronic device, which may include: fully unfolded state, semi-folded state, and folded state. In addition, the embodiments of the present application do not limit the folding method of the electronic device. The shoulder key control method provided in the embodiments of the present application is applicable to both outward-folding foldable screen devices and inward-folding foldable screen devices.
[0070] Figure 2 illustrates various possible configurations of an electronic device in a vertically folded configuration. The electronic device may include display screen 1, display screen 2, display screen 3, shoulder keys 1, and shoulder keys 2. Shoulder keys 1 are located on the side of display screen 1, and shoulder keys 2 are located on the side of display screen 2. Display screens 1 and 2 are positioned one above the other, forming the foldable screen of the electronic device.
[0071] Figure 2(a) shows the fully unfolded state of the electronic device. As shown in Figure 2(a), in the fully unfolded state, display screens 1 and 2 face the user, and the angle between display screens 1 and 2 is 180°, meaning that the plane of display screens 1 and 2 is on the same horizontal plane.
[0072] In the fully unfolded state, the electronic device can simultaneously display images on the display screen 1 and the display screen 2. In this way, the user can view images from the display screen 1 and the display screen 2 at the same time.
[0073] Figure 2(b) shows the electronic device in a semi-folded state. As shown in Figure 2(b), in the semi-folded state, there is a certain angle between the plane where display screen 1 is located and the plane where display screen 2 is located, and the angle is greater than 0° and less than 180°.
[0074] In the half-folded state, the electronic device can display images only on display screen 1 or display screen 2. In this way, the user can view images from only display screen 1 or display screen 2. Alternatively, the electronic device can simultaneously display different images on display screen 1 and display screen 2. In this way, the user can selectively view images from display screen 1 or display screen 2 from the two displays.
[0075] Figure 2(c) shows the folded state of the electronic device. As shown in Figure 2(c), in the folded state, the angle between the plane where display screen 1 is located and the plane where display screen 2 is located is 0°, and display screens 1 and 2 are folded face to face.
[0076] In the folded state, the display screens 1 and 2 no longer face the user, and the electronic device can display images through the display screen 3. The display screen 3 can be located on the back of the display screen 1 or the back of the display screen 2.
[0077] It is understood that in other embodiments of the present application, the fully unfolded state may also be referred to as the unfolded state, the semi-folded state may also be referred to as the hovering state, the semi-folded state, etc., and the folded state may also be referred to as the fully folded state. The embodiments of the present application do not limit the names of the device states. In addition, it is also understood that the electronic device may not include the display screen 3. In this case, when the electronic device is in the folded state, the electronic device does not display any image.
[0078] In addition, it should be noted that in the embodiment of the present application, shoulder key 1 and shoulder key 2 can be located on the same side of the display screen, and on both sides of the hinge of the electronic device (as shown by the dotted line in Figure 2 (a)) and close to the hinge. That is, shoulder key 1 is located at the edge of one side of display screen 1 that connects to display screen 2, and shoulder key 2 is located at the edge of one side of display screen 2 that connects to display screen 1. In this way, shoulder key 1 and shoulder key 2 can be spliced and separated as the electronic device is unfolded and folded.
[0079] Specifically, when the electronic device is in the fully unfolded state, see Figure 2 (a), shoulder key 1 and shoulder key 2 can be spliced together and used as one shoulder key. During the inward folding process of the electronic device, see Figure 2 (b), shoulder key 1 and shoulder key 2 can be separated as the folding screen folds inward, and shoulder key 1 and shoulder key 2 can be used as two independent shoulder keys. After the electronic device is folded and in the folded state, shoulder key 1 and shoulder key 2 can be spliced together and used as one shoulder key.
[0080] It can be seen that in the device forms shown in (a)-(c) of Figure 2, when the electronic device is in a fully unfolded state, the shoulder key 1 and / or shoulder key 2 can be used to control the display screen 1 and the display screen 2, wherein the shoulder key 1 and the shoulder key 2 can be combined into one shoulder key for use; when the electronic device is in a semi-folded state, the shoulder key 1 can be used to control the display screen 1, and the shoulder key 2 can be used to control the display screen 2; when the electronic device is in a folded state, the shoulder key 1 and / or shoulder key 2 can be used to control the display screen 3, wherein the shoulder key 1 and the shoulder key 2 can be combined into one shoulder key for use.
[0081] Figure 3 illustrates various possible configurations of an electronic device in a horizontally folded configuration. The electronic device may include display screen 1, display screen 2, display screen 3, and shoulder keys 1 and 2. Shoulder keys 1 are located to the side of display screen 1, and shoulder keys 2 are located to the side of display screen 2. Display screens 1 and 2 are arranged side by side, forming the foldable screen of the electronic device.
[0082] FIG3(a) shows the electronic device in a fully unfolded state. FIG3(b) shows the electronic device in a half-folded state. FIG3(c) shows the electronic device in a folded state.
[0083] For detailed descriptions of the fully unfolded state, half-folded state, and folded state, please refer to the relevant content in Figure 2 above, which will not be repeated here.
[0084] The difference is that in the horizontally folded configuration, shoulder buttons 1 and 2 are located on the side of display screens 1 and 2, respectively, away from the hinge (as indicated by the dotted line in Figure 3(a)). In this case, shoulder buttons 1 and 2 can be spliced together when the electronic device is in the folded configuration.
[0085] Specifically, when the electronic device is in the fully unfolded state (see FIG3 (a)), shoulder button 1 and shoulder button 2 can be used as a single shoulder button. When the electronic device is folded inward (see FIG3 (b)), shoulder button 1 and shoulder button 2 can be used as two independent shoulder buttons. Further, after the electronic device is folded and in the folded state, shoulder button 1 and shoulder button 2 can be spliced together and used as a single shoulder button.
[0086] It can be seen that, similar to the description in Figure 2, in the device forms shown in (a)-(c) in Figure 3, when the electronic device is in the fully unfolded state, the shoulder key 1 and / or the shoulder key 2 can be used to control the display screen 1 and the display screen 2; when the electronic device is in the semi-folded state, the shoulder key 1 can be used to control the display screen 1, and the shoulder key 2 can be used to control the display screen 2; when the electronic device is in the folded state, the display screen 3 can be controlled by the shoulder key 1 and / or the shoulder key 2, wherein the shoulder key 1 and the shoulder key 2 can be combined into one shoulder key for use.
[0087] It should be understood that for outward-folding folding screen devices, in the vertically folded state, the electronic device can also have the fully unfolded state, half-folded state, and folded state described in Figure 2 above; in the horizontally folded state, the electronic device can also have the fully unfolded state, half-folded state, and folded state described in Figure 3 above.
[0088] The difference is that during the outward folding process, the electronic device folds outward. When the folding is complete, that is, in the folded state, display screens 1 and 2 are bonded back to back, with one display screen 1 facing the user and the other facing away from the user. That is, with reference to Figure 2(c), when the outward folding device is in the folded state, display screen 3 shown in the electronic device can refer to either display screen 1 or display screen 2.
[0089] Taking display screen 1 as an example, if the electronic device is in a folded state and displays the picture through display screen 1, then the display screen 1 can be controlled by shoulder key 1 and / or shoulder key 2. Taking display screen 2 as an example, if the electronic device is in a folded state and displays the picture through display screen 2, then the display screen 2 can be controlled by shoulder key 1 and / or shoulder key 2.
[0090] In the embodiment of the present application, the shoulder keys may be of the following types:
[0091] 1) Touch buttons
[0092] When the shoulder button is a touch button, the electronic device can trigger the corresponding function by detecting the user's operation on the shoulder button. For example, the operation can be a touch operation, which can include: single click, double click, triple click, slide, long press, etc.
[0093] 2) Mechanical buttons
[0094] When the shoulder button is a mechanical button, the electronic device can trigger the corresponding function by detecting the user's operation on the shoulder button. For example, the operation can be a pressing operation, which can include single-click, double-click, triple-click, long press, sliding, etc.
[0095] Taking the shoulder keys as touch keys as an example, the following describes the user interface involved in the operation of the shoulder keys acting on the electronic device 100 in combination with Figures 4A-4B, 5A-5B, 6A-6D, 7, 8, 9A-9B, 10A-10B, and 11.
[0096] The electronic device 100 may refer to the electronic device shown in FIG2 . The electronic device 100 may include a display screen 1, a display screen 2, a display screen 3, a shoulder key 1, and a shoulder key 2. The shoulder key 1 is located on the side of the display screen 1, and the shoulder key 2 is located on the side of the display screen 2. The specific physical form of the electronic device 100 can be found in FIG2 and will not be further described here.
[0097] 4A-4B, 5A-5B, 6A-6D, and 7 may refer to user interfaces displayed when the electronic device 100 is in a fully expanded state. For a detailed description of the fully expanded state, please refer to the relevant content of (a) in FIG. 2 .
[0098] 4A-4B show the relevant user interfaces for adjusting the brightness of the display screen after the electronic device 100 detects a sliding operation on the shoulder key.
[0099] FIG4A shows a user interface 10 displayed when the electronic device 100 opens a gallery application. The user interface 10 is used to display pictures in the gallery application.
[0100] It can be understood that Figures 4A-4B take the gallery application as an example to describe the process of the electronic device 100 adjusting the brightness of the display screen based on the user's operation on the shoulder key when displaying the page of the gallery application. In other embodiments of the present application, the electronic device 100 can also adjust the brightness of the display screen based on the user's operation on the shoulder key when displaying other pages. The embodiments of the present application do not limit this.
[0101] In addition, it is worth mentioning that when the electronic device 100 is in the unfolded state, the electronic device 100 combines the display screen 1 and the display screen 2 into one display screen for displaying the picture. As can be seen from Figure 4A, the electronic device 100 displays the user interface 10 in the folding screen composed of the display screen 1 and the display screen 2.
[0102] As shown in FIG4A , when the electronic device 100 detects a user operation on the shoulder button, such as a downward sliding operation, the electronic device 100 may display a brightness indicator bar 101 in the user interface 10 in response to the operation. The brightness indicator bar 101 indicates the current brightness of the display screen. Furthermore, the electronic device 100 adjusts the brightness of the display screen and the brightness indicator bar 101 according to the sliding distance of the sliding operation, thereby displaying the user interface 10 shown in FIG4B .
[0103] As shown in FIG. 4B , compared with FIG. 4A , the brightness value indicated by the brightness indicator bar 101 is larger, and the image displayed in the user interface 10 is brighter.
[0104] In addition, it should be noted that, in the fully expanded state, the electronic device 100 can use the shoulder key 1 and the shoulder key 2 as one shoulder key to control the display screen 1 and the display screen 2 combined. In the user interface shown in Figures 4A and 4B, the user can adjust the brightness of the display screen by sliding operations on the shoulder keys. In this case, when the electronic device 100 uses the shoulder key 1 and the shoulder key 2 as one shoulder key, the sliding range of the user's sliding operation on the shoulder key can be the sliding range where the shoulder key 1 is located, or the sliding range where the shoulder key 2 is located, or the sliding range including the shoulder key 1 and the shoulder key 2 as shown in Figures 4A and 4B. That is, in the fully expanded state, the electronic device 100 can detect the sliding operation on the shoulder key 1 and / or the shoulder key 2, and adjust the brightness of the display screen 1 and the display screen 2 combined.
[0105] 5A-5B show the relevant user interfaces for adjusting the video playback progress after the electronic device 100 detects a sliding operation on the shoulder button.
[0106] FIG5A shows a user interface 20 displayed when the electronic device 100 opens a multimedia application. The user interface 20 includes a video playback page for playing videos.
[0107] In addition, it is worth mentioning that when the electronic device 100 is in the unfolded state, the electronic device 100 combines the display screen 1 and the display screen 2 into one display screen for displaying images. As can be seen from Figure 5A, the electronic device 100 displays the user interface 20 on the display screen combined with the display screen 1 and the display screen 2.
[0108] As shown in FIG5A , the user interface 20 may include a video playback window 201 and a playback progress bar 202 . The video playback window 201 is used to display the video being played, and the playback progress bar 202 is used to indicate the progress of the video being played in the video playback window 201 .
[0109] When the electronic device 100 detects a user operation on the shoulder key, such as a sliding operation from top to bottom, in response to the operation, the electronic device 100 can adjust the progress of the video played in the video playback page and display the user interface 20 shown in Figure 5B.
[0110] As shown in FIG. 5B , compared to FIG. 5A , the video image displayed in the video playback window 201 has changed, and the playback progress indicated by the playback progress bar 202 has moved backward.
[0111] 4A-4B , in the fully extended state, electronic device 100 can use shoulder button 1 and shoulder button 2 as a single shoulder button, and the sliding range of a sliding operation on the shoulder button detected by electronic device 100 can include the key range of shoulder button 1 and shoulder button 2. In other words, in the fully extended state, electronic device 100 can detect a sliding operation on shoulder button 1 and / or shoulder button 2 and adjust the progress of the video displayed on the combined display screen of display screen 1 and display screen 2.
[0112] It can be seen that the above Figures 4A-4B and 5A-5B show that if the electronic device 100 is in a fully expanded state and only displays one application page, the electronic device 100 can be controlled based on the user's operation on the shoulder key 1 and the shoulder key 2 combined shoulder key.
[0113] 6A-6D illustrate user interfaces involved in detecting user operations on shoulder buttons when the electronic device 100 is in a fully expanded state and simultaneously displays multiple application pages.
[0114] Figure 6A shows a user interface 30 of electronic device 100, in which both a page of a gallery application and a video playback page of a multimedia application are displayed. User interface 30 may include a first window 301 and a second window 302. First window 301 is used to display the video playback page of the multimedia application, and second window 302 is used to display the page of the gallery application.
[0115] It is understood that the embodiments of the present application do not limit the display format of multiple application pages when the electronic device 100 displays the pages of multiple applications simultaneously. For example, the electronic device 100 can display the application pages in full screen form, or in floating window form, or in split screen form.
[0116] For example, in the user interface 30 shown in (a) of FIG6A , the electronic device 100 may display a page of a gallery application in full screen format and a video playback page of a multimedia application in a floating window format.
[0117] For example, in the user interface 30 shown in (b) of FIG6A , the electronic device 100 may display a page of a gallery application and a video playback page of a multimedia application in split screen.
[0118] Taking (b) in Figure 6A as an example, when the electronic device 100 detects a user operation on the shoulder key, such as a downward sliding operation on the shoulder key 1 shown in (b) in Figure 6A, in response to the operation, the electronic device 100 can adjust the progress of the video played in the first window 301 and display the user interface 30 shown in Figure 6B.
[0119] For details about adjusting the video progress, please refer to the relevant content in Figures 5A and 5B above, which will not be repeated here.
[0120] When the electronic device 100 detects a user operation on the shoulder key, such as a downward sliding operation on the shoulder key 2 shown in Figure 6C, in response to the operation, the electronic device 100 can adjust the brightness of the display area of the second window 302 and display the user interface 30 shown in Figure 6D.
[0121] For details on adjusting the brightness, please refer to the relevant content in Figures 4A and 4B above, which will not be repeated here.
[0122] In some embodiments, when the electronic device 100 is in a fully expanded state and multiple application pages are displayed simultaneously, the shoulder key 1 and / or the shoulder key 2 can also be used to control the application page in one of the application windows. For example, the application window can be a focus window, which refers to the window that the user last focused on, or the layer where the focus window is located is above the layer where other windows are located. Taking the user interface 30 shown in (a) in Figure 6A as an example, assuming that the first window 301 is the focus window, the adjustment operation performed by the user on the shoulder key 1 and / or the shoulder key 2, such as a sliding operation, can be used to adjust the video playback progress in the first window 301.
[0123] As can be seen from FIG. 6A to FIG. 6D , in the fully expanded state, if the electronic device 100 displays multiple application windows, the electronic device 100 can use the shoulder key 1 and the shoulder key 2 as independent shoulder keys to control different application windows.
[0124] 7 shows a user interface 40 displayed by the electronic device 100 after detecting a designated operation on a shoulder key when the electronic device 100 is in the unfolded state. The user interface 40 is a precision adjustment interface through which the user can adjust the precision of the shoulder key.
[0125] The shoulder key precision is used to indicate the adjustment amplitude of the adjustment object by the user's adjustment operation on the shoulder key. For example, the adjustment operation may refer to the sliding operation shown in Figures 4A-4B and 6C-6D, and the adjustment object may refer to the brightness of the display screen. Alternatively, the adjustment operation may refer to the sliding operation shown in Figures 5A-5B and 6A-6B, and the adjustment object may refer to the video playback progress. For a detailed description of the shoulder key precision, please refer to the subsequent description of Figure 8, which will not be expanded here.
[0126] Exemplarily, the designated operation may refer to a double-click operation, a triple-click operation, a long press operation, etc. The embodiment of the present application does not limit the designated operation.
[0127] In addition, in the expanded state, the designated operation acting on the shoulder key may refer to an operation acting on the shoulder key 1 and the shoulder key 2 combined. In this case, the electronic device 100 can determine whether to display the user interface 40 by detecting whether there is a designated operation acting on the shoulder key 1 and / or the shoulder key 2.
[0128] Exemplarily, the precision adjustment interface may be an interface in a settings application. In addition to detecting a specified operation on the shoulder key and opening the precision adjustment interface, the electronic device 100 may also detect the user's operation of opening the settings application and display the precision adjustment interface in the settings application.
[0129] As shown in FIG7 , the user interface 40 may include an adjustment option 401. The adjustment option 401 may be used to adjust the precision of the shoulder button 1 and the shoulder button 2 simultaneously.
[0130] For example, the adjustment options 401 may include an adjustment indicator 401A, which is used to indicate the precision of shoulder button 1 and shoulder button 2. Furthermore, the electronic device 100 may detect a left or right swipe operation by the user on the adjustment indicator 401A, and in response to the swipe operation, adjust the precision of shoulder button 1 and shoulder button 2. Specifically, when the electronic device 100 detects a left swipe operation on the adjustment indicator 401A, the precision of shoulder button 1 and shoulder button 2 is reduced in response to the swipe operation. Correspondingly, when the electronic device 100 detects a right swipe operation on the adjustment indicator 401A, the precision of shoulder button 1 and shoulder button 2 is increased in response to the swipe operation.
[0131] It is understandable that the electronic device 100 can also detect the sliding operation acting on the shoulder key 1 and / or the shoulder key 2, and adjust the precision indicated by the adjustment option 401. The embodiment of the present application does not limit the interactive method of the user to adjust the shoulder key precision.
[0132] Optionally, the user interface 40 further includes an adjustment option 402. The adjustment option 402 can be used to adjust the precision of the shoulder button 1 and the shoulder button 2 respectively.
[0133] For example, adjustment options 402 may include a first option 402A and a second option 402B. First option 402A indicates the precision of shoulder button 1. The electronic device 100 may detect an adjustment operation on first option 402A, adjusting the precision of shoulder button 1. Second option 402B indicates the precision of shoulder button 2. The electronic device 100 may detect an adjustment operation on second option 402B, adjusting the precision of shoulder button 2.
[0134] As can be seen from adjustment option 402, the precision of shoulder button 1 and shoulder button 2 can be adjusted separately, and the precision of shoulder button 1 and shoulder button 2 can be different. In a specific example, the precision of shoulder button 2 can be higher than that of shoulder button 1. Both shoulder buttons 1 and 2 can be used to adjust the playback progress of a video. In this case, the user can use shoulder button 1 to make coarse-grained adjustments to the playback progress, and use shoulder button 2 to make fine-grained adjustments to the playback progress.
[0135] In some optional embodiments, the precision of shoulder key 1 and shoulder key 2 indicated in adjustment option 402 may be effective when electronic device 100 is in a semi-folded state. Thus, when electronic device 100 is in a semi-folded state, shoulder key 1 and shoulder key 2 may have different precisions. Alternatively, in some other optional embodiments, the precision of shoulder key 1 and shoulder key 2 indicated in adjustment option 402 may be effective when electronic device 100 is in a fully extended state and multiple application windows are displayed. Thus, when electronic device 100 is in a fully extended state and multiple application windows are displayed, shoulder key 1 and shoulder key 2 may have different precisions. In addition, when shoulder key 1 and shoulder key 2 are used together as one shoulder key, for example, when electronic device 100 is in a fully extended state and only one application window is displayed, the precision indicated in adjustment option 401 is effective. Thus, when shoulder key 1 and shoulder key 2 are used together, the precision of shoulder key 1 and shoulder key 2 is the same.
[0136] The shoulder key accuracy is described in detail below.
[0137] Taking the shoulder key as a touch key, FIG8 shows a schematic diagram of the mapping relationship between the shoulder key precision and the adjustment amplitude of the adjustment object under a sliding operation of a certain sliding distance on the shoulder key.
[0138] Exemplarily, the adjustment object may refer to one or more objects such as volume, brightness, video playback progress, focal length, page sliding progress, aperture value, exposure, shutter time, etc.
[0139] As shown in Figure 8, when a sliding operation is performed on a shoulder key over a certain sliding distance, if the shoulder key precision is low, the adjustment range of the adjustment object is large, while if the shoulder key precision is high, the adjustment range of the adjustment object is small. In other words, the lower the shoulder key precision, the coarser the adjustment of the adjustment object caused by the sliding operation on the shoulder key, and the higher the shoulder key precision, the finer the adjustment of the adjustment object caused by the sliding operation on the shoulder key.
[0140] Taking volume as an example, let's assume the progress bar before and after adjustment shown in Figure 8 is a volume progress bar, and a sliding operation on the shoulder key can be used to adjust the volume. Then, for a sliding operation on the shoulder key with the same sliding distance, the higher the shoulder key precision, the smaller the volume adjustment, while the lower the shoulder key precision, the larger the volume adjustment. For example, if the sliding operation is used to increase the volume, if the volume before and after the adjustment is the same, the volume after adjustment will be higher if the shoulder key precision is lower than if the shoulder key precision is higher.
[0141] In an internal implementation, the electronic device 100 may pre-store a mapping relationship between shoulder key precision and the adjustment amplitude of the adjustment object at a certain sliding distance. Assuming that shoulder key precision has five numerical levels of 1-5 and the adjustment object has a numerical adjustment range of 0-100, the adjustment amplitude may refer to the interval of change in the numerical value of the adjustment object at a certain sliding distance. For example, the electronic device 100 may pre-store the mapping relationship shown in Table 1 below.
[0142] Table 1
[0143] As can be seen from Table 1, the greater the shoulder key precision, the smaller the adjustment range of the adjustment object, and the smaller the shoulder key precision, the larger the adjustment range of the adjustment object. Assuming a sliding distance of 1 mm, a shoulder key precision of 1, and an adjustment range of 10, if the electronic device 100 detects a sliding distance of 3 mm on the shoulder key, the value of the adjustment object changes by 10*3=30, for example, the volume increases by 30.
[0144] It can be understood that Table 1 is only an illustrative example. The shoulder key accuracy, the numerical adjustment range of the adjustment object, the adjustment amplitude and the sliding distance may have other numerical values. The embodiments of the present application do not limit this, and Table 1 does not constitute a limitation on the embodiments of the present application.
[0145] It is understood that Figure 8 uses the shoulder keys as touch buttons as an example to illustrate the mapping relationship between the shoulder key precision and the adjustment range of the adjustment object under a sliding operation on the shoulder keys. If the shoulder keys are mechanical buttons, for adjustment objects with a numerical adjustment range, the user can change the value of the adjustment object by clicking or long-pressing the shoulder keys. In this case, it is still possible to determine the mapping relationship between different shoulder key precisions and the adjustment range of the adjustment object under the operation of the shoulder keys.
[0146] Assume that a click operation on a shoulder button can trigger an adjustment of an adjustment object. In a continuous click process, the more clicks are performed, the greater the change in the value of the adjustment object. In a single click operation, if the shoulder button has low precision, the adjustment amplitude of the adjustment object is large, while if the shoulder button has high precision, the adjustment amplitude of the adjustment object is small.
[0147] Assume that a long press on a shoulder button triggers an adjustment of the adjustment object. During a long press, the longer the long press, the greater the change in the value of the adjustment object. Furthermore, for a given unit press duration, if the shoulder button's precision is low, the adjustment of the adjustment object will be larger, while if the shoulder button's precision is high, the adjustment of the adjustment object will be smaller.
[0148] As can be seen from Figures 7 and 8, in the fully expanded state, the electronic device 100 can display a precision adjustment interface on the combined display screen of display screen 1 and display screen 2 by acting on the shoulder key 1 and / or the specified operation of the shoulder key. The user can customize the shoulder key precision through the precision adjustment interface. In this way, when the user needs to fine-tune the progress bar, the shoulder key precision can be increased. When the user needs to make a fast and large progress bar, the shoulder key precision can be reduced, thereby providing a better user experience for the user to adjust the parameter value through the shoulder key.
[0149] The user interfaces shown in Figures 9A-9B and 10A-10B may be user interfaces displayed when the electronic device 100 is in a semi-folded state. For a detailed description of the semi-folded state, please refer to the relevant content of Figure 2 (b).
[0150] 9A-9B show the relevant user interfaces for adjusting the brightness of the display screen after the electronic device 100 detects a sliding operation on the shoulder key.
[0151] FIG9A shows a user interface 50 displayed when the electronic device 100 opens a gallery application. The user interface 50 is used to display pictures in the gallery application.
[0152] In addition, it is worth mentioning that when the electronic device 100 is in the semi-folded state, the electronic device 100 can display images independently on the display screen 1 and the display screen 2. In this case, the electronic device 100 can display the user interface 50 shown in FIG. 9A on the display screen 1 or the display screen 2.
[0153] As shown in Figure 9A, when the electronic device 100 detects a user operation on the shoulder key, such as a sliding operation from left to right, in response to the operation, the electronic device 100 can adjust the brightness of the display area where the user interface 50 is located and display the user interface 50 shown in Figure 9B.
[0154] As shown in FIG. 9B , the screen displayed in the user interface 50 is brighter than that in FIG. 9A .
[0155] It can be understood that the brightness adjustment process shown in Figures 9A and 9B is similar to the brightness adjustment process shown in Figures 4A and 4B. The content not expanded in detail in Figures 9A and 9B can be referred to the content in Figures 4A and 4B, and will not be repeated here.
[0156] 4A-4B , the sliding operation on the shoulder keys shown in FIG9A-9B is an operation on shoulder key 1 or shoulder key 2 in electronic device 100. Specifically, if electronic device 100 displays user interface 50 on display screen 1, the sliding operation on the shoulder keys is a sliding operation on shoulder key 1; if electronic device 100 displays user interface 50 on display screen 2, the sliding operation on the shoulder keys is a sliding operation on shoulder key 2.
[0157] 10A-10B show the relevant user interfaces for adjusting the video playback progress after the electronic device 100 detects a sliding operation on the shoulder button.
[0158] FIG10A shows a user interface 60 displayed when the electronic device 100 opens a multimedia application. The user interface 60 is used to display a video playback page for playing videos.
[0159] In addition, it is worth mentioning that when the electronic device 100 is in the semi-folded state, the electronic device 100 can display images independently on the display screen 1 and the display screen 2. In this case, the electronic device 100 can display the user interface 60 shown in Figure 10A on the display screen 1 or the display screen 2.
[0160] As shown in Figure 10A, when the electronic device 100 detects a user operation on the shoulder key, such as a sliding operation from left to right, in response to the operation, the electronic device 100 can adjust the progress of the video played in the video playback page and display the user interface 60 shown in Figure 10B.
[0161] As shown in FIG10B , compared with FIG10A , the progress of the page played in the video playback page moves backward.
[0162] It can be understood that the video progress adjustment process shown in Figures 10A-10B is similar to the video progress adjustment process shown in Figures 5A-5B. The content not expanded in detail in Figures 10A-10B can be referred to the content in Figures 5A-5B, and will not be repeated here.
[0163] 5A-5B , the sliding operation on the shoulder key shown in FIG10A-10B is an operation on shoulder key 1 or shoulder key 2 in electronic device 100. Specifically, if electronic device 100 displays user interface 60 on display screen 1, the sliding operation on the shoulder key is a sliding operation on shoulder key 1; if electronic device 100 displays user interface 60 on display screen 2, the sliding operation on the shoulder key is a sliding operation on shoulder key 2.
[0164] As can be seen from Figures 9A-9B and Figures 10A-10B, when the electronic device 100 is in a semi-folded state, the electronic device 100 can display images through display 1 or display 2, and control display 1 through shoulder key 1 and control display 2 through shoulder key 2.
[0165] In addition, Figures 9A-9B and 10A-10B only describe the user interface displayed by the electronic device 100 when one of the display screens displays a picture in the semi-folded state. It can be understood that the other display screen may also display a picture, or be in an off state, or a state with low brightness. The embodiments of the present application do not limit this.
[0166] Figure 11 shows a user interface 70 displayed by the electronic device 100 after detecting a designated operation on a shoulder key when the electronic device 100 is in a semi-folded state. The user interface 70 is a precision adjustment interface through which the user can adjust the precision of the shoulder key.
[0167] For a detailed description of the user interface 70 , please refer to the relevant content in FIG. 7 . For a detailed description of the accuracy of the shoulder keys, please refer to the relevant content in FIG. 8 . Detailed descriptions will not be given here.
[0168] It should be noted that when the electronic device 100 is in the semi-folded state, the electronic device 100 can display the user interface 70 through the display screen 1 or the display screen 2. The content included in the user interface 70 can be the same as the content in the user interface 40 displayed when the electronic device 100 is in the fully unfolded state, or the content in the user interface 70 can be a portion of the user interface 40. For example, the user interface 70 can include only one of the first option 402A or the second option 402B shown in Figure 7, and does not include the adjustment option 401.
[0169] That is to say, when the electronic device 100 displays the precision adjustment interface only through the display screen 1 or the display screen 2, the precision adjustment interface only provides the user with the option of adjusting the precision of one of the shoulder keys. For example, if the electronic device 100 displays the precision adjustment interface only through the display screen 1, the precision adjustment interface may include the first option 402A shown in Figure 7, excluding the second option 402B and the adjustment option 401, so that the user can only adjust the precision of the shoulder key 1. For another example, if the electronic device 100 displays the precision adjustment interface only through the display screen 2, the precision adjustment interface may include the second option 402B shown in Figure 7, excluding the first option 402A and the adjustment option 401, so that the user can only adjust the precision of the shoulder key 2.
[0170] Furthermore, if the precision adjustment interface is displayed on display screen 1, the designated operation on the shoulder key detected by the electronic device 100 may be the designated operation on shoulder key 1; if the precision adjustment interface is displayed on display screen 2, the designated operation on the shoulder key detected by the electronic device 100 may be the designated operation on shoulder key 2. In other words, when the electronic device 100 is in a semi-folded state, the electronic device 100 may detect a designated operation on one of the shoulder keys and display the precision adjustment interface on the display screen on the side where the shoulder key is located.
[0171] In addition, when the electronic device 100 is in the folded state, the electronic device 100 can display images through the display screen 3. For a detailed description of the folded state, please refer to the relevant content in (c) of Figure 2 above, which will not be repeated here.
[0172] In this case, similar to the user interfaces shown in Figures 9A-9B, 10A-10B, and 11, the electronic device 100 can detect a sliding operation on the shoulder key, adjust the brightness of the display screen or adjust the playback progress of the video, or detect a specified operation on the shoulder key and display the accuracy adjustment interface. Among them, the content displayed by the electronic device 100 through the display screen 3 can refer to the user interfaces shown in Figures 9A-9B, 10A-10B, and 11 mentioned above. The difference is that when the electronic device 100 displays the picture through the display screen 3, the electronic device 100 can combine the shoulder key 1 and the shoulder key 2 into one shoulder key for controlling the display screen 3. That is, the sliding operation on the shoulder key may include a sliding operation on the shoulder key 1 and / or the shoulder key 2, and the specified operation on the shoulder key may include a specified operation on the shoulder key 1 and / or the shoulder key 2.
[0173] It is understandable that Figures 4A-4B, 5A-5B, 6A-6D, 9A-9B, and 10A-10B only illustrate the scenario in which the electronic device 100 adjusts the brightness by acting on the shoulder key when displaying the gallery page, and the scenario in which the video playback progress is adjusted by acting on the shoulder key when displaying the video playback page. In other embodiments of the present application, the electronic device 100 may also have other scenarios in which objects are adjusted by the shoulder key, and the adjustment objects may include: display brightness, volume, focal length, page sliding progress, video playback progress, focal length, aperture value, exposure or shutter time, etc., and the present application embodiment does not limit this. For example, when the electronic device 100 displays the settings page, the brightness can be adjusted by acting on the shoulder key, or, when the electronic device 100 displays the music playback page, the volume can be adjusted by acting on the shoulder key. The present application embodiment does not limit this.
[0174] In some embodiments, the objects adjusted by the shoulder buttons can be set by the user. For example, the user can set different adjustment objects for different pages. For example, the user can set that when the electronic device 100 displays the gallery page, the adjustment operation applied to the shoulder buttons can be used to adjust the brightness, and when the electronic device 100 displays the music playback page, the adjustment operation applied to the shoulder buttons can be used to adjust the volume.
[0175] In some embodiments, the adjustment operation for the shoulder buttons can also be set by the user. For example, the user can set the adjustment operation to a slide operation. In this way, when the electronic device 100 detects a slide operation on the shoulder button, the electronic device 100 can be triggered to adjust the corresponding adjustment object on the display screen. For another example, the user can also set the adjustment operation to a click operation. In this way, when the electronic device 100 detects a click operation on the shoulder button, the electronic device 100 can be triggered to adjust the corresponding adjustment object on the display screen.
[0176] FIG12 is an overall flow chart of the shoulder key control method provided in an embodiment of the present application.
[0177] As shown in FIG12 , the shoulder key control method may include:
[0178] S101. The electronic device 100 obtains the device form.
[0179] The electronic device 100 is a foldable screen device and may include a display screen 1, a display screen 2, a display screen 3, a shoulder key 1, and a shoulder key 2. The display screen 1 and the display screen 2 constitute the foldable screen of the electronic device 100. The shoulder key 1 is located on one side of the display screen 1, and the shoulder key 2 is located on one side of the display screen 2.
[0180] It should be noted that, for an outward-folding folding screen, display screen 3 may refer to display screen 1 or display screen 2; for an inward-folding folding screen, display screen 3 is located on the back of display screen 1 or display screen 2.
[0181] In the embodiment of the present application, display screen 1 can also be called the first display screen, display screen 2 can also be called the second display screen, display screen 3 can also be called the third display screen, shoulder key 1 can also be called the first shoulder key, and shoulder key 2 can also be called the second shoulder key.
[0182] The device form describes the form of the foldable screen of the electronic device 100 at different opening and closing angles. The device form of the electronic device 100 may include: fully unfolded state, half-folded state, and folded state.
[0183] For example, the electronic device 100 may determine the device form of the electronic device 100 through a sensor such as a magnetic sensor or a gyroscope sensor.
[0184] For a detailed description of the device form of the electronic device 100 , please refer to the relevant contents in the aforementioned FIG. 1 to FIG. 3 , which will not be repeated here.
[0185] According to the different device forms of the electronic device 100 , the electronic device 100 may respectively execute steps S102 , S104 and S109 .
[0186] S102 . If the device state is a semi-folded state, the electronic device 100 controls the display screen 1 and the display screen 2 to display images independently.
[0187] For example, if the electronic device 100 is in a semi-folded state, the device form of the electronic device 100 may be as shown in FIG. 2 ( b ) or FIG. 3 ( b ).
[0188] The independent display screens on the display screen 1 and the display screen 2 refer to that the electronic device 100 independently displays the display contents on the display screen 1 and the display screen 2, and the display contents on the display screen 1 and the display screen 2 do not affect each other.
[0189] In this case, the electronic device 100 can display the picture only on display screen 1, and display screen 2 is in an off state or a low brightness state, or the electronic device 100 can display the picture only on display screen 2, and display screen 1 is in an off state or a low brightness state, or the contents of different applications can be displayed on display screen 1 and display screen 2 respectively, or different pages of the same application can be displayed respectively.
[0190] Exemplarily, the screen displayed by the electronic device 100 on the display screen 1 may refer to the user interface 50 shown in Figures 9A-9B, or the user interface 60 shown in Figures 10A-10B, or the user interface 70 shown in Figure 11, and the screen displayed by the electronic device 100 on the display screen 2 may refer to the user interface 60 shown in Figures 10A-10B, or the user interface 50 shown in Figures 9A-9B, or the user interface 70 shown in Figure 11.
[0191] S103. The electronic device 100 controls the display screen 1 via the shoulder key 1 and controls the display screen 2 via the shoulder key 2.
[0192] Among them, shoulder key 1 and shoulder key 2 can be touch keys or mechanical keys, and the embodiment of the present application does not limit the type of shoulder keys.
[0193] The electronic device 100 controls the display screen 1 via the shoulder key 1, which means that the electronic device 100 detects that the user operation (for example, the first operation) acting on the shoulder key 1 is used to control the display screen 1. Correspondingly, the electronic device 100 controls the display screen 2 via the shoulder key 2, which means that the electronic device 100 detects that the user operation (for example, the second operation) acting on the shoulder key 2 is used to control the display screen 2.
[0194] For example, referring to Figures 9A-9B, if the user interface 50 is a picture displayed on display screen 1, the user can adjust the brightness of display screen 1 by sliding on shoulder key 1. If the user interface 50 is a picture displayed on display screen 2, the user can adjust the brightness of display screen 2 by sliding on shoulder key 2.
[0195] For example, referring to Figures 10A-10B, if the user interface 60 is a picture displayed on the display screen 1, the user can adjust the playback progress of the video played on the display screen 1 by sliding on the shoulder key 1. If the user interface 60 is a picture displayed on the display screen 1, the user can adjust the playback progress of the video played on the display screen 2 by sliding on the shoulder key 1.
[0196] For specific applications of the electronic device 100 controlling the display screen through the shoulder keys, please refer to the contents shown in the subsequent Figures 13 and 14, which will not be described here in detail.
[0197] S104. If the device state is the fully unfolded state, the electronic device 100 combines the display screen 1 and the display screen 2 into one display screen to display the image.
[0198] For example, if the electronic device 100 is in the fully unfolded state, the device form of the electronic device 100 may be as shown in (a) in FIG. 2 or (a) in FIG. 3 .
[0199] Among them, display screen 1 and display screen 2 are combined into one display screen display screen, which means that the electronic device 100 regards display screen 1 and display screen 2 as a display screen containing a display area of display screen 1 and display screen 2, and the electronic device 100 can send the display content to be displayed to the display area where display screen 1 and display screen 2 are located for display.
[0200] In this case, the electronic device 100 can display images on the display screen 1 and the display screen 2 at the same time, and cancel the images displayed on the display screen 1 and the display screen 2 at the same time.
[0201] Exemplarily, the screen displayed by the electronic device 100 on the combined display screen of display screen 1 and display screen 2 may refer to the user interface 10 shown in Figures 4A-4B, or the user interface 20 shown in Figures 5A-5B, or the user interface 30 shown in Figures 6A-6D, or the user interface 40 shown in Figure 7.
[0202] S105. The electronic device 100 controls the combined display screen of the display screen 1 and the display screen 2 through the shoulder key 1 and / or the shoulder key 2.
[0203] The electronic device 100 controls the combined display screen of display screen 1 and display screen 2 through shoulder key 1 and / or shoulder key 2, which means that the user operation (for example, the third operation) acting on shoulder key 1 and / or shoulder key 2 detected by the electronic device 100 is used to control the combined display screen, that is, the folding screen.
[0204] Furthermore, the electronic device 100 may further subdivide how to control the content in the display screen through the shoulder key 1 and the shoulder key 2 according to the number of application windows displayed in the combined display screen. For details, please refer to the subsequent steps S106-S108.
[0205] For specific applications of the electronic device 100 controlling the display screen through the shoulder keys, please refer to the contents shown in the subsequent Figures 13 and 14, which will not be described here in detail.
[0206] S106. The electronic device 100 determines whether only one application window is displayed on the combined display screen.
[0207] The electronic device 100 determines whether only one application window is displayed in the combined display screen, that is, determines whether only one application window is displayed in the display area where the display screen 1 and the display screen 2 are located.
[0208] If the electronic device 100 determines that only one application window is displayed on the combined display screen, the electronic device 100 executes step S107 ; otherwise, if the electronic device 100 determines that multiple application windows are displayed on the combined display screen, the electronic device 100 executes step S108 .
[0209] Among them, when multiple application windows are displayed on the combined display screen, these multiple application windows may include full-screen displayed windows, floating displayed windows, split-screen displayed windows, etc. The embodiment of the present application does not limit the window form of the application window.
[0210] S107. The electronic device 100 uses the shoulder key 1 and the shoulder key 2 as one shoulder key to control the content in the application window.
[0211] If only one application window is displayed on the combined display screen, the electronic device 100 can treat shoulder key 1 and shoulder key 2 as a single shoulder key to control the content in the application window. For example, the electronic device 100 can detect user operations on shoulder key 1 and / or shoulder key 2 and adjust the page progress displayed in the application window, the progress and brightness of the video playing in the application window, etc.
[0212] Among them, the following two situations can occur when shoulder button 1 and shoulder button 2 are used as one shoulder button;
[0213] 1) Shoulder button 1 and shoulder button 2 have the same function
[0214] In this case, whether the electronic device 100 detects an operation on the shoulder button 1 or detects an operation on the shoulder button 2, the same function is achieved.
[0215] In this way, if the user wants to adjust the brightness of the display screen by sliding the shoulder key, the user can adjust the brightness of the display screen by sliding either shoulder key 1 or shoulder key 2. In this case, the user does not need to distinguish between the shoulder keys to control the electronic device 100, and can achieve the same function by operating any shoulder key.
[0216] 2) Shoulder button 1 and shoulder button 2 are physically spliced together. The spliced shoulder button is considered to have a larger key range.
[0217] In some embodiments, the shoulder buttons 1 and 2 can be connected and separated as the electronic device 100 changes shape. When the electronic device 100 is in the fully extended state, the shoulder buttons 1 and 2 can be connected together. When connected together, the shoulder buttons 1 and 2 can be considered as one shoulder button.
[0218] Users can regard the spliced shoulder keys as shoulder keys with a larger key range.
[0219] For example, if the shoulder keys are touch-sensitive keys, the electronic device 100 can detect a sliding operation on the shoulder keys to execute a corresponding function, such as adjusting the progress of a video. For a shoulder key before splicing, such as shoulder key 1 or shoulder key 2, the sliding distance that the user can slide is the key length of shoulder key 1 or shoulder key 2. For a shoulder key after splicing, such as the shoulder key 1 and shoulder key 2 spliced together, the sliding distance that the user can slide is the key length of the spliced shoulder key 1 and shoulder key 2.
[0220] For another example, if the shoulder keys are mechanical keys, and the electronic device 100 can respectively detect click operations applied to both ends of the shoulder keys, the value of the adjustment object, such as the volume, can be increased or decreased. For a shoulder key before splicing, such as shoulder key 1 or shoulder key 2, the user can increase the volume by clicking on one end of the shoulder key 1 or shoulder key 2, and decrease the volume by clicking on the other end of the shoulder key 1 or shoulder key 2. For the shoulder keys after splicing, such as the shoulder keys spliced together from shoulder key 1 and shoulder key 2, the user can increase the volume by clicking on one end of the spliced shoulder key, such as one end of shoulder key 1, and decrease the volume by clicking on the other end of the spliced shoulder key, such as the other end of shoulder key 2.
[0221] For example, referring to FIG. 4A-FIG . 4B , the electronic device 100 may detect a sliding operation applied to the range where the shoulder key 1 and the shoulder key 2 are located, and adjust the brightness of the screen in the user interface 10 .
[0222] For example, referring to FIG. 5A-FIG . 5B , the electronic device 100 may detect a sliding operation applied to the range of the shoulder key 1 and the shoulder key 2 to adjust the progress of the video played in the user interface 20 .
[0223] In this way, compared to using shoulder key 1 or shoulder key 2 to control electronic device 100, using the spliced shoulder key to control electronic device 100 allows the user to have a wider physical control range for the shoulder key. Taking the shoulder key as a touch key as an example, when the user needs to adjust the video playback progress by sliding the shoulder key, if the amount of change in the video playback progress that the user wants to change is large, the narrow physical control range may require the user to repeatedly slide the shoulder key multiple times before the video playback progress can be adjusted to the user's desired position. For the shoulder key with a wider physical control range after splicing, the user only needs one sliding operation to adjust the video playback progress to the user's desired position, which shortens the user's adjustment time, helps the user quickly change the value of the adjustment object, and improves the user's experience.
[0224] S108. The electronic device 100 controls the contents in different application windows through the shoulder key 1 and the shoulder key 2 respectively.
[0225] When multiple application windows are displayed on the combined display screen, the electronic device 100 can control different application windows using different shoulder keys. For example, assuming that the electronic device 100 displays multiple application windows on the foldable screen, a user operation (e.g., the fourth operation) detected by the electronic device 100 on shoulder key 1 is used to control one of the multiple application windows (e.g., the first application window), and a user operation (e.g., the fifth operation) detected by the electronic device 100 on shoulder key 2 is used to control another application window (e.g., the second application window) among the multiple application windows.
[0226] Wherein, a shoulder key is used to control the application window to be the window that has a corresponding relationship with the shoulder key. The electronic device 100 can determine the corresponding relationship between the shoulder key and the application window in the following manner:
[0227] 1) The electronic device 100 can determine the correspondence between the shoulder key and the application window according to the position of the application window
[0228] Exemplarily, the electronic device 100 may determine the application window closest to the shoulder key as the application window corresponding to the shoulder key.
[0229] For example, referring to (b) in FIG6A , the user interface 30 includes a first window 301 and a second window 302. The window closest to shoulder button 1 is the first window 301, and the window closest to shoulder button 2 is the second window 302. Therefore, shoulder button 1 is used to control the first window 301, and shoulder button 2 is used to control the second window 302.
[0230] 2) The electronic device 100 can determine the correspondence between the shoulder keys and the application windows based on the upper and lower layer relationships between the application windows.
[0231] For example, the electronic device 100 may sequentially assign corresponding relationships to the shoulder keys according to the application windows arranged from top to bottom in the layer.
[0232] For example, referring to (a) in FIG6A , the user interface 30 includes a first window 301 and a second window 302. The first window 301 is located above the layer where the second window 302 is located. The electronic device 100 can assign the application window corresponding to shoulder key 1 as the first window 301, and the application window corresponding to shoulder key 2 as the second window 302. Therefore, shoulder key 1 is used to control the first window 301, and shoulder key 2 is used to control the second window 302.
[0233] It is understandable that the electronic device 100 can also determine the correspondence between the shoulder key and the application window in other ways to control the application window through the shoulder key, and the embodiment of the present application does not limit this.
[0234] In some embodiments, when the electronic device 100 displays multiple application windows, the electronic device 100 may combine the shoulder key 1 and the shoulder key 2 into one shoulder key for controlling the content of one of the multiple application windows. For example, the controlled application window may be the focus window.
[0235] S109 . If the device state is the folded state, the electronic device 100 controls the display screen 3 to display the image.
[0236] For example, if the electronic device 100 is in a folded state, the device form of the electronic device 100 may be as shown in (c) in FIG. 2 or (c) in FIG. 3 .
[0237] It should be noted that if the electronic device 100 is an inward-folding folding screen device, the display screen 3 is a display screen different from the display screen 1 or the display screen 2; if the electronic device 100 is an outward-folding folding screen, the display screen 3 is the display screen 1 or the display screen 2.
[0238] S110. The electronic device 100 uses the shoulder key 1 and the shoulder key 2 as one shoulder key to control the display screen 3.
[0239] The electronic device 100 can control the display screen 3 by detecting a user operation on the shoulder button 1 and / or the shoulder button 2. In the embodiment of the present application, if the electronic device 100 is an inward-folding folding screen device, the user operation can also be referred to as the sixth operation; if the electronic device 100 is an outward-folding folding screen device, the user operation can also be referred to as the seventh operation.
[0240] For specific applications of the electronic device 100 controlling the display screen through the shoulder keys, please refer to the contents shown in the subsequent Figures 13 and 14, which will not be described here in detail.
[0241] Among them, the electronic device 100 treats shoulder key 1 and shoulder key 2 as one shoulder key in the following two situations: 1) shoulder key 1 and shoulder key 2 have the same function; 2) shoulder key 1 and shoulder key 2 are physically spliced together, and the spliced shoulder key is regarded as a shoulder key with a larger key range.
[0242] For a detailed description of treating shoulder key 1 and shoulder key 2 as one shoulder key, please refer to the relevant content of the aforementioned step S107, which will not be repeated here.
[0243] As can be seen from steps S101-S110, the electronic device 100 can combine multiple shoulder keys into a single shoulder key to control the display screen, or independently control each display screen using each shoulder key, taking into account changes in the device form factor. This can expand the application scenarios of the shoulder keys, allowing users to use them to achieve more functions and facilitate user operation.
[0244] The specific application scenarios of the shoulder keys are described below with reference to FIG13 and FIG14 .
[0245] FIG13 is a flow chart of a method for adjusting an adjustment object indicated on a display screen through shoulder keys provided in an embodiment of the present application.
[0246] S201. The electronic device 100 detects an adjustment operation on a shoulder key.
[0247] The shoulder key may refer to the shoulder key 1 and / or the shoulder key 2 in the electronic device 100 .
[0248] The adjustment operation is used to adjust the value of the adjustment object. For example, when the shoulder key is a touch key, the adjustment operation may be a sliding operation or a long press operation, etc. When the shoulder key is a mechanical key, the adjustment operation may be a clicking operation, a long press operation, or a sliding operation, etc.
[0249] The embodiment of the present application does not limit the operation method of the adjustment operation.
[0250] S202. The electronic device 100 adjusts the adjustment object indicated on the display screen according to the adjustment operation.
[0251] For example, the adjustment object may refer to any one or more of volume, brightness, video playback progress, focal length, page sliding progress, and the like.
[0252] In some embodiments, the electronic device 100 may further adjust the adjustment object indicated on the display screen in conjunction with the shoulder key precision. For example, the higher the shoulder key precision, the smaller the adjustment amplitude of the adjustment object; the lower the shoulder key precision, the larger the adjustment amplitude of the adjustment object.
[0253] That is to say, the electronic device 100 can adjust the volume, brightness, video playback progress, focal length, page sliding progress, etc. according to the adjustment operation acting on the shoulder key, with a certain shoulder key accuracy.
[0254] The shoulder key accuracy can be a preset accuracy of the electronic device 100, or can be an accuracy adjusted by the user through the accuracy adjustment page. For example, the electronic device 100 can open the accuracy adjustment interface by detecting a specified operation performed by the user on the shoulder key. For details, please refer to the subsequent Figure 14, which will not be expanded here.
[0255] In addition, with reference to FIG. 12 , when the electronic device 100 is in different device forms, the shoulder keys mentioned in step S201 and the display screen mentioned in step S202 may be in the following situations:
[0256] 1) The electronic device 100 is in a semi-folded state
[0257] If the electronic device 100 is in a semi-folded state, the electronic device 100 can control the display screen 1 and the display screen 2 via the shoulder key 1 and the shoulder key 2 respectively.
[0258] Therefore, when the electronic device 100 is in the semi-folded state, if the adjustment operation performed on the shoulder button in step S201 is performed on shoulder button 1, then the display screen mentioned in step S202 is display screen 1. In other words, the user can adjust the adjustment object indicated on display screen 1 by initiating an adjustment operation on shoulder button 1. Correspondingly, if the adjustment operation performed on the shoulder button in step S201 is performed on shoulder button 2, then the display screen mentioned in step S202 is display screen 2. In other words, the user can adjust the adjustment object indicated on display screen 2 by initiating an adjustment operation on shoulder button 2.
[0259] 2) The electronic device 100 is in the fully unfolded state
[0260] If the electronic device 100 is in the fully unfolded state, the electronic device 100 can control the combined display screen of the display screen 1 and the display screen 2 through the shoulder key 1 and / or the shoulder key 2.
[0261] Therefore, when the electronic device 100 is in the fully extended state, the adjustment operation applied to the shoulder button in step S201 is an adjustment operation applied to shoulder button 1 and / or shoulder button 2, and the display screens mentioned in step S202 include display screen 1 and display screen 2. In other words, the user can adjust the adjustment objects indicated on display screens 1 and 2 by initiating an adjustment operation on shoulder button 1, shoulder button 2, or both.
[0262] Among them, in the fully expanded state, the shoulder buttons and display screen can also exist in the following two situations:
[0263] a) Only one application window is displayed on the display area where display screen 1 and display screen 2 are located
[0264] In this case, the adjustment operation acting on shoulder key 1, or the adjustment operation acting on shoulder key 2, or the adjustment operation acting on the shoulder key combined with shoulder key 1 and shoulder key 2 is used to adjust the adjustment object indicated in the application window.
[0265] b) Multiple application windows are displayed on the display area where display screen 1 and display screen 2 are located
[0266] In this case, the adjustment operation applied to shoulder button 1 and the adjustment operation applied to shoulder button 2 can be used to adjust the adjustment object indicated in different application windows. Alternatively, the adjustment operation applied to shoulder button 1 and / or shoulder button 2 can be used to adjust the adjustment object indicated in one of multiple application windows. For example, the application window can be the focus window.
[0267] 3) The electronic device 100 is in a folded state
[0268] If the electronic device 100 is in the folded state, the electronic device 100 can control the display screen 3 via the shoulder key 1 and / or the shoulder key 2 .
[0269] Therefore, when the electronic device 100 is in the folded state, the adjustment operation applied to the shoulder button in step S201 is an adjustment operation applied to shoulder button 1 and / or shoulder button 2, and the display screen mentioned in step S202 is display screen 3. In other words, the user can adjust the adjustment object indicated on display screen 3 by initiating an adjustment operation on shoulder button 1, shoulder button 2, or both shoulder buttons 1 and 2.
[0270] In addition, the adjustment object is related to the picture displayed on the electronic device 100. Specifically, the electronic device 100 can determine the adjustment object indicated on the display screen according to the picture displayed on the display screen.
[0271] In some embodiments, the electronic device 100 can determine the adjustment object of the adjustment operation by determining whether the screen displayed on the display screen includes a specified page. For example, if the displayed screen includes the specified page, the adjustment operation performed on the shoulder key is used to adjust the adjustment object corresponding to the specified page; if the displayed screen does not include the specified page, the adjustment operation performed on the shoulder key is used to adjust the preset adjustment object on the display screen.
[0272] The designated page may refer to a page preset by the electronic device 100, for example, the designated page may include: a video playback page, a long page, a photo taking page, etc. The adjustment objects corresponding to the video playback page may refer to video playback progress, video volume, etc., the adjustment objects corresponding to the long page may refer to page sliding progress, and the adjustment objects corresponding to the photo taking page may refer to focal length, aperture value, exposure, shutter time, etc. The preset adjustment objects are objects that are applicable to any page displayed on the electronic device 100, such as brightness, volume, etc.
[0273] That is to say, if the electronic device 100 displays a specified page, the adjustment operation acting on the shoulder key can be used to adjust the adjustment object in the specified page. For example, if the electronic device 100 displays a video playback page, the adjustment operation acting on the shoulder key is used to adjust the video playback progress. If the electronic device 100 displays a long page, the adjustment operation acting on the shoulder key is used to adjust the page sliding progress. If the electronic device 100 displays a photo taking page, the adjustment operation acting on the shoulder key is used to adjust the focal length, etc.; otherwise, the adjustment operation acting on the shoulder key can be used to adjust the brightness of the picture, or the volume of the device.
[0274] FIG14 is a flow chart of a method for opening a precision adjustment interface through a shoulder key provided in an embodiment of the present application.
[0275] S301. The electronic device 100 detects a designated operation performed on a shoulder key.
[0276] The shoulder key may refer to shoulder key 1 and / or shoulder key 2. The designated operation may refer to a double-click operation, a triple-click operation, a long press operation, etc. The embodiment of the present application does not limit the operation method of the designated operation.
[0277] S302. The electronic device 100 obtains the device form.
[0278] For example, the electronic device 100 may determine the device form of the electronic device 100 through a magnetic sensor or a gyroscope sensor.
[0279] According to the different device forms of the electronic device 100 , the electronic device 100 may respectively execute steps S303 , S304 and S305 .
[0280] S303. If the device is in a semi-folded state, the electronic device 100 displays a precision adjustment interface on the display screen corresponding to the shoulder key.
[0281] The precision adjustment interface displays an option for shoulder key precision, which is used to indicate the precision of the shoulder key. The electronic device 100 can also detect the user's adjustment operation on the option to adjust the precision of the shoulder key.
[0282] Exemplarily, the precision adjustment interface may refer to the user interface 70 shown in FIG. 11 .
[0283] That is to say, when the electronic device 100 is in a semi-folded state, if the electronic device 100 detects a designated operation acting on the shoulder key 1, the electronic device 100 displays the precision adjustment interface on the display screen 1; if the electronic device 100 detects a designated operation acting on the shoulder key 2, the electronic device 100 displays the precision adjustment interface on the display screen 2.
[0284] S304. If the device state is the fully unfolded state, the electronic device 100 displays the accuracy adjustment interface on the combined display screen of display screen 1 and display screen 2.
[0285] The precision adjustment interface displays an option for shoulder key precision, which is used to indicate the precision of the shoulder key. The electronic device 100 can also detect the user's adjustment operation on the option to adjust the precision of the shoulder key.
[0286] Exemplarily, the precision adjustment interface may refer to the user interface 40 shown in FIG. 7 .
[0287] That is to say, when the electronic device 100 is in the fully expanded state, the action detected by the electronic device 100 and the specified operation of the shoulder key 1 and / or the shoulder key 2 are used to trigger the electronic device 100 to display the precision adjustment interface on the combined display screen of the display screen 1 and the display screen 2.
[0288] S305 . If the device state is the folded state, the electronic device 100 displays the accuracy adjustment interface on the display screen 3 .
[0289] The precision adjustment interface displays an option for shoulder key precision, which is used to indicate the precision of the shoulder key. The electronic device 100 can also detect the user's adjustment operation on the option to adjust the precision of the shoulder key.
[0290] Exemplarily, the precision adjustment interface may refer to the user interface 70 shown in FIG. 11 .
[0291] Among them, the precision adjustment interface mentioned in steps S303, S304 and S305 may include options for adjusting the precision of shoulder key 1 and shoulder key 2 at the same time, and may also include options for adjusting the precision of shoulder key 1 alone, and may also include options for adjusting shoulder key 2 alone.
[0292] For example, referring to Figure 7, the user interface 40 includes: an adjustment option 401, which can be used to simultaneously adjust the accuracy of shoulder key 1 and shoulder key 2. The user interface 40 also includes: a first option 402A, a second option 402B, the first option 402A can be used to adjust the accuracy of shoulder key 1, and the second option 402B can be used to adjust the accuracy of shoulder key 2.
[0293] In some embodiments, the precision adjustment interface displayed by the electronic device 100 in different device configurations may be different. Compared to other device configurations, since the fully expanded configuration has the largest display area visible to the user, the precision adjustment interface displayed in the fully expanded configuration may include more content than the precision adjustment interface displayed in the folded or semi-folded configuration.
[0294] For example, in the semi-folded state, the precision adjustment interface displayed by the electronic device 100 may only include options for adjusting the precision of shoulder key 1 or shoulder key 2, or only include options for adjusting the precision of shoulder key 1 and shoulder key 2 at the same time.
[0295] S306. The electronic device 100 detects an adjustment operation performed on the accuracy adjustment interface.
[0296] Among them, this adjustment operation can be used to adjust the accuracy of the shoulder key. This adjustment operation can be a touch operation or a voice command, which is not limited in this embodiment of the application. In this embodiment of the application, this adjustment operation can also be called the eighth operation.
[0297] For example, the precision adjustment interface may include an option for shoulder key precision, and the adjustment operation may specifically be an adjustment operation acting on the option.
[0298] Exemplarily, taking FIG. 7 as an example, the operation may be a left-slide operation or a right-slide operation on the adjustment mark 401A shown in FIG. 7 .
[0299] S307. The electronic device 100 adjusts the shoulder key precision, where the shoulder key precision indicates the adjustment range of the adjustment operation on the adjustment object.
[0300] In response to the adjustment operation, the electronic device 100 may increase the accuracy of the shoulder key 1 and / or the shoulder key 2 , or decrease the accuracy of the shoulder key 1 and / or the shoulder key 2 .
[0301] Among them, the greater the precision of the shoulder key, the smaller the adjustment range of the adjustment object, and the smaller the precision of the shoulder key, the greater the adjustment range of the shoulder key object.
[0302] In a specific application, after the electronic device 100 adjusts the shoulder key accuracy, if the electronic device 100 receives an adjustment operation acting on the shoulder key again, the electronic device 100 can change the value of the adjustment object according to the adjusted adjustment amplitude. For a detailed description of the shoulder key accuracy, please refer to the relevant content in the aforementioned Figure 8.
[0303] This allows users to dynamically adjust the precision of the shoulder buttons based on their needs. For example, if a user wants to significantly change the volume, they can lower the precision of the shoulder buttons, allowing them to easily increase or decrease the volume. Alternatively, if a user wants to precisely adjust to a specific playback point in a video, they can increase the precision of the shoulder buttons, allowing them to fine-tune the playback progress of the video, ensuring they are as close to the desired playback point as possible.
[0304] FIG15 is a flow chart of another shoulder key control method provided in an embodiment of the present application.
[0305] As shown in FIG15 , the shoulder key control method may include but is not limited to the following steps:
[0306] S401. The electronic device 100 detects a user operation on a shoulder key.
[0307] In the shoulder key control method shown in FIG15 , the electronic device 100 may not be an electronic device. For example, the electronic device 100 may be a mobile phone, a tablet, a computer, or other electronic device.
[0308] The electronic device 100 may include one or more shoulder keys, which may be touch keys or mechanical keys.
[0309] S402. The electronic device 100 determines whether the user operation is a designated operation.
[0310] Among them, the specified operation can be used to trigger the electronic device 100 to display the accuracy adjustment interface. Exemplarily, the specified operation can be a click operation, a double-click operation, a triple-click operation, a long press operation, etc. The embodiment of the present application does not limit the operation method of the specified operation.
[0311] When the electronic device 100 determines that the user operation is a designated operation, the electronic device 100 may execute step S403; otherwise, the electronic device 100 may execute step S406.
[0312] S403. The electronic device 100 displays a precision adjustment interface.
[0313] The precision adjustment interface may display an option for shoulder key precision, which may be used to indicate the precision of the shoulder key. The electronic device 100 may detect an adjustment operation on the option and adjust the precision of the shoulder key.
[0314] S404. The electronic device 100 detects an adjustment operation performed on the accuracy adjustment interface.
[0315] The adjustment operation is used to adjust the accuracy of the shoulder key. The adjustment operation can be a touch operation or a voice command, which is not limited in this embodiment of the present application.
[0316] For example, the accuracy adjustment interface may include an option for shoulder key accuracy, which may include a progress bar for the shoulder key accuracy and an adjustment indicator located above the progress bar. The adjustment operation may be a sliding operation on the adjustment indicator above the progress bar.
[0317] S405. The electronic device 100 adjusts the shoulder key precision, where the shoulder key precision indicates the adjustment range of the adjustment operation on the adjustment object.
[0318] In response to the adjustment operation, the electronic device 100 can increase or decrease the shoulder key accuracy, where the higher the shoulder key accuracy, the smaller the adjustment amplitude of the adjustment operation on the adjustment object, and the lower the shoulder key accuracy, the larger the adjustment amplitude of the adjustment operation on the adjustment object.
[0319] For a detailed description of the shoulder key accuracy, please refer to the relevant content in Figure 14 above, which will not be repeated here.
[0320] S406. The electronic device 100 determines whether the operation is an adjustment operation.
[0321] The adjustment operation is used to change the numerical value of the adjustment object. For example, the adjustment operation may be a click operation, a slide operation, a long press operation, etc. The embodiment of the present application does not limit the operation method of the adjustment operation.
[0322] When the electronic device 100 determines that the operation is an adjustment operation, the electronic device 100 may execute step S407.
[0323] It is understood that the present embodiment does not limit the order in which steps S402 and S406 are executed. For example, the electronic device 100 may first determine whether the user operation is an adjustment operation, and if not, then determine whether the user operation is a designated operation. For another example, the electronic device 100 may simultaneously determine whether the user operation is an adjustment operation or a designated operation.
[0324] S407. The electronic device 100 determines whether a designated page is displayed on the display screen.
[0325] The designated page may refer to a page preset by the electronic device 100 . For example, the designated page may include a video playback page, a long page, a photo taking page, and the like.
[0326] When the electronic device 100 determines that the designated page is displayed on the display screen, the electronic device 100 executes step S408 ; otherwise, the electronic device 100 executes step S409 .
[0327] In some embodiments, if the electronic device 100 displays multiple application windows, the electronic device 100 may further combine the multiple application windows and select an application window therefrom to determine whether the specified page is displayed in the selected application window.
[0328] Among them, these multiple application windows may include windows displayed in full screen, windows displayed in full screen, and windows displayed in split screen. The embodiment of the present application does not limit the display form of the application window.
[0329] In addition, the application window selected by the electronic device 100 may be in the following situations:
[0330] 1) The application window is the focus window
[0331] That is, when the electronic device 100 displays multiple application windows, the adjustment operation performed by the user on the shoulder key is used to adjust the corresponding adjustment object in the application window currently being focused on by the user among the multiple application windows.
[0332] 2) The application window is the last window opened by the user
[0333] That is, when the electronic device 100 displays multiple application windows, the adjustment operation performed by the user on the shoulder key is used to adjust the corresponding adjustment object in the application window last opened by the user among the multiple application windows.
[0334] It is understandable that there may be other situations in which the application window selected by the electronic device 100 is selected, and the embodiment of the present application does not limit this.
[0335] S408. The electronic device 100 adjusts the adjustment object corresponding to the designated page.
[0336] The adjustment objects corresponding to the video playback page may refer to the video playback progress, video volume, etc., the adjustment objects corresponding to the long page may refer to the page sliding progress, and the adjustment objects corresponding to the photo page may refer to the focal length, aperture value, exposure value, shutter time, etc. The preset adjustment objects are parameters applicable to any page displayed on the electronic device 100, such as brightness, volume, etc.
[0337] In some implementations, the electronic device 100 may adjust the adjustment object corresponding to the designated page according to the accuracy of the shoulder keys.
[0338] The shoulder key accuracy can be a preset shoulder key accuracy of the electronic device 100 or the shoulder key accuracy adjusted by the user in step S405. The higher the shoulder key accuracy, the smaller the adjustment range of the adjustment object, and the lower the shoulder key accuracy, the larger the adjustment range of the adjustment object.
[0339] S409. The electronic device 100 adjusts the preset adjustment object in the display screen.
[0340] The preset adjustment object may refer to brightness, volume of the device, etc.
[0341] In some implementations, the electronic device 100 may adjust a preset adjustment object in the display screen according to the precision of the shoulder keys.
[0342] The shoulder key accuracy can be a preset shoulder key accuracy of the electronic device 100, or can be the shoulder key accuracy adjusted by the user in step S405. The higher the shoulder key accuracy, the smaller the adjustment range of the preset adjustment object, and the lower the shoulder key accuracy, the larger the adjustment range of the preset adjustment object.
[0343] In other words, as can be seen from steps S407-S409, if the electronic device 100 displays a designated page, the user can use the shoulder keys to adjust the adjustment objects on the designated page, such as adjusting the playback progress of a video or the focus of a photo. Otherwise, if the electronic device 100 does not display the designated page, the user can use the shoulder keys to adjust the screen brightness, device volume, etc. This improves the utilization of the shoulder keys and expands their application scenarios.
[0344] It is understandable that for the contents not described in detail in steps S401-S409, please refer to the contents in the aforementioned Figures 13 and 14, and no further details will be given here.
[0345] FIG16 shows a schematic diagram of the hardware structure of the electronic device 100 .
[0346] The electronic device 100 can be a mobile phone, a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a cellular phone, a personal digital assistant (PDA), an augmented reality (AR) device, a virtual reality (VR) device, an artificial intelligence (AI) device, a wearable device, an in-vehicle device, a smart home device and / or a smart city device. The embodiments of the present application do not impose any special restrictions on the specific type of the electronic device.
[0347] The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
[0348] It should be understood that the structure illustrated in the embodiments of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0349] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.
[0350] In some embodiments, the processor 110 may be used to control the display of images on the display screen according to the device form of the electronic device 100, and to determine the display screen affected by the user operation based on the operation initiated by the user through the shoulder key.
[0351] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.
[0352] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.
[0353] The charging management module 140 is configured to receive charging input from a charger. In some wired charging embodiments, the charging management module 140 may receive charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 may receive wireless charging input via the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 may also provide power to the electronic device via the power management module 141.
[0354] The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 and provides power to the processor 110, the internal memory 121, the display 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage, impedance).
[0355] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.
[0356] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.
[0357] The mobile communication module 150 can provide wireless communication solutions, including 2G / 3G / 4G / 5G, for the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low-noise amplifier (LNA), and the like. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, filter and amplify the received electromagnetic waves, and transmit them to the modem processor for demodulation. The mobile communication module 150 can also amplify the signals modulated by the modem processor and convert them into electromagnetic waves for radiation via the antenna 1.
[0358] The modem processor may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium- or high-frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is passed to the application processor. The application processor outputs sound signals through an audio device (including but not limited to the speaker 170A, the receiver 170B, etc.) or displays images or videos through the display screen 194.
[0359] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, demodulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.
[0360] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with a network and other devices through wireless communication technologies. The wireless communication technologies may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).
[0361] Electronic device 100 implements display functionality through a GPU, display screen 194, and an application processor. A GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.
[0362] The display screen 194 is used to display images, videos, etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194 , where N is a positive integer greater than 1.
[0363] In some embodiments, the electronic device 100 may include two display screens 194, such as display screen 1 and display screen 2. In this case, the electronic device 100 may be an outward-folding folding screen device. Alternatively, the electronic device 100 may include three display screens 194, such as display screen 1, display screen 2, and display screen 3. In this case, the electronic device 100 may be an inward-folding folding screen device. For a detailed description of outward-folding folding screen devices and inward-folding folding screen devices, please refer to the relevant content of Figure 1 above.
[0364] The electronic device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.
[0365] The ISP is used to process data fed back by the camera 193 .
[0366] The camera 193 is used to capture still images or videos. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.
[0367] Digital signal processors are used to process digital signals. In addition to processing digital image signals, they can also process other digital signals.
[0368] Video codecs are used to compress or decompress digital video.
[0369] NPU is a neural-network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can also continuously self-learn.
[0370] The internal memory 121 may include one or more random access memories (RAM) and one or more non-volatile memories (NVM).
[0371] The random access memory can be directly read and written by the processor 110, and can be used to store executable programs (such as machine instructions) of the operating system or other running programs, and can also be used to store user and application data.
[0372] The non-volatile memory may also store executable programs and user and application data, etc., and may be loaded into the random access memory in advance for direct reading and writing by the processor 110 .
[0373] The external memory interface 120 can be used to connect to an external non-volatile memory to expand the storage capacity of the electronic device 100. The external non-volatile memory communicates with the processor 110 via the external memory interface 120 to implement data storage. For example, files such as music and videos can be stored in the external non-volatile memory.
[0374] The electronic device 100 can implement audio functions such as music playback and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.
[0375] The audio module 170 is used to convert digital audio information into analog audio signals for output, and is also used to convert analog audio input into digital audio signals.
[0376] The speaker 170A, also called a "speaker", is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or listen to hands-free calls through the speaker 170A.
[0377] The receiver 170B, also called a "handset", is used to convert audio electrical signals into sound signals. When the electronic device 100 receives a call or a voice message, the user can place the receiver 170B close to the ear to hear the voice.
[0378] Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals.
[0379] The headphone jack 170D is used to connect a wired headphone.
[0380] Pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In some embodiments, pressure sensor 180A can be located on display screen 194. When force is applied to pressure sensor 180A, the capacitance between the electrodes changes. Electronic device 100 determines the intensity of the pressure based on the change in capacitance. When a touch operation is applied to display screen 194, electronic device 100 detects the intensity of the touch operation using pressure sensor 180A. Electronic device 100 can also calculate the location of the touch based on the detection signal from pressure sensor 180A.
[0381] The gyro sensor 180B can be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (i.e., x, y, and z axes) can be determined by the gyro sensor 180B. The gyro sensor 180B can also be used for image stabilization.
[0382] The air pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device 100 calculates the altitude using the air pressure value measured by the air pressure sensor 180C to assist in positioning and navigation.
[0383] The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip case. In some embodiments, when the electronic device 100 is a flip phone, the electronic device 100 can detect the opening and closing of the flip cover based on the magnetic sensor 180D. Based on the detected opening and closing status of the case or flip cover, features such as automatic unlocking of the flip cover can be configured.
[0384] In some embodiments, when the electronic device 100 is an electronic device, the electronic device 100 can determine the device form using the magnetic sensor 180D. The device form may include: fully unfolded, semi-folded, and folded. For example, if the electronic device 100 is an inward-folding folding screen, please refer to the relevant content of Figures 2 and 3 above for details on the device form of the electronic device 100.
[0385] Accelerometer 180E can detect the magnitude of acceleration of electronic device 100 in all directions (generally three axes). It can also detect the magnitude and direction of gravity when electronic device 100 is stationary. It can also be used to identify the electronic device's posture, enabling applications such as switching between landscape and portrait modes and pedometers.
[0386] The distance sensor 180F is used to measure distance. The electronic device 100 can measure distance using infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 can use the distance sensor 180F to measure distance to achieve fast focusing.
[0387] The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 100 emits infrared light outward through the light emitting diode. The electronic device 100 uses the photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100. When insufficient reflected light is detected, the electronic device 100 can determine that there is no object near the electronic device 100.
[0388] The ambient light sensor 180L is used to sense the brightness of the ambient light. The electronic device 100 can adaptively adjust the brightness of the display screen 194 based on the sensed ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking photos.
[0389] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application locks, fingerprint photography, fingerprint call answering, etc.
[0390] Temperature sensor 180J is used to detect temperature. In some embodiments, electronic device 100 uses the temperature detected by temperature sensor 180J to implement a temperature management strategy. For example, when the temperature reported by temperature sensor 180J exceeds a threshold, electronic device 100 may reduce the performance of a processor located near temperature sensor 180J to reduce power consumption and implement thermal protection.
[0391] The touch sensor 180K, also known as a "touch device," can be mounted on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also known as a "touch screen." The touch sensor 180K detects touch operations applied to or near the touch sensor. The touch sensor can transmit the detected touch operations to the application processor to determine the type of touch event. Visual output related to the touch operations can be provided via the display screen 194.
[0392] Bone conduction sensor 180M can acquire vibration signals. In some embodiments, bone conduction sensor 180M can acquire vibration signals from vibrating bones in the human body. Bone conduction sensor 180M can also contact the human pulse to receive blood pressure signals.
[0393] The buttons 190 include a power button, a volume button, and the like. The buttons 190 may be mechanical buttons or touch buttons. The electronic device 100 may receive key inputs and generate key signal inputs related to user settings and function control of the electronic device 100.
[0394] In some embodiments, if the button 190 is located on the side of the display screen 194, the button 190 may also be called a shoulder button. The electronic device 100 may include a shoulder button 1 and a shoulder button 2, wherein the shoulder button 1 is located on one side of the display screen 1 and the shoulder button 2 is located on one side of the display screen 2.
[0395] Furthermore, the shoulder button 1 and the shoulder button 2 can be attached and detached according to the changes in the device form of the electronic device 100. When the shoulder button 1 and the shoulder button 2 are attached together, the shoulder button 1 and the shoulder button 2 can be regarded as one shoulder button. When the shoulder button 1 and the shoulder button 2 are detached, the shoulder button 1 and the shoulder button 2 can be used independently.
[0396] For example, taking the shoulder keys as touch keys as an example, FIG17 exemplarily shows a circuit structure diagram of the shoulder keys.
[0397] As shown in FIG17 , the circuit structure of the shoulder key may include: a touch screen, a touch integrated circuit (IC), and a touch screen algorithm (TSA) module.
[0398] The touch screen is used to detect touch operations performed by a user on or near it. The touch control IC can generate raw data of the touch operation based on the touch operation. The raw data includes a capacitance value, which represents the capacitance change generated when the user touches the touch screen. The touch IC sends this raw data to the TSA module, which can calculate operation data based on the raw data. The operation data may include: operation type, position, sliding distance, etc. The operation type may include a click operation, a double-click operation, a triple-click operation, a long press operation, a sliding operation, etc. The position refers to the position of the user's touch operation on the shoulder button. The sliding distance refers to the sliding distance of the sliding operation on the shoulder button when the user's touch operation is a sliding operation.
[0399] Furthermore, the electronic device 100 may send the operation data to the processor 110 so that the processor 110 triggers a corresponding function according to the operation initiated by the user.
[0400] It is understandable that FIG17 is only an illustrative introduction to the circuit structure of the shoulder key. In other embodiments of the present application, the shoulder key may also include more or fewer components, and the embodiments of the present application do not limit this.
[0401] Motor 191 can generate vibration alerts. Motor 191 can be used for incoming call vibration alerts or touch vibration feedback. For example, touch operations on different applications (such as taking photos, playing audio, etc.) can correspond to different vibration feedback effects.
[0402] The indicator 192 may be an indicator light, which may be used to indicate the charging status, power level changes, messages, missed calls, notifications, etc.
[0403] The SIM card interface 195 is used to connect a SIM card.
[0404] The electronic device 100 may be a portable terminal device equipped with iOS, Android, Microsoft or other operating systems, such as a mobile phone, tablet computer, wearable device, etc., or a non-portable terminal device such as a laptop computer with a touch-sensitive surface or touch panel, a desktop computer with a touch-sensitive surface or touch panel. The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a microservice architecture, or a cloud architecture. The embodiment of the present invention takes the Android system with a layered architecture as an example to illustrate the software structure of the electronic device 100.
[0405] FIG18 is a block diagram of the software structure of the electronic device 100 according to an embodiment of the present application.
[0406] A layered architecture divides software into several layers, each with distinct roles and responsibilities. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer.
[0407] The application layer can include a series of application packages.
[0408] As shown in FIG18 , the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and short message.
[0409] The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer includes some predefined functions.
[0410] As shown in FIG18 , the application framework layer may include a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and the like.
[0411] The window manager is used to manage window programs. The window manager can obtain the display size, determine whether there is a status bar, lock the screen, take screenshots, etc.
[0412] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.
[0413] The view system includes visual controls, such as those for displaying text and images. The view system is used to build applications. A display interface can consist of one or more views. For example, a display interface containing a text notification icon might include a view for displaying text and a view for displaying images.
[0414] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including answering, hanging up, etc.).
[0415] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.
[0416] The Notification Manager allows applications to display notifications in the status bar. These messages can be displayed briefly and then disappear automatically without user interaction. For example, the Notification Manager is used to notify users of completed downloads and message reminders. The Notification Manager can also display notifications in the top status bar of the system as icons or scrolling text, such as notifications from background applications, or as dialog windows on the screen. Examples include text messages in the status bar, beeps, vibrations on electronic devices, and flashing indicator lights.
[0417] Android Runtime includes core libraries and a virtual machine. Android runtime is responsible for scheduling and management of the Android system.
[0418] The core library consists of two parts: one is the function that needs to be called by the Java language, and the other is the Android core library.
[0419] The application layer and application framework layer run in a virtual machine. The virtual machine executes Java files in the application layer and application framework layer as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.
[0420] The system library can include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.
[0421] The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.
[0422] The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
[0423] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
[0424] A 2D graphics engine is a drawing engine for 2D drawings.
[0425] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, and sensor driver.
[0426] The following describes the workflow of the software and hardware of the electronic device 100 in conjunction with capturing a photo scene.
[0427] When the touch sensor 180K receives a touch operation, the corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the touch operation into a raw input event (including touch coordinates, touch operation timestamp, and other information). The raw input event is stored in the kernel layer. The application framework layer obtains the raw input event from the kernel layer and identifies the control corresponding to the input event. For example, if the touch operation is a touch single-click operation and the control corresponding to the single-click operation is the control of the camera application icon, the camera application calls the interface of the application framework layer to start the camera application, and then starts the camera driver by calling the kernel layer to capture a still image or video through the camera 193.
[0428] It should be understood that each step in the above method embodiment can be completed by hardware integrated logic circuits in a processor or by software instructions. The method steps disclosed in the embodiments of the present application can be directly embodied as being executed by a hardware processor, or by a combination of hardware and software modules in a processor.
[0429] The present application also provides an electronic device, which may include a memory and a processor. The memory may be used to store a computer program, and the processor may be used to call the computer program in the memory so that the electronic device executes the method executed by the electronic device 100 in any of the above embodiments.
[0430] The present application also provides a chip system, which includes at least one processor for implementing the functions involved in the method performed by the electronic device 100 in any of the above embodiments.
[0431] In one possible design, the chip system further includes a memory, which is used to store program instructions and data, and the memory is located inside or outside the processor.
[0432] The chip system can be composed of chips, or can include chips and other discrete devices.
[0433] Optionally, there may be one or more processors in the chip system. The processor may be implemented in hardware or software. When implemented in hardware, the processor may be a logic circuit, an integrated circuit, etc. When implemented in software, the processor may be a general-purpose processor implemented by reading software code stored in a memory.
[0434] Optionally, the memory in the chip system may be one or more. The memory may be integrated with the processor or may be provided separately from the processor, which is not limited in the embodiments of the present application. For example, the memory may be a non-transient processor, such as a read-only memory (ROM), which may be integrated with the processor on the same chip or provided on different chips. The embodiments of the present application do not specifically limit the type of memory or the configuration of the memory and the processor.
[0435] Exemplarily, the chip system may be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on chip (SoC), a central processor unit (CPU), a network processor (NP), a digital signal processor (DSP), a microcontroller unit (MCU), a programmable logic device (PLD) or other integrated chips.
[0436] The present application also provides a computer program product, which includes: a computer program (also referred to as code, or instructions), which, when executed, enables a computer to execute any method executed by the electronic device 100 in any of the above embodiments.
[0437] The present application also provides a computer-readable storage medium storing a computer program (also referred to as code or instruction). When the computer program is executed, the computer executes the method executed by any one of the electronic devices 100 in any of the above embodiments.
[0438] It should be understood that the processor in the embodiments of the present application can be an integrated circuit chip with signal processing capabilities. During implementation, each step of the above-mentioned method embodiment can be completed by hardware integrated logic circuits in the processor or by software instructions. The above-mentioned processor can be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. The various methods, steps, and logic block diagrams disclosed in the embodiments of the present application can be implemented or executed. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the method disclosed in the embodiments of the present application can be directly implemented and executed by a hardware decoding processor, or by a combination of hardware and software modules in the decoding processor. The software module can be located in a storage medium well-known in the art, such as random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, etc. The storage medium is located in the memory, and the processor reads the information in the memory and, in conjunction with its hardware, completes the steps of the above-mentioned method.
[0439] In addition, embodiments of the present application further provide a device. Specifically, the device may be a component or module, and may include one or more processors and a memory connected to each other. The memory is configured to store a computer program. When the computer program is executed by one or more processors, the device performs the methods described in each of the above method embodiments.
[0440] The apparatus, computer-readable storage medium, computer program product, or chip provided in the embodiments of the present application are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects of the corresponding methods provided above, and will not be repeated here.
[0441] The various implementation modes of this application can be combined arbitrarily to achieve different technical effects.
[0442] In the above embodiments, all or part of the embodiments may be implemented by software, hardware, firmware, or any combination thereof. When implemented using software, all or part of the embodiments may be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described herein are generated. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated therein. The available medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive (SSD)).
[0443] Those skilled in the art will appreciate that all or part of the process steps in the above-described method embodiments can be implemented by a computer program instructing the relevant hardware. The program can be stored in a computer-readable storage medium, and when executed, the program can include the process steps in the above-described method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.
[0444] In short, the above description is only an embodiment of the technical solution of the present invention and is not intended to limit the scope of protection of the present invention. Any modifications, equivalent replacements, improvements, etc. made based on the disclosure of the present invention should be included in the scope of protection of the present invention.
Claims
1. A shoulder key control method, It is characterized in that The method is applied to an electronic device including a folding screen, a first shoulder key and a second shoulder key, wherein the folding screen includes a first display screen and a second display screen, the first shoulder key is located on a side of the first display screen, and the second shoulder key is located on a side of the second display screen, and the method includes: The electronic device detects that the folding screen is in a semi-folded state; The electronic device detects a first operation applied to the first shoulder key, controls the first display screen, and does not control the second display screen; The electronic device detects a second operation applied to the second shoulder key, controls the second display screen, and does not control the first display screen.
2. The method according to claim 1, It is characterized in that The method further comprises: The electronic device detects that the folding screen is in a fully unfolded state; The electronic device detects a third operation acting on the first shoulder key and / or the second shoulder key, and controls the folding screen.
3. The method according to claim 1 or 2, It is characterized in that The method further comprises: The electronic device detects that the folding screen is in a fully unfolded state, and a plurality of application windows are displayed on the folding screen; The electronic device detects a fourth operation acting on the first shoulder key, and controls a first application window among the multiple application windows; The electronic device detects a fifth operation applied to the second shoulder key and controls a second application window among the multiple application windows.
4. The method according to claim 3, It is characterized in that The electronic device controlling the first application window specifically includes: The electronic device adjusts the corresponding adjustment object in the first application window; The electronic device controlling the second application window specifically includes: The electronic device adjusts the corresponding adjustment object in the second application window; The adjustment object includes any one of the following: display brightness, volume, focal length, page sliding progress, video playing progress, focal length, aperture value, exposure or shutter time.
5. The method according to any one of claims 1 to 4, It is characterized in that The electronic device further includes: a third display screen, the third display screen is located on the back of the first display screen or the second display screen, and the method further includes: The electronic device detects that the folding screen is in a folded state, wherein the first display screen and the second display screen in the folded state are face-to-face attached; The electronic device detects a sixth operation acting on the first shoulder key and / or the second shoulder key, and controls the third display screen.
6. The method according to any one of claims 1 to 5, It is characterized in that The method further comprises: The electronic device detects that the folding screen is in a folded state, wherein the first display screen and the second display screen in the folded state are in back-to-back contact with each other; The electronic device detects a seventh operation acting on the first shoulder key and / or the second shoulder key, and controls the first display screen or the second display screen.
7. The method according to any one of claims 1 to 6, It is characterized in that The controlling includes adjusting a corresponding adjustment object in a display screen controlled by the electronic device; The adjustment object includes any one of the following: display brightness, volume, focal length, page sliding progress, video playing progress, focal length, aperture value, exposure or shutter time.
8. The method according to claim 7, It is characterized in that The adjustment object is related to a page displayed on a display screen controlled by the electronic device.
9. The method according to any one of claims 1 to 6, It is characterized in that The controlling includes displaying a precision adjustment interface on a display screen controlled by the electronic device; the method also includes: The electronic device detects an eighth operation acting on the accuracy adjustment interface; The electronic device adjusts the accuracy of the first shoulder key and / or the second shoulder key.
10. The method according to claim 2, It is characterized in that When the folding screen is in a fully unfolded state, the first shoulder key and the second shoulder key are physically spliced together, and the third operation is used to adjust a corresponding adjustment object in the folding screen; When the first shoulder key and the second shoulder key are touch keys, the third operation includes a sliding operation within a range where the touch screen where the first shoulder key and the second shoulder key are spliced together is located; When the first shoulder key and the second shoulder key are mechanical keys, the third operation includes a pressing or sliding operation at a first end of the first shoulder key or a second end of the second shoulder key.
11. The method according to any one of claims 1 to 10, It is characterized in that The first shoulder key is located at an edge of the first side of the first display screen that is connected to the second display screen, and the second shoulder key is located at an edge of the first side of the second display screen that is connected to the first display screen.
12. An electronic device, It is characterized in that The electronic device comprises a memory, one or more processors, and one or more programs; when the one or more processors execute the one or more programs, the electronic device implements the method as claimed in any one of claims 1 to 11.
13. A computer-readable storage medium comprising instructions, It is characterized in that When the instructions are executed on an electronic device, the electronic device is caused to execute the method according to any one of claims 1 to 11.
14. A computer program product, It is characterized in that When the computer program product is run on a computer, the computer is enabled to execute the method according to any one of claims 1 to 11.
Citation Information
Patent Citations
Flexible device control method, flexible device and storage medium
CN110456864A
Mobile terminal control method and device
CN110658975A
Screen control method, electronic equipment and storage medium
CN113504866A
Key control method of electronic equipment and electronic equipment
CN115617117A
