Device Control Method, Device, Storage Medium and Electronic Device
By identifying one-handed operation and adjusting the expansion area of the flexible display screen, the problem of one-handed operation of large-screen electronic devices is solved, flexible display size adjustment is achieved, and user operation convenience is improved.
Patent Information
- Application Number
- CN202010464217.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-05-27
- Publication Date
- 2025-07-29
- Estimated Expiration
- 2041-01-20
AI Technical Summary
Due to the limitation of the size of the user's palm, when operating a large-screen electronic device with one hand, the upper display area of the display screen is difficult to reach, resulting in poor operability of the electronic device.
By identifying whether the electronic device is operated with one hand, obtain the display target area that can be controlled by one hand, and adjust the size of the retractable display expansion area according to the target area, and use the retractable flexible display to shrink or extend to match the size of the user's palm.
It improves the operability of electronic devices, allows users to operate electronic devices easily with one hand, avoids blind spots in the display screen operation, and enhances the user experience.
Smart Images

Figure CN113741778B_ABST
Abstract
Description
Technical Field
[0001] This application belongs to the technical field of electronic devices, and particularly relates to a device control method, apparatus, storage medium, and electronic device. Background Art
[0002] With the continuous development of technology, the screens of electronic devices are getting larger and larger. A large screen can provide users with a better visual experience, such as better photo taking, video viewing, etc. However, due to the limitation of the size of the user's palm, it is becoming increasingly difficult for users to operate electronic devices with one hand. The upper display area of the display screen is often difficult to touch, resulting in users being unable to conveniently operate the electronic device with one hand. Therefore, the operability of electronic devices is poor. Summary of the Invention
[0003] Embodiments of this application provide a device control method, apparatus, storage medium, and electronic device, which can improve the operability of electronic devices.
[0004] In a first aspect, embodiments of this application provide a device control method applied to an electronic device, where the electronic device includes a retractable display screen, and the method includes:
[0005] Identifying whether the electronic device is being operated with one hand;
[0006] If so, obtaining a target area of the retractable display screen that can be controlled with one hand;
[0007] Adjusting the size of the expanded area of the retractable display screen according to the target area.
[0008] In a second aspect, embodiments of this application provide a device control apparatus, including:
[0009] A judgment module, configured to identify whether the electronic device is being operated with one hand;
[0010] An obtaining module, configured to, if so, obtain a target area of the retractable display screen that can be controlled with one hand;
[0011] A processing module, configured to adjust the size of the expanded area of the retractable display screen according to the target area.
[0012] In a third aspect, embodiments of this application provide a storage medium, on which a computer program is stored. When the computer program is executed on a computer, the computer is caused to execute the method provided by the embodiments of this application.
[0013] In a fourth aspect, embodiments of this application further provide an electronic device, including a memory and a processor. The processor is configured to execute the method provided by the embodiments of this application by calling the computer program stored in the memory.
[0014] In the embodiments of the present application, the electronic device can identify whether the electronic device is being operated with one hand; if so, obtain the target area of the display screen that can be controlled with one hand; and adjust the size of the expandable area of the display screen according to the target area. When different users operate the electronic device with one hand, the size of the expandable area of the display screen can be flexibly adjusted according to the target area of the display screen that can be controlled by each user with one hand, so that the user can conveniently operate the adjusted display screen with one hand, thereby improving the operability of the electronic device. BRIEF DESCRIPTION OF THE DRAWINGS
[0015] The technical solutions and their beneficial effects of the present application will become apparent by describing the specific embodiments of the present application in detail with reference to the accompanying drawings.
[0016] Figure 1 It is a schematic structural diagram of the flexible display screen of the electronic device in the contracted state provided by the embodiments of the present application.
[0017] Figure 2 It is a schematic structural diagram of the flexible display screen of the electronic device in the extended state provided by the embodiments of the present application.
[0018] Figure 3 It is an exploded view of the electronic device provided by the embodiments of the present application.
[0019] Figure 4 It is an exploded view of the cross-sectional structural diagram of the flexible display screen of the electronic device in the contracted state provided by the embodiments of the present application.
[0020] Figure 5 It is an exploded view of the cross-sectional structural diagram of the flexible display screen of the electronic device in the extended state provided by the embodiments of the present application.
[0021] Figure 6 It is a schematic flowchart of the device control method provided by the embodiments of the present application.
[0022] Figure 7 It is another schematic flowchart of the device control method provided by the embodiments of the present application.
[0023] Figure 8 It is a schematic diagram of the scenario of the device control method provided by the embodiments of the present application.
[0024] Figure 9 It is another schematic diagram of the scenario of the device control method provided by the embodiments of the present application.
[0025] Figure 10 It is a schematic structural diagram of the device control device provided by the embodiments of the present application.
[0026] Figure 11 It is a schematic structural diagram of the electronic device provided by the embodiments of the present application.
[0027] Figure 12 It is another schematic structural diagram of the electronic device provided by the embodiments of the present application. Detailed implementation manners
[0028] Please refer to the drawings, where the same component symbols represent the same components. The principle of the present application is illustrated by implementing it in a suitable computing environment. The following description is based on the specific embodiments of the present application illustrated, and it should not be regarded as limiting other specific embodiments of the present application not detailed herein.
[0029] It can be understood that the execution subject of the embodiments of the present application can be an electronic device such as a smart phone or a tablet computer.
[0030] Please combine Figures 1 to 3 , the electronic device 100 of this embodiment includes a housing assembly 10, a flexible display screen 30, a driving member 50, and a driving mechanism 70. The housing assembly 10 is a hollow structure; components such as the driving member 50, the driving mechanism 70, and the camera 90 can be disposed in the housing assembly 10. It can be understood that the electronic device 100 of the embodiments of the present application includes but is not limited to mobile terminals such as mobile phones and tablets or other portable electronic devices. In this article, the electronic device 100 is taken as an example of a mobile phone for illustration.
[0031] In this embodiment, the housing assembly 10 includes a first housing 12 and a second housing 14, and the first housing 12 and the second housing 14 can move relative to each other. Specifically, in this embodiment, the first housing 12 and the second housing 14 are slidably connected, that is to say, the second housing 14 can slide relative to the first housing 12.
[0032] Specifically, please refer to Figure 4 and Figure 5 , the first housing 12 and the second housing 14 together form an accommodation space 16. The accommodation space 16 can be used to place components such as the driving member 50, the camera 90, and the driving mechanism 70. The housing assembly 10 may further include a rear cover 18, and the rear cover 18 and the first housing 12 and the second housing 14 together form the accommodation space 16.
[0033] The driving member 50 is disposed in the second housing 14. One end of the flexible display 30 is disposed in the first housing 12. The flexible display 30 bypasses the driving member 50, and the other end of the flexible display is disposed within the accommodating space 16. This allows a portion of the flexible display 30 to be hidden within the accommodating space 16. The portion of the flexible display 30 hidden within the accommodating space 16 can be unlit. The first housing 12 and the second housing 14 are relatively separated. The driving member 50 can be used to drive the flexible display 30 to unfold, exposing more of the flexible display 30 outside the accommodating space 16. Illuminating the portion of the flexible display 30 exposed outside the accommodating space 16 increases the display area presented by the electronic device 100.
[0034] The driving member 50 can be specifically a rotating shaft structure with teeth 52 on the outside. The flexible display screen 30 is linked to the driving member 50 through engagement or other means. When the first shell 12 and the second shell 14 are relatively far away from each other, the driving member 50 drives the part of the flexible display screen 30 engaged on the driving member 50 to move and unfold.
[0035] It is understood that the driving member 50 can also be a circular shaft without the teeth 52. When the first housing 12 and the second housing 14 are relatively separated, the driving member 50 is used to expand the portion of the flexible display 30 wrapped around the driving member 50, thereby exposing more of the flexible display outside the accommodating space 16 and maintaining a flat state. Specifically, the driving member 50 is rotatably mounted on the second housing 14. As the flexible display 30 is gradually expanded, the driving member 50 rotates with the movement of the flexible display 30. In other embodiments, the driving member 50 can also be fixed to the second housing 14 and have a smooth surface. When the flexible display 30 is expanded, the driving member 50 can slide in contact with the flexible display 30 through its smooth surface.
[0036] When the first housing 12 and the second housing 14 are brought into close proximity, the flexible display screen can be retracted by the driving member 50. Alternatively, the electronic device 100 further includes a restoring member (not shown), and one end of the flexible display screen accommodated in the accommodating space 16 is linked to the restoring member. When the first housing 12 and the second housing 14 are brought into close proximity, the restoring member drives the flexible display screen 30 to return to its original position, thereby partially retracting the flexible display screen into the accommodating space 16.
[0037] In this embodiment, a drive mechanism 70 may be disposed within the accommodating space 16 and may be interlocked with the second housing 14. The drive mechanism 70 is configured to drive the second housing 14 to move away from the first housing 12, thereby extending the flexible display assembly 30. It is understood that the drive mechanism 70 may be omitted, and the user may manually move the first and second housings relative to each other.
[0038] It should be noted that in addition to being able to stretch horizontally (left - right stretching), the flexible display screen of the electronic device can also stretch vertically (up - down stretching). The embodiments of the present application do not limit the stretching direction of the flexible display screen. Electronic devices that stretch in different directions have similar stretching structures. For example, by changing the arrangement directions of hardware such as the first housing, the second housing, the driving member, and the driving mechanism, the vertical stretching of the flexible display screen can be achieved, and the stretching structure will not be elaborated here.
[0039] Please refer to Figure 6 , Figure 6 which is a schematic flowchart of the device control method provided by the embodiments of the present application. This device control method can be applied to an electronic device, and the electronic device can include a stretchable display screen. The process of this device control method can include:
[0040] In 101, identify whether the electronic device is being operated with one hand.
[0041] With the development of technology, the display screens of electronic devices are getting larger and larger. When the display screen of an electronic device is relatively large, due to the limitation of the user's palm size, during the process of operating the electronic device with one hand, especially in the vertical screen mode, the upper display area of the display screen will exceed the touch range of the user's fingers, making it difficult for the user to operate and resulting in a poor user experience.
[0042] In the embodiments of the present application, identifying whether the current electronic device is being operated with one hand by the user does not specifically limit the identification method. The user's one - hand operation can be a left - hand operation or a right - hand operation. For example, it can be determined according to the collected touch position of the user.
[0043] In some embodiments, sensors can be arranged on the frame of the electronic device. When the user holds the electronic device with one hand, the sensors will obtain the touch positions of the user's multiple fingers at the frame. For example, when the user uses multiple fingers of one hand to cooperate to hold the electronic device, the sensors on the left and right frames of the electronic device will obtain the touch positions of the user's multiple fingers. Through the touch positions of the user's multiple fingers, it can be determined whether the user is operating the electronic device with the left hand or the right hand.
[0044] Through the touch positions collected by the sensors on the frame of the electronic device, the electronic device can determine the number of fingers on the left and right frames when it is held, and then determine the user's holding posture. For example, when the number of fingers holding the left frame of the electronic device is more than the number of fingers holding the right frame, the electronic device can determine that the user is holding the electronic device with the right hand. On the contrary, when the number of fingers holding the right frame of the electronic device is more than the number of fingers holding the left frame, the electronic device can determine that the user is holding the electronic device with the left hand. It should be noted that the types of sensors can include at least one of the following: capacitive sensors, pressure sensors, ultrasonic sensors, etc.
[0045] In 102, if so, obtain the target area of the retractable display screen that can be controlled with one hand.
[0046] For example, the user can pre-set the area of the retractable display screen that can be controlled when operating with the left hand alone according to the size of their own palm, and the area of the retractable display screen that can be controlled when operating with the right hand alone. Among them, the area of the retractable display screen that can be controlled when operating with the left hand alone is the area of the display screen that the user's left thumb can touch when operating the electronic device with the left hand alone. The area of the retractable display screen that can be controlled when operating with the right hand alone is the area of the display screen that the user's right thumb can touch when operating the electronic device with the right hand alone.
[0047] Then, when it is recognized that the electronic device is operated by the user with one hand, the electronic device can obtain the target area of the retractable display screen that can be controlled with one hand. For example, if the user operates the electronic device with the left hand alone, then the electronic device can determine the area of the retractable display screen that can be controlled when operating with the left hand alone pre-set as the target area. Or, if the user operates the electronic device with the right hand alone, then the electronic device can determine the area of the retractable display screen that can be controlled when operating with the right hand alone pre-set as the target area.
[0048] In one embodiment, the interface of the electronic device can pre-set multiple display screen areas of different sizes that can be selected by the user. The user can pre-select one of the display screen areas as the area of the retractable display screen that can be controlled when operating with the left hand alone according to the size of the left palm, and pre-select one of the display screen areas as the area of the retractable display screen that can be controlled when operating with the right hand alone according to the size of the right palm.
[0049] Then, when it is recognized that the electronic device is operated by the user with one hand, the electronic device can obtain the target area of the retractable display screen that can be controlled with one hand. For example, if the user operates the electronic device with the left hand alone, then the electronic device can determine the pre-selected area of the retractable display screen that can be controlled when operating with the left hand alone as the target area. Or, if the user operates the electronic device with the right hand alone, then the electronic device can determine the pre-selected area of the retractable display screen that can be controlled when operating with the right hand alone as the target area.
[0050] In one embodiment, the display screen target area can be determined by a large number of display screen areas of the user's left or right hand single-handed operations historically collected by the electronic device. The display screen target area can be the largest display screen area that can be controlled by the user's left or right hand alone.
[0051] In one embodiment, the length of the user's left or right thumb can also be obtained, and the display screen area that can be controlled with one hand can be determined based on the length of the thumb. For example, the electronic device can pre-set a mapping table between the thumb length and the size of the display screen area that can be controlled with one hand. The mapping table can be obtained through the corresponding relationship between the thumb length calculated by big data and the size of the display screen area that can be controlled with one hand. The electronic device can measure the length of the user's thumb. For example, when the electronic device is held in one hand, the touch position of the thumb collected by the sensor at the border and the root position of the thumb collected by the sensor at the border are used to measure the length of the user's thumb through the above touch position and root position.
[0052] In 103, the size of the expandable display screen expansion area is adjusted according to the target area.
[0053] For example, the display screen of the electronic device is a flexible and expandable display screen. A telescopic mechanism is provided at the upper end of the electronic device for contracting or stretching the flexible display screen. The electronic device can flexibly adjust the size of the display screen expansion area by contracting or stretching part of the flexible display screen, so as to provide the user with display screens of different sizes. Among them, the contracted part of the flexible display screen can be stored in the electronic device.
[0054] When it is recognized that the user operates the electronic device with one hand and the user has preset the target area of the display screen that can be controlled with one hand according to the size of his own palm, then the electronic device contracts or stretches part of the flexible display screen so that the size of the display screen expansion area matches the target area of the display screen preset by the user. The user can touch all or almost all of the display screen area with one hand, thereby improving the operability of the electronic device and facilitating the user to operate the electronic device with one hand.
[0055] In one embodiment, if it is recognized that the electronic device is not operated with one hand, the size of the expandable display screen expansion area can remain unchanged.
[0056] Please refer to Figure 7 , Figure 7 which is another schematic flowchart of the device control method provided by the embodiment of the present application. The process can include:
[0057] In 201, it is recognized whether the electronic device is operated with one hand.
[0058] It is recognized whether the current electronic device is operated by the user with one hand. The user's one-handed operation can be a left-handed operation or a right-handed operation. The specific recognition method is not limited. For example, it can be determined according to the collected touch position of the user.
[0059] In some embodiments, sensors may be provided on the frame of the electronic device. When the user holds the electronic device with one hand, the sensors can obtain the touch positions of multiple fingers of the user at the frame. For example, when the user holds the electronic device with multiple fingers of one hand in cooperation, the sensors on the left and right frames of the electronic device can obtain the touch positions of multiple fingers of the user. Based on the touch positions of multiple fingers of the user, it can be determined whether the user is operating the electronic device with the left hand or the right hand.
[0060] Based on the touch positions collected by the sensors, the electronic device can determine the number of fingers on the left and right frames when it is held, and then determine the holding posture of the user. For example, when the number of fingers holding the left frame of the electronic device is more than the number of fingers holding the right frame, the electronic device can determine that the user is holding the electronic device with the right hand. Conversely, when the number of fingers holding the right frame of the electronic device is more than the number of fingers holding the left frame, the electronic device can determine that the user is holding the electronic device with the left hand. It should be noted that the types of sensors may include at least one of the following: capacitive sensors, pressure sensors, ultrasonic sensors, etc.
[0061] In 202, if so, identify the sliding trajectory corresponding to the touch operation received by the retractable display screen.
[0062] In 203, if the sliding trajectory matches the preset sliding trajectory, obtain the target area of the display screen that can be controlled with one hand. When the sliding trajectory corresponding to the touch operation received by the retractable display screen matches the preset sliding trajectory, it means that the size of the expanded area of the retractable display screen needs to be adjusted.
[0063] If it is recognized that the electronic device is being operated with one hand, the electronic device can further identify the sliding trajectory corresponding to the touch operation received by the retractable display screen. If the recognized sliding trajectory matches the preset sliding trajectory, it means that the user needs to adjust the size of the expanded area of the retractable display screen to facilitate the user to touch all or almost all of the expanded area of the display screen when operating with one hand.
[0064] If the recognized sliding trajectory does not match the preset sliding trajectory, the size of the expanded area of the retractable display screen remains unchanged.
[0065] Among them, the touch operation can be a sliding operation. When the user performs a sliding operation on the display screen and the sliding trajectory matches the preset sliding trajectory. For example, when the user draws a "Z" - shaped pattern on the touch display screen, and the electronic device recognizes that the touch trajectory corresponding to the touch operation received on the display screen is the preset "Z" - shaped sliding trajectory. In this case, since the sliding trajectory matches the preset sliding trajectory, it indicates that the user needs to adjust the size of the expandable display area of the display screen. It should be noted that the preset sliding trajectory can also be other sliding trajectories. In addition, when the user operates with one hand, the user can also judge whether to adjust the size of the expandable display area of the display screen through shortcut key operations or a combination of shortcut key operations and sliding operations.
[0066] If it is recognized that the sliding trajectory matches the preset sliding trajectory, the electronic device can obtain the target area of the display screen that can be controlled with one hand. When the user operates the electronic device with one hand, the upper display area of the display screen is very likely to exceed the touch range of the user's finger. Therefore, the user can, according to the size of their own palm, preset the area of the expandable display screen that can be controlled when operating with the right hand. The area of the expandable display screen that can be controlled when operating with the right hand is the first area; and preset the area of the expandable display screen that can be controlled when operating with the left hand. The area of the expandable display screen that can be controlled when operating with the left hand is the second area. Among them, the first area is the area of the display screen that the user's right thumb can touch when operating the electronic device with the right hand, and the second area is the area of the display screen that the user's left thumb can touch when operating the electronic device with the left hand.
[0067] Then, when it is recognized that the electronic device is operated by the user with one hand, the electronic device can obtain the target area of the expandable display screen that can be controlled with one hand. For example, when the user operates the electronic device with the right hand, the electronic device can determine the preset first area as the target area. Or, when the user operates the electronic device with the left hand, the electronic device can determine the preset second area as the target area.
[0068] In one embodiment, the interface of the electronic device can preset multiple display screen areas of different sizes that can be selected by the user. The user can, according to the size of the right - hand palm, pre - select one of the display screen areas as the area of the expandable display screen that can be controlled when operating with the right hand. The area of the expandable display screen that can be controlled when operating with the right hand is the first area; and according to the size of the left - hand palm, pre - select one of the display screen areas as the area of the expandable display screen that can be controlled when operating with the left hand. The area of the expandable display screen that can be controlled when operating with the left hand is the second area.
[0069] Then, when it is recognized that the electronic device is operated by the user with one hand, the electronic device can obtain the target area of the retractable display screen that can be controlled with one hand. For example, if the user operates the electronic device with the right hand, the electronic device can determine the pre-selected first area as the target area; or, if the user operates the electronic device with the left hand, the electronic device can determine the pre-selected second area as the target area.
[0070] In one embodiment, the electronic device can determine the target area of the display screen based on the areas where a large number of users have operated the device with the left or right hand in the past. The target area of the display screen can be the largest area that can be controlled when the user operates the device with the left or right hand. Among them, the largest area that can be controlled when the user operates the device with the right hand is the first area, and the largest area that can be controlled when the user operates the device with the left hand is the second area.
[0071] In one embodiment, the length of the user's left or right thumb can also be obtained, and the target area of the display screen that can be controlled with one hand can be determined based on the length of the thumb. For example, the electronic device can pre-set a mapping table between the length of the thumb and the size of the display screen area that can be controlled with one hand. The mapping table can be obtained through the corresponding relationship between the length of the thumb calculated by big data and the size of the display screen area that can be controlled with one hand. The electronic device can measure the length of the user's thumb. For example, when the electronic device is held in one hand, the touch position of the thumb collected by the sensor at the border and the root position of the thumb collected by the sensor at the border are used to measure the length of the user's thumb. According to the above mapping table, the display screen area that can be controlled by the right hand corresponding to the length of the right thumb is the first area, and the display screen target that can be controlled by the left hand corresponding to the length of the left thumb is the second area.
[0072] Among them, the electronic device can also determine the target area of the display screen according to the user's usage habits. Specifically, the electronic device can also judge whether the hand used by the user to operate the electronic device is the dominant hand according to the user's usage habits. For example, if the user's dominant hand is the right hand and the electronic device has pre-set the first area that can be controlled when operating the device with the right hand, but in some scenarios, the user's right hand cannot operate the electronic device and needs to use the left hand to operate the electronic device. When the electronic device recognizes that the user is operating the device with the non-dominant hand, the electronic device can directly use the first area that can be controlled when the user operates the device with the dominant hand, such as the right hand, as the second area that can be controlled when operating the device with the left hand, or use the first area after reducing a part of its vertical height as the second area. For example, reduce the vertical height of the second area by 5% to 10%, etc. It can be understood that generally, the user's dominant hand is more flexible than the non-dominant hand. Therefore, the display screen area that can be controlled by the user with the dominant hand is generally slightly larger than the display screen area that can be controlled by the user with the non-dominant hand.
[0073] In 204, obtain the target resolution corresponding to the target area.
[0074] Resolution refers to the number of pixel points in the horizontal and vertical directions of the display screen. If the resolution of the display screen when fully expanded is 1920*1080, it means that there are 1920 pixel points in the vertical direction and 1080 pixel points in the horizontal direction of the display screen. After determining the target area that can be controlled by a single hand of the user, the electronic device can obtain the number of pixel points in the vertical direction corresponding to the target area. Since it is often difficult for the user to touch the upper area of the display screen when operating the display screen with a single hand, the number of pixel points in the vertical direction of the target area that can be controlled by a single hand of the user is generally less than the number of pixel points in the vertical direction when the display screen is fully expanded. For example, the number of pixel points in the vertical direction of the target area is 1860 pixel points, which is less than the number of pixel points in the vertical direction 1920 when the display screen is fully expanded.
[0075] Considering that the palm sizes of different users are different, the electronic device presets multiple resolutions. The number of pixel points in the vertical direction corresponding to the preset different resolutions is different, and the number of pixel points in the horizontal direction is the same. After obtaining the number of pixel points in the vertical direction corresponding to the target area, determine the target resolution from multiple preset resolutions. The number of pixel points in the vertical direction of the target resolution is closest to the number of pixel points in the vertical direction of the target area. For example, the electronic device compares the difference between the number of pixel points in the vertical direction corresponding to the target area and the number of pixel points in the vertical direction corresponding to each preset resolution, and determines the preset resolution with the smallest difference as the target resolution. For example, the resolution of the expandable display screen when fully expanded is 1920*1080, and the number of pixel points in the vertical direction corresponding to the target area is 1860. The preset resolutions of the electronic device include 1900*1080, 1850*1080, and 1800*1080, etc. Since the number of pixel points in the vertical direction of the preset resolution 1850*1080 is 1850, and its difference from the number of pixel points in the vertical direction 1860 of the target area is the smallest, the target resolution is determined to be 1850*1080.
[0076] In another implementation manner, after recognizing that the sliding trajectory matches the preset sliding trajectory, the device control method may further include: when the electronic device detects a resolution selection instruction, multiple resolution options may be displayed on the interface of the electronic device, and the user may actively select a resolution suitable for single-hand operation by himself / herself on the interface as the target resolution.
[0077] In 205, adjust the size of the expanded area of the expandable display screen according to the target resolution, and display the adjusted expandable display screen at the target resolution.
[0078] The display screen of the electronic device is a retractable flexible display screen. A retraction mechanism is provided at the upper end of the electronic device for retracting or extending the flexible display screen. By retracting or extending a part of the flexible display screen, the electronic device can flexibly adjust the size of the unfolded area of the display screen, thereby providing the user with display screens of different sizes. Among them, the retracted part of the flexible display screen can be stored in the electronic device.
[0079] According to the target resolution, the electronic device retracts or extends a part of the flexible display screen to adjust the size of the unfolded area of the display screen, so that the user can touch all or almost all of the display screen area with one hand, facilitating the user to operate the electronic device with one hand.
[0080] For example, when the retractable display screen is fully unfolded, the resolution is 1920*1080, that is, the corresponding number of vertical pixel points is 1920, and the height of the corresponding display screen is 16 cm. The target resolution that the user can control with one hand is 1800*1080, that is, the corresponding number of vertical pixel points is 1800. Then the height of the target area is 16 cm * 1800 / 1920 = 15 cm. Therefore, the electronic device retracts a part of the flexible display screen so that the height of the target area of the display screen is 15 cm.
[0081] In the related art, when it is detected that the user operates the electronic device with one hand, only the display interface of the electronic device is reduced to a fixed size, such as 60% of the original display interface, and the size of the display screen cannot be flexibly adjusted according to the palm sizes of different users. In this embodiment, the electronic device can flexibly adjust the size of the unfolded area of the display screen according to the palm sizes of different users, so that the user can touch all or almost all of the unfolded area of the display screen with one hand, and there is no operation dead angle in the unfolded area of the display screen, thereby improving the operability of the electronic device and facilitating the user to operate the electronic device with one hand.
[0082] After that, the electronic device can display the adjusted retractable display screen at the target resolution. Each application supports multiple resolutions. For example, application programs such as the dialing application, the text message application, the contact application, and the input method application will adaptively display according to the target resolution. The application program adjusts the interface display according to the target resolution and the size of the unfolded area of the display screen, and the layout and size of the application program interface displayed on the adjusted display screen are reasonable. Since the horizontal width of the unfolded area of the display screen remains unchanged, that is, the horizontal resolution remains unchanged, the size of the operation icons (such as virtual buttons) in the application program hardly changes or changes very little, and it is not easy for the user to accidentally touch them when operating with one hand.
[0083] In one embodiment, if it is recognized that the electronic device is not operated with one hand, the size of the unfolded area of the retractable display screen remains unchanged.
[0084] Please refer to Figures 8 to 9 ,Figure 8 It is a schematic diagram of the scenario of the device control method provided by an embodiment of the present application. Figure 9 It is another schematic diagram of the scenario of the device control method provided by an embodiment of the present application. The electronic device provided in this embodiment includes a retractable display screen. The retractable display screen is a display screen that can be retracted and extended. The retractable display screen can be a flexible display screen, and the flexible display screen can be contracted and extended, etc. On the electronic device configured with the retractable display screen, the unfolded size of the display screen can be increased by extending the display screen, and the unfolded size of the display screen can also be reduced by contracting the display screen. In the embodiment of the present application, the flexible display screen of the electronic device takes vertical retraction (up and down retraction) as an example. As Figure 8 shown, Figure 8 shows the form of the display screen of the electronic device when the retractable display screen is in the contracted state, and the form of the display screen of the electronic device when the retractable display screen is in the extended state.
[0085] Identify whether the current electronic device is being operated by a user with one hand. The one-handed operation can be a left-handed one-handed operation or a right-handed one-handed operation. Sensors can be provided on the frame of the electronic device. When the user holds the electronic device with one hand, the sensors will obtain the touch positions of multiple fingers of the user at the frame. For example, when the user holds the electronic device with multiple fingers of one hand in cooperation, the sensors on the left and right frames of the electronic device will obtain the touch positions of multiple fingers of the user. The user's left or right hand operation of the electronic device can be determined through the touch positions of multiple fingers of the user.
[0086] If it is identified that the electronic device is being operated with one hand, the electronic device can further identify the sliding trajectory corresponding to the touch operation received by the retractable display screen. If the identified sliding trajectory matches the preset sliding trajectory, it means that the user needs to adjust the size of the unfolded area of the retractable display screen to facilitate the user to touch all or almost all of the unfolded area of the display screen during one-handed operation.
[0087] If it is identified that the sliding trajectory matches the preset sliding trajectory, the electronic device can obtain the target area of the display screen that can be controlled with one hand. When the user operates the electronic device with one hand, it can be a left-handed operation or a right-handed operation. The user can, according to his own usage habits, preset the area of the retractable display screen that can be controlled during right-handed one-handed operation. The area of the retractable display screen that can be controlled during right-handed one-handed operation is the first area; and preset the area of the retractable display screen that can be controlled during left-handed operation. The area of the retractable display screen that can be controlled during left-handed one-handed operation is the second area. Among them, the first area is the area of the display screen that the user's right thumb can touch when operating the electronic device with the right hand, and the second area is the area of the display screen that the user's left thumb can touch when operating the electronic device with the left hand.
[0088] Then, when it is recognized that the electronic device is operated by the user with one hand, the electronic device can obtain the target area of the retractable display screen that can be controlled with one hand. For example, if the user operates the electronic device with the right hand alone, the electronic device can determine the pre-set first area as the target area. Or, if the user operates the electronic device with the left hand alone, the electronic device can determine the pre-set second area as the target area.
[0089] Among them, the electronic device can also determine the target area of the display screen according to the user's usage habits. Specifically, the electronic device can also judge whether the hand used by the user to operate the electronic device is the dominant hand according to the user's usage habits. For example, if the user's dominant hand is the right hand and the electronic device has pre-set the first area that can be controlled when operating with the right hand alone, when the electronic device recognizes that the user is operating with the non-dominant hand, such as the left hand alone, the electronic device can directly use the first area that can be controlled when operating with the pre-set dominant hand, such as the right hand alone, as the second area that can be controlled when operating with the left hand alone, or use the first area after reducing a part of its vertical height as the second area. For example, reduce the vertical height of the second area by 5% to 10%, etc.
[0090] After obtaining the target area of the display screen that can be controlled with one hand, that is, the first area or the second area, the electronic device determines the corresponding target resolution according to the target area. The electronic device obtains the number of vertical pixel points corresponding to the target area. For example, the number of vertical pixel points in the target area is 1860. Considering that the palm sizes of different users are different, the electronic device has pre-set multiple resolutions, and the number of vertical pixel points corresponding to the pre-set different resolutions is different, while the number of horizontal pixel points is the same. The electronic device compares the difference between the number of vertical pixel points corresponding to the target area and the number of vertical pixel points corresponding to each pre-set resolution, and determines the pre-set resolution with the smallest difference as the target resolution. For example, when the retractable display screen is fully unfolded, the resolution is 1920*1080, and the number of vertical pixel points corresponding to the target area is 1860. The pre-set resolutions of the electronic device include 1900*1080, 1850*1080, and 1800*1080, etc. Since the number of vertical pixel points of the pre-set resolution 1850*1080 is 1850, and the difference between it and the number of vertical pixel points 1860 corresponding to the target area is the smallest, the target resolution is determined to be 1850*1080.
[0091] According to the target resolution, the electronic device adjusts the size of the unfolded area of the display screen by contracting or stretching part of the flexible display screen, so that the user can touch all or almost all of the unfolded area of the display screen with one hand, which is convenient for the user to operate the electronic device with one hand, thereby improving the operability of the electronic device.
[0092] For example, when the retractable display screen is fully unfolded, the resolution is 1920*1080, that is, the corresponding number of vertical pixel points is 1920, and the height of the display screen is 16 cm. The target resolution that can be controlled by a single hand of the user is 1800*1080, that is, the corresponding number of vertical pixel points is 1800. Then the height of the target area is 16 cm * 1800 / 1920 = 15 cm. Therefore, the electronic device shrinks part of the flexible display screen so that the height of the target area of the display screen is 15 cm.
[0093] The adjusted retractable display screen is displayed at the target resolution. Each application supports multiple resolutions. For example, application programs such as the dialing application, the text message application, the address book application, and the input method application will adaptively display according to the target resolution. The application program adjusts the interface display according to the target resolution and the size of the unfolded area of the display screen. The layout and size of the application program interface displayed on the adjusted display screen are reasonable. Since the horizontal width of the unfolded area of the display screen remains unchanged, that is, the horizontal resolution remains unchanged, the size of the operation icons (such as virtual buttons) in the application program hardly changes or changes very little, and it is not easy for the user to accidentally touch them during single-handed operation.
[0094] Please refer to Figure 10 , Figure 10 FIG. is a schematic structural diagram of a device control device provided by an embodiment of the present application. The device control device can be applied to an electronic device, and the electronic device includes a retractable touch display screen. The device control device 300 may include: a judgment module 301, an acquisition module 302, and a processing module 303.
[0095] The judgment module 301 is used for: identifying whether the electronic device is operated by a single hand;
[0096] The acquisition module 302 is used for: if so, acquiring the target area of the retractable display screen that can be controlled by a single hand;
[0097] The processing module 303 is used for: adjusting the size of the unfolded area of the retractable display screen according to the target area.
[0098] In one embodiment, the processing module 303 may be used for:
[0099] Determining the corresponding target resolution according to the target area;
[0100] Adjusting the size of the unfolded area of the retractable display screen according to the target resolution, and displaying the adjusted retractable display screen at the target resolution.
[0101] In one embodiment, the processing module 303 may be used for:
[0102] Acquiring the number of vertical pixel points of the target area;
[0103] Determine a target resolution from multiple preset resolutions according to the number of vertical pixels in the target area, where the number of vertical pixels in the target resolution is closest to the number of vertical pixels in the target area.
[0104] In one implementation, the first processing module 303 can be used to:
[0105] Identify the sliding trajectory corresponding to the touch operation received by the scalable display screen;
[0106] If the sliding trajectory matches a preset sliding trajectory, obtain a target area of the display screen that can be controlled with one hand. When the sliding trajectory corresponding to the touch operation received by the scalable display screen matches the preset sliding trajectory, it indicates that the size of the expanded area of the scalable display screen needs to be adjusted.
[0107] In one implementation, the first obtaining module 302 is used to:
[0108] Obtain the touch position of the finger through the sensor on the frame of the electronic device;
[0109] Determine whether the electronic device is operated by the user's right hand or the user's left hand according to the touch position;
[0110] If it is a right - hand operation, use the first area that can be controlled by the right hand as the target area of the scalable display screen that can be controlled;
[0111] If it is a left - hand operation, use the second area that can be controlled by the left hand as the target area of the scalable display screen that can be controlled.
[0112] The application embodiment provides a computer - readable storage medium, on which a computer program is stored. When the computer program is executed on a computer, the computer is caused to execute the processes in the device control method provided in this embodiment.
[0113] The application embodiment also provides an electronic device, including a memory and a processor. The processor is used to execute the processes in the device control method provided in this embodiment by calling the computer program stored in the memory.
[0114] For example, the above - mentioned electronic device can be a mobile terminal such as a tablet computer or a smart phone. Please refer to Figure 11 , Figure 11 which is a schematic structural diagram of the electronic device provided in the application embodiment.
[0115] The electronic device 400 may include components such as a touch display screen 401, a memory 402, and a processor 403. Those skilled in the art can understand, Figure 6The structure of the electronic device shown does not limit the electronic device, and it may include more or fewer components than shown, or combine certain components, or have different component arrangements.
[0116] The touch display screen 401 can be a retractable display screen. The retractable display screen can be a touch display screen that can be retracted. The retractable touch display screen can be a flexible display screen, and the flexible display screen can be bent, shrunk, stretched, etc. On an electronic device configured with a retractable touch display screen, the unfolded size of the screen can be increased by stretching the display screen, and the unfolded size of the screen can also be reduced by shrinking the display screen.
[0117] The memory 402 can be used to store application programs and data. The application programs stored in the memory 402 contain executable code. The application programs can form various functional modules. The processor 403 executes various functional applications and data processing by running the application programs stored in the memory 402.
[0118] The processor 403 is the control center of the electronic device. It connects various parts of the entire electronic device using various interfaces and lines. By running or executing the application programs stored in the memory 402 and calling the data stored in the memory 402, it executes various functions of the electronic device and processes data, thereby monitoring the entire electronic device.
[0119] In this embodiment, the processor 403 in the electronic device will, according to the following instructions, load the executable code corresponding to the processes of one or more application programs into the memory 402, and the processor 403 will run the application programs stored in the memory 402 to execute:
[0120] Identify whether the electronic device is being operated with one hand;
[0121] If so, obtain the target area of the retractable display screen that can be controlled with one hand;
[0122] According to the target area, adjust the size of the unfolded area of the retractable display screen.
[0123] Please refer to Figure 12 , the electronic device 400 may include components such as a touch display screen 401, a memory 402, a processor 403, a battery 405, a microphone 405, a speaker 406, etc.
[0124] The touch display screen 401 can be a retractable touch display screen. The retractable touch display screen can be a touch display screen that can be retracted. The retractable touch display screen can be a flexible display screen, and the flexible display screen can be bent, shrunk, stretched, etc. On an electronic device configured with a retractable touch display screen, the unfolded size of the display screen can be increased by stretching the screen, and the unfolded size of the screen can also be reduced by shrinking the display screen.
[0125] The memory 402 can be used to store application programs and data. The application programs stored in the memory 402 contain executable codes. The application programs can form various functional modules. The processor 403 executes various functional applications and data processing by running the application programs stored in the memory 402.
[0126] The processor 403 is the control center of the electronic device, connecting various parts of the entire electronic device using various interfaces and circuits. By running or executing the application programs stored in the memory 402 and calling the data stored in the memory 402, it executes various functions of the electronic device and processes data, thereby monitoring the electronic device as a whole.
[0127] The battery 404 can be used to supply power to various modules and components of the electronic device.
[0128] The microphone 405 can be used to pick up sound signals in the surrounding environment, such as receiving voice commands issued by the user, etc.
[0129] The speaker 406 can be used to play sound signals.
[0130] In this embodiment, the processor 403 in the electronic device will, according to the following instructions, load the executable codes corresponding to the processes of one or more application programs into the memory 402, and the processor 403 will run the application programs stored in the memory 402 to execute:
[0131] Identify whether the electronic device is being operated with one hand;
[0132] If so, obtain the target area of the retractable display screen that can be controlled with one hand;
[0133] According to the target area, adjust the size of the unfolded area of the retractable display screen.
[0134] In one implementation, when adjusting the size of the unfolded area of the retractable display screen according to the target area, the processor 403 also executes determining the corresponding target resolution according to the target area;
[0135] Adjust the size of the expandable display screen expansion area according to the target resolution, and display the adjusted expandable display screen at the target resolution.
[0136] In one embodiment, in determining the corresponding target resolution according to the target area, the processor 403 executes to obtain the number of vertical pixel points in the target area;
[0137] According to the number of vertical pixel points in the target area, determine the target resolution from multiple preset resolutions, and the number of vertical pixel points of the target resolution is closest to the number of vertical pixel points in the target area.
[0138] In one embodiment, in obtaining the target area of the expandable display screen that can be controlled with one hand, the processor 403 executes to detect and identify the sliding trajectory corresponding to the touch operation on the expandable display screen;
[0139] If the identified sliding trajectory matches the preset sliding trajectory, obtain the target area of the display screen that can be controlled with one hand. When the sliding trajectory corresponding to the touch operation received by the expandable display screen matches the preset sliding trajectory, it indicates that the size of the expandable display screen expansion area needs to be adjusted.
[0140] In one embodiment, sensors are provided on the frame of the electronic device. In obtaining the target area of the expandable display screen that can be controlled with one hand, the processor 403 executes to obtain the touch position of the finger through the sensors on the frame of the electronic device; determine whether the electronic device is operated by the user's right hand or the user's left hand according to the touch position;
[0141] If it is a right - hand operation, use the first area that can be controlled by the right hand as the target area of the expandable display screen;
[0142] If it is a left - hand operation, use the second area that can be controlled by the left hand as the target area of the expandable display screen.
[0143] In the above - mentioned embodiments, the descriptions of each embodiment have their own focuses. For the parts not detailed in a certain embodiment, reference can be made to the detailed description of the device control method above, and details will not be repeated here.
[0144] The device control device provided in the embodiments of the present application and the device control method in the above - mentioned embodiments belong to the same concept. Any method provided in the embodiments of the device control method can be run on the device control device. The specific implementation process is detailed in the embodiments of the device control method, and details will not be repeated here.
[0145] It should be noted that for the device control method described in the embodiments of the present application, those of ordinary skill in the art can understand that all or part of the processes for implementing the device control method described in the embodiments of the present application can be completed by controlling relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, such as stored in a memory and executed by at least one processor. During the execution process, it can include the processes of the embodiments of the device control method. Among them, the storage medium can be a magnetic disk, an optical disk, a read-only memory (ROM), a random access memory (RAM), etc.
[0146] For the device control device described in the embodiments of the present application, its various functional modules can be integrated in a processing chip, or each module can exist physically alone, or two or more modules can be integrated in one module. The above-mentioned integrated modules can be implemented in the form of hardware or in the form of software functional modules. When the integrated modules are implemented in the form of software functional modules and sold or used as independent products, they can also be stored in a computer-readable storage medium, such as a read-only memory, a magnetic disk or an optical disk.
[0147] The device control method, device, storage medium, and electronic device provided in the embodiments of the present application have been introduced in detail above. Specific examples are used in this article to elaborate on the principles and implementation methods of the present application. The descriptions of the above embodiments are only used to help understand the method and its core idea of the present application; at the same time, for those skilled in the art, according to the idea of the present application, there will be changes in the specific implementation methods and application scopes. In summary, the content of this specification should not be construed as a limitation to the present application.
Claims
1. A device control method, applied to an electronic device, characterized in that The electronic device includes a retractable display screen, and the method includes: Identifying whether the electronic device is operated with one hand; If so, obtaining a target area of the retractable display screen that can be controlled with one hand, and determining in advance the target area of the retractable display screen that can be controlled with one hand according to the size of the user's own palm or the display screen area of the user's one-handed operation collected historically; Adjusting the size of the unfolded area of the retractable display screen according to the target area, wherein determining a corresponding target resolution according to the target area, obtaining the number of vertical pixel points corresponding to the target area, determining the target resolution from multiple preset resolutions, and the difference between the number of vertical pixel points of the target resolution and the number of vertical pixel points of the target area is the smallest; adjusting the size of the unfolded area of the retractable display screen according to the target resolution, and displaying the adjusted retractable display screen at the target resolution.
2. The device control method according to claim 1, wherein The determining a corresponding target resolution according to the target area includes: Obtaining the number of vertical pixel points of the target area; Determining a target resolution from multiple preset resolutions according to the number of vertical pixel points of the target area, and the number of vertical pixel points of the target resolution is the closest to the number of vertical pixel points of the target area.
3. The device control method according to claim 1, wherein The obtaining a target area of the retractable display screen that can be controlled with one hand includes: Identifying a sliding trajectory corresponding to a touch operation received by the retractable display screen; If the sliding trajectory matches a preset sliding trajectory, obtaining a target area of the display screen that can be controlled with one hand. When the sliding trajectory corresponding to the touch operation received by the retractable display screen matches the preset sliding trajectory, it indicates that the size of the unfolded area of the retractable display screen needs to be adjusted.
4. The device control method according to claim 1, wherein A sensor is provided on the frame of the electronic device, and the obtaining a target area of the retractable display screen that can be controlled with one hand includes: Obtaining the touch position of a finger through the sensor on the frame of the electronic device; Determining whether the electronic device is operated by the user's right hand or the user's left hand according to the touch position; If it is a right-handed operation, using the first area that can be controlled by the right hand as the target area of the retractable display screen; If it is a left-handed operation, using the second area that can be controlled by the left hand as the target area of the retractable display screen.
5. A device control apparatus, applied to an electronic device, characterized in that, The electronic device includes a retractable display screen, and the device includes: A judgment module for identifying whether the electronic device is operated with one hand; An obtaining module for, if so, obtaining a target area of the retractable display screen that can be controlled with one hand, and determining in advance the target area of the retractable display screen that can be controlled with one hand according to the size of the user's own palm or the display screen area of the user's one-handed operation collected historically; A processing module, configured to adjust the size of the expandable display screen expansion area according to the target area, wherein a corresponding target resolution is determined according to the target area, the number of vertical pixel points corresponding to the target area is obtained, and the target resolution is determined from a plurality of preset resolutions, and the difference between the number of vertical pixel points of the target resolution and the number of vertical pixel points of the target area is the smallest; the size of the expandable display screen expansion area is adjusted according to the target resolution, and the adjusted expandable display screen is displayed at the target resolution.
6. The device control apparatus according to claim 5, wherein The processing module is configured to: Determine a corresponding target resolution according to the target area; Adjust the size of the expandable display screen expansion area according to the target resolution, and display the adjusted expandable display screen at the target resolution.
7. The device control apparatus according to claim 6, characterized in that, The processing module is configured to: Obtain the number of vertical pixel points of the target area; Determine a target resolution from a plurality of preset resolutions according to the number of vertical pixel points of the target area, and the number of vertical pixel points of the target resolution is the closest to the number of vertical pixel points of the target area.
8. A storage medium, on which a computer program is stored, characterized in that, When the computer program is executed on a computer, the computer is caused to execute the method according to any one of claims 1 to 4.
9. An electronic device, comprising a memory and a processor, characterized in that, The processor is configured to execute the method according to any one of claims 1 to 4 by calling a computer program stored in the memory.
Citation Information
Patent Citations
Electronic device and display method thereof
CN103310718A
Display control system and display control method
CN103885642A
Control method and electronic equipment
CN104808900A
Electronic equipment control method and electronic equipment
CN105094646A