Display control method and device and storage medium

Abstract

The invention relates to a display control method and device and a storage medium. The display control method comprises the steps that a detected gesture of a user in front of a screen of electronic equipment is responded, a screen interface area watched by the user in the watching direction is determined, and the electronic equipment supports split-screen display of a plurality of screen interfaces; and based on the gesture and the screen interface area, controlling the electronic equipment to display a plurality of screen interfaces in a split-screen manner. According to the technical scheme provided by the invention, the screen display interface is controlled through the gesture in the split-screen scene, and better use experience is provided for a user.

Description

Technical Field

[0001] The present disclosure relates to the field of split-screen display technology, and in particular to a display control method, device and storage medium. Background Art

[0002] Air gestures are an emerging form of human-computer interaction that uses the front camera of electronic devices to detect and recognize user gestures to achieve intelligent interaction.

[0003] In the related art, as the screens of electronic devices gradually increase, users can choose to turn on the split-screen function to browse multiple pages at the same time, thereby reducing the frequency of window switching. However, in complex split-screen scenarios, electronic devices cannot confirm which screen interface the user's air gesture is intended to control, which brings a bad experience to users. Summary of the invention

[0004] In order to overcome the problems existing in the related art, the present disclosure provides a display control method, device and storage medium.

[0005] According to a first aspect of an embodiment of the present disclosure, a display control method is provided, comprising: in response to detecting a gesture of a user in front of a screen of an electronic device, determining a screen interface area in the direction of a user's gaze, wherein the electronic device supports split-screen display of multiple screen interfaces; based on the gesture and the screen interface area, controlling the electronic device to display multiple screen interfaces in a split-screen manner.

[0006] In one embodiment, the current display interface of the electronic device includes multiple screen interfaces displayed in split screens, the screen interface area is the first screen interface among the multiple screen interfaces, and the gesture is a first gesture that has a corresponding relationship with an application execution function; based on the gesture and the screen interface area, controlling the electronic device to execute the split screen display function includes: controlling the application corresponding to the first gesture on the first screen interface, responding to the first gesture, and displaying the display interface after responding to the first gesture on the first screen interface; controlling other interfaces among the multiple screen interfaces that are different from the first screen interface to keep the display interface unchanged.

[0007] In one embodiment, the current display interface of the electronic device is a screen interface that is not split-screen displayed, and the gesture is a second gesture for triggering the execution of a split-screen display; controlling the electronic device to display multiple screen interfaces in a split-screen based on the gesture and the screen interface area includes: controlling the electronic device to display multiple screen interfaces in a split-screen based on the second gesture and the screen interface area, the multiple screen interfaces including the screen interface that is not split-screen displayed.

[0008] In one embodiment, controlling the electronic device to display multiple screen interfaces in a split screen based on the second gesture and the screen interface area includes: performing a split screen operation in response to the second gesture to display multiple screen interfaces, the multiple screen interfaces including a second screen interface, the display content of the second screen interface is the content displayed in the screen interface that is not split screen, and the display area of ​​the second screen interface includes the screen interface area that the user is looking at.

[0009] In one embodiment, the gesture is an air gesture, and the electronic device is a device equipped with a normally-on image acquisition device.

[0010] In one embodiment, the screen of the electronic device is a horizontal screen, and the multiple screen interfaces include multiple screen interfaces arranged in sequence from left to right or from right to left in the horizontal screen direction; or the screen of the electronic device is a vertical screen, and the multiple screen interfaces include multiple screen interfaces arranged in sequence from top to bottom or from bottom to top in the vertical screen direction.

[0011] According to a second aspect of an embodiment of the present disclosure, a display control device is provided, including: a determination unit, used to detect a gesture of a user in front of a screen of an electronic device, and determine a screen interface area in the direction of the user's gaze, wherein the electronic device supports split-screen display of multiple screen interfaces; a processing unit, used to control the electronic device to display multiple screen interfaces in a split-screen manner based on the gesture and the screen interface area.

[0012] In one embodiment, the current display interface of the electronic device includes multiple screen interfaces displayed in split screens, the screen interface area is the first screen interface among the multiple screen interfaces, and the gesture is a first gesture that has a corresponding relationship with an application execution function; the processing unit controls the electronic device to execute the split screen display function based on the gesture and the screen interface area in the following manner: controls the application corresponding to the first gesture on the first screen interface, responds to the first gesture, and displays the display interface after responding to the first gesture on the first screen interface; controls other interfaces among the multiple screen interfaces that are different from the first screen interface to keep the display interface unchanged.

[0013] In one embodiment, the current display interface of the electronic device is a screen interface that is not split-screen displayed, and the gesture is a second gesture for triggering the execution of a split-screen display; the processing unit controls the electronic device to display multiple screen interfaces in a split-screen based on the gesture and the screen interface area in the following manner: based on the second gesture and the screen interface area, the electronic device is controlled to display multiple screen interfaces in a split-screen, and the multiple screen interfaces include the screen interface that is not split-screen displayed.

[0014] In one embodiment, the processing unit controls the electronic device to display multiple screen interfaces in split screen based on the second gesture and the screen interface area in the following manner: a split screen operation is performed in response to the second gesture to display multiple screen interfaces, the multiple screen interfaces include a second screen interface, the display content of the second screen interface is the content displayed in the screen interface that is not split screen, and the display area of ​​the second screen interface includes the screen interface area that the user is looking at.

[0015] In one embodiment, the gesture is an air gesture, and the electronic device is a device equipped with a normally-on image acquisition device.

[0016] In one embodiment, the screen of the electronic device is a horizontal screen, and the multiple screen interfaces include multiple screen interfaces arranged in sequence from left to right or from right to left in the horizontal screen direction; or the screen of the electronic device is a vertical screen, and the multiple screen interfaces include multiple screen interfaces arranged in sequence from top to bottom or from bottom to top in the vertical screen direction.

[0017] According to a third aspect of an embodiment of the present disclosure, there is provided a display control device, including:

[0018] a processor; a memory for storing instructions executable by the processor;

[0019] The processor is configured to call the instructions stored in the memory to execute the display control method as described in the first aspect or any one of the embodiments of the first aspect.

[0020] According to a fourth aspect of an embodiment of the present disclosure, a storage medium is provided, in which instructions are stored. When the instructions in the storage medium are executed by a processor of a terminal, the terminal is enabled to execute the display control method described in the first aspect or any one of the embodiments of the first aspect.

[0021] The technical solution provided by the embodiments of the present disclosure may include the following beneficial effects: an electronic device that supports split-screen display of multiple screen interfaces detects a user's gestures in front of the electronic device screen, and controls the screen interface area corresponding to the user's current gaze direction based on the gestures, thereby realizing control of the screen display interface through gestures in a split-screen scenario, providing the user with a better user experience.

[0022] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0024] Figure 1 The figure is a flow chart of a display control method according to an exemplary embodiment.

[0025] Figure 2a The figure is a schematic diagram showing a horizontal screen split according to an exemplary embodiment.

[0026] Figure 2b The figure is a schematic diagram of a vertical screen split according to an exemplary embodiment.

[0027] Figure 3 The figure is a flow chart of a gesture control method according to an exemplary embodiment.

[0028] Figure 4 It is a schematic diagram showing a display control according to an exemplary embodiment.

[0029] Figure 5 is a flow chart of another gesture control method according to an exemplary embodiment.

[0030] Figure 6 is a flowchart of another display control method according to an exemplary embodiment.

[0031] Figure 7a The figure is a schematic diagram showing a second gesture to start the split-screen function according to an exemplary embodiment.

[0032] Figure 7b is a schematic diagram showing another second gesture for starting the split-screen function according to an exemplary embodiment.

[0033] Figure 8 The invention is a block diagram of a display control device according to an exemplary embodiment.

[0034] Fig. 9 The invention is a block diagram of a display control device according to an exemplary embodiment. DETAILED DESCRIPTION

[0035] Here, exemplary embodiments will be described in detail, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present disclosure.

[0036] Air gestures are based on computer vision technology and light and shadow capture technology. Gestures are made without touching any objects. According to the user's pre-set settings, the picture will change accordingly, such as fast forwarding and rewinding videos, taking screenshots and rotating pictures, etc., making the operation more convenient and flexible.

[0037] In the related art, as the screens of electronic devices gradually increase, users may choose to turn on the split-screen function to browse multiple pages at the same time. However, in complex split-screen scenarios, the electronic device cannot confirm which screen interface the user's air gesture will act on, which brings a bad experience to the user.

[0038] In view of this, the present disclosure provides a display control method, which, when determining that an electronic device displays multiple screen interfaces in split screen, detects the user's gestures in front of the electronic device screen, and controls the screen interface area corresponding to the user's current gaze direction based on the gesture, thereby realizing the control of the screen display interface through gestures in the split-screen scenario, providing the user with a better user experience.

[0039] Among them, in the embodiments of the present disclosure, the electronic device can be a tablet, a folding screen terminal, etc., which is not limited here.

[0040] The split-screen function of the electronic device can be used to display different applications in the same display interface, so that users can browse multiple application pages at the same time. It can also be used to display the same application in an application, so that different display contents of the same application can be displayed at the same time.

[0041] Figure 1 is a flow chart of a display control method according to an exemplary embodiment. Figure 1 As shown, the following steps are included.

[0042] In step S11, in response to detecting a gesture of a user in front of a screen of an electronic device, a screen interface area in a gaze direction of the user is determined.

[0043] In step S12, based on the gesture and the screen interface area, the electronic device is controlled to display multiple screen interfaces in split screen.

[0044] In the disclosed embodiment, the electronic device supports split-screen display of multiple screen interfaces, that is, the user can browse multiple application interfaces at the same time, thereby reducing the frequency of switching windows.

[0045] In the disclosed embodiment, the front camera of the electronic device detects the user's air gesture in front of the electronic device, determines the user's gaze direction, and then determines the screen interface area that the user is looking at in the direction of the gaze. For example, the front camera of the electronic device determines that the user is currently looking upward, that is, determines that the screen interface area that the user is looking at in the direction of the gaze is the upper area of ​​the screen interface of the electronic device. Based on the gesture and the screen interface area, the electronic device is controlled to display multiple screen interfaces in split screen.

[0046] In the disclosed embodiment, based on detecting the user's air gestures in front of the electronic device screen, the screen interface area corresponding to the user's current gaze direction is controlled, thereby realizing control of the screen display interface by gestures in a split-screen scenario, providing the user with a better user experience.

[0047] In the embodiment of the present disclosure, the current display interface of the electronic device includes multiple screen interfaces displayed in split screens, the screen interface area where the user is looking is determined to be the first screen interface among the multiple screen interfaces, and the gesture is the first gesture that has a corresponding relationship with the application execution function. The multiple screen interfaces include at least two split screen interfaces.

[0048] Among them, the split-screen method is different based on the placement of the electronic device. When the electronic device is placed in portrait mode, the current display interface can be divided into upper and lower split-screen methods. The first screen interface can be the upper screen interface, lower screen interface, middle screen interface, etc. of the electronic device. When the electronic device is placed in landscape mode, the first screen interface can be the left screen interface, right screen interface, middle screen interface, etc. of the electronic device, which is not limited here.

[0049] In the embodiment of the present disclosure, when the electronic device is placed in landscape orientation, the multiple screen interfaces include multiple screen interfaces arranged sequentially from left to right or from right to left in the landscape orientation. Figure 2a is a schematic diagram showing a horizontal screen split according to an exemplary embodiment. Figure 2a As shown, when the electronic device is split into two areas, the multiple screen interfaces include two screen interface areas arranged in sequence from right to left in the horizontal screen direction, including: split screen area A and split screen area B. If it is determined that the current user is looking at the left part of the screen, the split screen area B is the first screen interface.

[0050] In the embodiment of the present disclosure, when the electronic device is placed vertically, the multiple screen interfaces include multiple screen interfaces arranged sequentially from top to bottom or from bottom to top in the vertical direction. For example, Figure 2b is a schematic diagram showing a vertical screen split according to an exemplary embodiment. Figure 2b As shown, when the electronic device is split into two areas, the multiple screen interfaces include two screen interface areas arranged in sequence from bottom to top in the vertical screen direction, including: split screen area A and split screen area B. If it is determined that the current user is looking at the upper area of ​​the screen, then the split screen area B is the first screen interface.

[0051] Secondly, gestures are hand gestures preset by electronic devices. Electronic devices provide a variety of application execution functions, and users can select the correspondence between each gesture and the application execution function based on personal preferences. Users need to make gestures that are the same as the preset gestures in front of the electronic device screen before the electronic device can execute the corresponding application execution function. For example, the electronic device provides four preset gestures, including: waving to the left, waving to the right, grabbing, and clenching a fist. And it provides a variety of application functions, including: video fast forward, video rewind, video pause, image screenshot, e-book page turning and other functions. Users can select the correspondence between each gesture and the application execution function based on personal preferences or usage habits. Waving to the left can be set as the video rewind function, waving to the right can be set as the video fast forward function, grabbing can be set as the image screenshot, and clenching a fist can be set as the video pause function.

[0052] Figure 3 is a flow chart of a gesture control method according to an exemplary embodiment. Figure 3 As shown, the following steps are included.

[0053] In step S21, a first gesture of a user in front of a screen of an electronic device is detected, and a first screen interface in a gaze direction of the user is determined.

[0054] In step S22, the application corresponding to the first gesture on the first screen interface is controlled to respond to the first gesture.

[0055] In the embodiment of the present disclosure, a first gesture made by a user in front of a screen of the electronic device is detected by a front camera of the electronic device, and a first screen interface in the direction of the user's gaze is determined. Based on the correspondence between the preset gesture and the application execution function, the electronic device controls the application corresponding to the first gesture on the first screen interface to respond to the first gesture.

[0056] In step S23, other interfaces among the multiple screen interfaces that are different from the first screen interface are controlled to keep the display interface unchanged.

[0057] In the embodiment of the present disclosure, other interfaces among the multiple screen interfaces of the electronic device that are different from the first screen interface maintain the display interface unchanged and do not respond.

[0058] For example, when the electronic device is placed in portrait orientation, the screen is divided into an upper area and a lower area. The front camera of the electronic device detects that the first gesture made by the user is a grab gesture, and determines that the user is looking at the upper area of ​​the screen. The electronic device controls the application displayed in the upper area of ​​the screen to take a screenshot in response, and the application interface in the lower area of ​​the screen does not respond.

[0059] Figure 4 is a schematic diagram showing a display control according to an exemplary embodiment, such as Figure 4As shown, when the electronic device is already in a vertical split-screen scene, the multiple screen interfaces include two screen interface areas arranged in sequence from bottom to top in the vertical direction, including: split-screen area A and split-screen area B. Area B is located in the upper part of the screen, and area A is located in the lower part of the screen. When a user's gesture in front of the electronic device screen is detected, such as grabbing, when the split-screen area B in the direction of the user's gaze is determined, the gesture operation will act on the split-screen area B, such as taking an image screenshot. The split-screen area A keeps the display interface unchanged.

[0060] It can be understood that when the electronic device is already in a horizontal split-screen scene, the multiple screen interfaces include two screen interfaces arranged in sequence from right to left in the horizontal direction, including: split screen area A and split screen area B. Area B is located on the left part of the screen, and area A is located on the right part of the screen. When the user's gesture in front of the electronic device screen is detected, when the left split screen area B is determined to be the area where the user's gaze is directed, the gesture operation will act on the left split screen area B; when the right split screen area A is determined to be the area where the user's gaze is directed, the gesture operation will act on the right split screen area A.

[0061] Among them, in the embodiments of the present disclosure, in order to avoid possible accidental touches, the electronic device provides an information prompt function. When the user turns on the split-screen function, the electronic device will prompt the user to prepare to make a gesture in front of the screen. For example, the countdown words, i.e., 5, 4, 3, 2, 1, can be displayed on the screen. After the countdown ends, the user makes a gesture in front of the screen to avoid accidental touches, but this is not limited.

[0062] Furthermore, in order to avoid the situation where the user's gaze direction changes during use, the electronic device will pre-set the gaze duration, for example, 5 seconds. When it is detected that the user gazes in a certain direction for a duration greater than the preset duration, the screen interface area corresponding to the current gaze direction is determined as the final control area. For example, when the electronic device detects that the user looks at a part of the screen for a duration greater than the preset duration, the upper part of the screen interface area is determined as the final control area that the user wants to control.

[0063] In the embodiment of the present disclosure, the electronic device may preset a second gesture for triggering the execution of the split-screen display function. When the electronic device detects the second gesture of the user in front of the screen, the multiple screen interfaces are displayed in split screen.

[0064] Figure 5 is a flow chart of another method of gesture control according to an exemplary embodiment. Figure 5 As shown, the following steps are included.

[0065] In step S31, in response to detecting a second gesture of the user in front of the screen of the electronic device, the screen interface area in the direction of the user's gaze is determined.

[0066] In step S32, based on the second gesture and the screen interface area, the electronic device is controlled to display multiple screen interfaces in split screen.

[0067] In the embodiment of the present disclosure, a second gesture of a user in front of a screen of an electronic device is detected, and the second gesture is a preset gesture for triggering the execution of a split-screen display function. The screen interface area in the direction of the user's gaze is determined. Based on the detected second gesture and the determined screen interface area, the electronic device is controlled to display multiple screen interfaces in split screen, and a split-screen response is made.

[0068] In the disclosed embodiment, the screen split function can also be enabled by the user. For example, the user can long press the current screen page to move the current page to the split screen area to perform the split screen; or the user can directly select to enable the screen split function from the menu bar, etc., which is not limited here. It is determined that the screen of the current electronic device displays at least one interface, and the user can perform different operations in different application interfaces.

[0069] In the disclosed embodiment, the initial display interface of the electronic device is a screen interface that is not displayed in a split screen. When the electronic device is controlled to display multiple screen interfaces in a split screen, the multiple screen interfaces include a screen interface that is not displayed in a split screen.

[0070] Figure 6 is a flow chart of another display control method according to an exemplary embodiment. Figure 6 As shown, the following steps are included.

[0071] In step S41, in response to detecting a second gesture of the user in front of the screen of the electronic device, a split screen operation is performed.

[0072] In the disclosed embodiment, the electronic device detects a second gesture of the user in front of the screen and performs a split-screen operation to display multiple screen interfaces.

[0073] In step S42, the second screen interface that the user is gazing at is determined.

[0074] In step S43, the screen interface that is not split-screen displayed is controlled to be displayed on the second screen interface.

[0075] In an embodiment of the present disclosure, the multiple screen interfaces include a second screen interface, the display content of the second screen interface is the content displayed in the screen interface that is not split-screen displayed, and the display area of ​​the second screen interface includes the screen interface area that the user is looking at.

[0076] In the embodiment of the present disclosure, when performing a split-screen operation, the user's current gaze direction is determined, and the second screen interface that the user is looking at is determined, and the content displayed in the screen interface that is not split-screen is controlled to be displayed in the second screen interface.

[0077] For example, when a user is browsing a video in full screen, he wants to open a memo to record the key points of the video, and turns on the split-screen function through a customized second gesture in front of the screen. The electronic device detects the second gesture of the user in front of the screen and performs a split-screen operation. When the electronic device performs a split-screen operation, it determines that the user is currently looking at the upper area of ​​the screen, that is, it determines that the second screen interface is the upper area of ​​the screen, controls the video interface to be displayed in the upper area of ​​the screen, and the user can display the memo interface in the lower area of ​​the screen for recording.

[0078] Figure 7a is a schematic diagram showing a second gesture to enable the split screen function according to an exemplary embodiment. Figure 7a As shown, in the vertical screen scene, the user turns on the split screen function through the second gesture, and the multiple screen interfaces include two screen interface areas arranged sequentially from bottom to top in the vertical screen direction, and the screen is divided into split screen area A and split screen area B from bottom to top. Area B is located in the upper part of the screen, and area A is located in the lower part of the screen. When the electronic device turns on the split screen function, it is determined that the user is currently looking at screen area B, and the application interface that is not split will be set to the top in the split screen and displayed in split screen area B.

[0079] Figure 7b is a schematic diagram showing another second gesture to start the split screen function according to an exemplary embodiment. Figure 7b As shown, in the vertical screen scene, the user turns on the split screen function through the second gesture, and the multiple screen interfaces include two screen interface areas arranged sequentially from bottom to top in the vertical screen direction, and the screen is divided into split screen area A and split screen area B from bottom to top. Area B is located in the upper part of the screen, and area A is located in the lower part of the screen. When the electronic device turns on the split screen function, it is determined that the user is currently looking at area A of the screen, and the application interface that is not split will be placed at the bottom of the split screen and displayed in area A of the split screen.

[0080] It can be understood that when the electronic device is in a horizontal screen scene, after the user turns on the split-screen function through the second gesture, the multiple screen interfaces include two screen interface areas arranged in sequence from right to left in the horizontal screen direction, and the screen is split from right to left into area A and area B. Area B is located on the left part of the screen, and area A is located on the right part of the screen. When the electronic device turns on the split-screen function, when it is determined that the user is currently looking at area B on the left side of the screen, the unsplit application interface will be placed on the left side of the split screen; when it is determined that the user is currently looking at area A on the right side of the screen, the unsplit application interface will be placed on the right side of the split screen.

[0081] In the disclosed embodiment, the gesture is an air gesture, and the electronic device is a device equipped with an always-on camera (AON) device. The user does not need to perform any operation on the electronic device, but makes a preset gesture in front of the screen, and the electronic device recognizes the preset gesture made by the user through the always-on camera device and responds.

[0082] In the embodiment of the present disclosure, when it is determined that the electronic device displays multiple screen interfaces in split screen, the user's gesture in front of the electronic device screen is detected, and the screen interface area corresponding to the user's current gaze direction is controlled based on the gesture, thereby realizing control of the screen display interface by gesture in the split-screen scenario, providing the user with a better user experience.

[0083] Based on the same concept, an embodiment of the present disclosure also provides a display control device.

[0084] It is understandable that the display control device provided by the embodiment of the present disclosure includes hardware structures and / or software modules corresponding to the execution of each function in order to realize the above functions. In combination with the units and algorithm steps of each example disclosed in the embodiment of the present disclosure, the embodiment of the present disclosure can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the technical solution of the embodiment of the present disclosure.

[0085] Figure 8 is a block diagram of a display control device 100 according to an exemplary embodiment. Figure 8 The device includes a determining unit 101 and a processing unit 102.

[0086] The determination unit 101 is used to detect the gesture of the user in front of the screen of the electronic device and determine the screen interface area where the user is looking. The electronic device supports split-screen display of multiple screen interfaces.

[0087] The processing unit 102 is used to control the electronic device to display multiple screen interfaces in split screen based on gestures and screen interface areas.

[0088] In the disclosed embodiment, the current display interface of the electronic device includes multiple screen interfaces displayed in split screen, the screen interface area is the first screen interface among the multiple screen interfaces, and the gesture is the first gesture that has a corresponding relationship with the application execution function. The processing unit 102 controls the electronic device to execute the split screen display function based on the gesture and the screen interface area in the following manner: control the application corresponding to the first gesture on the first screen interface, respond to the first gesture, and display the display interface after responding to the first gesture on the first screen interface. Control other interfaces among the multiple screen interfaces that are different from the first screen interface to keep the display interface unchanged.

[0089] In the embodiment of the present disclosure, the current display interface of the electronic device is a screen interface that is not displayed in split screen, and the gesture is a second gesture for triggering the execution of split screen display. The processing unit 102 controls the electronic device to display multiple screen interfaces in split screen based on the gesture and the screen interface area in the following manner: based on the second gesture and the screen interface area, the electronic device is controlled to display multiple screen interfaces in split screen, and the multiple screen interfaces include the screen interface that is not displayed in split screen.

[0090] In an embodiment of the present disclosure, the processing unit 102 controls the electronic device to display multiple screen interfaces in a split screen based on the second gesture and the screen interface area in the following manner: a split screen operation is performed in response to the second gesture to display multiple screen interfaces, the multiple screen interfaces include the second screen interface, the display content of the second screen interface is the content displayed in the screen interface that is not split screen, and the display area of ​​the second screen interface includes the screen interface area that the user is looking at.

[0091] In the disclosed embodiment, the gesture is an air gesture, and the electronic device is a device equipped with a normally-on image acquisition device.

[0092] In an embodiment of the present disclosure, the screen of the electronic device is a horizontal screen, and the multiple screen interfaces include multiple screen interfaces arranged in sequence from left to right or from right to left in the horizontal direction; or the screen of the electronic device is a vertical screen, and the multiple screen interfaces include multiple screen interfaces arranged in sequence from top to bottom or from bottom to top in the vertical direction.

[0093] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0094] Fig. 9 2 is a block diagram of a display control device 200 according to an exemplary embodiment. For example, the device 200 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0095] Reference Fig. 9, the device 200 may include one or more of the following components: a processing component 202 , a memory 204 , a power component 206 , a multimedia component 208 , an audio component 210 , an input / output (I / O) interface 212 , a sensor component 214 , and a communication component 216 .

[0096] The processing component 202 generally controls the overall operation of the device 200, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 202 may include one or more processors 220 to execute instructions to perform all or part of the steps of the above-described method. In addition, the processing component 202 may include one or more modules to facilitate interaction between the processing component 202 and other components. For example, the processing component 202 may include a multimedia module to facilitate interaction between the multimedia component 208 and the processing component 202.

[0097] The memory 204 is configured to store various types of data to support operations on the device 200. Examples of such data include instructions for any application or method operating on the device 200, contact data, phone book data, messages, pictures, videos, etc. The memory 204 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0098] The power component 206 provides power to the various components of the device 200. The power component 206 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 200.

[0099] The multimedia component 208 includes a screen that provides an output interface between the device 200 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 208 includes a front camera and / or a rear camera. When the device 200 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0100] The audio component 210 is configured to output and / or input audio signals. For example, the audio component 210 includes a microphone (MIC), and when the device 200 is in an operation mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 204 or sent via the communication component 216. In some embodiments, the audio component 210 also includes a speaker for outputting audio signals.

[0101] I / O interface 212 provides an interface between processing component 202 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0102] The sensor assembly 214 includes one or more sensors for providing various aspects of the status assessment of the device 200. For example, the sensor assembly 214 can detect the open / closed state of the device 200, the relative positioning of components, such as the display and keypad of the device 200, the sensor assembly 214 can also detect the position change of the device 200 or a component of the device 200, the presence or absence of user contact with the device 200, the orientation or acceleration / deceleration of the device 200 and the temperature change of the device 200. The sensor assembly 214 can include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 214 can also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 214 can also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor or a temperature sensor.

[0103] The communication component 216 is configured to facilitate wired or wireless communication between the device 200 and other devices. The device 200 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 216 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 216 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0104] In an exemplary embodiment, the apparatus 200 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to perform the above method.

[0105] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 204 including instructions, and the instructions can be executed by the processor 220 of the device 200 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0106] It is to be understood that in the present disclosure, "plurality" refers to two or more than two, and other quantifiers are similar. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the associated objects before and after are in an "or" relationship. The singular forms "a", "the" and "the" are also intended to include plural forms, unless the context clearly indicates other meanings.

[0107] It is further understood that the terms "first", "second", etc. are used to describe various information, but such information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other, and do not indicate a specific order or degree of importance. In fact, the expressions "first", "second", etc. can be used interchangeably. For example, without departing from the scope of the present disclosure, the first information can also be referred to as the second information, and similarly, the second information can also be referred to as the first information.

[0108] It will be further understood that the terms “center”, “longitudinal”, “lateral”, “front”, “back”, “up”, “down”, “left”, “right”, “vertical”, “horizontal”, “top”, “bottom”, “inside”, “outside”, etc., indicating orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, are only for the convenience of describing the present embodiment and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation.

[0109] It can be further understood that, unless otherwise specified, “connection” includes a direct connection without other components between the two, and also includes an indirect connection with other components between the two.

[0110] It is further understood that, although the operations are described in a specific order in the drawings in the embodiments of the present disclosure, it should not be understood as requiring the operations to be performed in the specific order shown or in a serial order, or requiring the execution of all the operations shown to obtain the desired results. In certain environments, multitasking and parallel processing may be advantageous.

[0111] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any modifications, uses or adaptations of the present disclosure, which follow the general principles of the present disclosure and include common knowledge or customary technical means in the art that are not disclosed in the present disclosure.

[0112] It should be understood that the present disclosure is not limited to the precise structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the scope of the appended claims.

Claims

1. A display control method, characterized in that: include: In response to detecting a gesture of a user in front of a screen of an electronic device, determining a screen interface area in a gaze direction of the user, wherein the electronic device supports split-screen display of multiple screen interfaces; Based on the gesture and the screen interface area, the electronic device is controlled to display multiple screen interfaces in split screen.

2. The method according to claim 1, characterized in that The current display interface of the electronic device includes multiple screen interfaces displayed in split screens, the screen interface area is a first screen interface among the multiple screen interfaces, and the gesture is a first gesture having a corresponding relationship with an application execution function; The controlling the electronic device to perform a split-screen display function based on the gesture and the screen interface area includes: Controlling an application corresponding to the first gesture on the first screen interface to respond to the first gesture, and displaying a display interface after responding to the first gesture on the first screen interface; Control other interfaces among the multiple screen interfaces that are different from the first screen interface to keep the display interface unchanged.

3. The method according to claim 1, characterized in that The current display interface of the electronic device is a screen interface that is not displayed in split screen, and the gesture is a second gesture for triggering execution of split screen display; The controlling the electronic device to display multiple screen interfaces in split screen based on the gesture and the screen interface area includes: Based on the second gesture and the screen interface area, the electronic device is controlled to display multiple screen interfaces in split screen, and the multiple screen interfaces include the screen interface that is not displayed in split screen.

4. The method according to claim 3, characterized in that The controlling the electronic device to display multiple screen interfaces in split screen based on the second gesture and the screen interface area includes: In response to the second gesture, a split-screen operation is performed to display multiple screen interfaces, wherein the multiple screen interfaces include a second screen interface, the display content of the second screen interface is the content displayed in the screen interface that is not split-screen, and the display area of ​​the second screen interface includes the screen interface area that the user is looking at.

5. The method according to any one of claims 1 to 4, characterized in that: The gesture is an air gesture, and the electronic device is a device equipped with a normally-on image acquisition device.

6. The method according to any one of claims 1 to 4, characterized in that The screen of the electronic device is a horizontal screen, and the multiple screen interfaces include multiple screen interfaces arranged sequentially from left to right or from right to left in the horizontal screen direction; or The electronic device screen is a vertical screen, and the multiple screen interfaces include multiple screen interfaces arranged sequentially from top to bottom or from bottom to top in the vertical screen direction.

7. A display control device, characterized in that: include: A determination unit, configured to detect a user's gesture in front of a screen of an electronic device and determine a screen interface area in a gaze direction of the user, wherein the electronic device supports split-screen display of multiple screen interfaces; A processing unit is used to control the electronic device to display multiple screen interfaces in split screen based on the gesture and the screen interface area.

8. The device according to claim 7, characterized in that The current display interface of the electronic device includes multiple screen interfaces displayed in split screens, the screen interface area is a first screen interface among the multiple screen interfaces, and the gesture is a first gesture having a corresponding relationship with an application execution function; The processing unit controls the electronic device to perform a split-screen display function based on the gesture and the screen interface area in the following manner: Controlling an application corresponding to the first gesture on the first screen interface to respond to the first gesture, and displaying a display interface after responding to the first gesture on the first screen interface; Control other interfaces among the multiple screen interfaces that are different from the first screen interface to keep the display interface unchanged.

9. The device according to claim 8, characterized in that The current display interface of the electronic device is a screen interface that is not displayed in split screen, and the gesture is a second gesture for triggering execution of split screen display; The processing unit controls the electronic device to display multiple screen interfaces in split screen based on the gesture and the screen interface area in the following manner: Based on the second gesture and the screen interface area, the electronic device is controlled to display multiple screen interfaces in split screen, and the multiple screen interfaces include the screen interface that is not displayed in split screen.

10. The device according to claim 9, characterized in that The processing unit controls the electronic device to display multiple screen interfaces in split screen based on the second gesture and the screen interface area in the following manner: In response to the second gesture, a split-screen operation is performed to display multiple screen interfaces, wherein the multiple screen interfaces include a second screen interface, the display content of the second screen interface is the content displayed in the screen interface that is not split-screen, and the display area of ​​the second screen interface includes the screen interface area that the user is looking at.

11. The device according to any one of claims 7 to 10, characterized in that The gesture is an air gesture, and the electronic device is a device equipped with a normally-on image acquisition device.

12. The device according to any one of claims 7 to 10, characterized in that The screen of the electronic device is a horizontal screen, and the multiple screen interfaces include multiple screen interfaces arranged sequentially from left to right or from right to left in the horizontal screen direction; or The electronic device screen is a vertical screen, and the multiple screen interfaces include multiple screen interfaces arranged sequentially from top to bottom or from bottom to top in the vertical screen direction.

13. A display control device, characterized in that: include: processor; a memory for storing processor-executable instructions; Wherein, the processor is configured to: The device is used to call the instructions stored in the memory to execute the display control method according to any one of claims 1 to 6.

14. A storage medium, characterized in that: The storage medium stores instructions, and when the instructions in the storage medium are executed by a processor of the terminal, the terminal is enabled to execute the display control method according to any one of claims 1 to 6.

Images