Control method of electronic device and electronic device

Abstract

The application provides a control method of an electronic device and the electronic device; the method comprises the following steps: obtaining a pose form of the electronic device, wherein the pose form at least comprises an included angle between a first display area and a second display area of the electronic device; obtaining a first relative position relationship between a target user and the first display area and the second display area; controlling a working state of a monitoring module of the electronic device based on the first relative position relationship, so as to control the display of a target object located in the first display area and / or the second display area by using target monitoring data of a target monitoring module, wherein the target monitoring module is at least one of the monitoring modules of the electronic device.

Description

Technical Field

[0001] This application relates to the field of electronic equipment technology, specifically to a control method for an electronic device and an electronic device. Background Technology

[0002] With the development of technology, various display devices (such as smart TVs, computer monitors, tablets or mobile phones) are being used more and more. All of these display devices require users to operate them with their hands and control them accordingly. However, if both of the user's hands are occupied, they cannot operate the display device with both hands, which causes inconvenience to the user. Moreover, it is currently difficult to accurately locate the screen content on the display device using voice commands. Summary of the Invention

[0003] This application provides a control method, apparatus, electronic device, computer-readable storage medium, and computer program product for an electronic device, which is beneficial for intelligent control of the display of the electronic device.

[0004] The technical solution of this application embodiment is implemented as follows: In a first aspect, embodiments of this application provide a control method for an electronic device, the method comprising: obtaining the pose of the electronic device, the pose including at least the included angle between a first display area and a second display area of ​​the electronic device; obtaining a first relative positional relationship between a target user and the first display area and the second display area; controlling the working state of a monitoring module of the electronic device based on the first relative positional relationship, so as to control the display of a target object located in the first display area and / or the second display area using target monitoring data of the target monitoring module, wherein the target monitoring module is at least one of the monitoring modules of the electronic device.

[0005] Secondly, embodiments of this application provide a control device for an electronic device, comprising: a first obtaining module configured to obtain the pose of the electronic device, the pose including at least the included angle between a first display area and a second display area of ​​the electronic device; a second obtaining module configured to obtain a first relative positional relationship between a target user and the first display area and the second display area; and a control module configured to control the working state of a monitoring module of the electronic device based on the first relative positional relationship, so as to control the display of a target object located in the first display area and / or the second display area using target monitoring data from the target monitoring module, wherein the target monitoring module is at least one of the monitoring modules of the electronic device.

[0006] Thirdly, embodiments of this application provide an electronic device, which includes a first body and a second body rotatably connected, a first display area disposed on the first body and a second display area disposed on the second body, wherein the first body is rotatable relative to the second body so that the electronic device has different device forms, and the included angle between the first display area and the second display area is different in the different device forms; The electronic device further includes a monitoring module and a processor disposed on the first body and / or the second body, wherein the processor is capable of performing the following operations: Memory for storing computer programs that can run on the processor; Processor, configured to execute the computer program in the memory, performing: The pose shape of the electronic device is obtained, wherein the pose shape includes at least the angle between the first display area and the second display area of ​​the electronic device; Obtain the first relative positional relationship between the target user and the first display area and the second display area; The working state of the monitoring module of the electronic device is controlled based on the first relative position relationship, so as to control the display of the target object located in the first display area and / or the second display area using the target monitoring data of the target monitoring module. The target monitoring module is at least one of the monitoring modules of the electronic device.

[0007] Fourthly, embodiments of this application provide a computer-readable storage medium storing a computer program or computer-executable instructions for implementing the control method of the electronic device provided in embodiments of this application when executed by a processor.

[0008] Fifthly, embodiments of this application provide a computer program product, including a computer program or computer-executable instructions, wherein when the computer program or computer-executable instructions are executed by a processor, the control method of the electronic device provided in embodiments of this application is implemented. Attached Figure Description

[0009] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the specification, serve to explain the technical solutions of this application. Obviously, the drawings described below are merely some embodiments of this application, and those skilled in the art can obtain other drawings based on these drawings without any inventive effort.

[0010] The flowcharts shown in the accompanying drawings are merely illustrative and do not necessarily include all content and operations / steps, nor do they necessarily have to be performed in the described order. For example, some operations / steps can be broken down, while others can be combined or partially combined; therefore, the actual execution order may change depending on the specific circumstances.

[0011] Figure 1 A schematic diagram illustrating the implementation flow of the control method for the electronic device provided in the embodiments of this application; Figure 2 A schematic diagram of the implementation process for controlling the display parameters of target content provided in this application embodiment. Figure 1 ; Figure 3 A schematic diagram of the implementation process for controlling the display parameters of target content provided in this application embodiment. Figure 2 ; Figure 4 A schematic diagram of the implementation process for controlling the display parameters of target content provided in this application embodiment. Figure 3 ; Figure 5 A schematic diagram of a display for a single-user mode control electronic device provided in this application embodiment. Figure 1 ; Figure 6 A schematic diagram of a display for a single-user mode control electronic device provided in this application embodiment. Figure 2 ; Figure 7 A schematic diagram of a display for a dual-user mode control electronic device provided in an embodiment of this application; Figure 8 A schematic diagram of a multi-user mode control electronic device provided in this application embodiment. Figure 1 ; Figure 9 A schematic diagram of a multi-user mode control electronic device provided in this application embodiment. Figure 2 ; Figure 10 A schematic diagram of a multi-user mode control electronic device provided in this application embodiment. Figure 3 ; Figure 11 This is a schematic diagram of the structure of a control device for an electronic device provided in an embodiment of this application; Figure 12 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0012] To make the objectives, technical solutions, and advantages of this application clearer, the application will be further described in detail below with reference to the accompanying drawings. The described embodiments should not be regarded as limitations on this application. All other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0013] This application provides a control method for an electronic device. Figure 1 This is a schematic diagram illustrating the implementation flow of the control method for the electronic device provided in the embodiments of this application, as shown below. Figure 1 As shown, the control method for the electronic device includes the following steps 101 to 103: Step 101: Obtain the pose shape of the electronic device, wherein the pose shape includes at least the angle between the first display area and the second display area of ​​the electronic device; Step 102: Obtain the first relative positional relationship between the target user and the first display area and the second display area; Step 103: Control the working state of the monitoring module of the electronic device based on the first relative position relationship, so as to control the display of the target object located in the first display area and / or the second display area using the target monitoring data of the target monitoring module, wherein the target monitoring module is at least one of the monitoring modules of the electronic device.

[0014] It is understood that in this embodiment, the included angle between the first display area and the second display area of ​​the electronic device is obtained; and the first relative positional relationship between the target user and the first display area and the second display area is obtained; then, the working state of the monitoring module of the electronic device is controlled based on the first relative positional relationship, thereby using the target monitoring data of the target monitoring module to control the display of the target object located in the first display area and / or the second display area. In this way, the display of the electronic device is intelligently controlled by the user through the obtained pose of the electronic device and the first relative positional relationship between the target user and the display area of ​​the electronic device, without the need for the user to manually control the display of the target object.

[0015] It should be understood that the electronic device described in this application embodiment is not limited. In some embodiments, the electronic device is a single-screen device, a dual-screen device (e.g., a dual-folding screen device), or a multi-screen device (e.g., a tri-folding screen device). Accordingly, in this application embodiment, the first display area and the second display area can be two different display areas of a single display screen, or two display areas of two separate display screens. The orientation of the electronic device can be determined based on the angle between the first display area and the second display area. In some embodiments, the electronic device can be determined to be in tablet, laptop, flip, e-book, foldable, or tent form, etc., based on the angle between the first display area and the second display area.

[0016] It should be understood that the pose of the electronic device is not limited in the embodiments of this application. In some embodiments, the pose of the electronic device includes: the placement position / angle of the electronic device and / or the device shape of the electronic device. In some embodiments, the placement position / angle includes: placing the electronic device directly on a supporting surface such as a desktop, or placing it on a heat dissipation bracket with a certain tilt angle, or on other support frames. In some embodiments, the device shape includes, but is not limited to, at least one of the following: closed / folded shape (corresponding to an opening angle of 0 degrees), tent shape (corresponding to an opening angle of obtuse angle), book shape (corresponding to an opening angle of 180 degrees), notebook shape (corresponding to an opening angle of, for example, 60~160 degrees), etc.

[0017] In this embodiment, the target user is not limited. In some embodiments, the target user includes, but is not limited to, at least one of the following: a single user, two users, or multiple users. When there are multiple target users, obtaining the first relative positional relationship between the target user and the first display area and the second display area includes: obtaining the first relative positional relationship between each target user and the first display area and the second display area, respectively. In some embodiments, the first display area and the second display area belong to the same display screen. In other embodiments, the first display area and the second display area belong to different display screens.

[0018] In some embodiments, obtaining the first relative positional relationship between the target user and the first display area and the second display area includes: obtaining the angle between the target user's facial orientation and the first display area and the second display area, as well as the distance between the target user and the display area. In other embodiments, obtaining the first relative positional relationship between the target user and the first display area and the second display area includes: obtaining the angle and distance between the target user's line of sight and the first display area and the second display area.

[0019] It should be understood that the monitoring module is not limited in the embodiments of this application. In some embodiments, the monitoring module includes, but is not limited to, at least one of the following: a single module such as a camera, radar, infrared sensor, or time-of-flight (ToF) sensor, or an array module. In some embodiments, the monitoring module further includes: a single microphone module or a microphone array module.

[0020] In this application embodiment, the working state is not limited. In some embodiments, the working state includes: Shutdown / Power-Off, Enable, Active, and Standby. In other embodiments, the working state includes: a single monitoring module performing data acquisition, an array of multiple monitoring modules of the same type performing data acquisition, and at least two monitoring modules of different types collaboratively performing data acquisition.

[0021] In some embodiments, the target monitoring module comprises an array of multiple monitoring modules of the same type. Each monitoring module in the array is configured at different positions in a first display area and / or a second display area to collect monitoring data of the target user from different angles.

[0022] For example, when an electronic device detects that a target user is located in the interaction area of ​​the first display area and the second display area, or when it detects that multiple target users exist at the same time, it can control multiple monitoring modules in the array to work simultaneously, and make a comprehensive judgment based on the monitoring data collected by the multiple monitoring modules to determine the target user's facial orientation, gaze parameters, or area of ​​interest.

[0023] By using the collaborative acquisition of array monitoring modules, the recognition error caused by occlusion, angle deviation or environmental factors of a single monitoring module can be reduced, thereby improving the reliability of display control in multi-user or complex scenarios.

[0024] In this application embodiment, the target monitoring module is not limited. In some embodiments, the target monitoring module includes at least one monitoring module. In other embodiments, the target monitoring module includes an array of multiple monitoring modules of the same type. In still other embodiments, the target monitoring module includes monitoring modules of different types.

[0025] In this embodiment, the target monitoring data is not limited. In some embodiments, the target monitoring data includes: the target user's face orientation, the target user's gaze parameters, the target user's voice data, the target user's gesture data, or the target user's body part movement data.

[0026] It should be noted that, in the embodiments of this application, the monitoring data such as the target user's facial orientation, gaze parameters, and head posture are all collected in real time by the monitoring module locally configured on the electronic device, with the authorization or consent of the target user.

[0027] The monitoring data is only used to implement the display control and human-computer interaction functions described in the embodiments of this application, and is not used to identify the target user, nor is it stored for a long time or associated with the target user's identity information.

[0028] In some embodiments, the monitoring data may be discarded or anonymized immediately after local processing to meet relevant data security and privacy protection requirements.

[0029] In some embodiments, controlling the display of a target object located in the first display area and / or the second display area includes at least one of the following: controlling the mouse cursor to move from the first display area to the second display area; highlighting the target content in the first display area; marking the target display content in the first display area in the second display area; highlighting the common object content in the first display area and the second display area; and marking the common object content in the first display area and the second display area.

[0030] It should be understood that the target object is not limited in the embodiments of this application. In some embodiments, the target object includes, but is not limited to, at least one of the following: mouse cursor, input cursor, existing display content, and newly added display content. In some embodiments, controlling the display of the target object includes controlling the display parameters of the target object, such as: display position, display mode (static display, dynamic display), and display effect (transparency, whether to add labels, whether to indicate age, etc.).

[0031] For example, in one possible implementation, the angle between the first display area and the second display area of ​​the dual-screen electronic device is 180 degrees, and the target user is located in front of the first display area and to the side of the second display area; the camera in the first display area is controlled to enter the working state, and the mouse in the second display area is moved to the first display area based on the target user's line of sight captured by the camera in the first display area.

[0032] In some embodiments, obtaining the first relative positional relationship between the target user and the first display area and the second display area includes: obtaining the second relative positional relationship between the monitoring module of the electronic device and the first display area and the second display area; determining the first relative positional relationship between the target user and the first display area and the second display area based on the second relative positional relationship and the user data of the target user monitored by the monitoring module; wherein the target user may be unique or not unique, and the monitoring module includes the acquisition module configured by the electronic device itself and / or an external acquisition module.

[0033] It is understood that in this embodiment, a second relative positional relationship between the monitoring module and the first and second display areas is first determined; and based on the second relative positional relationship and the user data of the target user monitored by the monitoring module, a first relative positional relationship is determined. The target user can be multiple or one, and the monitoring module can be configured within the electronic device itself or be an external acquisition module. This expands the application scenarios of the electronic device control method, such as multi-user scenarios, single-user scenarios, electronic devices with monitoring modules, and electronic devices without monitoring modules. Furthermore, it makes the determined first relative positional relationship more accurate, thereby enabling more precise control of the electronic device's display and further improving the intelligent control of the electronic device.

[0034] It should be understood that the second relative positional relationship is not limited in the embodiments of this application. In some embodiments, the second relative positional relationship between the monitoring module of the electronic device and the first display area and the second display area is determined according to the position of the monitoring module on the electronic device. Further, in some embodiments, the second relative positional relationship is used to determine the direction of the acquisition centerline of the monitoring module, etc.

[0035] It should be understood that, in this embodiment, the position of the monitoring module on the display screen of the electronic device is not limited. For example, in one possible implementation, the monitoring module may be positioned centered on the top or bottom edge of the display screen; the monitoring module may be positioned at one-third of the top or bottom edge of the display screen; three monitoring modules may be evenly spaced along the top or bottom edge of the display screen; or multiple monitoring modules may be spaced apart around the perimeter of the display screen.

[0036] In this embodiment, the user data of the target user is not limited. The user data is used to determine the third relative positional relationship between the target user and the monitoring module, thereby determining the first relative positional relationship between the target user and the first display area and the second display area based on the second and third relative positional relationships.

[0037] It should be understood that, in the embodiments of this application, the first relative positional relationship between the target user and the first display area and the second display area can be determined by the second relative positional relationship between the monitoring module and the first display area and the second display area, and the third relative positional relationship between the target user and the monitoring module.

[0038] In this embodiment, the positional relationship between the target user and the two display areas can be determined by the positional relationship between the monitoring module and the two display areas, and the positional relationship between the user and the monitoring module. Based on user data, the positional relationship between the user and the monitoring module can be determined by combining the user's actual facial data and body contour data.

[0039] In some embodiments, the user data includes: facial data (e.g., facial orientation, facial contour size, etc.), sound data (used to locate the distance between the target user and the first display area and the second display area, or to determine the orientation of the target user relative to the first display area and the second display area), body pose data (e.g., number of body point clouds, body parts, body contour size, etc.).

[0040] It should be understood that the number of target users is not limited in the embodiments of this application. Therefore, the application scenarios of this application include: single-user scenarios, dual-user scenarios, or multi-user scenarios.

[0041] In this embodiment, the data acquisition module configured on the electronic device itself includes modules such as a camera, infrared sensor, radar, ToF sensor, or microphone built into the electronic device (e.g., a computer / tablet / smartphone). In this embodiment, the data acquisition module external to the electronic device includes auxiliary data acquisition modules connected via a Universal Serial Bus (USB) interface or a Magic Bay interface.

[0042] For example, in one possible implementation, the electronic device includes two displays, each with a camera positioned at the center of its upper edge. A first display area is located on the first display, and a second display area is located on the second display. If the camera on the first display captures the face of a target user, it is determined that the target user is facing the camera on the first display, thus determining that the target user is facing the first display area. The mouse cursor in the second display area is then moved to the first display area.

[0043] In some embodiments, controlling the working state of the monitoring module of the electronic device based on the first relative positional relationship includes: obtaining configuration information of the monitoring module, and controlling the working state of the monitoring module of the electronic device based on the configuration information and the first relative positional relationship; or, controlling the working state of the monitoring module of the electronic device based on the pose of the electronic device and the first relative positional relationship; wherein the first display area and the second display area belong to the same display screen or different display screens of the electronic device.

[0044] It is understood that, in this embodiment, the working state of the monitoring module of the electronic device is controlled based on the obtained configuration information of the monitoring module and the first relative positional relationship; or, the working state of the monitoring module of the electronic device is controlled based on the pose and shape of the electronic device and the first relative positional relationship; the first display area and the second display area belong to the same display screen or different display screens of the electronic device. This facilitates refined control of the monitoring module of the electronic device.

[0045] It should be understood that the configuration information is not limited in the embodiments of this application. In some embodiments, the configuration information includes at least one of the following: the number of monitoring modules, the location of the monitoring modules, the configuration type of the monitoring modules, and the performance configuration parameters of the monitoring modules; wherein, the location of the monitoring modules may be a second relative position relationship.

[0046] In this embodiment, controlling the working state of the monitoring module of the electronic device based on the configuration information and the first relative position relationship can determine the target control module according to the configuration number and configuration position of the monitoring modules, and control the working state of the target control module and non-target control modules. For example, in one possible implementation, the target control module is controlled to be in a working state, and the non-target control modules are controlled to be in a standby state.

[0047] In some embodiments, controlling the working state of the monitoring module of the electronic device based on the pose and the first relative positional relationship includes: determining the control of the monitoring module (e.g., camera module) in a corresponding scenario based on one or more of the following: the number of displays of the electronic device, the opening angle of the electronic device (e.g., 180 degrees, 60 degrees, or other angles), and the device form, as well as the first relative positional relationship. In this embodiment, controlling the working state of the monitoring module of the electronic device based on the pose and the first relative positional relationship allows for adaptive control of the working state of the monitoring module according to different scenarios of the electronic device.

[0048] In this embodiment of the application, the first display area and the second display area belong to the same display screen of the electronic device. The electronic device can be a single-screen device, a dual-screen device, a multi-screen device, or a foldable screen device. When the electronic device is a dual-screen device, a multi-screen device, or a foldable screen device, the first display area and the second display area are located on any one of the multiple display screens of the electronic device.

[0049] In this embodiment, the first display area and the second display area belong to different displays of the electronic device, which can be a dual-screen device, a multi-screen device, or a foldable screen device. When the electronic device is a dual-screen device, the first display area and the second display area are respectively located on two displays of the electronic device. When the electronic device is a multi-screen device or a foldable screen device, the first display area and the second display area are located on any two of the multiple displays of the electronic device.

[0050] For example, in one possible implementation, when there are two target users, the electronic device includes two displays, each display having a camera positioned in the center; the first target user is located in front of a first display area of ​​the first display, and the second target user is located in front of a second display area of ​​the second display; the cameras on the first and second displays are controlled to be in working order, so that the camera on the first display collects the gaze information of the first target user, and the camera on the second display collects the gaze information of the second target user, and the objects of interest of the first and second target users are marked and prompted in the first and second display areas respectively.

[0051] For example, in another possible implementation, the electronic device includes two displays, each display having a camera centrally located; the angle between a first display area on the first display and a second display area on the second display is 60 degrees; when the target user is facing the first display area, the camera on the first display is controlled to be in an active state so that it can collect the target user's gaze information, and the camera on the second display is controlled to be in a standby state so that the mouse in the second display area can be moved to the first display area.

[0052] In some embodiments, controlling the operating state of the monitoring module of the electronic device based on the configuration information and the first relative position relationship includes at least one of the following: When the first relative positional relationship indicates that the target user is unique and located in the first interactive area of ​​the first display area, the first monitoring module of the electronic device is controlled to be in a working state and the second monitoring module of the electronic device is controlled to be in a non-working state. When the first relative positional relationship indicates that the target user is unique and located in the second interactive area of ​​the second display area, the second monitoring module of the electronic device is controlled to be in a working state, and the first monitoring module of the electronic device is controlled to be in a non-working state. When the first relative positional relationship indicates that the target user is unique and located in the interaction area between the first display area and the second display area, based on the target user's facial orientation and / or gaze parameters, one of the first monitoring module and the second monitoring module of the electronic device is controlled to be in an active state and the other in an inactive state; or, When the first relative positional relationship indicates that the target user is not unique and is located in the first interaction area of ​​the first display area and the second interaction area of ​​the second display area respectively, the first monitoring module and the second monitoring module of the electronic device are controlled to be in working state. The first monitoring module is configured at a corresponding position in the first display area to provide the first interactive area, and the second monitoring module is configured at a corresponding position in the second display area to provide the second interactive area.

[0053] It should be understood that, in the embodiments of this application, the first interactive area where the target user is located in the first display area includes: the target user is located in the coverage area of ​​the first display screen, the first display screen is used to display the first display area, the first display area and the second display area belong to different display screens of the electronic device, and the first display screen is any display screen of the electronic device; or, the target user is located in the coverage area of ​​the first display area, and the first display area and the second display area belong to the same display screen of the electronic device.

[0054] For example, in one possible implementation, the electronic device includes a display screen, with a camera centrally located on each display screen; when the target user is located in the first display area, the camera on the first display screen is controlled to be in an active state so that the camera on the first display screen can collect the target user's gaze information, and the camera on the second display screen is controlled to be in an inactive state so that the mouse in the second display area can be moved to the first display area.

[0055] In this embodiment of the application, the second interactive area where the target user is located in the second display area includes: the target user is located in the coverage area of ​​the second display screen, the second display screen is used to display the second display area, the first display area and the second display area belong to different display screens of the electronic device, and the second display screen is any display screen of the electronic device; or, the target user is located in the coverage area of ​​the second display area, and the first display area and the second display area belong to the same display screen of the electronic device.

[0056] For example, in one possible implementation, the electronic device includes a display screen, with a camera centrally located on each display screen; when the target user is located in the second display area, the camera on the second display screen is controlled to be in an active state so that the camera on the second display screen can collect the target user's gaze information, and the camera on the first display screen is controlled to be in an inactive state so that the mouse in the first display area can be moved to the second display area.

[0057] It should be understood that, in the embodiments of this application, the interaction area between the target user and the first display area and the second display area includes: the target user is located in the middle area of ​​the display screen of the electronic device, and the first display area and the second display area belong to the same display screen or different display screens of the electronic device; or, the target user is located in the intersection of the first display area and the second display area, and the first display area and the second display area belong to the same display screen or different display screens of the electronic device.

[0058] In this embodiment, the target user's facial orientation and / or gaze parameters are used to determine the target display area (i.e., the first display area or the second display area) currently being focused on by the target user. For example, in one possible implementation, the operating state of the corresponding camera is determined based on which display screen the target user is looking at or which display area their body is tilting towards.

[0059] For example, in one possible implementation, the electronic device includes two displays, each display having a camera positioned centrally; when the target user is facing the first display area, the camera on the first display is controlled to be in an active state so that it can collect the target user's gaze information, and the camera on the second display is controlled to be in a non-active state. Based on the target user's gaze information collected by the camera on the first display area, the display content that the target user is interested in is marked on the first display area.

[0060] In some embodiments, the target user is located in a first interactive area of ​​the first display area, including: the target user's facial data, gaze parameters, or specific body parts are located in the first interactive area of ​​the first display area; correspondingly, in some embodiments, the target user is located in a second interactive area of ​​the second display area, including: the target user's facial data, gaze parameters, or specific body parts are located in the second interactive area of ​​the second display area.

[0061] For example, in one possible implementation, when there are two target users, the electronic device includes two display areas. A first camera is centrally located at the top edge of the first display area, and a second camera is centrally located at the top edge of the second display area. The first target user is located in a first interaction area of ​​the first display area, and the second target user is located in a second interaction area of ​​the second display area. The first and second cameras are controlled to be in an active state, so that the first camera collects the gaze information of the first target user, and the second camera collects the gaze information of the second target user, respectively marking the objects of interest of the first and second target users in the first and second display areas.

[0062] It should be understood that the configuration position of the first monitoring module is not limited in this embodiment. In some embodiments, the first monitoring module is located at the middle of the upper edge of the first display screen where the first display area is located, or at the left 1 / 3 of the edge of the first display screen. Similarly, the configuration position of the second monitoring module is not limited in this embodiment. In some embodiments, the second monitoring module is located at the middle of the upper edge of the second display screen where the second display area is located, or at the right 1 / 3 of the edge of the second display screen.

[0063] It should be understood that the first interactive area is not limited in the embodiments of this application. In some embodiments, the first interactive area refers to the detection area of ​​the corresponding first monitoring module, such as the field of view of a camera, the detection area of ​​a radar or ToF sensor or an infrared sensor, etc.

[0064] In some embodiments, the first display screen where the first display area is located is spliced ​​with the second display screen where the second display area is located, and the first monitoring module (e.g., camera, radar, infrared sensor, ToF sensor, etc.) and the second monitoring module (e.g., camera, radar, infrared sensor, ToF sensor, etc.) are located at the splicing edge.

[0065] In some embodiments, when the first relative positional relationship indicates that the target user is unique and located in the first interactive area of ​​the first display area or the second interactive area of ​​the second display area, the third monitoring module of the electronic device is controlled to be in a working state; the first display area and the second display area belong to the same display screen of the electronic device.

[0066] For example, in one possible implementation, when including a target user, the electronic device includes two display areas located on the same display screen; a camera is disposed at the center of the upper edge of the display screen; the camera is controlled to be in an active state, and when the target user's face is facing the first interactive area of ​​the first display area or the visual focus is on the first interactive area of ​​the first display area, the mouse of the second display area is moved to the first display area; when the target user's face is facing the second interactive area of ​​the second display area or the visual focus is on the second interactive area of ​​the second display area, the mouse of the first display area is moved to the second display area.

[0067] In some embodiments, controlling the operating state of the monitoring module of the electronic device based on the pose of the electronic device and the first relative positional relationship includes at least one of the following: When the angle between the first display area and the second display area is 0, and the first relative positional relationship indicates that the target user is unique and located in the interaction area between the first display area and the second display area, the first monitoring module and the second monitoring module of the electronic device are controlled to be in working state and the other in non-working state based on the target user's facial orientation and / or gaze parameters. When the angle between the first display area and the second display area, as represented by the pose shape, is within a first angle range, the monitoring module corresponding to the interactive area where the target user is located is controlled to be in working state based on the first relative positional relationship. When the angle between the first display area and the second display area, as represented by the pose shape, is 180 degrees, the first monitoring module and the second monitoring module of the electronic device are controlled to be in a non-working state. The first monitoring module is configured at a corresponding position in the first display area to provide the first interactive area, and the second monitoring module is configured at a corresponding position in the second display area to provide the second interactive area.

[0068] It should be understood that, in the embodiments of this application, the interaction area between the target user and the first display area and the second display area includes: the target user is located in the middle area of ​​the display screen of the electronic device, and the first display area and the second display area belong to the same display screen or different display screens of the electronic device; or, the target user is located in the intersection of the first display area and the second display area, and the first display area and the second display area belong to the same display screen or different display screens of the electronic device.

[0069] In this embodiment, the target user's facial orientation and / or gaze parameters are used to determine the target display area (i.e., the first display area or the second display area) currently being focused on by the target user. Based on the target monitoring module corresponding to the target display area, the working state of the target monitoring module and non-target monitoring modules is determined. For example, in one possible implementation, the working state of the corresponding camera is determined based on which display screen the target user is looking at or which display area their body is tilting towards.

[0070] For example, in one possible implementation, the electronic device includes two displays, each display having a camera positioned centrally; when the target user is facing the first display area, the camera on the first display is controlled to be in an active state so that it can collect the target user's gaze information, and the camera on the second display is controlled to be in a non-active state. Based on the target user's gaze information collected by the camera on the first display area, the display content that the target user is interested in is marked on the first display area.

[0071] It should be understood that the first angle range is not limited in this embodiment. In some embodiments, the first angle range includes 30~160 degrees, or 200~240 degrees. In this embodiment, when the angle between the first display area and the second display area is within the first angle range, the electronic device is in a partially folded state.

[0072] In this embodiment of the application, the monitoring module corresponding to the interactive area where the target user is located is controlled to be in working state based on the first relative position relationship. This can be understood as, in the scenario where the electronic device's display screen is face to face or the electronic device's display screen is folded, the decision to activate the corresponding monitoring module (e.g., camera, radar, ToF sensor / infrared sensor, etc.) is made based on whether there is a person and whether the user is within the interactive area.

[0073] For example, in one possible implementation, when the dual screens are folded 60 degrees face-to-face and the target user's gaze is focused on the first interactive area of ​​the first display area, the camera corresponding to the first interactive area is controlled to be in working state.

[0074] It should be understood that in the embodiments of this application, when the angle between the first display area and the second display area is 180 degrees, the display screen including the first display area and the second display screen including the second display area in the electronic device are in a snap-fit ​​state, for example, the dual-folding screen phone is in a fully folded state.

[0075] For example, in one possible implementation, for a dual-folding screen electronic device, when the electronic device is in a fully folded state, the first monitoring module configured at a corresponding position in the first display area and the second monitoring module configured at a corresponding position in the second display area are in a non-working state.

[0076] In some embodiments, controlling the display of a target object located in the first display area and / or the second display area using target monitoring data from the target monitoring module includes: Based on the first monitoring data of the unique user collected by the target monitoring module, the cursor focus of the electronic device is switched between the first display area and the second display area; or, Based on the second monitoring data of different users collected by the target monitoring module, the display parameters of the target content located in the first display area and / or the second display area are controlled, wherein the target content is the content of interest to the different users.

[0077] It should be understood that the first monitoring data is not limited in the embodiments of this application. In some embodiments, the first monitoring data includes one or more of the following: facial data of a unique user, gaze parameters of a unique user, voice data of a unique user, gesture data of a unique user, or motion data of a unique user.

[0078] In some embodiments, controlling the cursor focus of the electronic device to switch between the first display area and the second display area based on the first monitoring data of the unique user collected by the target monitoring module includes: controlling the cursor focus to switch between the first display area and the second display area based on one or more of the unique user's gaze, the unique user's facial orientation, and the unique user's gesture operation collected by the target monitoring module.

[0079] For example, in one possible implementation, the electronic device includes two displays, each with a camera centrally located. When the target user is facing a first display area, the camera on the first display is activated to capture the target user's gaze information, while the camera on the second display is deactivated. Based on the gaze information captured by the camera on the first display area, the mouse cursor on the second display area is moved to the first display area. Conversely, when the target user is facing the second display area, the camera on the second display is activated to capture the target user's gaze information, while the camera on the first display is deactivated. Based on the gaze information captured by the camera on the second display area, the mouse cursor on the first display area is moved to the second display area.

[0080] In this embodiment, the second monitoring data is not limited. In some embodiments, the second monitoring data includes one or more of the following: facial data of different users, gaze parameters of different users, voice data of different users, gesture data of different users, or motion data of different users.

[0081] It should be understood that the display parameters of the target content are not limited in this embodiment. In some embodiments, the display parameters of the target content include one or more of the following: display position, display mode (static display, dynamic display), and display effect (whether to highlight, emphasize, transparency, whether to add labels, etc.).

[0082] Furthermore, in some embodiments, the content that different users are interested in includes: content that different users are interested in individually, or content that different users are interested in together.

[0083] For example, in one possible implementation, when two target users are included, the electronic device includes two displays, each display having a camera centrally located; a first target user is located in front of a first display area of ​​the first display, and a second target user is located in front of a second display area of ​​the second display; the cameras of the first and second displays are controlled to be in an active state, such that the camera on the first display captures the gaze information of the first target user, and the camera on the second display captures the gaze information of the second target user; according to the implementation parameters of the first target user, the content of interest of the first target user is highlighted in the first display area and / or the second display area, and according to the implementation parameters of the second target user, the content of interest of the second target user is highlighted in the first display area and / or the second display area.

[0084] In some embodiments, Figure 2 A schematic diagram of the implementation process for controlling the display parameters of target content provided in this application embodiment. Figure 1 ,like Figure 2 As shown, the display parameters of target content located in the first display area and / or the second display area are controlled based on the second monitoring data of different users collected by the target monitoring module, including the following steps 201 to 203: Step 201: Control the first display area and the second display area to output the same display content in mirror mode. The first display area and the second display area belong to different displays of the electronic device. Step 202: Based on the second monitoring data, determine the target display content that each user is interested in, wherein the target display content is a part of the display content; Step 203: Control the first display area and / or the second display area to present the target display content that each user is interested in with different display parameters. The display parameters of the target display content are at least different from the display parameters of other content in the display content.

[0085] It is understood that, in this embodiment of the application, for multi-user scenarios where the first display area and the second display area are located on different screens of the electronic device, the first display area and the second display area display the same content. Based on the second monitoring data, the target display content that each user is interested in is determined, and then the first display area and / or the second display area are controlled to present the target display content that each user is interested in with different display parameters. This facilitates the sharing of content of interest to different users and improves communication efficiency.

[0086] It should be understood that, in the embodiments of this application, outputting the same content in mirror mode can be interpreted as the display content on two screens being identical and mirrored from each other. In the embodiments of this application, the target display content that different users focus on refers to the content that different users are looking at on their respective display screens.

[0087] In some embodiments, controlling the first display area and / or the second display area to present target display content of interest to different users with different display parameters includes: presenting the target display content of interest to different users with different display effects or display methods on the displays corresponding to different users. This is beneficial for reminding different users of the content they and others are interested in.

[0088] It should be understood that, in the embodiments of this application, the display parameters of the target display content are at least different from the display parameters of other content in the display content. This is beneficial for distinguishing between content that the user is interested in and content that is not interested in, so that the content that is interested in is highlighted.

[0089] For example, in one possible implementation, for face-to-face document inspection and signature confirmation scenarios related to banking and insurance, when a customer asks questions after seeing the screen content, the counter customer service representative can know which part of the screen the user is looking at, and while explaining and answering the questions through their own line of sight, they can also let the customer see where they are looking.

[0090] In some embodiments, Figure 3 A schematic diagram of the implementation process for controlling the display parameters of target content provided in this application embodiment. Figure 2 ,like Figure 3 As shown, the display parameters of target content located in the first display area and / or the second display area are controlled based on the second monitoring data of different users collected by the target monitoring module, including the following steps 301 to 304: Step 301: Control the first display area and the second display area to output the same display content in mirror mode. The first display area and the second display area belong to different displays of the electronic device. Step 302: Based on the second monitoring data, determine the target display content that each user is interested in, wherein the target display content is a part of the display content; Step 303: Generate target prompt information for at least one second user based on the user activity data of the first user, wherein the second user is a user whose target display content is different from that of the first user; Step 304: Control the second display area corresponding to the second user to present the target display content that the first user is interested in with different display parameters, and output the target prompt information.

[0091] It is understood that in this embodiment, for multi-user and multi-screen scenarios, the first display area and the second display area display the same content, and the target display content that different users are interested in is determined respectively; for second users whose target display content is different from that of the first user, target prompt information for at least one second user is generated based on the user activity data of the first user; and the second display area corresponding to the second user is controlled to present the target display content that the first user is interested in with different display parameters, and the target prompt information is output. In this way, it is beneficial to prompt unfocused / distracted users to pay attention to the target content that the first user is interested in.

[0092] In this embodiment, the first user is not limited. In some embodiments, the first user includes, but is not limited to, at least one of the following: speaker or organizer, speaker, boss, teacher, leader, etc. Correspondingly, in this embodiment, the second user is not limited. In some embodiments, the second user includes, but is not limited to, at least one of the following: participant, listener, student, employee, etc. Further, in some embodiments, the second user refers to a user who is not following the content of the first user's attention; for example, the second user is someone who is not listening attentively.

[0093] It should be understood that the target prompt information is not limited in the embodiments of this application. In some embodiments, the target prompt information is used to remind a second user to focus. Further, in some embodiments, the target prompt information may be a pop-up window, flashing, or vibration reminder.

[0094] In some embodiments, controlling the display parameters of target content located in the first display area and / or the second display area based on the second monitoring data of different users collected by the target monitoring module includes: controlling the first display area and the second display area to output the same display content in a mirror mode, wherein the first display area and the second display area belong to different displays of the electronic device; determining the target display content that each of the different users is interested in based on the second monitoring data, wherein the target display content is a part of the display content; generating target prompt information for at least one second user based on the user activity data of the first user, wherein the second user is a user of a different type from the first user; controlling the second display area corresponding to the second user to present the target display content that the first user is interested in with different display parameters, and outputting the target prompt information.

[0095] It is understood that in this embodiment, for multi-user and multi-display scenarios, the first display area and the second display area display the same content, and the target display content that different users are interested in is determined respectively; for second users with different types from the first user, target prompt information for at least one second user is generated based on the user activity data of the first user; and the second display area corresponding to the second user is controlled to present the target display content that the first user is interested in with different display parameters, and the target prompt information is output. In this way, it is beneficial to prompt the second user to pay attention to the target content that the first user is interested in.

[0096] It should be understood that the first user is not limited in the embodiments of this application. In some embodiments, the first user is the user who is speaking. The second user is not limited in the embodiments of this application. In some embodiments, the second user is the user who is listening.

[0097] For example, in one possible implementation, during meetings, training sessions, or classes, the speaker's target content is highlighted on the listener's screen. This allows the listener to see the speaker's current focus, thereby increasing concentration and improving understanding of the content the speaker is addressing.

[0098] In some embodiments, controlling the display parameters of target content located in the first display area and / or the second display area based on the second monitoring data of different users collected by the target monitoring module includes: controlling the first display area and the second display area to output the same display content in a mirror mode, wherein the first display area and the second display area belong to different displays of the electronic device; determining the target display content that each of the different users is interested in based on the second monitoring data, wherein the target display content is a part of the display content; generating target prompt information for at least one first user based on the user activity data of the second user, wherein the first user is a user of a different type from the second user; controlling the first display area corresponding to the first user to present the target display content that the second user is interested in with different display parameters, and outputting the target prompt information.

[0099] It is understood that in this embodiment, for scenarios with multiple users and multiple displays, the first display area and the second display area display the same content, and the target display content that different users are interested in is determined respectively; for second users with different user types than the first users, target prompt information for at least one first user is generated based on the user activity data of the second user; and the first display area corresponding to the first user is controlled to present the target display content that the second user is interested in with different display parameters, and the target prompt information is output. In this way, it is beneficial for the first user to know the content that the second user is interested in.

[0100] For example, in one possible implementation, during meetings, training sessions, or classes, the speaker's display screen highlights the target content for the listeners. This allows the speaker to know the target content being focused on, thus determining whether any listeners are distracted or not paying attention to the content being presented.

[0101] In some embodiments, controlling the display parameters of target content located in the first display area and / or the second display area based on the second monitoring data of different users collected by the target monitoring module includes: controlling the first display area and the second display area to output the same display content in a mirror mode, wherein the first display area and the second display area belong to different displays of the electronic device; determining the target display content that each of the different users is interested in based on the second monitoring data, wherein the target display content is a part of the display content; generating target prompt information for at least one first user based on the user activity data of the second user, wherein the second user is a user whose target display content is different from that of the first user; controlling the first display area corresponding to the first user to present the target display content that the second user is interested in with different display parameters, and outputting the target prompt information.

[0102] It is understood that in this embodiment, for multi-user and multi-screen scenarios, the first display area and the second display area display the same content, and the target display content that different users are interested in is determined respectively; for second users whose target display content is different from that of the first user, target prompt information for at least one first user is generated based on the second user's user activity data; and the first display area corresponding to the first user is controlled to present the target display content that the second user is interested in with different display parameters, and the target prompt information is output. In this way, it is beneficial to make the first user aware of which second users are distracted / not paying attention to the content introduced.

[0103] For example, in one possible implementation, in scenarios such as meetings, training, or classes, for listeners whose focus is different from the content displayed on the speaker's screen, the content that the listener is focusing on is highlighted. This helps the speaker to know what those who are not paying attention to are focusing on, or to identify those who are distracted, thereby reminding the listeners to pay attention to what they are explaining.

[0104] It is understood that, in this embodiment of the application, the second display area corresponding to the second user is controlled to present the target display content that the first user is interested in with different display parameters, and the target prompt information is output; in this way, the content that the first user is talking about can be highlighted on the second user's display screen, and prompt information can be given to help people who are not focused to concentrate.

[0105] For example, in one possible implementation, in a meeting, training, or class setting, when the content being focused on by the listener and the speaker differs, the content being focused on by the speaker is highlighted on the screen of the person who is distracted, and a prompt message is output to remind the distracted person to pay attention to the content being focused on by the speaker.

[0106] In some embodiments, Figure 4 A schematic diagram of the implementation process for controlling the display parameters of target content provided in this application embodiment. Figure 3 ,like Figure 4 As shown, the display parameters of target content located in the first display area and / or the second display area are controlled based on the second monitoring data of different users collected by the target monitoring module, including the following steps 401 to 403: Step 401: Control the first display area and the second display area to output the same display content in mirror mode. The first display area and the second display area belong to different displays of the electronic device. Step 402: Based on the second monitoring data, determine the target input content for each of the different users, wherein the target input content is different from the displayed content; Step 403: Control the first display area and / or the second display area to present the target input content input by different users with different display parameters, wherein the display parameters of the target input content are at least different from the display parameters of the displayed content.

[0107] It is understood that, in the embodiments of this application, in scenarios involving multiple users and multiple displays, the target input content entered by each user is presented on the corresponding display screen with different display parameters, and the display parameters of the target input content are at least different from the display parameters of the displayed content. This helps different users to focus on the target display content entered by themselves and other users, achieving efficient communication.

[0108] It should be understood that, in this embodiment of the application, the target input content entered by each different user is not limited. In some embodiments, the target input content entered by each different user may be content entered or drawn by different users on their respective display screens. The target input content is different from the displayed content, for example: a collaborative painting scene on the same canvas, a flowchart filling scene, or a collaborative challenge and level completion scene in a multiplayer collaborative game.

[0109] In this embodiment of the application, controlling the first display area and / or the second display area to present the target input content entered by different users with different display parameters means to prompt or distinguish the content entered by oneself and the other party on their respective display screens with different display effects or display methods.

[0110] It is understood that, in this embodiment of the application, the display parameters of the target input content are at least different from the display parameters of the displayed content; in this way, the input content and the original displayed content can be distinguished, so that the new input content is highlighted.

[0111] For example, in one possible implementation, for collaborative painting scenarios on the same canvas, flowchart filling scenarios, and collaborative challenge and level completion scenarios in multiplayer collaborative games, eye-tracking recognition using RGB cameras is used to semi-transparently overlay the focus frames of multiple displays and multiple eye-tracking recognitions onto the corresponding coordinates of the shared screen using a unified coordinate system. This enables efficient communication based on a shared focus. In multiplayer collaborative scenarios, this can improve the efficiency of quickly aligning ideas and collaborating on creative concepts.

[0112] The following examples illustrate possible implementation schemes of the control method for the electronic device described in one or more of the above embodiments.

[0113] With the gradual development of voice input, its application in human-computer interaction is increasing. However, due to the difficulty of accurately locating content on the screen, its application is subject to many limitations.

[0114] In some embodiments, eye-tracking recognition is achieved for a single screen based on a camera with special hardware; in other embodiments, eye-tracking recognition is achieved through a purely software method using information collected by an RGB single camera, which can be applied to autonomous driving, observing human eye focus, or to single-screen scenarios of mobile phones, tablets and computers.

[0115] In this application embodiment, a method for single-person and multi-person multi-mode eye tracking based on dual cameras with a dual-screen 360-degree hinge is provided (i.e., an example of an electronic device control method). It employs dual RGB cameras to address single-person multi-mode and dual-person multi-mode scenarios in dual-screen and multi-device modes, or dual RGB cameras with an infrared sensor to address low-light dual-screen and single-person multi-mode and dual-person multi-mode scenarios in multi-device modes. The RGB cameras include: a monocular RGB camera, an infrared binocular camera, a 3D structured light camera, and a ToF depth camera.

[0116] In some embodiments, the monitoring module further includes an infrared sensing module for assisting in acquiring facial features and / or gaze-related information of the target user under insufficient ambient light or low light conditions.

[0117] For example, when the ambient brightness is lower than a preset threshold, the electronic device controls the infrared sensing module to enter the working state to obtain the infrared feature data of the target user; and performs fusion processing on the infrared feature data and the image data collected by the RGB camera to improve the stability and accuracy of the recognition of the target user's facial orientation, gaze parameters or head posture.

[0118] By employing the above method, even in complex lighting environments such as low light or backlight, the relative positional relationship between the target user and the first and second display areas can still be reliably determined, thereby ensuring the accuracy of display control operations performed based on monitoring data.

[0119] In some embodiments, eye-tracking control of dual screens can be implemented in different modes, which can replace the functions of a mouse and touchpad in some scenarios to a certain extent.

[0120] In some embodiments, in dual-person, dual-screen mode, eye-tracking can be achieved by two or more people, and interactive and collaborative control can be performed to complete the same task.

[0121] In some embodiments, such as Figure 5As shown, in single-person mode, the two cameras recognize the side face and the front face. When the front face is visible, the eye movement control of the current screen is enabled, and the mouse control is automatically and quickly applied to the current front face screen. The eye movement control of the current screen is executed to simulate mouse movement and positioning. Clicks are confirmed through other means, such as double blinking.

[0122] In some embodiments, such as Figure 6 As shown, when a person turns their head to focus on the content of the right window, the camera on the right screen detects the change from the side of the face to the front of the face, then activates eye-tracking control on the right screen and disables eye-tracking control on the left screen, and quickly jumps the mouse cursor to the right screen to follow the movement of the eyeball.

[0123] In some embodiments, such as Figure 7 As shown, in multi-person scenarios, the content of two screens can be presented in a copy mode. This can be applied to face-to-face document checks and signature confirmations in banking and insurance-related settings. When customers ask questions after seeing the screen content, the counter staff can know which part of the screen the customer is looking at and, through their own eye movements, explain and answer while also letting the customer see where they are looking. This communication is highly efficient and direct.

[0124] In some embodiments, such as Figure 8 , Figure 9 and Figure 10 As shown, with dual screens unfolded 180 degrees or folded 60 degrees in a face-to-face configuration, in a meeting (or training) scenario, two people can attend a meeting in person, while one person attends online. In this multi-person scenario, participants can quickly direct the audience to focus on a specific part of the screen material during communication, allowing for targeted explanations. This solves the problem in training or classroom scenarios where listeners are unsure which part the instructor or trainer is currently explaining. It allows listeners to see the speaker's focus, improving concentration and comprehension. In other words, only the speaker's focus is displayed to everyone; whoever is speaking shows their focus. It also allows the speaker to see the attention level of all attendees, whether they are paying attention to their presentation or are completely distracted. This allows the instructor to remind the relevant participants to focus on the corresponding knowledge points.

[0125] In some embodiments, for collaborative painting scenarios on the same canvas, flowchart filling scenarios, and multiplayer collaborative game scenarios involving completing challenges and levels, eye-tracking recognition using RGB cameras is used to semi-transparently overlay the focus frames of multiple displays and multiple eye-tracking recognitions onto the corresponding coordinates of the shared screen using a unified coordinate system. This enables efficient communication based on a shared focus. In multiplayer collaborative scenarios, this can improve the efficiency of quickly aligning ideas and collaborating on creative concepts.

[0126] Based on the same inventive concept as the foregoing embodiments, this application provides a control device for an electronic device.

[0127] Figure 11 This is a schematic diagram of the structure of a control device for an electronic device provided in an embodiment of this application; as shown below. Figure 11 As shown, the control device 110 of the electronic device includes: a first acquisition module 1101, a second acquisition module 1102, and a control module 1103; wherein, The first acquisition module 1101 is configured to acquire the pose shape of the electronic device, the pose shape including at least the included angle between the first display area and the second display area of ​​the electronic device; The second acquisition module 1102 is configured to acquire a first relative positional relationship between the target user and the first display area and the second display area; The control module 1103 is configured to control the working state of the monitoring module of the electronic device based on the first relative position relationship, so as to control the display of the target object located in the first display area and / or the second display area using the target monitoring data of the target monitoring module, wherein the target monitoring module is at least one of the monitoring modules of the electronic device.

[0128] It should be noted that the module division in the embodiments of this application is illustrative and only represents one logical functional division. In actual implementation, there may be other division methods. Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, exist as separate physical units, or have two or more units integrated into one unit. The integrated units can be implemented in hardware, as software functional units, or a combination of software and hardware.

[0129] It should be noted that, in the embodiments of this application, if the above-described methods are implemented as software functional modules and sold or used as independent products, they can also be stored in a computer-readable storage medium. Based on this understanding, the technical solutions of the embodiments of this application, or the parts that contribute to related technologies, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause an electronic device to execute all or part of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), magnetic disks, or optical disks. Thus, the embodiments of this application are not limited to any specific hardware and software combination.

[0130] This application provides an electronic device. Figure 12 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application, such as... Figure 12 As shown, the electronic device 120 includes a first body 1201 and a second body 1202 rotatably connected, a first display area disposed on the first body 1201 and a second display area disposed on the second body 1202. The first body 1201 can rotate relative to the second body 1202 so that the electronic device 120 has different device forms. In different device forms, the included angle between the first display area and the second display area is different. The electronic device 120 further includes a monitoring module 1203 and a processor 1204 disposed on the first body 1201 and / or the second body 1202. The processor 1204 is capable of performing the following operations: The pose shape of the electronic device 120 is obtained, and the pose shape includes at least the angle between the first display area and the second display area of ​​the electronic device 120. Obtain the first relative positional relationship between the target user and the first display area and the second display area; The operating state of the monitoring module 1203 of the electronic device 120 is controlled based on the first relative position relationship, so as to control the display of the target object located in the first display area and / or the second display area using the target monitoring data of the target monitoring module. The target monitoring module is at least one of the monitoring modules 1203 of the electronic device 120.

[0131] In some embodiments, obtaining the first relative positional relationship between the target user and the first display area and the second display area includes: obtaining the second relative positional relationship between the monitoring module of the electronic device and the first display area and the second display area; determining the first relative positional relationship between the target user and the first display area and the second display area based on the second relative positional relationship and the user data of the target user monitored by the monitoring module; wherein the target user may be unique or not unique, and the monitoring module includes the acquisition module configured by the electronic device itself and / or an external acquisition module.

[0132] In some embodiments, controlling the working state of the monitoring module of the electronic device based on the first relative positional relationship includes: obtaining configuration information of the monitoring module, and controlling the working state of the monitoring module of the electronic device based on the configuration information and the first relative positional relationship; or, controlling the working state of the monitoring module of the electronic device based on the pose of the electronic device and the first relative positional relationship; wherein the first display area and the second display area belong to the same display screen or different display screens of the electronic device.

[0133] In some embodiments, controlling the operating state of the monitoring module of the electronic device based on the configuration information and the first relative position relationship includes at least one of the following: When the first relative positional relationship indicates that the target user is unique and located in the first interactive area of ​​the first display area, the first monitoring module of the electronic device is controlled to be in a working state and the second monitoring module of the electronic device is controlled to be in a non-working state. When the first relative positional relationship indicates that the target user is unique and located in the second interactive area of ​​the second display area, the second monitoring module of the electronic device is controlled to be in a working state, and the first monitoring module of the electronic device is controlled to be in a non-working state. When the first relative positional relationship indicates that the target user is unique and located in the interaction area between the first display area and the second display area, based on the target user's facial orientation and / or gaze parameters, one of the first monitoring module and the second monitoring module of the electronic device is controlled to be in an active state and the other in an inactive state; or, When the first relative positional relationship indicates that the target user is not unique and is located in the first interaction area of ​​the first display area and the second interaction area of ​​the second display area respectively, the first monitoring module and the second monitoring module of the electronic device are controlled to be in working state. The first monitoring module is configured at a corresponding position in the first display area to provide the first interactive area, and the second monitoring module is configured at a corresponding position in the second display area to provide the second interactive area.

[0134] In some embodiments, controlling the operating state of the monitoring module of the electronic device based on the pose of the electronic device and the first relative positional relationship includes at least one of the following: When the angle between the first display area and the second display area is 0, and the first relative positional relationship indicates that the target user is unique and located in the interaction area between the first display area and the second display area, the first monitoring module and the second monitoring module of the electronic device are controlled to be in working state and the other in non-working state based on the target user's facial orientation and / or gaze parameters. When the angle between the first display area and the second display area, as represented by the pose shape, is within a first angle range, the monitoring module corresponding to the interactive area where the target user is located is controlled to be in working state based on the first relative positional relationship. When the angle between the first display area and the second display area, as represented by the pose shape, is 180 degrees, the first monitoring module and the second monitoring module of the electronic device are controlled to be in a non-working state. The first monitoring module is configured at a corresponding position in the first display area to provide the first interactive area, and the second monitoring module is configured at a corresponding position in the second display area to provide the second interactive area.

[0135] In some embodiments, controlling the display of a target object located in the first display area and / or the second display area using target monitoring data from a target monitoring module includes: controlling the cursor focus of the electronic device to switch between the first display area and the second display area based on first monitoring data of a single user collected by the target monitoring module; or, controlling the display parameters of target content located in the first display area and / or the second display area based on second monitoring data of different users collected by the target monitoring module, wherein the target content is the content of interest to the different users.

[0136] In some embodiments, controlling the display parameters of target content located in the first display area and / or the second display area based on second monitoring data of different users collected by the target monitoring module includes: controlling the first display area and the second display area to output the same display content in a mirror mode, wherein the first display area and the second display area belong to different displays of the electronic device; determining the target display content that each of the different users is interested in based on the second monitoring data, wherein the target display content is part of the display content; and controlling the first display area and / or the second display area to present the target display content that each of the different users is interested in with different display parameters, wherein the display parameters of the target display content are at least different from the display parameters of other content in the display content.

[0137] In some embodiments, controlling the display parameters of target content located in the first display area and / or the second display area based on second monitoring data of different users collected by the target monitoring module includes: controlling the first display area and the second display area to output the same display content in a mirror mode, wherein the first display area and the second display area belong to different displays of the electronic device; determining the target display content that each of the different users is interested in based on the second monitoring data, wherein the target display content is a part of the display content; generating target prompt information for at least one second user based on the user activity data of the first user, wherein the second user is a user whose target display content is different from that of the first user; controlling the second display area corresponding to the second user to present the target display content that the first user is interested in with different display parameters, and outputting the target prompt information.

[0138] In some embodiments, controlling the display parameters of target content located in the first display area and / or the second display area based on second monitoring data of different users collected by the target monitoring module includes: controlling the first display area and the second display area to output the same display content in a mirror mode, wherein the first display area and the second display area belong to different displays of the electronic device; determining the target input content input by each of the different users based on the second monitoring data, wherein the target input content is different from the display content; and controlling the first display area and / or the second display area to present the target input content input by each of the different users with different display parameters, wherein the display parameters of the target input content are at least different from the display parameters of the display content.

[0139] In some embodiments, the monitoring module 1203 includes, but is not limited to, at least one of the following: a single module such as a camera, radar, infrared sensor, or time-of-flight sensor, or an array module. In some embodiments, the monitoring module further includes: a single microphone module or a microphone array module.

[0140] In some embodiments, the monitoring module 1203 includes: a camera module for a dual-screen device, or a camera module for a foldable screen device (e.g., a foldable laptop), or includes: a camera and an infrared sensing module / ToF sensor.

[0141] In some embodiments, the first body 1201 includes a first display screen, and the second body 1202 includes a second display screen; the first display area is located on the first display screen of the first body 1201, and the second display area is located on the second display screen of the second body 1202. In other embodiments, the first body 1201 and the second body 1202 are located on the same display screen; the first display area and the second display area are two display areas located on the display screens of the first body 1201 and the second body 1202.

[0142] This application provides a computer-readable storage medium storing a computer program thereon, which, when executed by a processor, implements the steps of the method provided in the above embodiments.

[0143] This application provides a computer program product containing instructions that, when run on a computer, cause the computer to perform the steps in the method provided in the above-described method embodiments.

[0144] It should be noted that the descriptions of the storage medium and device embodiments above are similar to the descriptions of the method embodiments above, and have similar beneficial effects. For technical details not disclosed in the storage medium, storage medium, and device embodiments of this application, please refer to the descriptions of the method embodiments of this application for understanding.

[0145] It should be understood that phrases such as "an embodiment," "one embodiment," "some embodiments," "in one possible implementation," or "example" throughout the specification mean that a specific feature, structure, or characteristic related to an embodiment is included in at least one embodiment of this application. Therefore, phrases such as "in one embodiment," "in one embodiment," "in some embodiments," "in one possible implementation," or "example" appearing throughout the specification do not necessarily refer to the same embodiment.

[0146] Furthermore, these specific features, structures, or characteristics can be combined in any suitable manner in one or more embodiments. It should be understood that in the various embodiments of this application, the sequence numbers of the above processes do not imply a specific order of execution; the execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0147] The sequence numbers of the embodiments in this application are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments. The descriptions of the various embodiments above tend to emphasize the differences between the various embodiments, and their similarities or commonalities can be referred to each other. For the sake of brevity, they will not be repeated here.

[0148] In this article, the term "and / or" is merely a description of the relationship between related objects, indicating that there can be three kinds of relationships. For example, object A and / or object B can represent three situations: object A exists alone, object A and object B exist simultaneously, and object B exists alone.

[0149] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.

[0150] In the several embodiments provided in this application, it should be understood that the disclosed devices and apparatuses can be implemented in other ways. The embodiments described above are merely illustrative. The features disclosed in the several product embodiments provided in this application can be arbitrarily combined to obtain new product embodiments without conflict.

[0151] The above description is merely an embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A control method for an electronic device, comprising: The pose shape of the electronic device is obtained, wherein the pose shape includes at least the angle between the first display area and the second display area of ​​the electronic device; Obtain the first relative positional relationship between the target user and the first display area and the second display area; The working state of the monitoring module of the electronic device is controlled based on the first relative position relationship, so as to control the display of the target object located in the first display area and / or the second display area using the target monitoring data of the target monitoring module. The target monitoring module is at least one of the monitoring modules of the electronic device.

2. The method according to claim 1, wherein obtaining the first relative positional relationship between the target user and the first display area and the second display area comprises: Obtain the second relative positional relationship between the monitoring module of the electronic device and the first display area and the second display area; Based on the second relative positional relationship and the user data of the target user monitored by the monitoring module, a first relative positional relationship between the target user and the first display area and the second display area is determined. The target user may be unique or not, and the monitoring module includes the acquisition module configured in the electronic device itself and / or an external acquisition module.

3. The method according to claim 1 or 2, wherein controlling the working state of the monitoring module of the electronic device based on the first relative positional relationship includes: Obtain the configuration information of the monitoring module, and control the working state of the monitoring module of the electronic device based on the configuration information and the first relative position relationship; or, The working state of the monitoring module of the electronic device is controlled based on the pose and the first relative position relationship of the electronic device. The first display area and the second display area belong to the same display screen or different display screens of the electronic device.

4. The method of claim 3, wherein, Controlling the operating status of the monitoring module of the electronic device based on the configuration information and the first relative position relationship includes at least one of the following: When the first relative positional relationship indicates that the target user is unique and located in the first interactive area of ​​the first display area, the first monitoring module of the electronic device is controlled to be in a working state and the second monitoring module of the electronic device is controlled to be in a non-working state. When the first relative positional relationship indicates that the target user is unique and located in the second interactive area of ​​the second display area, the second monitoring module of the electronic device is controlled to be in a working state, and the first monitoring module of the electronic device is controlled to be in a non-working state. When the first relative positional relationship indicates that the target user is unique and located in the interaction area between the first display area and the second display area, the first monitoring module and the second monitoring module of the electronic device are controlled to be in working state and the other in non-working state based on the target user's facial orientation and / or gaze parameters. or, When the first relative positional relationship indicates that the target user is not unique and is located in the first interaction area of ​​the first display area and the second interaction area of ​​the second display area respectively, the first monitoring module and the second monitoring module of the electronic device are controlled to be in working state. The first monitoring module is configured at a corresponding position in the first display area to provide the first interactive area, and the second monitoring module is configured at a corresponding position in the second display area to provide the second interactive area.

5. The method according to claim 3, wherein, Controlling the operating state of the monitoring module of the electronic device based on the pose and the first relative position relationship of the electronic device includes at least one of the following: When the angle between the first display area and the second display area is 0, and the first relative positional relationship indicates that the target user is unique and located in the interaction area between the first display area and the second display area, the first monitoring module and the second monitoring module of the electronic device are controlled to be in working state and the other in non-working state based on the target user's facial orientation and / or gaze parameters. When the angle between the first display area and the second display area, as represented by the pose shape, is within a first angle range, the monitoring module corresponding to the interactive area where the target user is located is controlled to be in working state based on the first relative positional relationship. When the angle between the first display area and the second display area, as represented by the pose shape, is 180 degrees, the first monitoring module and the second monitoring module of the electronic device are controlled to be in a non-working state. The first monitoring module is configured at a corresponding position in the first display area to provide a first interactive area, and the second monitoring module is configured at a corresponding position in the second display area to provide a second interactive area.

6. The method according to any one of claims 1, 4, or 5, wherein, Controlling the display of target objects located in the first display area and / or the second display area using target monitoring data from the target monitoring module includes: Based on the first monitoring data of the unique user collected by the target monitoring module, the cursor focus of the electronic device is switched between the first display area and the second display area; or, Based on the second monitoring data of different users collected by the target monitoring module, the display parameters of the target content located in the first display area and / or the second display area are controlled, wherein the target content is the content of interest to the different users.

7. The method according to claim 6, wherein, Based on the second monitoring data of different users collected by the target monitoring module, the display parameters of the target content located in the first display area and / or the second display area are controlled, including: The first display area and the second display area are controlled to output the same display content in a mirror mode, and the first display area and the second display area belong to different displays of the electronic device; Based on the second monitoring data, the target display content that each user is interested in is determined, and the target display content is a part of the display content; The first display area and / or the second display area are controlled to present target display content of interest to different users with different display parameters, wherein the display parameters of the target display content are at least different from the display parameters of other content in the display content.

8. The method according to claim 6, wherein, Based on the second monitoring data of different users collected by the target monitoring module, the display parameters of the target content located in the first display area and / or the second display area are controlled, including: The first display area and the second display area are controlled to output the same display content in a mirror mode, and the first display area and the second display area belong to different displays of the electronic device; Based on the second monitoring data, the target display content that each user is interested in is determined, and the target display content is a part of the display content; Based on the user activity data of the first user, a target prompt message is generated for at least one second user, where the second user is a user whose target content is different from that of the first user. The system controls the second display area corresponding to the second user to display the target content that the first user is interested in using different display parameters, and outputs the target prompt information.

9. The method according to claim 6, wherein, Based on the second monitoring data of different users collected by the target monitoring module, the display parameters of the target content located in the first display area and / or the second display area are controlled, including: The first display area and the second display area are controlled to output the same display content in a mirror mode, and the first display area and the second display area belong to different displays of the electronic device; Based on the second monitoring data, the target input content entered by each of the different users is determined, and the target input content is different from the displayed content; The first display area and / or the second display area are controlled to present target input content input by different users with different display parameters, wherein the display parameters of the target input content are at least different from the display parameters of the displayed content.

10. An electronic device, comprising a first body and a second body rotatably connected, a first display area disposed on the first body and a second display area disposed on the second body, wherein the first body is rotatable relative to the second body to give the electronic device different device forms, and the included angle between the first display area and the second display area is different in the different device forms; in, The electronic device further includes a monitoring module and a processor disposed on the first body and / or the second body, the processor being capable of performing the following operations: The pose shape of the electronic device is obtained, and the pose shape includes at least the angle between the first display area and the second display area of ​​the electronic device; Obtain the first relative positional relationship between the target user and the first display area and the second display area; The working state of the monitoring module of the electronic device is controlled based on the first relative position relationship, so as to control the display of the target object located in the first display area and / or the second display area using the target monitoring data of the target monitoring module. The target monitoring module is at least one of the monitoring modules of the electronic device.

Images