Processing method and electronic equipment

Abstract

The present disclosure relates to a processing method and an electronic device. The processing method includes: determining that a second display screen is connected to the electronic device; determining a main screen from a first display screen and a second display screen of the electronic device through at least one component provided in the electronic device; and determining a relative relationship between the second display screen and the first display screen and / or a user based on the determined main screen.

Description

Technical Field

[0001] The present disclosure relates to the field of information processing technology, and in particular to a processing method and electronic device. Background Art

[0002] Using multiple display devices often requires users to manually adjust screen parameters to make the screen status consistent with the user's usage status, which results in poor experience and low efficiency. Summary of the Invention

[0003] The purpose of the embodiments of the present disclosure is to provide a processing method and an electronic device.

[0004] In one aspect, an embodiment of the present disclosure provides a processing method, including:

[0005] determining that a second display screen is connected to the electronic device;

[0006] Determining a home screen from a first display screen and a second display screen of the electronic device by at least one component provided in the electronic device;

[0007] Based on the determined main screen, a relative relationship between the second display screen and the first display screen and / or the user is determined.

[0008] In some embodiments, the first display screen is provided with a first transmitting component and a first receiving component, and the second display screen is provided with a second transmitting component and a second receiving component, and determining the home screen from the first display screen and the second display screen by at least one component provided in the electronic device includes:

[0009] Transmitting a first transmission signal to the user through the first transmission component, and transmitting a second transmission signal to the user through the second transmission component;

[0010] obtaining, by the first receiving component, a first return signal returned to the first display screen based on the first transmitted signal, and obtaining, by the second receiving component, a second return signal returned to the second display screen based on the second transmitted signal;

[0011] Obtaining a first time difference between the first transmitted signal and the first returned signal, and a second time difference between the second transmitted signal and the second returned signal;

[0012] The home screen is determined based on the first return signal, the second return signal, the first time difference, and the second time difference.

[0013] In some embodiments, determining the home screen based on the first return signal, the second return signal, the first time difference, and the second time difference includes:

[0014] If the signal strength of the first return signal is greater than the signal strength of the second return signal, and the first time difference is close to the second time difference, determining that the first display screen is the main screen;

[0015] If the signal strength of the first return signal is less than the signal strength of the second return signal, and the first time difference is close to the second time difference, the second display screen is determined to be the main screen.

[0016] In some embodiments, if the first display screen is the primary screen, determining the relative relationship between the second display screen and the first display screen based on the determined primary screen includes:

[0017] respectively transmitting a third transmission signal and a fourth transmission signal to the user through the two second transmission components provided on the second display screen;

[0018] Obtaining a third return signal returned to the first receiving component of the first display screen based on the third transmission signal, and a fourth return signal returned to the first receiving component based on the fourth transmission signal;

[0019] If the signal strength of the third return signal is greater than the signal strength of the fourth return signal, the second display screen is located on the right side of the first display screen; if the signal strength of the third return signal is less than the signal strength of the fourth return signal, the second display screen is located on the left side of the first display screen.

[0020] In some embodiments, if the second display screen is the main screen and the user is in the first state, determining the relative relationship between the second display screen and the user based on the determined main screen includes:

[0021] identifying an angle between the user's sight line and the first display screen by a third component provided in the electronic device;

[0022] The distance between the user and the second display screen is calculated based on the angle.

[0023] In some embodiments, identifying the angle between the user's line of sight and the first display screen by a third component provided in the electronic device includes:

[0024] Identifying a first angle between a first sight line of the user and the first display screen, wherein the first sight line is a line connecting an eye of the user and a first edge of the second display screen;

[0025] identifying a second angle between a second line of sight of the user and the first display screen, wherein the first line of sight is a line connecting an eye of the user and a second edge of the second display screen;

[0026] A third angle between the first line of sight or the second line of sight and a third line of sight when the user is in the first state is calculated based on the first angle and the second angle, wherein the third line of sight is a line connecting the user's eyes and the center of the first display screen, and the first line of sight is symmetrical to the second line of sight.

[0027] In some embodiments, if the second display screen is the primary screen, determining the relative relationship between the second display screen and the user based on the determined primary screen includes:

[0028] identifying, by a fourth component provided in the electronic device, first position coordinates of the user relative to the first display screen;

[0029] The second position coordinates of the user relative to the second display screen are calculated based on the first position coordinates.

[0030] In some embodiments, the method further comprises:

[0031] Based on the first position coordinates of the user relative to the first display screen when in the first state and the relative position relationship between the first display screen and the second display screen, an association relationship between the first position coordinates and the second position coordinates is determined.

[0032] In some embodiments, the second position coordinates are polar coordinates, and the method further comprises:

[0033] The distance between the user and the second display screen is calculated based on the second position coordinates.

[0034] On the other hand, an embodiment of the present disclosure further provides an electronic device, including a first display screen, and further including a determination module, wherein the determination module is configured to:

[0035] determining that a second display screen is connected to the electronic device;

[0036] Determining a home screen from the first display screen and the second display screen by at least one component provided in the electronic device;

[0037] Based on the determined main screen, a relative relationship between the second display screen and the first display screen and / or the user is determined.

[0038] The processing method and electronic device provided by the embodiments of the present disclosure can, after determining that an external second display screen is connected to the electronic device, determine the main screen from the second display screen and the first display screen of the electronic device through at least one component provided in the electronic device, and based on the determined main screen, determine the relative relationship between the second display screen and the first display screen and / or the user, and can automatically configure the display screen for the user, and can also monitor the user's usage status of the second display screen in real time, provide the user with better usage configuration parameters (including the above-mentioned periodic reminders or lock screens, etc.), and improve the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] Figure 1 is a first flow chart of the processing method according to an embodiment of the present disclosure;

[0040] Figure 2 is a second flow chart of the processing method according to an embodiment of the present disclosure;

[0041] Figure 3 is a third flow chart of the processing method according to an embodiment of the present disclosure;

[0042] Figure 4 is a fourth flow chart of the processing method according to an embodiment of the present disclosure;

[0043] Figure 5 is a fifth flow chart of the processing method according to an embodiment of the present disclosure;

[0044] Figure 6 A schematic diagram of determining a home screen according to an embodiment of the present disclosure;

[0045] Figure 7 Another schematic diagram of determining a home screen according to an embodiment of the present disclosure;

[0046] Figure 8 A schematic diagram of determining a user's status according to an embodiment of the present disclosure;

[0047] Figure 9 A schematic diagram of determining the relative relationship between the second display screen and the user according to an embodiment of the present disclosure;

[0048] Figure 10 This is another schematic diagram of determining the relative relationship between the second display screen and the user according to an embodiment of the present disclosure.

[0049] Reference numerals:

[0050] 10-first display screen; 20-second display screen, 201-first area, 202-second area; 1-first transmitting component, 11-first sub-transmitting component, 12-first sub-transmitting component, 2-first receiving component, 3-second transmitting component, 31-second sub-transmitting component, 32-second sub-transmitting component, 4-second receiving component; 30-determination module; 40-calculation module. DETAILED DESCRIPTION

[0051] Various aspects and features of the present disclosure are described herein with reference to the accompanying drawings.

[0052] It should be understood that various modifications may be made to the embodiments disclosed herein. Therefore, the above description should not be considered as limiting, but merely as an example of an embodiment. Other modifications within the scope and spirit of the present disclosure will occur to those skilled in the art.

[0053] The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the present disclosure and, together with the general description of the present disclosure given above and the detailed description of the embodiments given below, serve to explain the principles of the present disclosure.

[0054] These and other characteristics of the present disclosure will become apparent from the following description of a preferred form of embodiment given as a non-limiting example with reference to the accompanying drawings.

[0055] It should also be understood that although the disclosure has been described with reference to certain specific examples, those skilled in the art will readily recognize that many other equivalent forms of the disclosure can be implemented.

[0056] The above and other aspects, features and advantages of the present disclosure will become more apparent from the following detailed description when taken in conjunction with the accompanying drawings.

[0057] Specific embodiments of the present disclosure will be described hereinafter with reference to the accompanying drawings; however, it should be understood that the claimed embodiments are merely examples of the present disclosure, which may be implemented in a variety of ways. Well-known and / or repetitive functions and structures are not described in detail to avoid obscuring the present disclosure with unnecessary or redundant detail. Therefore, the specific structural and functional details claimed herein are not intended to be limiting, but rather serve merely as a basis and representative basis for teaching those skilled in the art to variously employ the present disclosure with substantially any suitable detailed structure.

[0058] Figure 1 A flowchart of a processing method according to an embodiment of the present disclosure is shown. Figure 1 As shown, an embodiment of the present disclosure provides a processing method, which is applied to an electronic device including a first display screen 10, and the method includes:

[0059] S101: Determine whether the second display screen 20 is connected to the electronic device.

[0060] Among them, the electronic device can be a desktop computer (PC), a laptop computer, a tablet computer, etc. with a first display screen 10, and the second display screen 20 can be an independent display. After the second display screen 20 is connected to the electronic device, the display of the second display screen 20 can be controlled by the electronic device. The user can determine one of the first display screen 10 and the second display screen 20 as the main screen and the other as the extended screen (auxiliary screen) as needed.

[0061] There is at least one second display screen 20. That is, in this embodiment, multiple second display screens 20 can be connected to the electronic device simultaneously. When one of the first display screen 10 and the multiple display screens is determined as the primary screen, the other display screens are designated as extended screens. In this embodiment, the processing method is specifically described using one second display screen 20 as an example.

[0062] S102 : Determine a home screen from the first display screen 10 and the second display screen 20 by using at least one component provided in the electronic device.

[0063] Specifically, radar ranging can be performed through the built-in radar of the electronic device to measure the distance between the first display screen 10 and the user to determine the main screen. If the distance between the first display screen 10 and the user is within a preset distance range, it is determined that the user is concentrating on using the first display screen 10 and the first display screen 10 is not the main screen; if the distance between the first display screen 10 and the user exceeds the preset distance range, it is determined that the user is not concentrating on using the first display screen 10 and the second display screen 20 is the main screen.

[0064] In a specific implementation, the home screen can also be determined by ultrasonic ranging or other methods such as at least one component provided in the electronic device, which is not specifically limited in this disclosure. While the above method automatically determines the home screen based on the distance between the user and the display screen, in other embodiments, the home screen can also be determined based on user selection, for example, by manually determining the home screen through user operation of an input device such as a mouse or keyboard of the electronic device.

[0065] S103: Based on the determined main screen, determine the relative relationship between the second display screen 20 and the first display screen 10 and / or the user.

[0066] After determining the primary screen from the first and second displays 10, 20, the relative positional relationship between the second display 20 and the first display 10 can be determined (e.g., whether the second display 20 is located to the left or right of the first display 10, or the distance between the second display 20 and the first display 10, etc.). This can be automatically determined without user intervention, and the distance between the two can also be adjusted to provide the user with a good visual experience (e.g., to facilitate simultaneous viewing of both displays). After determining the primary screen, the relative positional relationship between the second display 20 and the user, as well as the relative relationship such as the interaction status, can also be determined. For example, when the second display 20 is determined to be the primary screen, the distance between the second display 20 and the user can be used to determine whether the user is concentrating on using the second display 20. Alternatively, the user's use of the second display 20 can be monitored to customize the user's usage parameters for the second display 20 based on the user's usage habits. For example, after using the second display 20 for a certain period of time, the user can be prompted to take a break to avoid fatigue. Especially when the first display 10 is a laptop or tablet computer, the smaller screen size makes it difficult for the user to view the screen. The user may connect a larger monitor for easier viewing. The brightness of the second display 20 is typically brighter and may be glaring. Therefore, when the user selects the monitor as the primary screen, the optimal display brightness can be determined based on factors such as the distance between the user and the monitor. This ensures clear viewing while avoiding glare, thereby improving the user experience. Furthermore, after the second display 20 is designated as the primary screen, if the user does not use the second display 20 for an extended period, the user can control the electronic device to lock the second display 20 or put it into sleep mode, thereby preventing information leakage and saving power.

[0067] It is understandable that since the first display screen 10 is a screen built into the electronic device, the relative relationship between the first display screen 10 and the user can be directly obtained through components provided on the electronic device (e.g., radar), thereby enabling the first display screen 10 to be locked, etc. In other words, the present disclosure primarily considers the relative relationship between the unknown second display screen 20 connected to the electronic device and the first display screen 10 and / or the user, and the relevant parameters of the first display screen 10 are not specifically described in this disclosure.

[0068] The processing method provided by the embodiment of the present disclosure can determine the main screen from the second display screen 20 and the first display screen 10 of the electronic device through at least one component provided in the electronic device after determining that the second display screen 20 is connected to the electronic device, and based on the determined main screen, determine the relative relationship between the second display screen 20 and the first display screen 10 and / or the user. The display screens (including the first display screen 10 and the second display screen 20) can be automatically configured for the user, and the user's usage status of the second display screen 20 can be monitored in real time to provide the user with better usage configuration parameters (including the above-mentioned periodic reminders or lock screens, etc.), thereby improving the user experience.

[0069] In some embodiments, as Figure 2 and Figure 6 As shown, the first display screen 10 is provided with a first transmitting component 1 and a first receiving component 2, and the second display screen 20 is provided with a second transmitting component 3 and a second receiving component 4. In step S102, determining the main screen from the first display screen 10 and the second display screen 20 by at least one component provided in the electronic device includes:

[0070] S201: transmitting a first transmission signal to a user through the first transmission component 1, and transmitting a second transmission signal to the user through the second transmission component 3;

[0071] S202: Obtaining, through the first receiving component 2, a first return signal returned to the first display screen 10 based on the first transmitted signal, and obtaining, through the second receiving component 4, a second return signal returned to the second display screen 20 based on the second transmitted signal;

[0072] S203: Obtain a first time difference Δt1 between the first transmitted signal and the first returned signal, and a second time difference Δt2 between the second transmitted signal and the second returned signal;

[0073] S204: Determine the main screen based on the first return signal, the second return signal, the first time difference, and the second time difference.

[0074] The first transmitting component 1 and the second transmitting component 3 are speakers, and the first receiving component 2 and the second receiving component 4 are microphones. The first transmitting signal is an ultrasonic signal emitted by the first transmitting component 1 located on the first display screen 10, and the second transmitting signal is an ultrasonic signal emitted by the second transmitting component 3 located on the second display screen 20. When the ultrasonic signal encounters an obstacle (in this embodiment, a user between the first display screen 10 and the second display screen 20), it generates a return signal that is captured by the receiving component. The first receiving component 2 receives the first return signal returned by the first transmitting signal, and the second receiving component 4 receives the second return signal returned by the second transmitting signal. After receiving the first and second return signals, the first and second receiving components 2 and 4, respectively, can send the return signals to the processor of the electronic device. When the first transmitting component 1 and the second transmitting component 3 transmit the ultrasonic signals, the processor synchronously measures the time difference Δt1 between the transmission of the first transmitting signal and the reception of the first return signal, and the second time difference Δt2 between the transmission of the second transmitting signal and the reception of the second return signal. The processor then determines the primary screen from the first display screen 10 and the second display screen 20 based on the first and second return signals, the first and second time differences Δt1, and Δt2. Since the first transmission signal and the second transmission signal are transmitted simultaneously, in this embodiment, by obtaining the first time difference Δt1 and the second time difference Δt2, it can be ensured that the first return signal and the second return signal are returned based on the first transmission signal and the second transmission signal transmitted simultaneously, thereby ensuring the accuracy of the main screen determination.

[0075] It should be noted that if the user is sitting in front of the first display screen 10 or the second display screen 20, the return signal can be received by the receiving component. If the receiving component does not receive the return signal, it can be determined that the user is probably not in the designated location and the signal can be retransmitted until both the first receiving component 2 and the second receiving component 4 can receive the return signal and the first time difference Δt1 and the second time difference Δt2 meet the preset conditions.

[0076] In some embodiments, in step S204, determining the home screen based on the first return signal, the second return signal, the first time difference, and the second time difference includes:

[0077] S2041: If the signal strength of the first return signal is greater than the signal strength of the second return signal, and the first time difference Δt1 is close to the second time difference Δt2, then determine that the first display screen 10 is the main screen;

[0078] S2042: If the signal strength of the first return signal is less than the signal strength of the second return signal, and the first time difference Δt1 is close to the second time difference Δt2, then determine that the second display screen is the main screen.

[0079] The processor of the electronic device compares the signal strengths of the first return signal and the second return signal, and determines the primary screen based on the comparison result. If the signal strength of the first return signal is greater than the signal strength of the second return signal, it can be determined that the user is relatively close to the first display screen 10 (facing the first display screen 10), and the first display screen 10 can be determined as the primary screen. If the signal strength of the first return signal is less than the signal strength of the second return signal, it can be determined that the user is relatively close to the second display screen 20, and the second display screen 20 can be determined as the primary screen.

[0080] At the same time, in step S2041 and step S2042, the signal strengths of the two return signals are compared when the first time difference Δt1 is close to the second time difference Δt2. It can be ensured that the first return signal and the second return signal are returned based on the first transmission signal and the second transmission signal transmitted simultaneously. The first time difference Δt1 and the second time difference Δt2 are close, and the difference between the two can be less than a preset time (for example, 1s). If the first time difference Δt1 and the second time difference Δt2 are not close, the signal is retransmitted by the first transmitting component 1 and the second transmitting component 3 until the first time difference Δt1 and the second time difference Δt2 are close, and then the signal strengths of the return signals are compared.

[0081] In this embodiment, the ultrasonic reflection characteristics and the ranging principle are combined, and the cooperation of the speakers and microphones set on the two display screens can be used to send and receive ultrasonic signals, so that the main screen is automatically determined according to the relative position of the identified user and the display screen. There is no need for the user to manually configure the main screen, the operation is convenient, and it can be achieved through the speakers and microphones set on the display screens, without the need to add special sensors, and the cost is low.

[0082] In a specific implementation, the transmitting component and the receiving component can be the same component, and the transmitted and received signals can be infrared signals or other signals, which is not specifically limited in this disclosure.

[0083] In some embodiments, as Figure 3 and Figure 7 As shown, if the first display screen 10 is the main screen, in step S103, based on the determined main screen, the relative relationship between the second display screen 20 and the first display screen 10 is determined, including:

[0084] S301: transmitting a third transmission signal and a fourth transmission signal to the user respectively through the two second transmission components 3 provided on the second display screen 20;

[0085] S302: Obtain a third return signal returned to the first receiving component 2 of the first display screen 10 based on the third transmission signal, and a fourth return signal returned to the first receiving component 2 based on the fourth transmission signal;

[0086] S303: If the signal strength of the third return signal is greater than the signal strength of the fourth return signal, the second display screen 20 is located on the right side of the first display screen 10; if the signal strength of the third return signal is less than the signal strength of the fourth return signal, the second display screen 20 is located on the left side of the first display screen 10.

[0087] Specifically, if Figure 7 As shown, the first receiving component 2 is installed in the middle of the first display screen 10, and a first transmitting component 1 is provided on the left and right sides of the first receiving component 2 respectively; the second receiving component 4 is installed in the middle of the second display screen 20, and a second transmitting component 3 (respectively a second sub-transmitting component 31 and a second sub-transmitting component 32) is provided on the left and right sides of the second receiving component 4 respectively. After determining that the first display screen 10 is the main screen, the third transmitting signal and the fourth transmitting signal can be simultaneously transmitted to the user by the two second transmitting components 3 set on the second display screen 20, and the third return signal and the fourth return signal generated based on the third transmitting signal and the fourth transmitting signal are returned to the first receiving component 2 through signal reflection. After receiving the above two return signals, the first receiving component 2 compares the signal strengths of the two, and then determines the distance between the two second transmitting components 3 and the first receiving component 2 according to the signal strength, thereby determining the relative position of the second display screen 20 and the first display screen 10. When the signal strength of the third return signal is greater than the signal strength of the fourth return signal, it can be determined that the second sub-transmitting component 31 is closer to the first receiving component 2, and the second display screen 20 is located on the right side of the first display screen 10; when the signal strength of the third return signal is less than the signal strength of the fourth return signal, it can be determined that the second sub-transmitting component 32 is closer to the first receiving component 2, and the second display screen 20 is located on the left side of the first display screen 10.

[0088] That is, steps S301 to S303 also determine the relative position relationship between the second display screen 20 and the first display screen 10 by ultrasonic ranging, and the transmitting component and the receiving component are respectively arranged on the second display screen 20 and the first display screen 10.

[0089] In some embodiments, based on step S303, if the signal strength of the third return signal is close to the signal strength of the fourth return signal, the method further includes:

[0090] S3031: Obtain a third time difference Δt3 between the third transmit signal and the third return signal, and obtain a fourth time difference Δt4 between the fourth transmit signal and the fourth return signal;

[0091] S3032: Compare the third time difference Δt3 and the fourth time difference Δt3;

[0092] S3033: If the third time difference Δt3 is greater than the fourth time difference Δt3, the second display screen 20 is located on the left side of the first display screen 10; if the third time difference Δt3 is less than the fourth time difference Δt3, the second display screen 20 is located on the right side of the first display screen 10.

[0093] Specifically, a third time difference Δt3 between the third transmitted signal and the third return signal is the time interval from transmitting the third transmitted signal to receiving the third return signal, and a fourth time difference Δt4 between the fourth transmitted signal and the fourth return signal is the time interval from transmitting the fourth transmitted signal to receiving the fourth return signal. If the third time difference Δt3 is greater than the fourth time difference Δt4, the second sub-transmitting component 31 is farther from the first receiving component 2, and the second display screen 20 is located to the left of the first display screen 10. If the third time difference Δt3 is less than the fourth time difference Δt4, the second sub-transmitting component 31 is closer to the first receiving component 2, and the second display screen 20 is located to the right of the first display screen 10. If the third time difference Δt3 is close to the fourth time difference Δt4, the second sub-transmitting component 31 and the second sub-transmitting component 32 retransmit signals for comparison.

[0094] Similarly, if it is determined that the second display screen 20 is the main screen, the fifth transmission signal and the sixth transmission signal can be respectively transmitted to the user through the two first transmitting components 1 (the first sub-transmitting component 11 and the first sub-transmitting component 12) of the first display screen 10; the second receiving component 4 of the second display screen 20 receives the fifth return signal returned to the second receiving component 4 based on the fifth transmission signal, and the sixth return signal returned to the second receiving component 4 based on the sixth transmission signal, and sends the above-mentioned fifth return signal and sixth return signal to the processor of the electronic device. The processor of the electronic device compares the signal strengths of the fifth return signal and the sixth return signal. If the signal strength of the fifth return signal is greater than the signal strength of the sixth return signal, the first sub-transmitting component 11 is close to the second receiving component 4, and the first display screen 10 is located on the right side of the second display screen 20; if the signal strength of the fifth return signal is less than the signal strength of the sixth return signal, the first sub-transmitting component 12 is close to the second receiving component 4, and the first display screen 10 is located on the left side of the second display screen 20.

[0095] If the signal strength of the fifth return signal is close to the signal strength of the sixth return signal, the relative position relationship between the first display screen 10 and the second display screen 20 can be further determined by comparing the fifth time difference Δt5 between the fifth transmitted signal and the fifth return signal, and the sixth time difference Δt6 between the sixth transmitted signal and the sixth return signal. The specific determination method refers to the above steps S3031-S3033, which will not be repeated in this disclosure.

[0096] In this embodiment, through steps S301-S303, after the main screen is determined, the speaker and microphone can be further used to perform distance measurement to determine the relative position relationship between the first display screen 10 and the second display screen 20, so as to facilitate the user to perform corresponding operations later. For example, after determining that the first display screen 10 is the main screen, it is determined that the second display screen 20 as the extended screen is on the left side of the first display screen 10. When the user mainly uses the first display screen 10 to operate, when he needs to observe the extended screen, he can look directly to the left, or he can adjust the position of the second display screen 20 so that the user can view both displays at the same time.

[0097] In this embodiment, two emission components can be configured on each display screen. Figure 6As shown, when executing steps S201 to S203, a first transmission signal can be transmitted to the user through the two first transmission components 1, and a second transmission signal can be transmitted to the user through the two second transmission components 3; two first return signals based on the first transmission signal returned to the first display screen 10 are obtained through the first receiving component 2, and two second return signals based on the second transmission signal returned to the second display screen 20 are obtained through the second receiving component 4; and a first time difference Δt1 between each first transmission signal and the first return signal is obtained, and a second time difference Δt2 between each second transmission signal and the second return signal is obtained. If the signal strengths of the two first return signals and the signal strengths of the two second return signals meet a preset threshold (for example, the signal strengths of the two first return signals are close, and the signal strengths of the two second return signals are close), and the two first time differences Δt1 and the two second time differences Δt2 meet a preset time threshold (for example, the two first time differences Δt1 are close, and the two second time differences Δt2 are close), it is determined that the signals are stable and are return signals corresponding to the simultaneously transmitted first transmission signal and the second transmission signal, and then the main screen is determined by comparing the signal strengths of the first return signals and the second return signals. In the process of determining the main screen, the signal strength of the two first return signals needs to be greater than or less than the signal strength of the two second return signals at the same time in order to determine the main screen. If the signal strength of one of the two first return signals is greater than the signal strength of the corresponding second return signal, and the signal strength of the other is less than the signal strength of the corresponding second return signal, the first transmission signal is re-transmitted through the two first transmitting components 1 respectively, and the second transmission signal is re-transmitted through the two second transmitting components 3 respectively to re-perform signal detection. In this embodiment, the accuracy of main screen recognition can be guaranteed by the two first return signals and the two second return signals.

[0098] In some embodiments, as Figure 4 and Figure 8 As shown, if the second display screen 20 is the main screen and the user is in the first state, in step S103, based on the determined main screen, the relative relationship between the second display screen and the user is determined, including:

[0099] S401: Identifying an angle between the user's sight line and the first display screen 10 by a third component provided in the electronic device;

[0100] S402: Calculate the distance between the user and the second display screen 20 based on the angle.

[0101] The first state is the focused use state. After determining that the second display screen 20 is the main screen, it is determined whether the user is focused on using the second display screen 20 (whether the user is facing the second display screen 20). If so, the relative relationship between the second display screen 20 and the user is determined. When the user is in the focused use state, the line between the user's eyes and the center of the second display screen 20 ( Figure 8 The middle OD) is perpendicular to the screen surface of the second display screen 20.

[0102] The third component may be a camera provided in the electronic device, which can capture the user's line of sight in real time and identify the angle between the user's line of sight and the first display screen 10 ( Figure 8 ∠AOH and ∠COH in the figure), and then calculate the distance (OB) between the user and the second display screen 20 based on the above angles.

[0103] In some embodiments, in step S401, identifying the angle between the user's line of sight and the first display screen 10 by a third component provided in the electronic device includes:

[0104] S4011: Identify a first angle between the user's first sight line and the first display screen 10 , wherein the first sight line is a line connecting the user's eyes and a first edge of the second display screen 20 ;

[0105] S4012: Identify a second angle between the user's second sight line and the first display screen 10 , wherein the second sight line is a line connecting the user's eyes and a second edge of the second display screen 20 ;

[0106] S4013: Calculate a third angle between the first line of sight or the second line of sight and a third line of sight when the user is in the first state based on the first angle and the second angle, wherein the third line of sight is a line connecting the user's eyes and the center of the first display screen 10, and the first line of sight is symmetrical to the second line of sight.

[0107] Specifically, a first angle (∠AOH) formed by a first line of sight (OA) formed by a line connecting the user's eye (O) and the first edge of the second display screen 20 and a parallel line (OH) parallel to the first display screen 10 is α, and a second angle (∠COH) formed by a second line of sight (OC) formed by a line connecting the user's eye and the second edge of the second display screen 20 and a parallel line (OH) parallel to the first display screen 10 is β.

[0108] Since in the user's line of sight when observing the second display screen 20, the first line of sight (OA) between the user's eye and the first edge of the second display screen 20 and the second line of sight (OC) between the user's eye and the second edge of the second display screen 20 are symmetrical relative to the line (OB) connecting the user's eye and the center of the second display screen 20, the size of the third angle ∠BOC is Ψ=1 / 2×(β–α).

[0109] Since the length AC of the second display screen 20 is L, which can be calculated by multiplying the screen width by the corresponding ratio, OB perpendicularly bisects AC, and the length of OB can be calculated as S = 1 / 2 × L × cotΨ. Here, S is the distance between the user and the second display screen 20, which serves as the main screen.

[0110] In a specific implementation, multiple pairs of first angles and second angles can be acquired through multiple acquisitions by the third component. Then, when calculating the third angle, the average value of the multiple first angles and the average value of the multiple second angles are taken as inputs for calculation to improve the accuracy of the calculation.

[0111] In this embodiment, after determining that the second display screen 20 is the main screen, it is possible to determine whether the user is in the first state (identify whether the user is facing the second display screen 20) based on the user's input operation on the second display screen 20. Figure 8 As shown, when the user uses the second display screen 20 as the main screen, the first display screen 10 is placed on one side. Figure 9 As shown, an area can be defined in the center of the second display screen 20, for example, a rectangular area (first area 201) whose length and width each account for 20% of the length and width of the screen. If mouse clicks and / or keyboard input events are continuously detected in the center area over a long period of time (e.g., 2 minutes), it is considered that the user is intently looking at the second display screen 20 and facing the second display screen 20 (intentionally using the second display screen 20).

[0112] After detecting that the user is facing the second display screen 20, the device further captures mouse click events and keyboard input events within 10% of the area on each side of the second display screen 20 (the second area 202). A third component provided in the electronic device identifies the angle between the user's line of sight and the first display screen 10, thereby calculating the distance between the user and the second display screen 20. In a specific implementation, the device can also directly capture an image of the user viewing the second display screen 20 through a camera to determine whether the user is focused on the second display screen 20.

[0113] In this embodiment, after determining that the second display screen 20 is the main screen, the amplitude of the user's eye movement when viewing the screen can be identified by a third component provided in the electronic device, and then the distance between the user and the second display screen 20 can be measured, providing a reference for subsequent users to use the second display screen 20, thereby improving the user experience.

[0114] In some embodiments, as Figure 5 and Figure 10 As shown, if the second display screen 20 is the main screen, in step S103, based on the determined main screen, the relative relationship between the second display screen 20 and the user is determined, including:

[0115] S501: Identifying the first position coordinates of the user relative to the first display screen 10 by a fourth component provided in the electronic device;

[0116] S502: Calculating the second position coordinates of the user relative to the second display screen 20 based on the first position coordinates.

[0117] The fourth component is a radar installed within the electronic device, which can be used to directly measure the user's position relative to the first display screen 10. When the user is facing the first display screen 10, the first position coordinates can be used to determine whether the user is within the designated area. Since the second display screen 20 is associated with the first display screen 10 when it serves as the primary screen, this embodiment can use the radar-detected position of the user relative to the first display screen 10 to calculate the user's position relative to the second display screen 20, adding a virtual radar detection function to the second display screen 20, thereby achieving a similar radar detection effect as when the user is using the first display screen 10.

[0118] In some embodiments, the method further comprises:

[0119] S503: Determine an association relationship between the first position coordinates and the second position coordinates based on the first position coordinates of the user relative to the first display screen 10 when in the first state and the relative position relationship between the first display screen 10 and the second display screen 20.

[0120] Since the relative position relationship between the first display screen 10 and the second display screen 20 is determined, in this embodiment, the relative position of the first display screen 10 and the second display screen 20, as well as the position of the user relative to the first display screen 10 detected by the radar, can be used to determine the correlation relationship between the first position coordinates and the second position coordinates, and then calculate the position of the user relative to the second display screen 20.

[0121] In this embodiment, a polar coordinate system can be established with the radar (E) as the origin, with the user's first position coordinates represented by polar coordinates (r, θ), where r is the distance between the radar and the user, and θ is the angle between the line connecting the radar and the user and the first display screen 10. When the user is facing the first display screen 10, simply determining whether r and θ are within a set range allows the user to be identified as being within the designated area. Therefore, in this embodiment, by establishing a polar coordinate system with the midpoint of the second display screen 20 as the origin and using similar coordinates (R, ξ) to represent the user's second position coordinates, it is possible to determine whether the user is within the designated area in front of the screen. In this embodiment, by determining the correspondence between the second position coordinates (R, ξ) and the first position coordinates (r, θ), that is, solving the function R = f(r, θ), ξ = g(r, θ), the user's coordinates relative to the second display screen 20 can be calculated, thereby identifying the user's position in front of the second display screen 20.

[0122] like Figure 10 As shown, AC is the second display screen 20, DF is the first display screen 10, O is the position of the user when in the first state, B is the midpoint of AC (the center of the second display screen 20), E is the midpoint of DF (the center of the first display screen 10), and when the user is in the first state, OB perpendicularly bisects AC, and GH is a line parallel to DF and passes through point O.

[0123] In this embodiment, steps S401 and S402 can be used to calculate the distance between the user and the second display screen 20 (the side length L of OB) when the user is in the first state and facing the second display screen 20 (i.e., ∠OBC is a right angle). From steps S4011 to S4013, it can be seen that the angle of ∠AOH is α, the angle of ∠COH is β, OB is the angle bisector of ∠AOC, and the size of ∠BOH is δ = 1 / 2 × (α + β). Since GH and DF are parallel, the size of ∠HOE γ is equal to the size of ∠DEO. The size of ∠FEO θ′ and the side length r′ of OE can be obtained through the fourth component (radar), and γ = 180° - θ′. Therefore, the size of ∠EOB δ′ = δ - γ.

[0124] The length of the side of the line BE between the center of the first display screen 10 and the center of the second display screen 20 can be calculated by the triangle cosine theorem: S = (r' 2 +L 2 -2r′L×cosδ′)^1 / 2. Then use the law of cosines to find the size of ∠OEB a=arccos[(r′ 2 +S 2 -L 2 ) / (2r′S)] and the size of ∠OBE b=arccos[(L 2 +S 2 -r′ 2) / (2LS)]. Then the size of ∠DEB is c=γ-a, and the size of ∠ABE is d=90°-b.

[0125] After calculating the magnitudes of ∠ABE and ∠DEB, as well as the length of BE, the relative positional relationship between the two displays can be determined. This relative positional relationship can then be used to convert the user's first position coordinate relative to the first display 10, as acquired by the radar, into a second position coordinate relative to the second display 20. This means solving the functions R = f(r, θ) and ξ = g(r, θ).

[0126] like Figure 10 As shown, assuming the user moves to position O', the radar detects the side length r of O'E and the size θ of ∠O'EF. The size of ∠O'EB is a'=180°-θ-c, and the side length of O'B is R=f(r,θ)=(S 2 +r 2 -2rS×cosa′)^1 / 2=[S 2 +r 2 -2rS×cos(180°-θ-c)]^1 / 2. From this, we can calculate the size of ∠O′BE b′=arccos[(S 2 +R 2 -r 2 ) / (2SR)], then the size of ∠ABO′ξ=g(r,θ)=b′+d=arccos[(S 2 +R 2 -r 2 ) / (2SR)]+d=arccos[(S 2 +f(r,θ) 2 –r 2 ) / (2S×f(r,θ))]+d. In this way, the first position coordinates r and θ detected by the radar can be used to represent the second position coordinates R and ξ relative to the second display screen 20, and an association relationship between the first position coordinates and the second position coordinates can be established.

[0127] In some embodiments, the second position coordinates are polar coordinates, and the method further comprises:

[0128] S504: Calculate the distance between the user and the second display screen based on the second position coordinates.

[0129] By using the aforementioned correlation between the first and second position coordinates in polar coordinates, the polar coordinates of the second position are calculated, and the distance between the user and the second display screen 20 can be calculated. This distance is the distance regardless of whether the user is in focused use or not. In other words, in this embodiment, the distance between the user and the second display screen 20 in any state can be calculated based on the distance between the user and the second display screen 20 in a specific state, which has a wider range of applicability.

[0130] In this embodiment, the first position coordinates and the second position coordinates are both polar coordinates. In a specific implementation, the first position coordinates and the second position coordinates may also be position coordinates in a rectangular coordinate system or a spherical coordinate system.

[0131] The present disclosure also provides an electronic device, including a first display screen 10, and a determination module 30, wherein the determination module 30 is configured to:

[0132] Determining that the second display screen 20 is connected to the electronic device;

[0133] Determining a home screen from the first display screen 10 and the second display screen 20 by at least one component provided in the electronic device;

[0134] Based on the determined main screen, a relative relationship between the second display screen 20 and the first display screen 10 and / or the user is determined.

[0135] In some embodiments, the first display screen 10 is provided with a first transmitting component 1 and a first receiving component 2, and the second display screen 20 is provided with a second transmitting component 3 and a second receiving component 4. Determining a home screen from the first display screen 10 and the second display screen 20 by at least one component provided in the electronic device includes:

[0136] Transmitting a first transmission signal to the user through the first transmission component, and transmitting a second transmission signal to the user through the second transmission component;

[0137] obtaining, by the first receiving component, a first return signal returned to the first display screen based on the first transmitted signal, and obtaining, by the second receiving component, a second return signal returned to the second display screen based on the second transmitted signal;

[0138] Obtaining a first time difference between the first transmitted signal and the first returned signal, and a second time difference between the second transmitted signal and the second returned signal;

[0139] The home screen is determined based on the first return signal, the second return signal, the first time difference, and the second time difference.

[0140] In some embodiments, the determination module 30 is further configured to:

[0141] If the signal strength of the first return signal is greater than the signal strength of the second return signal, and the first time difference is close to the second time difference, determining that the first display screen is the main screen;

[0142] If the signal strength of the first return signal is less than the signal strength of the second return signal, and the first time difference is close to the second time difference, the second display screen is determined to be the main screen.

[0143] In some embodiments, if the first display screen is the main screen, the determination module 30 is further configured to:

[0144] respectively transmitting a third transmission signal and a fourth transmission signal to the user through the two second transmission components provided on the second display screen;

[0145] Obtaining a third return signal returned to the first receiving component of the first display screen based on the third transmission signal, and a fourth return signal returned to the first receiving component based on the fourth transmission signal;

[0146] If the signal strength of the third return signal is greater than the signal strength of the fourth return signal, the second display screen is located on the right side of the first display screen; if the signal strength of the third return signal is less than the signal strength of the fourth return signal, the second display screen is located on the left side of the first display screen.

[0147] In some embodiments, if the second display screen is the main screen and the user is in the first state, the determination module 30 is further configured to:

[0148] identifying an angle between the user's sight line and the first display screen by a third component provided in the electronic device;

[0149] The distance between the user and the second display screen is calculated based on the angle.

[0150] In some embodiments, identifying the angle between the user's line of sight and the first display screen by a third component provided in the electronic device includes:

[0151] Identifying a first angle between a first sight line of the user and the first display screen, wherein the first sight line is a line connecting an eye of the user and a first edge of the second display screen;

[0152] identifying a second angle between a second line of sight of the user and the first display screen, wherein the first line of sight is a line connecting an eye of the user and a second edge of the second display screen;

[0153] A third angle between the first line of sight or the second line of sight and a third line of sight when the user is in a first state is calculated based on the first angle and the second angle, wherein the third line of sight is a line connecting the user's eyes and the center of the first display screen, and the first line of sight is symmetrical to the second line of sight.

[0154] In some embodiments, if the second display screen is the main screen, the determination module 30 is further configured to:

[0155] identifying, by a fourth component provided in the electronic device, first position coordinates of the user relative to the first display screen;

[0156] The second position coordinates of the user relative to the second display screen are calculated based on the first position coordinates.

[0157] In some embodiments, the determination module 30 is further configured to:

[0158] Based on the first position coordinates of the user relative to the first display screen when in the first state and the relative position relationship between the first display screen and the second display screen, an association relationship between the first position coordinates and the second position coordinates is determined.

[0159] In some embodiments, the second position coordinates are polar coordinates, and the electronic device further includes a calculation module 40 for:

[0160] The distance between the user and the second display screen is calculated based on the second position coordinates.

[0161] The electronic device provided in the embodiments of the present disclosure corresponds to the processing method in the above-mentioned embodiments. Based on the above-mentioned processing method, those skilled in the art can understand the specific implementation methods of the electronic device in the embodiments of the present disclosure and its various variations. Any optional items in the processing method embodiments are also applicable to the electronic device and will not be repeated here.

[0162] An embodiment of the present disclosure further provides an electronic device, comprising a processor and a memory for storing instructions executable by the processor, wherein the processor implements the steps of the above-mentioned processing method when executing the executable instructions stored in the memory.

[0163] The above-mentioned processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, and discrete hardware components.

[0164] The memory may include random access memory (RAM) or non-volatile memory, such as at least one disk drive. The memory is preferably non-volatile memory to store the distance calculation formula between the user and the second display screen 20, the association between the first position coordinates and the second position coordinates, and the like.

[0165] Those skilled in the art will appreciate that embodiments of the present disclosure may be provided as methods, electronic devices, computer-readable storage media, or computer program products. Thus, the present disclosure may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Furthermore, the present disclosure may take the form of a computer program product implemented on one or more computer-usable storage media containing computer-usable program code.

[0166] When implemented in software, the functions may be stored on or transmitted over as one or more instructions or codes on a computer-readable medium.

[0167] The embodiment of the present disclosure further provides a computer-readable storage medium having computer-executable instructions stored thereon. When the computer-executable instructions are executed by a processor, the above-mentioned processing method is implemented.

[0168] The above embodiments are merely exemplary embodiments of the present disclosure and are not intended to limit the present disclosure. The scope of protection of the present disclosure is defined by the claims. Those skilled in the art may make various modifications or equivalent substitutions to the present disclosure within the essence and scope of protection of the present disclosure, and such modifications or equivalent substitutions shall also be deemed to fall within the scope of protection of the present disclosure.

Claims

1. A processing method comprising: determining that a second display screen is connected to the electronic device; Determining a home screen from a first display screen and a second display screen of the electronic device by at least one component provided in the electronic device; Based on the determined main screen, determining a relative relationship between the second display screen and the first display screen and / or the user; Wherein, if the second display screen is the main screen and the user is in a first state, the user being in the first state means that the user is facing the second display screen, and based on the determined main screen, determining the relative relationship between the second display screen and the user includes: identifying an angle between the user's sight line and the first display screen by a third component provided in the electronic device; calculating a distance between the user and the second display screen based on the angle; The method of identifying the angle between the user's sight line and the first display screen by a third component provided in the electronic device includes: Identifying a first angle between a first sight line of the user and the first display screen, wherein the first sight line is a line connecting an eye of the user and a first edge of the second display screen; Identifying a second angle between a second sight line of the user and the first display screen, wherein the second sight line is a line connecting an eye of the user and a second edge of the second display screen; A third angle between the first line of sight or the second line of sight and a third line of sight when the user is in the first state is calculated based on the first angle and the second angle, wherein the third line of sight is a line connecting the user's eyes and the center of the first display screen, and the first line of sight is symmetrical to the second line of sight.

2. The method according to claim 1, wherein The first display screen is provided with a first transmitting component and a first receiving component, the second display screen is provided with a second transmitting component and a second receiving component, and determining a home screen from the first display screen and the second display screen by at least one component provided in the electronic device includes: Transmitting a first transmission signal to the user through the first transmission component, and transmitting a second transmission signal to the user through the second transmission component; obtaining, by the first receiving component, a first return signal returned to the first display screen based on the first transmitted signal, and obtaining, by the second receiving component, a second return signal returned to the second display screen based on the second transmitted signal; Obtaining a first time difference between the first transmitted signal and the first returned signal, and a second time difference between the second transmitted signal and the second returned signal; The home screen is determined based on the first return signal, the second return signal, the first time difference, and the second time difference.

3. The method according to claim 2, wherein: Determining the home screen based on the first return signal, the second return signal, the first time difference, and the second time difference includes: If the signal strength of the first return signal is greater than the signal strength of the second return signal, and the first time difference is close to the second time difference, determining that the first display screen is the main screen; If the signal strength of the first return signal is less than the signal strength of the second return signal, and the first time difference is close to the second time difference, the second display screen is determined to be the main screen.

4. The method according to claim 2, wherein: If the first display screen is the main screen, determining a relative relationship between the second display screen and the first display screen based on the determined main screen includes: The second transmitting components provided on the second display screen transmit a third transmitting signal and a fourth transmitting signal to the user respectively; wherein the second transmitting component corresponding to the third transmitting signal is provided on the left side of the second transmitting component corresponding to the fourth transmitting signal; Obtaining a third return signal returned to the first receiving component of the first display screen based on the third transmission signal, and a fourth return signal returned to the first receiving component based on the fourth transmission signal; If the signal strength of the third return signal is greater than the signal strength of the fourth return signal, the second display screen is located on the right side of the first display screen; if the signal strength of the third return signal is less than the signal strength of the fourth return signal, the second display screen is located on the left side of the first display screen.

5. The method according to claim 1, wherein If the second display screen is the main screen, determining a relative relationship between the second display screen and the user based on the determined main screen includes: identifying, by a fourth component provided in the electronic device, first position coordinates of the user relative to the first display screen; The second position coordinates of the user relative to the second display screen are calculated based on the first position coordinates.

6. The method according to claim 5, wherein: The method further comprises: Based on the first position coordinates of the user relative to the first display screen when in the first state and the relative position relationship between the first display screen and the second display screen, an association relationship between the first position coordinates and the second position coordinates is determined.

7. The method according to claim 6, wherein: The second position coordinates are polar coordinates, and the method further includes: The distance between the user and the second display screen is calculated based on the second position coordinates.

8. An electronic device comprising a first display screen, the electronic device further comprising a determination module, the determination module being configured to: determining that a second display screen is connected to the electronic device; Determining a home screen from the first display screen and the second display screen by at least one component provided in the electronic device; Based on the determined main screen, determining a relative relationship between the second display screen and the first display screen and / or the user; in, If the second display screen is the main screen and the user is in a first state, the first state means that the user is facing the second display screen. Based on the determined main screen, the relative relationship between the second display screen and the user is determined, wherein the first state is a focused use state, including: identifying an angle between the user's sight line and the first display screen by a third component provided in the electronic device; calculating a distance between the user and the second display screen based on the angle; The method of identifying the angle between the user's sight line and the first display screen by a third component provided in the electronic device includes: Identifying a first angle between a first sight line of the user and the first display screen, wherein the first sight line is a line connecting an eye of the user and a first edge of the second display screen; Identifying a second angle between a second sight line of the user and the first display screen, wherein the second sight line is a line connecting an eye of the user and a second edge of the second display screen; A third angle between the first line of sight or the second line of sight and a third line of sight when the user is in the first state is calculated based on the first angle and the second angle, wherein the third line of sight is a line connecting the user's eyes and the center of the first display screen, and the first line of sight is symmetrical to the second line of sight.

Images