Screen projection method and electronic device

By determining and processing the focus area of ​​user attention in the screen projection device, generating and projecting screen projection data, the problem of inability to capture key content in the prior art is solved, and the effect and user experience of screen projection sharing are improved.

CN112256224BActive Publication Date: 2024-11-08SHENZHEN IQOO COMM SOFTWARE
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202011134960.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-10-21
Publication Date
2024-11-08
Estimated Expiration
2040-10-21

AI Technical Summary

Technical Problem

The existing screen projection technology cannot capture the key content that the screen projection sharing party wants to emphasize for the current screen projection screen, resulting in poor screen projection sharing effect and user experience.

Method used

By determining the focus area of ​​the user's attention in the first electronic device and performing differentiation processing on the area, screen projection data is generated and projected to the second electronic device so that the key content can be captured and displayed differently in real time.

Benefits of technology

It improves the effect of screen projection sharing, enables users to quickly grasp key content, improves user experience, and improves the efficiency of screen projection data processing.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112256224B_ABST
    Figure CN112256224B_ABST
Patent Text Reader

Abstract

The present application discloses a screen projection method and electronic device, which belongs to the field of image processing technology. The screen projection method includes determining a first focus area of ​​the display content of a first electronic device that a first user is concerned about; performing a first process on the first focus area, and / or performing a second process on the first non-focus area to generate projection data; wherein the first non-focus area is other areas in the display content except the first focus area; and projecting the projection data to at least one second electronic device to display content corresponding to the projection data on the second electronic device. The screen projection method and electronic device provided by the present application at least solve the problem that it is difficult to capture the key content of the current projection screen in the existing projection process, resulting in poor projection sharing effect and user experience.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application belongs to the field of image processing technology, and specifically relates to a screen projection method and electronic device. Background Art

[0002] As screen projection technology is increasingly used in various industries, continuously improving the screen projection experience has become the goal pursued by many screen projection technology developers. In a broad sense, screen projection refers to projecting the content on one device to one or more other terminal devices or media for display.

[0003] In the prior art, the screen projection method used is only to directly display the display content on one device on other devices. In the process of implementing this application, the inventor found that there are at least the following problems in the prior art: the screen projection receiver cannot capture the key content that the screen projection sharing party wants to emphasize on the current screen projection in real time, resulting in poor screen projection sharing effect and user experience. Summary of the invention

[0004] The purpose of the embodiments of the present application is to provide a screen projection method and an electronic device, which can solve the problem that it is difficult to capture the key content of the current projection screen during the projection process, resulting in poor screen projection sharing effect and user experience.

[0005] In order to solve the above technical problems, this application is implemented as follows:

[0006] In a first aspect, an embodiment of the present application provides a screen projection method, the method comprising:

[0007] Determine a first focus area of ​​display content of the first electronic device that is focused on by the first user;

[0008] Performing a first process on the first focus area, and / or performing a second process on the first non-focus area, to generate screen projection data; wherein the first non-focus area is other areas of the display content except the first focus area;

[0009] The projection data is projected to at least one second electronic device so that content corresponding to the projection data is displayed on the second electronic device.

[0010] In a second aspect, an embodiment of the present application provides a screen projection method, the method comprising:

[0011] Receiving screen projection data projected by a first electronic device; wherein the screen projection data is display data generated by performing a first processing on a first focus area and / or performing a second processing on a first non-focus area, the first focus area is a first focus area focused on by a first user in display content of the first electronic device, and the first non-focus area is other areas of the display content except the first focus area;

[0012] Content corresponding to the projection data is displayed on the second electronic device.

[0013] In a third aspect, an embodiment of the present application provides a screen projection device, the device comprising:

[0014] An area determination module, configured to determine a first focus area of ​​the display content of the first electronic device, which is focused on by the first user;

[0015] a data generating module, configured to perform a first processing on the first focus area, and / or perform a second processing on the first non-focus area, to generate screen projection data; wherein the first non-focus area is an area other than the first focus area in the display content;

[0016] A data projection module is used to project the projection data to at least one second electronic device so as to display content corresponding to the projection data on the second electronic device.

[0017] In a fourth aspect, an embodiment of the present application provides a screen projection device, the device comprising:

[0018] a data receiving module, configured to receive screen projection data projected by a first electronic device; wherein the screen projection data is display data generated by performing a first processing on a first focus area and / or performing a second processing on a first non-focus area, wherein the first focus area is a first focus area focused on by a first user in display content of the first electronic device, and the first non-focus area is other areas of the display content except the first focus area;

[0019] The screen projection display module is used to display the content corresponding to the screen projection data on the second electronic device.

[0020] In a fifth aspect, an embodiment of the present application provides an electronic device, which includes a processor, a memory, and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the steps of the method described in either the first aspect or the second aspect.

[0021] In a sixth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the method described in any one of the first aspect or the second aspect are implemented.

[0022] In a seventh aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect.

[0023] In an embodiment of the present application, a first focus area of ​​interest to a first user is determined in the display content of a first electronic device to obtain key content in the currently displayed content, and then the first focus area and / or the first non-focus area are differentiated to mark the key content in the currently displayed content. After the differentiated projection data is projected to at least one second electronic device, the second electronic device displays the projection data, so that the second electronic device can capture and differentiate the key content in real time based on the projection data, thereby enabling the user of the second electronic device to quickly grasp the key points of the currently projected display content and improve the sharing effect of the projection. At the same time, the display format of the projection content with highlighted key points also improves the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 is an architectural diagram showing a screen projection process according to an exemplary embodiment;

[0025] Figure 2 is a flow chart of a screen projection method according to an exemplary embodiment;

[0026] Figure 3a is a schematic diagram of an original screen projection display interface according to an exemplary embodiment;

[0027] Figure 3b is a schematic diagram of a screen projection display interface in a single focus tracking mode according to an exemplary embodiment;

[0028] Figure 3c is a schematic diagram of a screen projection display interface in a multi-focus tracking mode according to an exemplary embodiment;

[0029] Figure 4 is a flow chart of another screen projection method according to an exemplary embodiment;

[0030] Figure 5 is a structural block diagram of a screen projection device according to an exemplary embodiment;

[0031] Figure 6is a structural block diagram of another screen projection device according to an exemplary embodiment;

[0032] Figure 7 is a structural block diagram of an electronic device according to an exemplary embodiment;

[0033] Figure 8 A schematic diagram of the hardware structure of an electronic device for implementing an embodiment of the present application;

[0034] Fig. 9 A schematic diagram of the hardware structure of another electronic device to implement an embodiment of the present application. DETAILED DESCRIPTION

[0035] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0036] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0037] The screen projection method and electronic device provided in the embodiments of the present application are described in detail below through specific embodiments and their application scenarios in combination with the accompanying drawings.

[0038] Figure 1 is an architectural diagram of a screen projection process according to an exemplary embodiment. The screen projection method provided in the embodiment of the present application can be applied to Figure 1 In the architecture shown, the specific Figure 1 Provide detailed explanation.

[0039] like Figure 1As shown, the architecture diagram may include a first electronic device 10 and at least one second electronic device 11. The first electronic device 10 as the screen sharing end and the second electronic device 11 as the screen receiving end may be connected through a network. Of course, multiple second electronic devices 11 may also be connected through a network, which is not limited here. Among them, the first electronic device 10 may specifically be a device with communication functions such as a mobile phone, a tablet computer, an all-in-one machine, or a device simulated by a virtual machine or a simulator. The second electronic device 11 may specifically be a device with only display functions such as a projector and a display, or it may be a smart display device such as a mobile phone, a tablet computer, an all-in-one machine, etc.

[0040] Based on the above architecture, a first user using the first electronic device 10, such as a screen caster, can project the display content on the first electronic device 10 to one or more second electronic devices 11 by accessing an application on the first electronic device 10, or by accessing a specific website through the electronic device 10. A second user using the second electronic device 11, such as a screen cast receiver, can view the display content projected by the first electronic device 10 by accessing a corresponding application on the second electronic device 11, or a specific website.

[0041] Since in most cases, the screen caster will explain the displayed content during the screen casting process, in order for the screen cast recipient to quickly grasp the key points of the screen caster's explanation of the current screen cast display content, the original display content of the screen cast can be processed in the following way. First, the first electronic device 10 determines the first focus area of ​​the current display content that the screen caster focuses on based on the collected data of the screen caster's current focus status, and then processes the data of other areas other than the first focus area and / or the first non-focus area to generate screen casting data. Then, the first electronic device 10 projects the screen casting data to at least one second electronic device 11 that is communicatively connected. After receiving the screen casting data, the second electronic device 11 can display it according to the screen casting data to achieve the effect of highlighting the first focus area in the display content.

[0042] Furthermore, in order to enable the screen projection sharer to promptly obtain the focus of the screen projection receiver and dynamically receive feedback on the screen projection effect to adjust the explanation content, the second electronic device 11 can also determine the second focus area of ​​the screen projection receiver's focus in the content currently displayed on the screen based on the collected data on the screen projection receiver's current focus status, and send the information corresponding to the second focus area to the first electronic device 10, so that the first electronic device 10 highlights the second focus area in the displayed content based on the focus information.

[0043] In this way, on the one hand, the screen casting recipient can grasp the key points of the screen casting sharer's sharing content through the highlighted first focus area, thereby improving the effect of screen casting and enhancing the user experience. On the other hand, the screen casting sharer can grasp the key points of the screen casting recipient's attention when watching the screen casting display content through the highlighted second focus area, thereby timely adjusting the explanation focus according to the content that the screen casting recipient pays attention to, further improving the effect of screen casting.

[0044] In addition, in order to enable the screen projection recipient to obtain the focus of other screen projection recipients in a timely manner, in the screen projection display content of the second electronic device 11, in addition to highlighting the first focus area that the screen projection sharer is focusing on, it can also receive focus information sent by other second electronic devices to highlight the focus areas that other screen projection recipients are focusing on based on the focus information, thereby making it convenient for the screen projection recipient to grasp the viewing situation of other screen projection recipients at any time, thereby improving user interactivity.

[0045] According to the above architecture, the following Figure 2-Figure 4 The screen projection method provided in the embodiment of the present application is described in detail.

[0046] Figure 2 The screen projection method provided in the embodiment of the present application may be executed by a screen projection device or a control module in the screen projection device for executing the screen projection method, and the screen projection device may be configured as follows: Figure 1 In the first electronic device 10 shown.

[0047] like Figure 2 As shown, the screen projection method may specifically include the following steps:

[0048] First, in step 210, a first focus area focused on by a first user in display content of a first electronic device is determined.

[0049] Next, in step 220, a first process is performed on the first focus area, and / or a second process is performed on the first non-focus area to generate screen projection data; wherein the first non-focus area is an area other than the first focus area in the display content.

[0050] Then, in step 230, the projection data is projected to at least one second electronic device so that content corresponding to the projection data is displayed on the second electronic device.

[0051] Therefore, by determining the first focus area that the first user is concerned about in the display content of the first electronic device, the key content in the currently displayed content is obtained, and then the first focus area and / or the first non-focus area are differentiated to achieve marking of the key content in the currently displayed content. After the differentiated projection data is projected to at least one second electronic device, the second electronic device displays the projection data, so that the second electronic device can realize real-time capture and differentiated display of the key content based on the projection data, so that the user of the second electronic device can quickly grasp the key points of the current projection display content and improve the sharing effect of the projection. At the same time, the display form of the projection content with highlighted key points also improves the user experience.

[0052] The above steps are described in detail below:

[0053] First, step 210 is involved. In the embodiment of the present application, the first focus area may be one or more areas. Methods for determining the first focus area include, but are not limited to, human eye focus capture methods, voice focus capture methods, and operation focus capture methods. In different application scenarios, the above-mentioned different methods may be used to determine the first focus area of ​​concern to the first user. In order to capture the focus of the first user, that is, the screen caster, on the screen display content of the first electronic device, it is first necessary to determine the content that the first user is concerned about, and the regional position in the current screen display content, that is, the first focus area. Among them, the display content can be the display interface of the entire screen, it can also be the display interface of a specific application, or it can be a portion of the display interface selected by the first user to display, which is not limited here.

[0054] Specifically, step 210 may include:

[0055] Determine the first user's eye focus; and determine a first focus area of ​​the display content of the first electronic device that the first user pays attention to based on the eye focus.

[0056] Among them, when determining the focus of human eye, the eye area of ​​the first user can be firstly identified by face recognition or other methods, and then the infrared data of the human eye can be extracted by infrared probe, front camera, etc., and the data of the first user's retina, screen imaging, etc. can be analyzed by iris recognition or other methods, and then the position of the focus of human eye on the screen can be extracted from the analyzed data. Secondly, after determining the focus of human eye of the first user, according to the position information of the focus of human eye, the area where the focus of human eye is located can be delineated in the display content of the first electronic device according to the preset range as the first focus area.

[0057] Since the content that the human eye is gazing at is often the content that the user is currently paying attention to, as long as the position of the first user's gaze focus is detected in real time, the position of the first focus area can be changed in real time following the position of the first user's gaze focus, thereby tracking the key content that the first user is paying attention to.

[0058] In addition, in different application scenarios, different methods may be used to capture the first focus area. In one embodiment, determining the first focus area of ​​the first user's attention in the display content of the first electronic device according to the focus of human eyes may specifically include:

[0059] Acquire voice information and / or operation information of the first user; determine a first focus area of ​​the first user's attention in the display content of the first electronic device according to the voice information and / or operation information and the focus of human eyes.

[0060] For example, in the application scenario of game live broadcast, the screen projection receiver, that is, the audience, often pays more attention to the operation process of the screen projection sharer, that is, the game anchor. Therefore, the operation focus capture method can be used as an auxiliary method of the human eye focus capture method to capture the focus content. Specifically, the operation focus capture method can be to collect the operation information of the first user, obtain the corresponding operation position in the displayed content, and define the area where the operation position is located according to the preset range as the first focus area.

[0061] In another application scenario, such as online education, the screen projection recipient, that is, the student, often pays more attention to the voice content of the screen projection sharer, that is, the teacher. Therefore, the voice focus capture method can be used as an auxiliary method of the human eye focus capture method to capture the focus content. Specifically, the voice focus capture method can be to collect the voice information of the first user, use voice recognition technology, match the current screen content, and then determine the content position related to the voice in the displayed content, and define the area where the content position is located according to the preset range as the first focus area.

[0062] Of course, the above are only practical examples given in conjunction with actual application scenarios. In addition to using the combination of the above-mentioned focus capture methods, the three methods of human eye focus capture method, voice focus capture method and operation focus capture method can also be used simultaneously to jointly determine the first focus area.

[0063] In this way, by using the voice focus capture method and / or the operation focus capture method as a method to assist in determining the focus area, it can be better adapted to different application scenarios. Selecting different focus capture methods according to the actual application scenarios can improve the accuracy and reliability of focus capture.

[0064] Secondly, step 220 is involved. After determining the first focus area that the first user is paying attention to, in order to highlight the content in the first focus area in the final displayed projection content, it is necessary to perform data processing on the first focus area and / or the first non-focus area differently. Specific data processing methods may include: performing the first processing only on the first focus area, and performing the second processing only on other areas in the displayed content except the first focus area, that is, the first non-focus area, or performing different processing on the first focus area and the first non-focus area. Among them, the first processing may include enhancement processing, such as color enhancement, brightness adjustment, boundary enhancement, local magnification and / or automatic circling, etc.; the second processing may include weakening processing, such as blurring, color averaging, reduction, etc. For example, in the case of Figure 3a In the original online education display screen shown, the focus content of the first user is "length a", then the first focus area where "length a" is located in the display screen is enhanced to generate projection data. When displaying according to the projection data, it can be presented Figure 3b The display effect of the first focus area 31 is shown in FIG.

[0065] Specifically, when the position of the first focus area changes continuously, the position of the first focus area may be tracked and determined in a manner such as step 210 above, and data processing may be performed in real time in a manner such as step 220 above.

[0066] In particular, when the position of the first focus area changes in a jumpy manner, that is, in a discontinuous change, in order to avoid the dizziness of the user caused by the direct switching of the area position, a streamline switching method can be used to switch from the old focus area to the new focus area, such as the flow of water drops. Specifically, it may include: determining the movement trajectory according to the position of the first focus area before and after the movement; and enhancing the movement trajectory. Of course, the area outside the movement trajectory may also be weakened, which is not limited here.

[0067] Finally, step 230 involves generating screen projection data from the screen projection display content after data processing, and sending it to at least one connected screen projection receiving end, that is, the second electronic device. In this way, after receiving the screen projection data, the second electronic device can highlight the first focus area of ​​the first user's attention according to the screen projection data, thereby quickly capturing the key points of the shared content and improving the sharing effect of the screen projection.

[0068] In addition, in addition to the above steps 210-230, in a possible embodiment, after performing the first processing on the first focus area and / or performing the second processing on the first non-focus area to generate the screen projection data, the screen projection method may further include:

[0069] Receive a first input from a first user; in response to the first input, update the display content of the first electronic device according to the projection data to display a first focus area in the display content of the first electronic device.

[0070] Specifically, in order to facilitate the first user to view his own focus tracking effect, a control for turning on the focus tracking mode may be set on the first electronic device. Accordingly, the first input may be a control clicked by the first user for turning on the focus tracking mode. After receiving the first input from the first user, the focus tracking mode may be turned on the first electronic device, and the current original display content may be updated to display content that can highlight the first focus area. In this way, the first user can check the focus tracking effect of his own and promptly proofread the key content, thereby improving the accuracy of capturing key content. Of course, the first user may also cancel the focus tracking mode through other inputs, thereby switching the display content of the first electronic device to the original display content.

[0071] In order to facilitate the screen casting sharer to timely understand the screen casting receiver's feedback on the screen casting content, in another possible embodiment, the screen casting method may also include:

[0072] Receive first focus information sent by at least one second electronic device; wherein the first focus information includes information corresponding to a second focus area of ​​interest to at least one second user in the displayed content; based on the first focus information, update the displayed content of the first electronic device to display the second focus area in the displayed content of the first electronic device.

[0073] The information corresponding to the second focus area may be display information after data processing. After the first electronic device receives the information, it may be directly displayed according to the information to distinguish the second focus area. Of course, in order to save transmission traffic, the information corresponding to the second focus area may also be only location information. After the first electronic device receives the information, it is necessary to process the second focus area and / or other areas except the second focus area, that is, the second non-focus area, according to the location information before displaying them to distinguish the second focus area.

[0074] In this way, the screen projection sharer can grasp the focus of the screen projection receiver in a timely manner based on the feedback of the screen projection receiver, so as to adjust the explanation content in time and improve the screen projection sharing effect.

[0075] It should be noted here that the manner in which the second electronic device determines the second focus area is similar to the manner in which the first electronic device determines the first focus area, and is not described in detail here.

[0076] In addition, the focus tracking mode may include a single focus tracking mode and a multi-focus tracking mode, wherein the single focus tracking mode may be applicable to a scenario with only one second electronic device, while the multi-focus tracking mode may be applicable to a scenario involving multiple second electronic devices, that is, while tracking its own focus, it also tracks the focus of multiple projection recipients.

[0077] Based on this, one implementation method is to process multiple focus areas in different processing methods so as to display them differently. For example, different focus areas can be circled with different boundary colors, or different focus areas can be processed in different enhancement methods, such as Figure 3c The different display effects presented between the second focus area 32 and the first focus area 31.

[0078] Another implementation manner is that, when it is determined that there are multiple second focus areas, updating the display content of the first electronic device according to the first focus information to display the second focus area in the display content of the first electronic device, which may specifically include:

[0079] According to the first focus area, multiple second focus areas are processed according to a preset processing method; the third focus area and / or the first feedback information are determined according to the processing result; and the third focus area and / or the first feedback information are displayed in the display content of the first electronic device.

[0080] Specifically, in order to more conveniently display the focus of multiple screen projection recipients and keep the displayed content neat and orderly, the first focus area can be combined with the second focus areas that multiple second users respectively focus on to be summarized and aggregated according to a preset processing method to obtain a third focus area and / or first feedback information, which are then displayed in the display content instead of the multiple second focus areas.

[0081] Among them, the preset processing method may include: at least one processing method of area overlap statistics, area separation statistics, area out-of-focus statistics, and second user operation statistics.

[0082] Here, the regional overlap statistics can be to count the second focus area that overlaps with the first focus area. The overlap area indicates that the focus of the second user is consistent with the focus of the first user, and the screen projection receiver is interested in the current focus. Therefore, the screen projection sharer does not need to adjust the key content currently shared, and there is no need to display the second focus area, ignoring the focus. The regional separation statistics are the opposite. The second focus area that does not overlap with the first focus area is counted, indicating that the screen projection receiver is not interested in the current focus. The regional out-of-focus statistics are to count the second electronic device that has not detected the focus of the second user, indicating that the screen projection receiver is not interested in the currently shared content. In addition, when the user slows down or replays part of the content, it means that the user is very interested in this part of the shared content and may have doubts, which requires refined processing, such as instantaneous operations in game live broadcast scenarios, key classroom knowledge points in online education scenarios, etc. Therefore, second user operation statistics can also be performed.

[0083] Through the above-mentioned processing method, it is possible to summarize and count multiple second focus areas, and perform data mining on the statistical results, for example, to obtain content that most second users are interested in or possible difficulties, and determine the third focus area based on the results, and / or obtain the perceptual experience of the current content by all parties during the screen projection process, and generate first feedback information to present display content with interactive analysis information on the first electronic device, so as to help the screen projection sharer to adjust the current sharing focus in time.

[0084] In addition, it should be noted that on the first electronic device, only the focus area of ​​the first user's attention can be highlighted, or only the focus area and / or feedback information of at least one second user's attention can be highlighted. Of course, all focus areas can also be highlighted. It can be set according to actual application needs and is not limited here.

[0085] Figure 4 The screen projection method provided in the embodiment of the present application may be executed by a screen projection device or a control module in the screen projection device for executing the screen projection method, and the screen projection device may be configured as follows: Figure 1 In the second electronic device 11 shown.

[0086] like Figure 4 As shown, the screen projection method may specifically include the following steps:

[0087] First, step 410, receiving screen projection data projected by a first electronic device; wherein the screen projection data is display data generated by performing a first processing on a first focus area and / or performing a second processing on a first non-focus area, the first focus area is a first focus area focused on by a first user in display content of the first electronic device, and the first non-focus area is other areas in the display content except the first focus area;

[0088] Next, in step 420, content corresponding to the projection data is displayed on the second electronic device.

[0089] Therefore, by receiving the projection data projected by the first electronic device on the second electronic device, and because the projection data is the data generated after distinguishing the first focus area of ​​the first user's attention and / or the first non-focus area, when displaying according to the projection data, the first focus area of ​​the first user's attention can be highlighted on the second electronic device, so that the second user using the second electronic device can grasp the key points of the current projection content in time, thereby improving the effect of screen projection sharing and improving user experience.

[0090] The above steps are described in detail below:

[0091] First, regarding step 410, in the embodiment of the present application, the projection data is generated by the first electronic device. Therefore, please refer to the relevant description of the method for generating the projection data in the above embodiment for details, which will not be repeated here.

[0092] Next, it involves step 420. In one embodiment, after receiving the projection data projected by the first electronic device, the second electronic device directly displays the projection data.

[0093] In another embodiment, before displaying the content corresponding to the screen projection data on the second electronic device, the screen projection method may further include:

[0094] Display a first prompt message of whether to start the focus tracking mode; and receive a confirmation input from a second user in response to the first prompt message.

[0095] Specifically, in addition to the projection data, the second electronic device can also receive unprocessed display content data. After receiving the projection data, the second user using the second electronic device can be provided with a first prompt message of whether to turn on the focus tracking mode, so as to prompt the second user to choose whether to turn on the focus tracking mode. If the user chooses to turn on the focus tracking mode, the first focus area of ​​the first user's attention is displayed differently according to the projection data; if the user chooses not to turn on the focus tracking mode, or does not make a selection, the normal playback mode is used to display the unprocessed original display content. In this way, the second user can choose whether to perform focus tracking display according to actual needs, thereby improving the user's selectivity and user experience.

[0096] In addition, in addition to displaying the focus of the screen sharer, that is, the first user, the focus of one's own attention can also be captured to feed back to the screen sharer, or displayed on the local end. Specifically, the focus capture method is the same as the capture method adopted by the first electronic device, which will not be repeated here.

[0097] Similar to the first electronic device described above, the screen projection recipient can also enable the multi-focus tracking mode, and track and display the focus of the screen projection sharer while tracking and displaying the focus of other screen projection recipients. Specifically, the screen projection method can also include:

[0098] Display a second prompt message indicating whether to turn on the multi-focus tracking mode; receive a confirmation input from a second user for the second prompt message; in response to the confirmation input, obtain second focus information of at least one third electronic device; wherein the second focus information includes information corresponding to a fourth focus area of ​​interest to at least one third user in the displayed content; and display the fourth focus area in the displayed content of the second electronic device based on the second focus information.

[0099] Specifically, after the second user chooses to turn on the focus tracking mode, the second prompt information of whether to turn on the multi-focus tracking mode can continue to be displayed. If the user chooses not to turn on the focus tracking mode, only the first focus area focused on by the first user is displayed; if the user chooses to turn on the focus tracking mode, while tracking and displaying the first focus area, the fourth focus area captured by the other second electronic device, that is, the third electronic device, is tracked and displayed. The specific display method can refer to the above description of the display method in the multi-focus mode of the first electronic device, which will not be repeated here.

[0100] In this way, the second user can understand the differences between the focus of other users and his own by observing the focus content of other screen projection recipients, that is, the third users, so as to fill in the gaps and further improve the effect of screen projection sharing.

[0101] Based on this, similarly, in the case where it is determined that there are multiple fourth focus areas, displaying the fourth focus area in the display content of the second electronic device according to the second focus information may specifically include:

[0102] According to the first focus area, multiple fourth focus areas are processed according to a preset processing method; the fifth focus area and / or the second feedback information are determined according to the processing result; and the fifth focus area and / or the second feedback information are displayed in the display content of the second electronic device.

[0103] The preset processing method may include at least one of: region overlap statistics, region separation statistics, region out-of-focus statistics, and second user operation statistics, which will not be described in detail here.

[0104] Therefore, the screen projection method provided in the embodiment of the present application can highlight the key points in the shared content by capturing and tracking the focus of all parties in the displayed content in real time during the screen projection process. The screen projection sharing end only needs very little or no post-processing to improve the processing efficiency of the data of the sharing party in the screen projection scene. At the same time, by efficiently collecting the user experience of the screen projection receiver, it can help the sharer to grasp the sharing effect of the shared content. In addition, the screen projection receiver can easily obtain the key content in the screen projection content without concentrating, which improves the user experience.

[0105] Based on the same inventive concept, the present application also provides a screen projection device. Figure 5-Figure 6 The screen projection device provided in the embodiment of the present application is described in detail.

[0106] Figure 5 is a schematic diagram of a screen projection device according to an exemplary embodiment. The screen projection device can be configured as follows Figure 1 In the first electronic device 10 shown.

[0107] like Figure 5 As shown, the first screen projection device 500 may specifically include:

[0108] The area determination module 501 is used to determine a first focus area that a first user pays attention to in display content of a first electronic device;

[0109] A data generating module 502 is configured to perform a first processing on the first focus area and / or perform a second processing on the first non-focus area to generate screen projection data; wherein the first non-focus area is an area other than the first focus area in the display content;

[0110] The data projection module 503 is used to project the projection data to at least one second electronic device so as to display content corresponding to the projection data on the second electronic device.

[0111] The first screen projection device 500 is described in detail below, as shown below:

[0112] In one embodiment, the region determination module 501 may specifically include: a gaze focus determination submodule and a first region determination submodule; wherein,

[0113] A gaze focus determination submodule, used to determine a gaze focus of a first user's eyes;

[0114] The first area determination submodule is used to determine a first focus area that a first user focuses on in display content of a first electronic device according to the human eye gaze focus.

[0115] Based on this, in one embodiment, the first area determination submodule mentioned above specifically includes:

[0116] an information acquisition unit, configured to acquire voice information and / or operation information of the first user;

[0117] A focus determination unit is used to determine a first focus area focused on by a first user in display content of a first electronic device according to the voice information and / or operation information and the human eye gaze focus.

[0118] In one embodiment, the first processing includes an enhancement processing, and the second processing includes a weakening processing.

[0119] In one embodiment, when the position of the first focus area changes, the first screen projection device 500 may further include: a trajectory determination module 504 and a trajectory processing module 505; wherein,

[0120] A trajectory determination module 504, configured to determine a movement trajectory according to the positions of the first focus area before and after the movement;

[0121] The trajectory processing module 505 is used to perform enhancement processing on the movement trajectory.

[0122] In addition, in one embodiment, the first screen projection device 500 mentioned above may further include: a first input receiving module 506 and a first area display module 507; wherein,

[0123] A first input receiving module 506, configured to receive a first input from the first user after performing a first processing on the first focus area and / or performing a second processing on the first non-focus area to generate screen projection data;

[0124] The first area display module 507 is used to update the display content of the first electronic device in response to the first input according to the projection data, so as to display the first focus area in the display content of the first electronic device.

[0125] Based on this, in one embodiment, the first screen projection device 500 mentioned above may further include: a first information receiving module 508 and a second area display module 509; wherein,

[0126] The first information receiving module 508 is configured to receive first focus information sent by at least one second electronic device; wherein the first focus information includes information corresponding to a second focus area focused on by at least one second user in the displayed content;

[0127] The second area display module 509 is used to update the display content of the first electronic device according to the first focus information, so as to display the second focus area in the display content of the first electronic device.

[0128] In one embodiment, when it is determined that there are multiple second focus areas, the second area display module 509 mentioned above specifically includes:

[0129] A focus processing submodule, configured to process the plurality of second focus areas according to a preset processing method based on the first focus area;

[0130] An area information determination submodule, used to determine a third focus area and / or first feedback information according to the processing result;

[0131] The area information display submodule is used to display the third focus area and / or the first feedback information in the display content of the first electronic device.

[0132] In one of the embodiments, the preset processing methods mentioned above include: at least one of area overlap statistics, area separation statistics, area out-of-focus statistics, and second user operation statistics.

[0133] Therefore, by determining the first focus area that the first user is concerned about in the display content of the first electronic device, the key content in the currently displayed content is obtained, and then the first focus area and / or the first non-focus area are differentiated to achieve marking of the key content in the currently displayed content. After the differentiated projection data is projected to at least one second electronic device, the second electronic device displays the projection data, so that the second electronic device can realize real-time capture and differentiated display of the key content based on the projection data, so that the user of the second electronic device can quickly grasp the key points of the current projection display content and improve the sharing effect of the projection. At the same time, the display form of the projection content with highlighted key points also improves the user experience.

[0134] In addition, based on the same inventive concept, the present application also provides another screen projection device.

[0135] Figure 6FIG. 1 is a schematic diagram showing the structure of another screen projection device according to an exemplary embodiment. The screen projection device can be configured as follows: Figure 1 In the second electronic device 11 shown.

[0136] like Figure 6 As shown, the second screen projection device 600 may specifically include:

[0137] The data receiving module 601 is used to receive screen projection data projected by the first electronic device; wherein the screen projection data is display data generated by performing a first processing on a first focus area and / or performing a second processing on a first non-focus area, wherein the first focus area is a first focus area focused on by a first user in display content of the first electronic device, and the first non-focus area is other areas in the display content except the first focus area;

[0138] The screen projection display module 602 is used to display the content corresponding to the screen projection data on the second electronic device.

[0139] The second screen projection device 600 is described in detail below, as shown below:

[0140] In one embodiment, the second screen projection device 600 mentioned above may further include: a first prompt display module 603 and a first confirmation receiving module 604; wherein,

[0141] A first prompt display module 603, used for displaying a first prompt message of whether to turn on the focus tracking mode before displaying the content corresponding to the projection data on the second electronic device;

[0142] The first confirmation receiving module 604 is configured to receive a confirmation input from the second user regarding the first prompt information.

[0143] In one embodiment, the second screen projection device 600 mentioned above may further include: a second prompt display module 605, a second confirmation receiving module 606, a second information acquisition module 607 and a fourth area display module 608; wherein,

[0144] A second prompt display module 605, used to display a second prompt message of whether to start the multi-focus tracking mode;

[0145] A second confirmation receiving module 606 is used to receive a confirmation input of the second user in response to the second prompt information;

[0146] A second information acquisition module 607 is used to acquire second focus information of at least one third electronic device in response to the confirmation input; wherein the second focus information includes information corresponding to a fourth focus area focused on by at least one third user in the displayed content;

[0147] The fourth area display module 608 is configured to display the fourth focus area in the display content of the second electronic device according to the second focus information.

[0148] In one embodiment, when it is determined that there are multiple fourth focus areas, the fourth area display module 608 mentioned above specifically includes:

[0149] A region processing submodule, configured to process the plurality of fourth focus regions according to a preset processing method based on the first focus region;

[0150] An information area determination submodule, used to determine a fifth focus area and / or second feedback information according to the processing result;

[0151] The information area display submodule is used to display the fifth focus area and / or the second feedback information in the display content of the second electronic device.

[0152] Therefore, by receiving the projection data projected by the first electronic device on the second electronic device, and because the projection data is the data generated after distinguishing the first focus area of ​​the first user's attention and / or the first non-focus area, when displaying according to the projection data, the first focus area of ​​the first user's attention can be highlighted on the second electronic device, so that the second user using the second electronic device can grasp the key points of the current projection content in time, thereby improving the effect of screen projection sharing and improving user experience.

[0153] The screen projection device involved in the embodiments of the present application can be a device, or a component, integrated circuit, or chip in a terminal. The device can be a mobile electronic device or a non-mobile electronic device. Exemplarily, the mobile electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA), etc. The non-mobile electronic device can be a network attached storage (NAS), a personal computer (PC), a television (TV), etc., which is not specifically limited in the embodiments of the present application.

[0154] The screen projection device involved in the embodiments of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiments of the present application.

[0155] The screen projection device provided in the embodiment of the present application can achieve Figures 2 to 4 To avoid repetition, the various processes implemented by the method embodiment are not described here.

[0156] Optional, such as Figure 7 As shown, an embodiment of the present application also provides an electronic device 700, including a processor 701, a memory 702, and a program or instruction stored in the memory 702 and executable on the processor 701. When the program or instruction is executed by the processor 701, each process of the above-mentioned screen projection method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be described here.

[0157] It should be noted that the first electronic device in the embodiment of the present application includes the mobile electronic device and the non-mobile electronic device mentioned above.

[0158] Figure 8 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.

[0159] The first electronic device 800 includes but is not limited to: a first processor 801 , an output unit 802 , a sensor 803 , a first user input unit 804 , a first input unit 805 , a first display unit 806 , a first memory 807 and other components.

[0160] Those skilled in the art will appreciate that the first electronic device 800 may further include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the first processor 801 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Figure 8 The electronic device structure shown in the figure does not constitute a limitation on the first electronic device. The first electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0161] The first processor 801 is used to determine a first focus area of ​​the display content of the first electronic device that the first user focuses on; perform a first process on the first focus area, and / or perform a second process on the first non-focus area to generate screen projection data; wherein the first non-focus area is other areas of the display content except the first focus area;

[0162] The first output unit 802 is used to project the projection data to at least one second electronic device so as to display content corresponding to the projection data on the second electronic device.

[0163] Therefore, by determining the first focus area that the first user is concerned about in the display content of the first electronic device, the key content in the currently displayed content is obtained, and then the first focus area and / or the first non-focus area are differentiated to achieve marking of the key content in the currently displayed content. After the differentiated projection data is projected to at least one second electronic device, the second electronic device displays the projection data, so that the second electronic device can realize real-time capture and differentiated display of the key content based on the projection data, so that the user of the second electronic device can quickly grasp the key points of the current projection display content and improve the sharing effect of the projection. At the same time, the display form of the projection content with highlighted key points also improves the user experience.

[0164] Optionally, the first processor 801 is further configured to determine a gaze focus of the first user; and determine a first focus area of ​​the display content of the first electronic device that the first user focuses on based on the gaze focus of the first user.

[0165] Optionally, sensor 803 is used to obtain voice information and / or operation information of the first user.

[0166] The first processor 801 is further configured to determine a first focus area of ​​the display content of the first electronic device that the first user focuses on based on the voice information and / or operation information and the human eye gaze focus.

[0167] The first processing includes an enhancement processing, and the second processing includes a weakening processing.

[0168] Optionally, when the position of the first focus area jumps, the first processor 801 is further used to determine a movement trajectory according to the positions of the first focus area before and after the movement; and perform enhancement processing on the movement trajectory.

[0169] Optionally, the first user input unit 804 is used to receive a first input from the first user.

[0170] The first processor 801 is further configured to update the display content of the first electronic device in response to the first input and according to the projection data.

[0171] The first display unit 806 is configured to display the first focus area in the display content of the first electronic device.

[0172] Optionally, the first input unit 805 is used to receive first focus information sent by at least one second electronic device; wherein the first focus information includes information corresponding to a second focus area focused on by at least one second user in the displayed content.

[0173] The first processor 801 is further configured to update display content of the first electronic device according to the first focus information.

[0174] The first display unit 806 is further configured to display the second focus area in the display content of the first electronic device.

[0175] Optionally, when it is determined that there are multiple second focus areas, the first processor 801 is further used to process the multiple second focus areas according to the first focus area in a preset processing method; and determine the third focus area and / or the first feedback information based on the processing result.

[0176] The first display unit 806 is further configured to display the third focus area and / or the first feedback information in the display content of the first electronic device.

[0177] The preset processing method includes at least one of area overlap statistics, area separation statistics, area out-of-focus statistics, and second user operation statistics.

[0178] Fig. 9 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.

[0179] The second electronic device 900 includes but is not limited to: a second processor 901 , a second display unit 902 , a second user input unit 903 , a second input unit 904 , a second memory 905 and other components.

[0180] Those skilled in the art will appreciate that the second electronic device 900 may further include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the second processor 901 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig. 9 The electronic device structure shown in does not constitute a limitation on the second electronic device. The second electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0181] Among them, the second processor 901 is used to receive screen projection data projected by the first electronic device; wherein the screen projection data is display data generated by performing a first processing on a first focus area and / or performing a second processing on a first non-focus area, wherein the first focus area is a first focus area that a first user focuses on in the display content of the first electronic device, and the first non-focus area is other areas in the display content except the first focus area.

[0182] The second display unit 902 is used to display content corresponding to the projection data on the second electronic device.

[0183] Therefore, by receiving the projection data projected by the first electronic device on the second electronic device, and because the projection data is the data generated after distinguishing the first focus area of ​​the first user's attention and / or the first non-focus area, when displaying according to the projection data, the first focus area of ​​the first user's attention can be highlighted on the second electronic device, so that the second user using the second electronic device can grasp the key points of the current projection content in time, thereby improving the effect of screen projection sharing and improving user experience.

[0184] Optionally, the second display unit 902 is further used to display a first prompt message indicating whether the focus tracking mode is turned on.

[0185] The second user input unit 903 is used to receive a confirmation input from a second user regarding the first prompt information.

[0186] Optionally, the second display unit 902 is further used to display a second prompt message indicating whether the multi-focus tracking mode is turned on.

[0187] The second user input unit 903 is further used to receive a confirmation input from the second user regarding the second prompt information.

[0188] The second input unit 904 is used to obtain second focus information of at least one third electronic device in response to the confirmation input; wherein the second focus information includes information corresponding to a fourth focus area of ​​at least one third user's attention in the displayed content.

[0189] The second display unit 902 is further configured to display the fourth focus area in the display content of the second electronic device according to the second focus information.

[0190] Optionally, when it is determined that there are multiple fourth focus areas, the second processor 901 is further used to process the multiple fourth focus areas according to the first focus area in a preset processing method; and determine the fifth focus area and / or second feedback information based on the processing results.

[0191] The second display unit 902 is further configured to display the fifth focus area and / or the second feedback information in the display content of the second electronic device.

[0192] The preset processing method includes at least one of area overlap statistics, area separation statistics, area out-of-focus statistics, and second user operation statistics.

[0193] Therefore, by capturing and tracking the focus of all parties in the displayed content in real time during the screen projection process, the screen projection sharing end only needs little or no post-processing to highlight the key points in the shared content, thereby improving the processing efficiency of the data of the sharing party in the screen projection scene. At the same time, by efficiently collecting the user experience of the screen projection receiver, it can help the sharer to grasp the sharing effect of the shared content. In addition, the screen projection receiver can easily obtain the key content in the screen projection content without concentrating, which improves the user experience.

[0194] It should be understood that in the embodiment of the present application, the input unit involved above may include a graphics processor (Graphics Processing Unit, GPU) and a network interface, and the graphics processor processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit may include a display panel, and the display panel may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit includes a touch panel, a microphone, and other input devices. A touch panel is also called a touch screen. The touch panel may include two parts: a touch detection device and a touch controller. Other input devices may include, but are not limited to, a physical keyboard, function keys (such as volume control buttons, switch buttons, etc.), a trackball, a mouse, and a joystick, which will not be repeated here. The processor may integrate an application processor and a modem processor, wherein the application processor mainly processes an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor.

[0195] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned screen projection method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0196] The processor is a processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0197] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned screen projection method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0198] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0199] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0200] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0201] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. A screen projection method, characterized in that: include: Determine a first focus area of ​​display content of the first electronic device that is focused on by the first user; In the displayed content, a first processing is performed on the first focus area, and / or a second processing is performed on the first non-focus area, to generate screen projection data, so that the content in the first focus area is highlighted in the finally displayed screen projection content; wherein the first non-focus area is other areas in the displayed content except the first focus area; Projecting the projection data to at least one second electronic device, so as to display content corresponding to the projection data on the second electronic device; The method further comprises: Receiving first focus information sent by at least one second electronic device; wherein the first focus information includes information corresponding to a second focus area focused on by at least one second user in the displayed content; In the case where it is determined that there are multiple second focus areas, the multiple second focus areas are processed according to a preset processing method according to the first focus area, and the preset processing method includes: at least one processing method of area overlap statistics, area separation statistics, area out-of-focus statistics, and second user operation statistics; determining a third focus area and / or first feedback information according to the processing result; The third focus area and / or the first feedback information are displayed in the display content of the first electronic device.

2. The method according to claim 1, characterized in that The determining of a first focus area of ​​the display content of the first electronic device that the first user focuses on includes: Determining a gaze focus of a first user; A first focus area focused on by the first user in display content of the first electronic device is determined according to the human eye focus.

3. The method according to claim 2, characterized in that The determining, based on the human eye gaze focus, a first focus area of ​​the display content of the first electronic device that the first user is paying attention to includes: Acquiring voice information and / or operation information of the first user; A first focus area focused on by the first user in the display content of the first electronic device is determined according to the voice information and / or operation information and the human eye gaze focus.

4. A screen projection device, characterized in that: include: An area determination module, configured to determine a first focus area of ​​the display content of the first electronic device, which is focused on by the first user; a data generating module, configured to perform a first processing on the first focus area and / or a second processing on the first non-focus area in the displayed content, to generate screen projection data, so that the content in the first focus area is highlighted in the finally displayed screen projection content; wherein the first non-focus area is other areas in the displayed content except the first focus area; a data projection module, configured to project the projection data to at least one second electronic device, so as to display content corresponding to the projection data on the second electronic device; The device also includes: A first information receiving module is configured to receive first focus information sent by at least one second electronic device; wherein the first focus information includes information corresponding to a second focus area focused on by at least one second user in the displayed content; a focus processing submodule, configured to process the plurality of second focus areas according to a preset processing method based on the first focus area when it is determined that there are a plurality of second focus areas, wherein the preset processing method includes at least one of: area overlap statistics, area separation statistics, area defocus statistics, and second user operation statistics; An area information determination submodule, used to determine a third focus area and / or first feedback information according to the processing result; The area information display submodule is used to display the third focus area and / or the first feedback information in the display content of the first electronic device.

5. The device according to claim 4, characterized in that The area determination module specifically includes: A gaze focus determination submodule, used to determine a gaze focus of a first user's eyes; The first area determination submodule is used to determine a first focus area that a first user focuses on in display content of a first electronic device according to the human eye gaze focus.

6. The device according to claim 5, characterized in that The first area determination submodule specifically includes: an information acquisition unit, configured to acquire voice information and / or operation information of the first user; A focus determination unit is used to determine a first focus area focused on by a first user in display content of a first electronic device according to the voice information and / or operation information and the human eye gaze focus.