Content display method and device, equipment and storage medium
By collecting user head and eye movement data in real time, determining the focus area of the line of sight and judging the display conditions, the problem of single operation mode in the prior art is solved, and richer user interaction and lower screen limitations are achieved.
Patent Information
- Application Number
- CN202411493717.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-24
- Publication Date
- 2025-02-07
AI Technical Summary
In the prior art, the operation mode of users choosing to view the target content of interest is single, resulting in greater limitations in the use of the screen.
The camera device collects the user's head movement trajectory and eye rotation direction in real time, determines the user's focal area of the line of sight, and judges whether the condition to display the target content is triggered based on the residence time and the proportion of the overlapping area of the area, so as to display the corresponding conditions on the screen. target content.
It enriches the operation method of users choosing to watch content of interest on the screen, reduces the limitations during the screen use process, and improves the user experience.
Smart Images

Figure CN119396306A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of data processing technology, and in particular to a content display method, device, equipment and storage medium. Background Art
[0002] Electronic devices usually have a screen for displaying images. With the development of display technology, the screen can be divided into multiple display areas, each of which is used to display different content. Users will have different interests in different content and can choose to watch the content that they are more interested in.
[0003] Currently, in the prior art, a user can select and watch target content of interest on the screen through an input device such as a touch screen or a mouse.
[0004] However, in the prior art, the operation method for users to select and watch target content of interest is single, resulting in great limitations in the use of the screen. Summary of the invention
[0005] The present application provides a content display method, apparatus, device and storage medium, which are used to enrich the operation mode of selecting and viewing target content of interest on a screen.
[0006] In a first aspect, the present application provides a content display method, which is applied to an electronic device, wherein the electronic device has a camera device and a screen, and the method includes:
[0007] The camera device is used to collect the real-time movement trajectory of the user's head and the real-time rotation direction of the eyeballs in real time;
[0008] Determine a real-time focal area formed by the user's line of sight on the screen based on the real-time movement trajectory of the user's head and the real-time rotation direction of the eyeballs;
[0009] determining a display area on the screen where the real-time focus area stays as a target display area, wherein the screen includes a plurality of display areas;
[0010] Determining whether a preset attribute of the real-time focus area satisfies a trigger condition;
[0011] If the preset attribute of the real-time focus area meets the trigger condition, obtaining the target content corresponding to the target display area;
[0012] The target content is displayed at a target display area on the screen.
[0013] In a possible design, determining the real-time focal area formed by the user's line of sight on the screen based on the real-time movement trajectory of the user's head and the real-time rotation direction of the eyeballs includes:
[0014] Determine the focus of the user's line of sight on the screen based on the real-time movement trajectory of the user's head and the real-time rotation direction of the eyeballs;
[0015] A circular area formed by taking the focus of the user's line of sight on the screen as the center and a preset length as the radius is determined as the real-time focus area.
[0016] In a possible design, determining the display area on the screen where the real-time focus area stays as the target display area includes:
[0017] Obtaining the area occupied by each display area on the screen;
[0018] Obtaining the overlapping area between each display area and the real-time focus area;
[0019] Comparing the overlapping area between each display area and the real-time focus area with the area occupied on the screen to obtain the overlapping area ratio corresponding to each display area;
[0020] Compare the size of the overlap area ratio corresponding to each display area with the preset ratio;
[0021] If the overlapping area ratio corresponding to the display area exceeds the preset ratio, the display area is determined as the target display area.
[0022] In a possible design, the preset attribute is the length of time the real-time focus area stays in the target display area;
[0023] Accordingly, the determining whether the preset attribute of the real-time focus area meets the trigger condition includes:
[0024] Determine the length of time the real-time focus area stays in the target display area;
[0025] Determine whether the time for which the real-time focus area stays in the target display area reaches a preset time;
[0026] If the stay time of the real-time focus area in the target display area does not reach the preset time, it is determined that the preset attribute of the real-time focus area does not meet the trigger condition;
[0027] If the stay time of the real-time focus area in the target display area reaches a preset time, it is determined that the preset attribute of the real-time focus area meets the trigger condition.
[0028] In a possible design, determining the length of time that the real-time focus area stays in the target display area includes:
[0029] Starting from obtaining the target display area, accumulating the length of time the real-time focus area stays in the target display area from zero;
[0030] Obtaining a real-time deviation of the real-time focus area;
[0031] If the real-time deviation does not exceed the preset threshold, the residence time continues to be accumulated;
[0032] If the real-time deviation exceeds a preset threshold, the stay duration is reset to zero.
[0033] In a possible design, obtaining the target content corresponding to the target display area includes:
[0034] Acquire a content library corresponding to the target display area, wherein the content library includes a plurality of candidate contents;
[0035] Use a recommendation algorithm to prioritize each candidate content;
[0036] The candidate content with the highest priority is determined as the target content.
[0037] In a second aspect, the present application provides a content display device, which is applied to an electronic device, wherein the electronic device has a camera device and a screen, and the device includes:
[0038] A collection module, used to collect the real-time movement trajectory of the user's head and the real-time rotation direction of the eyeballs in real time through the camera device;
[0039] A determination module, configured to determine a real-time focal area formed by the user's line of sight on the screen based on the real-time movement trajectory of the user's head and the real-time rotation direction of the eyeballs;
[0040] The determination module is further used to determine the display area on the screen where the real-time focus area stays as the target display area, wherein the screen includes a plurality of display areas;
[0041] A judging module, used to judge whether the preset attribute of the real-time focus area meets the triggering condition;
[0042] An acquisition module, configured to acquire target content corresponding to the target display area if the preset attribute of the real-time focus area meets a trigger condition;
[0043] A display module is configured to display the target content in a target display area on the screen.
[0044] In a third aspect, an embodiment of the present application provides an electronic device, comprising: at least one processor and a memory; the memory stores computer execution instructions; the at least one processor executes the computer execution instructions stored in the memory, so that the at least one processor executes the content display method described in the first aspect and various possible designs of the first aspect.
[0045] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, in which computer execution instructions are stored. When a processor executes the computer execution instructions, the content display method described in the first aspect and various possible designs of the first aspect is implemented.
[0046] In a fifth aspect, an embodiment of the present application provides a computer program product, including a computer program. When the computer program is executed by a processor, it implements the content display method described in the first aspect and various possible designs of the first aspect.
[0047] The content display method, device, equipment and storage medium provided by the present application first collect the real-time movement trajectory of the user's head and the real-time rotation direction of the eyeball in real time through a camera device, then determine the real-time focus area formed by the user's line of sight on the screen, and determine the display area where the real-time focus area stays on the screen as the target display area, and obtain the target content corresponding to the target display area when the preset attribute of the real-time focus area meets the trigger condition, and display the target content in the target display area on the screen. Based on the method provided by the present application, the target display area and the target content can be determined by the focus area of the user's line of sight on the screen, and the target content can be displayed in the target display area, which enriches the user's operation mode of selecting the target content of interest to watch on the screen and reduces the limitations of the screen during use. BRIEF DESCRIPTION OF THE DRAWINGS
[0048] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.
[0049] Figure 1 This is the application scenario diagram of this application;
[0050] Figure 2 The process of the content display method provided in the embodiment of the present application Figure 1 ;
[0051] Figure 3 A schematic diagram of a real-time focus area formed on the screen by the user's line of sight as an example;
[0052] Figure 4 The process of the content display method provided in the embodiment of the present application Figure 2 ;
[0053] Figure 5 The process of the content display method provided in the embodiment of the present application Figure 3 ;
[0054] Figure 6 Another schematic diagram of a real-time focus area formed on the screen by the user's line of sight as an example;
[0055] Figure 7 The process of the content display method provided in the embodiment of the present application Figure 4 ;
[0056] Figure 8 The process of the content display method provided in the embodiment of the present application Figure 5 ;
[0057] Fig. 9 A schematic diagram of the real-time deviation of an example;
[0058] Fig.10 The process of the content display method provided in the embodiment of the present application Figure 6 ;
[0059] Fig.11 A schematic diagram of the structure of a content display device provided in an embodiment of the present application;
[0060] Fig.12 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application.
[0061] The above drawings have shown clear embodiments of the present application, which will be described in more detail later. These drawings and text descriptions are not intended to limit the scope of the present application in any way, but to illustrate the concept of the present application to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION
[0062] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.
[0063] In the technical solution of this application, the collection, storage, use, processing, transmission, provision and disclosure of information such as financial data or user data involved shall comply with the provisions of relevant laws and regulations and shall not violate public order and good morals.
[0064] It should be noted that in the embodiments of the present application, certain software, components, models and other existing solutions in the industry may be mentioned, and they should be regarded as exemplary. Their purpose is only to illustrate the feasibility of implementing the technical solution of the present application, but it does not mean that the applicant has or will necessarily use the solution.
[0065] Figure 1 This is the application scenario diagram of this application. Figure 1 As shown, the application scenario includes: an electronic device ①, the electronic device includes a screen and a camera device ②, there are multiple display areas on the screen, and each display area is used to display different content. Users will have different interests in different content, and can choose to watch the content with higher interest. At present, in the prior art, users can choose to watch the target content of interest on the screen through input devices such as a touch screen or a mouse. For example, the user selects the target content corresponding to display area 1 by touching the screen with his finger. However, in the prior art, the operation method for users to select the target content of interest to watch is single, which leads to greater limitations of the screen during use.
[0066] In response to the above technical problems, the present application proposes the following technical concept: first, the real-time movement trajectory of the user's head and the real-time rotation direction of the eyeballs are collected in real time by the camera device on the electronic device, and then the real-time focus area formed by the user's line of sight on the screen is determined, and the display area where the real-time focus area stays on the screen is determined as the target display area, and when the preset attribute of the real-time focus area meets the trigger condition, the target content corresponding to the target display area is obtained, and the target content is displayed in the target display area on the screen. Based on the method provided by the present application, the target display area and the target content can be determined by the focus area of the user's line of sight on the screen, and the target content can be displayed in the target display area, which enriches the user's operation mode of selecting and viewing the target content of interest on the screen and reduces the limitations of the screen during use.
[0067] The technical solution of the present application and how the technical solution of the present application solves the above-mentioned technical problems are described in detail below with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present application will be described below in conjunction with the accompanying drawings.
[0068] based on Figure 1 In the application scenario shown, the embodiment of the present application further provides a content display method, which is applied to an electronic device, wherein the electronic device has a camera device and a screen. Figure 2 The process of the content display method provided in the embodiment of the present application Figure 1 ,like Figure 2 As shown, the method includes:
[0069] S201. Collect the real-time movement trajectory of the user's head and the real-time rotation direction of the eyeballs in real time through the camera device.
[0070] The execution subject of the method of this embodiment may be Figure 1 The electronic device shown in .
[0071] In combination with the scenario example, when a user is watching an electronic screen, the user's line of sight is fixed on different display areas, and the movement trajectory of the user's head and the rotation direction of the eyeball will be different. The real-time movement trajectory of the user's head and the real-time rotation direction of the eyeball can be obtained by shooting with a camera device, such as taking a photo every preset time, such as taking a photo every 0.1 seconds, and obtaining the real-time movement trajectory of the user's head and the real-time rotation direction of the eyeball from multiple photos. Alternatively, the real-time movement trajectory of the user's head and the real-time rotation direction of the eyeball can be obtained by recording with a device, and each frame of the video can be used to obtain the real-time movement trajectory of the user's head and the real-time rotation direction of the eyeball.
[0072] S202: Determine a real-time focal area formed by the user's line of sight on the screen based on the real-time movement trajectory of the user's head and the real-time rotation direction of the eyeballs.
[0073] Combined with the scene example, the angle between the user's line of sight and the screen will change with the real-time movement trajectory of the user's head and the real-time rotation direction of the eyeballs. Therefore, the real-time angle between the user's line of sight and the screen can be obtained according to the real-time movement trajectory of the user's head and the real-time rotation direction of the eyeballs, thereby obtaining the focus area of the user's line of sight on the screen.
[0074] S203: Determine a display area on the screen where the real-time focus area stays as a target display area, wherein the screen includes a plurality of display areas.
[0075] Combined with the scene example, Figure 3 Schematic diagram of the real-time focus area formed on the screen by the user's line of sight, as shown in Figure 3 As shown in Figure 3, the real-time focus area formed by the user’s line of sight on the screen is ③. Figure 3 It can be known that the display area where the real-time focus area stays is display area 1, so display area 1 can be determined as the target display area.
[0076] S204: Determine whether the preset attributes of the real-time focus area meet the triggering condition.
[0077] In combination with the scenario example, the preset attribute of the real-time focus area can be the time the user's gaze is on the target display area, and the trigger condition can be whether the real-time focus area is on the target display area for more than the preset time. Therefore, if the user's gaze time on the target display area exceeds the preset time, it is determined that the preset attribute of the real-time focus area meets the trigger condition.
[0078] S205: If the preset attribute of the real-time focus area meets the trigger condition, obtain the target content corresponding to the target display area.
[0079] In combination with the scenario example, each display area corresponds to different target content. For example, when the user's gaze time on display area 1 exceeds a preset time, the target content corresponding to display area 1 is obtained.
[0080] S206: Display the target content in a target display area on the screen.
[0081] In combination with the scenario example, after the target content of the display area 1 is acquired, the target content of the display area 1 is displayed at the position of the display area 1.
[0082] Based on the method provided in this embodiment, the target display area and target content can be determined by the focus area of the user's line of sight on the screen, and the target content can be displayed in the target display area, which enriches the user's operation methods for selecting the target content of interest to watch on the screen and reduces the limitations of the screen during use.
[0083] Optional, Figure 4 The process of the content display method provided in the embodiment of the present application Figure 2 ,like Figure 4 As shown, S202 includes:
[0084] S401: Determine the focus of the user's line of sight on the screen based on the real-time movement trajectory of the user's head and the real-time rotation direction of the eyeballs.
[0085] In combination with the scene example, the intersection point between the straight line where the user's sight line is located and the screen is used as the focus of the user's sight line on the screen.
[0086] S402: Determine a circular area formed by taking the focus of the user's line of sight on the screen as the center and a preset length as the radius as the real-time focus area.
[0087] In combination with the scene example, the user's focus area on the screen can be a circular area. Specifically, the circle with the focus on the screen as the center and a preset length as the radius can be used as the focus area. Since the real-time movement trajectory of the user's head is different from the real-time rotation direction of the eyeball, the user's line of sight will change in real time, and the real-time focus area will change in real time with the user's line of sight. Based on the method provided in this embodiment, the real-time focus area formed by the user's line of sight on the screen can be determined.
[0088] Optional, Figure 5 The process of the content display method provided in the embodiment of the present application Figure 3,like Figure 5 As shown, S203 includes:
[0089] S501: Obtain the area occupied by each display area on the screen.
[0090] Combined with the scene example, combined with Figure 3 , the area occupied by each display region on the screen can be determined by the number of pixels in the display region.
[0091] S502: Obtain an overlapping area between each display area and the real-time focus area.
[0092] Combined with the scene example, combined with Figure 3 If the overlapping area of the real-time focus area ③ and the display area is the area of the real-time focus area falling on the display area, it can be determined by the pixel points of the real-time focus area ③ falling on the display area.
[0093] S503: Compare the overlapping area between each display area and the real-time focus area with the area occupied on the screen to obtain the overlapping area ratio corresponding to each display area.
[0094] Combined with the scene example, combined with Figure 3 , assuming that each display area contains 1000 pixels. Figure 1 In the figure, the real-time focus area ③ completely falls in the display area 1, and the real-time focus area ③ contains 100 pixels, so the overlap area between the real-time focus area ③ and the display area 1 is 100 pixels, and the overlap area between the real-time focus area ③ and the display area 1 is 0 pixels. The overlap area ratio corresponding to the display area 1 is 10%, and the overlap area ratio corresponding to other display areas is 0.
[0095] S504: Compare the size of the overlapping area ratio corresponding to each display area with the preset ratio.
[0096] In combination with the scenario example, the preset ratio can be determined according to actual conditions, for example, the preset ratio can be determined as 5%.
[0097] S505: If the overlapping area ratio corresponding to the display area exceeds the preset ratio, the display area is determined as the target display area.
[0098] In combination with the scenario example, the overlap area ratio corresponding to each display area is compared with 5%. It can be seen that the overlap area ratio corresponding to display area 1 exceeds 5%, so the display area can be determined as the target display area.
[0099] Figure 6 Another schematic diagram of the real-time focus area formed on the screen by the user's line of sight is shown in FIG. Figure 6 As shown, the real-time focus area ③ does not completely fall into the display area 1, but part of the real-time focus area falls into the display area 1, and part falls into the display area 2. If the overlap area corresponding to the display area 1 is 40 pixels and the overlap area corresponding to the display area 2 is 10 pixels, then the overlap area ratio corresponding to the display area 1 is 4%, the overlap area ratio corresponding to the display area 2 is 1%, and the overlap area ratio corresponding to the other display areas is 0. At this time, there is no overlap area of any display area exceeding 5%. In this case, the display area with the largest overlap area ratio can be determined as the target display area, so the display area 1 is determined as the target display area. Or in this case, there is no target display area. Based on this embodiment, the target display area that the user's line of sight is focused on can be determined.
[0100] Optionally, the preset attribute is the length of time the real-time focus area stays in the target display area;
[0101] Accordingly, Figure 7 The process of the content display method provided in the embodiment of the present application Figure 4 ,like Figure 7 As shown, S204 includes:
[0102] S701: Determine the length of time the real-time focus area stays in the target display area.
[0103] Combined with the scenario example, when users observe the screen, they will have different interests in different contents, which will be reflected in the persistence of their gaze. If they are interested in a certain content, they will stare at it for a longer time, otherwise, they will skip it. Therefore, the length of time that the user's real-time focus area stays in the display area can be used as a preset attribute. The length of time that the user's real-time focus area stays in the target display area represents the length of time that the user continues to stare at the target display area.
[0104] S702: Determine whether the time for which the real-time focus area stays in the target display area reaches a preset time.
[0105] In combination with the scenario example, the preset duration can be determined based on actual conditions. If the preset duration is determined to be two seconds, the duration that the real-time focus area stays in the target display area can be compared with two seconds.
[0106] S703: If the residence time of the real-time focus area in the target display area does not reach the preset time, it is determined that the preset attribute of the real-time focus area does not meet the trigger condition.
[0107] In combination with the scenario example, if the real-time focus area stays in the target display area for less than two seconds, it is determined that the preset attribute of the real-time focus area does not meet the trigger condition.
[0108] S704: If the residence time of the real-time focus area in the target display area reaches a preset time, it is determined that a preset attribute of the real-time focus area meets a trigger condition.
[0109] In combination with the scenario example, if the real-time focus area stays in the target display area for two seconds, it is determined that the preset attributes of the real-time focus area have met the trigger condition.
[0110] Optionally, the preset attribute of the real-time focus area can be determined according to actual conditions, and can also be the user blinking, etc. For example, through the photo of the user's head captured by the camera device, it is determined whether the user's real-time focus area has a blinking action when gazing at the target display area. If the user has a blinking action, it is determined that the preset attribute of the real-time focus area has met the trigger condition. On the contrary, if the user has no blinking action, it is determined that the preset attribute of the real-time focus area does not meet the trigger condition.
[0111] Based on the method provided in this example, it is possible to determine whether the real-time focus area meets the trigger condition, and then display the corresponding target content after the trigger condition is met, which can improve the orderliness of the target content displayed on the screen.
[0112] Optional, Figure 8 The process of the content display method provided in the embodiment of the present application Figure 5 ,like Figure 8 As shown, S701 includes:
[0113] S801: Starting from obtaining the target display area, accumulating the length of time the real-time focus area stays in the target display area from zero.
[0114] Combined with the scene example, combined with Figure 3 If the target display area is determined to be display area 1, the time is counted from zero, and the length of time the user's real-time focus area stays in display area 1 is accumulated.
[0115] S802: Obtain the real-time deviation of the real-time focus area.
[0116] In combination with the scenario example, the user's focus area on the screen will not remain stationary, the real-time focus area changes in real time, and the deviation of the real-time focus area can be determined by the displacement between the centers of the focus areas. Fig. 9 A schematic diagram of the real-time deviation of an example is shown in FIG. Fig. 9 As shown, points AB are the centers of the focus area at the previous moment and the next moment in the real-time focus area, respectively. The distance between the two centers AB is the deviation between these two moments. In this way, the deviation between any two adjacent moments is integrated to obtain the real-time deviation corresponding to the real-time focus area.
[0117] S803: If the real-time deviation does not exceed a preset threshold, the residence time is continuously accumulated.
[0118] Combined with the scenario example, the preset length can be used as the preset threshold of the deviation, and the preset threshold of the deviation can be determined according to the actual situation. If the real-time deviation of the real-time focus area does not exceed the preset threshold, it can be determined that the target display area is always display area 1, and the corresponding stay time of the real-time focus area in display area 1 can be accumulated.
[0119] S804: If the real-time deviation exceeds a preset threshold, the stay duration is reset to zero.
[0120] Combined with the scenario example, if the real-time deviation of the real-time focus area exceeds the preset threshold, it can be determined that the target display area has been changed. At this time, the target display area is no longer display area 1, so it is necessary to reset the accumulated stay time in display area 1 and then start to accumulate the stay time of the real-time focus area in the new target display area from zero. Based on the method provided in this embodiment, the stay time of the user's real-time focus area in the target display area can be obtained.
[0121] Fig.10 The process of the content display method provided in the embodiment of the present application Figure 6 ,like Fig.10 As shown, obtaining the target content corresponding to the target display area in S205 includes:
[0122] S1001. Acquire a content library corresponding to the target display area, wherein the content library includes a plurality of candidate contents.
[0123] In combination with the scenario example, different display areas on the screen library correspond to different content libraries, and the content library includes all candidate contents of the corresponding display area.
[0124] S1002: Use a recommendation algorithm to determine the priority of each candidate content.
[0125] Combined with the scenario example, the priority of each candidate content is calculated according to the recommendation algorithm. The priority can be represented by the degree of recommendation, such as the priority being expressed in the form of a percentage. The higher the degree of recommendation of the candidate content, the higher the percentage value corresponding to the candidate content.
[0126] S1003: Determine the candidate content with the highest priority as the target content.
[0127] In combination with the scenario example, all candidate contents in the content library are sorted according to priority, and the candidate content ranked first is used as the target content to be displayed in the target display area. Based on the method provided in this embodiment, the target content corresponding to the target display area can be determined.
[0128] Based on the method provided in the present application example, the target display area and target content can be determined by the user's line of sight on the focus area on the screen, and the target content can be displayed in the target display area, thereby enriching the user's operation method of selecting the target content of interest to watch on the screen and reducing the limitations of the screen during use.
[0129] Fig.11 The schematic diagram of the structure of the content display device provided in the embodiment of the present application is applied to an electronic device, wherein the electronic device has a camera device and a screen, such as Fig.11 As shown, the device comprises:
[0130] The acquisition module 111 is used to acquire the real-time movement trajectory of the user's head and the real-time rotation direction of the eyeballs in real time through the camera device;
[0131] A determination module 112, configured to determine a real-time focal area formed by the user's line of sight on the screen based on the real-time movement trajectory of the user's head and the real-time rotation direction of the eyeballs;
[0132] The determination module 112 is further configured to determine a display area on the screen where the real-time focus area stays as a target display area, wherein the screen includes a plurality of display areas;
[0133] A determination module 113, used to determine whether the preset attribute of the real-time focus area meets the trigger condition;
[0134] The acquisition module 114 is configured to acquire the target content corresponding to the target display area if the preset attribute of the real-time focus area meets the trigger condition;
[0135] The display module 115 is configured to display the target content in a target display area on the screen.
[0136] Optionally, the determination module 112 is specifically configured to determine the focus of the user's line of sight on the screen based on the real-time movement trajectory of the user's head and the real-time rotation direction of the eyeball;
[0137] The determination module 112 is further specifically configured to determine a circular area formed by taking the focus of the user's line of sight on the screen as the center and a preset length as the radius as the real-time focus area.
[0138] Optionally, the determination module 112 is further configured to obtain an area occupied by each display area on the screen;
[0139] The determination module 112 is further configured to obtain an overlap area between each display area and the real-time focus area;
[0140] The determination module 112 is further configured to compare the overlap area between each display area and the real-time focus area with the area occupied on the screen to obtain the overlap area ratio corresponding to each display area;
[0141] The determination module 112 is further configured to compare the size of the overlap area ratio corresponding to each display area with a preset ratio;
[0142] The determination module 112 is further configured to determine the display area as the target display area if the overlap area ratio corresponding to the display area exceeds the preset ratio.
[0143] Optionally, the preset attribute is the length of time the real-time focus area stays in the target display area;
[0144] Accordingly, the judgment module 113 is specifically used to determine the length of time that the real-time focus area stays in the target display area;
[0145] The judging module 113 is specifically used to judge whether the staying time of the real-time focus area in the target display area reaches a preset time;
[0146] The judging module 113 is specifically configured to judge that a preset attribute of the real-time focus area does not meet a trigger condition if the stay time of the real-time focus area in the target display area does not reach a preset time;
[0147] The judgment module 113 is specifically configured to judge whether a preset attribute of the real-time focus area meets a trigger condition if the stay time of the real-time focus area in the target display area reaches a preset time.
[0148] Optionally, the determination module 112 is further configured to, starting from obtaining the target display area, accumulate the length of time the real-time focus area stays in the target display area from zero;
[0149] The determination module 112 is further configured to obtain a real-time deviation of the real-time focus area;
[0150] The determination module 112 is further configured to continue accumulating the stay time if the real-time deviation does not exceed a preset threshold;
[0151] The determination module 112 is further configured to reset the stay duration to zero if the real-time deviation exceeds a preset threshold.
[0152] Optionally, the acquisition module 114 is specifically configured to acquire a content library corresponding to the target display area, wherein the content library includes a plurality of candidate contents;
[0153] The acquisition module 114 is further configured to use a recommendation algorithm to determine the priority of each candidate content;
[0154] The acquisition module 114 is further configured to determine the candidate content with the highest priority as the target content.
[0155] The content display device provided in the embodiment of the present application can be used to execute the technical solution of the content display method in the above embodiment. Its implementation principle and technical effect are similar and will not be repeated here.
[0156] It should be noted that it should be understood that the division of the various modules of the above device is only a division of logical functions. In actual implementation, they can be fully or partially integrated into one physical entity, or they can be physically separated. And these modules can all be implemented in the form of software called by processing elements; they can also be all implemented in the form of hardware; some modules can also be implemented in the form of software called by processing elements, and some modules can be implemented in the form of hardware. For example, the acquisition module 114 can be a separately established processing element, or it can be integrated in a chip of the above device. In addition, it can also be stored in the memory of the above device in the form of program code, and called and executed by a processing element of the above device. The function of the above acquisition module 114. The implementation of other modules is similar. In addition, all or part of these modules can be integrated together, or they can be implemented independently. The processing element here can be an integrated circuit with signal processing capabilities. In the implementation process, each step of the above method or each module above can be completed by an integrated logic circuit of hardware in the processor element or instructions in the form of software.
[0157] Fig.12 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Fig.12 As shown, the electronic device may include: a transceiver 121 , a processor 122 , and a memory 123 .
[0158] The processor 122 executes the computer execution instructions stored in the memory, so that the processor 122 executes the scheme in the above embodiment. The processor 122 can be a general-purpose processor, including a central processing unit CPU, a network processor (network processor, NP), etc.; it can also be a digital signal processor DSP, an application-specific integrated circuit ASIC, a field programmable gate array FPGA or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components.
[0159] The memory 123 is connected to the processor 122 via a system bus and completes communication between them. The memory 123 is used to store computer program instructions.
[0160] The transceiver 121 may be used to obtain tasks to be executed and configuration information of the tasks to be executed.
[0161] The system bus can be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus, etc. The system bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, only one thick line is used in the figure, but it does not mean that there is only one bus or one type of bus. The transceiver is used to realize the communication between the database access device and other computers (such as clients, read-write libraries, and read-only libraries). The memory may include random access memory (RAM) and may also include non-volatile memory.
[0162] The electronic device provided in the embodiment of the present application may be the terminal device of the above embodiment.
[0163] The embodiment of the present application also provides a chip for executing instructions, and the chip is used to execute the technical solution of the content display method in the above embodiment.
[0164] The embodiment of the present application further provides a computer-readable storage medium, in which computer instructions are stored. When the computer instructions are executed on a computer, the computer executes the technical solution of the content display method of the above embodiment.
[0165] An embodiment of the present application also provides a computer program product, which includes a computer program stored in a computer-readable storage medium. At least one processor can read the computer program from the computer-readable storage medium. When at least one processor executes the computer program, the technical solution of the content display method in the above embodiment can be implemented.
[0166] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of modules is only a logical function division, and there may be other division methods in actual implementation, such as multiple modules can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or modules, which can be electrical, mechanical or other forms.
[0167] The modules described as separate components may or may not be physically separated, and the components shown as modules may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the modules may be selected according to actual needs to implement the solution of this embodiment.
[0168] In addition, each functional module in each embodiment of the present application can be integrated into one processing unit, or each module can exist physically separately, or two or more modules can be integrated into one unit. The above-mentioned module-composed unit can be implemented in the form of hardware or in the form of hardware plus software functional units.
[0169] The above-mentioned integrated module implemented in the form of a software function module can be stored in a computer-readable storage medium. The above-mentioned software function module is stored in a storage medium, including a number of instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor to perform some steps of the methods of various embodiments of the present application.
[0170] It should be understood that the processor may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), etc. A general-purpose processor may be a microprocessor or any conventional processor. The steps of the method disclosed in the invention may be directly implemented as being executed by a hardware processor, or may be implemented by a combination of hardware and software modules in the processor.
[0171] The memory may include a high-speed RAM memory, and may also include a non-volatile storage NVM, such as at least one disk memory, and may also be a USB flash drive, a mobile hard disk, a read-only memory, a magnetic disk or an optical disk, etc.
[0172] The bus may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, the bus in the drawings of the present application is not limited to only one bus or one type of bus.
[0173] The above storage medium can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk. The storage medium can be any available medium that can be accessed by a general or special purpose computer.
[0174] An exemplary storage medium is coupled to a processor so that the processor can read information from the storage medium and write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and the storage medium can be located in an application specific integrated circuit (ASIC). Of course, the processor and the storage medium can also exist as discrete components in an electronic control unit or a main control device.
[0175] Those skilled in the art can understand that all or part of the steps of implementing the above-mentioned method embodiments can be completed by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When the program is executed, the steps of the above-mentioned method embodiments are executed; and the aforementioned storage medium includes: ROM, RAM, disk or optical disk and other media that can store program codes.
[0176] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.
Claims
1. A content display method, characterized in that: Applied to an electronic device, the electronic device is provided with a camera device and a screen, the method comprising: The camera device is used to collect the real-time movement trajectory of the user's head and the real-time rotation direction of the eyeballs in real time; Determine a real-time focal area formed by the user's line of sight on the screen based on the real-time movement trajectory of the user's head and the real-time rotation direction of the eyeballs; determining a display area on the screen where the real-time focus area stays as a target display area, wherein the screen includes a plurality of display areas; Determining whether a preset attribute of the real-time focus area satisfies a trigger condition; If the preset attribute of the real-time focus area meets the trigger condition, obtaining the target content corresponding to the target display area; The target content is displayed at a target display area on the screen.
2. The method according to claim 1, characterized in that The determining, based on the real-time movement trajectory of the user's head and the real-time rotation direction of the eyeballs, a real-time focal area formed by the user's line of sight on the screen includes: Determine the focus of the user's line of sight on the screen based on the real-time movement trajectory of the user's head and the real-time rotation direction of the eyeballs; A circular area formed by taking the focus of the user's line of sight on the screen as the center and a preset length as the radius is determined as the real-time focus area.
3. The method according to claim 1, characterized in that: The step of determining the display area on the screen where the real-time focus area stays as the target display area includes: Obtaining the area occupied by each display area on the screen; Obtaining an overlapping area between each display area and the real-time focus area; Comparing the overlapping area between each display area and the real-time focus area with the area occupied on the screen to obtain the overlapping area ratio corresponding to each display area; Compare the size of the overlap area ratio corresponding to each display area with the preset ratio; If the overlapping area ratio corresponding to the display area exceeds the preset ratio, the display area is determined as the target display area.
4. The method according to claim 1, characterized in that: The preset attribute is the length of time the real-time focus area stays in the target display area; Accordingly, the determining whether the preset attribute of the real-time focus area meets the trigger condition includes: Determine the length of time the real-time focus area stays in the target display area; Determine whether the time for which the real-time focus area stays in the target display area reaches a preset time; If the stay time of the real-time focus area in the target display area does not reach the preset time, it is determined that the preset attribute of the real-time focus area does not meet the trigger condition; If the stay time of the real-time focus area in the target display area reaches a preset time, it is determined that the preset attribute of the real-time focus area meets the trigger condition.
5. The method according to claim 4, characterized in that The determining the length of time the real-time focus area stays in the target display area includes: Starting from obtaining the target display area, accumulating the length of time the real-time focus area stays in the target display area from zero; Obtaining a real-time deviation of the real-time focus area; If the real-time deviation does not exceed the preset threshold, the residence time continues to be accumulated; If the real-time deviation exceeds a preset threshold, the stay duration is reset to zero.
6. The method according to any one of claims 1 to 5, characterized in that: The acquiring the target content corresponding to the target display area includes: Acquire a content library corresponding to the target display area, wherein the content library includes a plurality of candidate contents; Use a recommendation algorithm to prioritize each candidate content; The candidate content with the highest priority is determined as the target content.
7. A content display device, characterized in that: Applied to electronic equipment, the electronic equipment has a camera device and a screen, the device comprises: A collection module, used to collect the real-time movement trajectory of the user's head and the real-time rotation direction of the eyeballs in real time through the camera device; A determination module, configured to determine a real-time focal area formed by the user's line of sight on the screen based on the real-time movement trajectory of the user's head and the real-time rotation direction of the eyeballs; The determination module is further used to determine the display area on the screen where the real-time focus area stays as the target display area, wherein the screen includes a plurality of display areas; A judging module, used to judge whether the preset attribute of the real-time focus area satisfies a trigger condition; An acquisition module, configured to acquire target content corresponding to the target display area if the preset attribute of the real-time focus area meets a trigger condition; A display module is configured to display the target content in a target display area on the screen.
8. An electronic device, characterized in that: include: A processor, and a memory communicatively connected to the processor; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory to implement the method according to any one of claims 1 to 6.
9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, which are used to implement the method according to any one of claims 1 to 6 when executed by a processor.
10. A computer program product, characterized in that The invention comprises a computer program, which implements the method according to any one of claims 1 to 6 when being executed by a processor.
Citation Information
Patent Citations
Method and device for utilizing eye motion control information for search
CN107957779A
A method for acquiring focus points on a screen by using an eyeball tracking technology
CN109919065A
Screen browsing data processing method and device, medium and electronic equipment
CN111414074A
Information processing apparatus, information processing method, and program
US20210116998A1