Information preloading method and apparatus, storage medium, and electronic device

Abstract

The application discloses an information preloading method and device, a storage medium and an electronic device. It relates to the field of artificial intelligence. The method comprises the following steps: obtaining a visual focus of a user when the user uses a terminal device at a current time, determining an observation range of the visual focus on the terminal device, and obtaining a target display area; obtaining display information in the target display area, obtaining a plurality of first candidate display information, and determining whether preset display information exists; in the case where the preset display information exists, determining the preset display information as to-be-loaded information, and loading information content of the to-be-loaded information; in the case where the preset display information does not exist, determining the first candidate display information located at a preset position of the target display area as to-be-loaded information, and loading content of the to-be-loaded information. Through the application, the problem that the efficiency of the user in viewing display content is low due to the need for the user to wait for content loading after the user clicks to-be-displayed content in the related art is solved.

Description

Technical Field

[0001] This application relates to the field of artificial intelligence, and more specifically, to an information preloading method, apparatus, storage medium, and electronic device. Background Technology

[0002] As applications are continuously updated and iterated, their functions also gradually increase. Therefore, when users interact with an application and click on sub-content such as subroutines, images, or videos, the application needs to wait for the click before loading the content. This results in users having to wait multiple times when viewing information within the application, wasting their time. For example, in a certain online banking app, there are subroutines for bank card application and points inquiry. When a user wants to inquire about their points, the app needs to load the user's points information after the user clicks the points inquiry icon, causing the user to wait for the loading process.

[0003] There is currently no effective solution to the problem that users have to wait for content to load after clicking on it, which results in low efficiency in viewing the displayed content. Summary of the Invention

[0004] This application provides an information preloading method, apparatus, storage medium, and electronic device to solve the problem in the related art where users have to wait for the content to load after clicking on it, resulting in low efficiency for users to view the displayed content.

[0005] According to one aspect of this application, an information preloading method is provided. The method includes: acquiring the visual focus of a user using a terminal device at a current moment, and determining the observation range of the visual focus on the terminal device to obtain a target display area; acquiring display information in the target display area to obtain multiple first candidate display information, and determining whether preset display information exists among the multiple first candidate display information, wherein the preset display information is determined through the user's historical behavior information; if preset display information exists among the multiple first candidate display information, determining the preset display information as information to be loaded, and loading the information content of the information to be loaded; if preset display information does not exist among the multiple first candidate display information, determining the first candidate display information located at a preset position in the target display area as information to be loaded, and loading the information content of the information to be loaded.

[0006] Optionally, after loading the information content of the information to be loaded, the method further includes: obtaining information clicked by the user to obtain user browsing information; determining whether the user browsing information is the information to be loaded; if the user browsing information is not the information to be loaded, obtaining the coordinate information of the user browsing information on the terminal device to obtain first coordinate information; obtaining the coordinate information of the information to be loaded on the terminal device to obtain second coordinate information; determining the coordinate deviation between the first coordinate information and the second coordinate information, and storing the coordinate deviation in the user's historical behavior information, wherein the coordinate deviation is used to adjust the user's visual focus the next time the user uses the terminal device.

[0007] Optionally, obtaining the user's visual focus when using the terminal device at the current moment includes: obtaining the user's eye image information sent by the terminal device, wherein the terminal device captures the user's eye image through a camera and identifies the eye image information from the eye image; inputting the eye image information into a first preset model to obtain the user's visual focus, wherein the first preset model is obtained by training a machine learning model through sample information, and the sample information includes multiple historical eye image information and the focus position corresponding to each eye image information.

[0008] Optionally, after determining the observation range of the visual focus on the terminal device and obtaining the target display area, the method further includes: acquiring the user's visual focus when using the terminal device at the previous moment, and determining the observation range of the visual focus on the terminal device to obtain an initial display area; determining whether the similarity between the initial display area and the target display area is greater than or equal to a preset similarity, wherein the similarity is determined by the overlap rate between the initial display area and the target display area; if the similarity is greater than or equal to the preset similarity, performing the step of acquiring display information in the target display area to obtain multiple first candidate display information; if the similarity is less than the preset similarity, determining that the user is in a browsing state, and re-performing the step of acquiring the user's visual focus when using the terminal device at the current moment.

[0009] Optionally, obtaining display information in the display area to obtain multiple first candidate display information includes: obtaining coordinate information of the display area on the screen of the terminal device; determining the arrangement information of multiple display information of the terminal device at the current moment; determining multiple display information associated with the coordinate information in the arrangement information to obtain multiple first candidate display information.

[0010] Optionally, before determining whether preset display information exists among multiple first candidate display information, the method further includes: acquiring multiple historical browsing information of the user, and sorting the multiple historical browsing information in descending order of browsing count to obtain a target sequence; determining whether the maximum browsing count in the target sequence is greater than or equal to a preset number; if the maximum browsing count in the target sequence is greater than or equal to the preset number, determining the historical browsing information in the target sequence with a browsing count greater than or equal to the preset number as preset display information; if the maximum browsing count in the target sequence is less than the preset number, acquiring the user's user information, and inputting the user information into a second preset model to obtain the preset display information corresponding to the user, wherein the second preset model is trained using multiple historical user information and the preset display information corresponding to each historical user information as sample data.

[0011] Optionally, after determining whether preset display information exists among the multiple first candidate display information, the method further includes: if preset display information does not exist among the multiple first candidate display information, expanding the target display area with a preset position of the target display area as the center to obtain an updated target display area; obtaining display information in the updated target display area to obtain multiple second candidate display information, and determining whether preset display information exists among the multiple second candidate display information; if preset display information exists among the multiple second candidate display information, determining the preset display information as information to be loaded, and loading the information content of the information to be loaded; if preset display information does not exist among the multiple second candidate display information, determining the candidate display information located at a preset position of the target display area as information to be loaded, and loading the information content of the information to be loaded.

[0012] According to another aspect of this application, an information preloading device is provided. The device includes: a first acquisition unit, configured to acquire the visual focus of a user using a terminal device at a current moment, and determine the observation range of the visual focus on the terminal device to obtain a target display area; a second acquisition unit, configured to acquire display information in the target display area, obtain a plurality of first candidate display information, and determine whether preset display information exists among the plurality of first candidate display information, wherein the preset display information is determined through the user's historical behavior information; a first determination unit, configured to, if preset display information exists among the plurality of first candidate display information, determine the preset display information as information to be loaded, and load the information content of the information to be loaded; and a second determination unit, configured to, if preset display information does not exist among the plurality of first candidate display information, determine the first candidate display information located at a preset position in the target display area as information to be loaded, and load the information content of the information to be loaded.

[0013] According to another aspect of the present invention, a computer storage medium is also provided for storing a program, wherein the program, when running, controls the device where the computer storage medium is located to execute an information preloading method.

[0014] According to another aspect of the present invention, an electronic device is also provided, comprising one or more processors and a memory; the memory stores computer-readable instructions, and the processor is configured to execute the computer-readable instructions, wherein the computer-readable instructions execute an information preloading method when they are run.

[0015] This application employs the following steps: obtaining the user's visual focus when using the terminal device at the current moment, and determining the observation range of the visual focus on the terminal device to obtain a target display area; obtaining display information in the target display area to obtain multiple first candidate display information, and determining whether there is preset display information among the multiple first candidate display information, wherein the preset display information is determined through the user's historical behavior information; if preset display information exists among the multiple first candidate display information, the preset display information is determined as the information to be loaded, and the information content of the information to be loaded is loaded; if preset display information does not exist among the multiple first candidate display information, the first candidate display information located at a preset position in the target display area is determined as the information to be loaded, and the information content of the information to be loaded is loaded. This solves the problem in related technologies where users need to wait for the content to be displayed to load after clicking on it, resulting in low efficiency for users viewing the displayed content. Based on the user's historical behavior information, the system determines the user's frequently used information to be loaded, and based on the user's visual information, it determines the user's visual focus and loads the frequently used information to be loaded from the visual focus. This achieves the goal of accurately determining the information to be loaded that is suitable for each user. Furthermore, by determining the user's focus, the system predicts the user's click position and preloads the information at the predicted position, thereby ensuring that the loaded content minimizes the memory usage. Attached Figure Description

[0016] The accompanying drawings, which form part of this application, are used to provide a further understanding of this application. The illustrative embodiments and descriptions of this application are used to explain this application and do not constitute an undue limitation of this application. In the drawings:

[0017] Figure 1 This is a flowchart of an information preloading method provided according to an embodiment of this application;

[0018] Figure 2 This is a schematic diagram of optional terminal device display content provided according to the embodiments of this application. Figure 1 ;

[0019] Figure 3 This is a schematic diagram of optional terminal device display content provided according to the embodiments of this application. Figure 2 ;

[0020] Figure 4 This is a schematic diagram of optional terminal device display content provided according to the embodiments of this application. Figure 3 ;

[0021] Figure 5 This is a flowchart of an optional information preloading method provided according to an embodiment of this application;

[0022] Figure 6 This is a schematic diagram of an information preloading device provided according to an embodiment of this application;

[0023] Figure 7 This is a schematic diagram of an electronic device provided according to an embodiment of this application. Detailed Implementation

[0024] It should be noted that, unless otherwise specified, the embodiments and features described in this application can be combined with each other. This application will now be described in detail with reference to the accompanying drawings and embodiments.

[0025] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present application, and not all embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative effort should fall within the scope of protection of the present application.

[0026] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate for the embodiments of this application described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0027] It should be noted that all information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for display, data used for analysis, etc.) involved in this disclosure are information and data authorized by the user or fully authorized by all parties. For example, this system has an interface with relevant users or organizations. Before obtaining relevant information, it is necessary to send an acquisition request to the aforementioned user or organization through the interface, and obtain the relevant information after receiving consent information from the aforementioned user or organization.

[0028] It should be noted that the information preloading method, apparatus, storage medium and electronic device defined in this disclosure can be used in the field of artificial intelligence, or in any field other than artificial intelligence. The application fields of the information preloading method, apparatus, storage medium and electronic device defined in this disclosure are not limited.

[0029] According to an embodiment of this application, an information preloading method is provided.

[0030] Figure 1 This is a flowchart of an information preloading method provided according to an embodiment of this application. For example... Figure 1 As shown, the method includes the following steps:

[0031] Step S101: Obtain the user's visual focus when using the terminal device at the current moment, and determine the observation range of the visual focus on the terminal device to obtain the target display area.

[0032] Specifically, the terminal device can be a user's mobile phone, tablet computer, or other electronic device. When the user runs an application on the terminal device, the device's camera can capture the user's facial image at a fixed acquisition frequency. Based on the eye image of the facial image, the position of the user's pupils can be determined. Based on the pupil position, the user's observation range on the terminal device can be determined, thus obtaining the target display area, which is the area that the user is currently observing.

[0033] Step S102: Obtain display information in the target display area, obtain multiple first candidate display information, and determine whether there is preset display information among the multiple first candidate display information, wherein the preset display information is determined by the user's historical behavior information.

[0034] Specifically, after determining the target display area currently being observed by the user, the content being viewed by the user can be determined based on the current display interface. Since it is impossible to accurately determine a specific content to be loaded through the user's visual focus, all display information in the target display area can be obtained to obtain multiple first candidate display information. Based on the user's corresponding preset display information, it can be determined whether the preset display information exists among the first candidate display information. The preset display information can be determined by obtaining the user's historical browsing records. Based on the historical browsing records, the display information that the user frequently visits can be determined, and the importance of the display information can be increased. The display information with the highest importance can be determined as the preset display information.

[0035] Step S103: If there is preset display information among multiple first candidate display information, the preset display information is determined as the information to be loaded, and the information content of the information to be loaded is loaded.

[0036] Specifically, if a preset display information exists among multiple first-candidate display information, indicating that the user is more likely to click on the preset display information, the information content of the preset display information among the multiple first-candidate display information can be preloaded, thereby reducing the user's waiting time when the user clicks.

[0037] Figure 2 This is a schematic diagram of optional terminal device display content provided according to the embodiments of this application. Figure 1 ,like Figure 2 As shown in the figure, the mobile phone can be a terminal device, and each small square in the figure is a display information, which can represent application content and other information. When the target display area is determined to be the circular area in the figure by the user's visual focus, it can be determined whether there is preset display information among the display information 1-4 in the figure. If the display information 3 is the preset display information, the information content in the display information 3 can be preloaded so that when the user clicks on the display information 3, the information of the next layer of the interface can be loaded directly.

[0038] Step S104: If there is no preset display information among the multiple first candidate display information, the first candidate display information located at the preset position in the target display area is determined as the information to be loaded, and the information content of the information to be loaded is loaded.

[0039] Specifically, when a user may want to click on new display content, or when the user is a new user and there is no preset display information for that user, there is no preset display information among the multiple first candidate display information. In this case, the first candidate display information at a preset position in the target display area can be determined as the information to be loaded. For example, the first candidate display information at the center position of the target display area can be determined as the information to be loaded, and the information content in the information to be loaded can be loaded.

[0040] For example, such as Figure 2 As shown, if there is no preset display information in the target display area of ​​the figure, it can be predicted that the display information that the user may click is the display information No. 1 in the center position. Therefore, the information content in display information No. 1 can be preloaded so that when the user clicks display information No. 1, the information of the next layer interface can be loaded directly.

[0041] The information preloading method provided in this application embodiment obtains the user's visual focus when using the terminal device at the current moment and determines the observation range of the visual focus on the terminal device to obtain a target display area; obtains display information in the target display area to obtain multiple first candidate display information, and determines whether there is preset display information among the multiple first candidate display information, wherein the preset display information is determined through the user's historical behavior information; if preset display information exists among the multiple first candidate display information, the preset display information is determined as the information to be loaded, and the information content of the information to be loaded is loaded; if preset display information does not exist among the multiple first candidate display information, the first candidate display information located at a preset position in the target display area is determined as the information to be loaded, and the information content of the information to be loaded is loaded. This solves the problem in related technologies where users need to wait for the content to be displayed to load after clicking on it, resulting in low efficiency for users to view the displayed content. Based on the user's historical behavior information, the frequently used information to be loaded for the user is determined. Based on the user's visual information, the user's visual focus is determined, and the frequently used information to be loaded from the visual focus is loaded. This achieves the goal of accurately determining the information to be loaded that is suitable for each user. Furthermore, by determining the user's focus, the user's click position is predicted, and the information of the predicted position is preloaded, thereby ensuring that the loaded content minimizes the memory usage.

[0042] Optionally, in the information preloading method provided in this application embodiment, after loading the information content of the information to be loaded, the method further includes: obtaining information clicked by the user to obtain user browsing information; determining whether the user browsing information is information to be loaded; if the user browsing information is not information to be loaded, obtaining the coordinate information of the user browsing information on the terminal device to obtain first coordinate information; obtaining the coordinate information of the information to be loaded on the terminal device to obtain second coordinate information; determining the coordinate deviation between the first coordinate information and the second coordinate information, and storing the coordinate deviation in the user's historical behavior information, wherein the coordinate deviation is used to adjust the user's visual focus when the user uses the terminal device next time.

[0043] Specifically, after loading the information content to be loaded, it can be determined whether the information clicked by the user is the predicted information to be loaded. If it is not the information to be loaded, it indicates that the content clicked by the user is not the information in focus. Therefore, it is necessary to determine the position information of the information clicked by the user and the information to be loaded in the display interface, and determine the coordinate deviation between the two positions. This position deviation is then associated with the user. When the user reopens the display interface, the user's focus position and coordinate deviation can be combined to more accurately predict the display information that the user wants to click, thereby more accurately determining the information to be loaded.

[0044] For example, Figure 3 This is a schematic diagram of optional terminal device display content provided according to the embodiments of this application. Figure 2 ,like Figure 3 As shown, after determining the target display area 1 based on the user's visual focus, the information the user is about to click can be predicted to be display information number 1. However, if the user actually clicks display information number 5, the coordinate deviation between display information number 1 and display information number 5 can be determined. The next time the user opens the interface, after determining the target display area 2 based on the user's visual focus, the predicted display information the user is about to click can be adjusted from display information number 6 to display information number 7 based on the coordinate deviation, thereby improving the accuracy of the prediction of the information to be loaded for the user.

[0045] Optionally, in the information preloading method provided in this application embodiment, obtaining the user's visual focus when using the terminal device at the current moment includes: obtaining user eye image information sent by the terminal device, wherein the terminal device captures the user's eye image through a camera and identifies eye image information from the eye image; inputting the eye image information into a first preset model to obtain the user's visual focus, wherein the first preset model is obtained by training a machine learning model through sample information, and the sample information includes multiple historical eye image information and the focus position corresponding to each eye image information.

[0046] Specifically, human eye images are characterized by a darker central area, a whiter outer area around the pupil, and strong contrast. Currently, the front-facing cameras of commonly used smart terminals have tens of millions of pixels and high dynamic capture capabilities. They can acquire grayscale images of the user's face at a certain frequency and identify and focus on the user's eyes to obtain the user's eye image.

[0047] Furthermore, after obtaining the human eye image, it can be input into the first preset model. The CNN convolutional neural network model uses the darker pixel area of ​​the pupil as the tracking focus. By continuously capturing and cropping the grayscale change trend of the pixel area of ​​the eye image, the focus position and movement direction of the user's pupil are determined, thereby obtaining the user's visual focus. The first preset model can be a trained CNN (Convolutional Neural Networks) model. It can be trained with a large amount of human eye information and the focus position confirmed by the user, so as to accurately determine the user's focus position based on the user's eye information.

[0048] It should be noted that when a change in the user's gaze is detected, a general range of eye focus can be defined based on the user's scanning or gazing direction. If the camera supports focal length information reading, the user's field of view in the display area can be further calculated based on the user's gaze angle, focal length, and other information to more accurately determine the user's focus position, thereby accurately determining the user's focus position information and thus accurately determining the information the user is currently focusing on.

[0049] Optionally, in the information preloading method provided in this application embodiment, after determining the observation range of the visual focus on the terminal device and obtaining the target display area, the method further includes: obtaining the user's visual focus when using the terminal device at the previous moment, and determining the observation range of the visual focus on the terminal device to obtain an initial display area; determining whether the similarity between the initial display area and the target display area is greater than or equal to a preset similarity, wherein the similarity is determined by the overlap rate between the initial display area and the target display area; if the similarity is greater than or equal to the preset similarity, performing the step of obtaining display information in the target display area to obtain multiple first candidate display information; if the similarity is less than the preset similarity, determining that the user is in a browsing state, and re-performing the step of obtaining the user's visual focus when using the terminal device at the current moment.

[0050] Specifically, a user's visual focus might move too quickly, meaning the user is browsing content rather than intending to click on it. To prevent excessive preloading of display information due to incorrect detection in this scenario, it's necessary to determine if the user's visual focus lingers at a particular position for the required duration. Therefore, this can be achieved by detecting the user's previous visual focus and determining its observation range on the device, thus obtaining the initial display area. Comparing this initial area with the target display area helps determine if there's a significant offset between the user's previous and current observation positions. The similarity between the initial and target display areas can be used to determine the shift, and the user's browsing state can be established based on this shift. If the user is browsing, the current determination of loading information can be skipped, and the information to be loaded can be determined at the next visual focus acquisition moment.

[0051] Optionally, in the information preloading method provided in this application embodiment, obtaining display information in the display area and obtaining multiple first candidate display information includes: obtaining coordinate information of the display area on the screen of the terminal device; determining the arrangement information of multiple display information of the terminal device at the current moment; determining multiple display information associated with the coordinate information in the arrangement information to obtain multiple first candidate display information.

[0052] Specifically, after determining the display area, the coordinate information of the display area on the terminal device can be determined, and the layout information of the currently displayed information on the terminal device can be determined. Based on the layout information and coordinate information, the display information in the layout information corresponding to the coordinate information can be determined, thereby determining multiple first candidate display information corresponding to the user's visual focus.

[0053] It should be noted that if the system detects that the user is swiping the screen, the system can combine the intersection of the screen swiping direction and the pupil movement direction to determine the area of ​​interest. This area can then be used as the display area observed by the user, and the coordinate information of this display area can be obtained, thereby improving the accuracy of determining the information to be loaded.

[0054] Optionally, in the information preloading method provided in this application embodiment, before determining whether preset display information exists among multiple first candidate display information, the method further includes: obtaining multiple historical browsing information of the user, and sorting the multiple historical browsing information in descending order of browsing count to obtain a target sequence; determining whether the maximum browsing count in the target sequence is greater than or equal to a preset number; if the maximum browsing count in the target sequence is greater than or equal to the preset number, determining the historical browsing information in the target sequence with a browsing count greater than or equal to the preset number as preset display information; if the maximum browsing count in the target sequence is less than the preset number, obtaining the user's user information, and inputting the user information into a second preset model to obtain the preset display information corresponding to the user, wherein the second preset model is trained using multiple historical user information and the preset display information corresponding to each historical user information as sample data.

[0055] Specifically, when determining the preset display information for each user, the system can obtain the user's historical browsing information and select the most frequently viewed content from multiple historical browsing records as the preset display content for that user. It can also fully utilize the system's backend historical data, including the user's periodic (up to three months) historical transaction data (which may include transaction time, transaction type, etc.) and user profile features within the system (including user occupation, gender, age, consumption preferences, income, and user operating habits at different times). These historical data are input into a trained Long Short-Term Memory (LSTM) network model to generate a ranking of the user's current behavior, thus obtaining the preset display information generated by the algorithm. The trained LTM network model can be trained using a large amount of user historical data and the user's actual browsing information, enabling the LTM network model to predict the information that the user might be interested in based on user information, thereby obtaining the preset display information.

[0056] Optionally, in the information preloading method provided in this application embodiment, after determining whether preset display information exists among the multiple first candidate display information, the method further includes: if preset display information does not exist among the multiple first candidate display information, expanding the target display area with a preset position of the target display area as the center to obtain an updated target display area; obtaining display information in the updated target display area to obtain multiple second candidate display information, and determining whether preset display information exists among the multiple second candidate display information; if preset display information exists among the multiple second candidate display information, determining the preset display information as information to be loaded, and loading the information content of the information to be loaded; if preset display information does not exist among the multiple second candidate display information, determining the candidate display information located at a preset position of the target display area as information to be loaded, and loading the information content of the information to be loaded.

[0057] Specifically, to address scenarios where visual divergence might cause actual operations to deviate from the visual focus, if no preset display information exists among multiple first candidate display information, the target display area can be expanded to a newer target display area centered on a preset position. Within this newer target display area, it can be determined whether preset display information exists. If so, the display content within the preset display information is preloaded. If not, the candidate display information located at the preset position within the target display area is then identified as the information to be loaded, thereby improving the accuracy of predicting the display content the user wants to click.

[0058] For example, Figure 4 This is a schematic diagram of optional terminal device display content provided according to the embodiments of this application. Figure 3 ,like Figure 4 As shown, after obtaining the target display area, multiple first candidate display information can be identified as display information 1-4. However, if display information 1-4 is not among the preset display information, the target display area can be expanded to obtain an updated target display area. Then, multiple first candidate display information in the updated target display area can be identified as display information 1-9. If display information 7 is the preset display information, the display content in display information 7 can be preloaded, thereby improving the prediction accuracy of the display content that the user wants to click.

[0059] Figure 5 This is a flowchart of an optional information preloading method provided according to an embodiment of this application, such as... Figure 5As shown, the user's eye image information can first be obtained through the camera of the terminal device. The eye image is then input into the first preset model. The CNN convolutional neural network model uses the darker pixel area of ​​the pupil as the tracking focus. By continuously capturing and cropping the grayscale change trend of the pixel in the eye image area, the focus position and movement direction of the user's pupil are determined, thereby obtaining the user's visual focus. The first preset model can be a trained CNN convolutional neural network model. It can be trained with a large amount of human eye information and the focus position confirmed by the user, so as to accurately determine the user's focus position based on the user's eye information.

[0060] It should be noted that when a change in the user's gaze is detected, a general range of eye focus can be defined based on the user's scanning or gazing direction. If the camera supports focal length information reading, the user's field of view in the display area can be further calculated based on the user's gaze angle, focal length, and other information to more accurately determine the user's focus position, thereby accurately determining the user's focus position information and thus accurately determining the information the user is currently focusing on.

[0061] After determining the target display area, the system's backend historical data can be used to input the user's periodic (up to 3 months) historical transaction data (including transaction time, transaction type, etc.) and user profile features (including user occupation, gender, age, consumption preferences, income, user's operating habits at different times, etc.) into a trained Long Short-Term Memory (LSTM) network model. This generates a predicted ranking of the user's current behavior and obtains the algorithm-generated preset display information for the user. Based on the preset display information and multiple candidate display contents in the target display area, the information to be loaded is determined.

[0062] Finally, after the user clicks on an information, it can be determined whether the information clicked is the predicted information to be loaded. If it is not the information to be loaded, it indicates that the content clicked by the user is not the information in focus. Therefore, it is necessary to determine the position information of the information clicked by the user and the information to be loaded in the display interface, and determine the coordinate deviation between the two positions. This position deviation is then associated with the user. When the user reopens the display interface, the user's focus position and coordinate deviation can be combined to more accurately predict the display information that the user wants to click, thereby more accurately determining the information to be loaded.

[0063] It should be noted that the steps shown in the flowchart in the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions, and although a logical order is shown in the flowchart, in some cases the steps shown or described may be executed in a different order than that shown here.

[0064] This application also provides an information preloading device. It should be noted that the information preloading device of this application can be used to execute the information preloading method provided in this application. The information preloading device provided in this application is described below.

[0065] Figure 6 This is a schematic diagram of an information preloading device provided according to an embodiment of this application. For example... Figure 6 As shown, the device includes: a first acquisition unit 61, a second acquisition unit 62, a first determination unit 63, and a second determination unit 64.

[0066] The first acquisition unit 61 is used to acquire the visual focus of the user when using the terminal device at the current moment, and determine the observation range of the visual focus on the terminal device to obtain the target display area.

[0067] The second acquisition unit 62 is used to acquire display information in the target display area, obtain multiple first candidate display information, and determine whether there is preset display information among the multiple first candidate display information, wherein the preset display information is determined by the user's historical behavior information.

[0068] The first determining unit 63 is used to determine the preset display information as the information to be loaded when there is preset display information among multiple first candidate display information, and to load the information content of the information to be loaded.

[0069] The second determining unit 64 is used to determine the first candidate display information located at a preset position in the target display area as the information to be loaded when there is no preset display information among the multiple first candidate display information, and to load the information content of the information to be loaded.

[0070] The information preloading device provided in this application embodiment acquires the user's visual focus when using the terminal device at the current moment through a first acquisition unit 61, and determines the observation range of the visual focus on the terminal device to obtain a target display area; a second acquisition unit 62 acquires the display information in the target display area to obtain multiple first candidate display information, and determines whether there is preset display information among the multiple first candidate display information, wherein the preset display information is determined through the user's historical behavior information; if the preset display information exists among the multiple first candidate display information, a first determination unit 63 determines the preset display information as the information to be loaded, and loads the information content of the information to be loaded; if the preset display information does not exist among the multiple first candidate display information, a second determination unit 64 determines the first candidate display information located at a preset position in the target display area as the information to be loaded, and loads the information content of the information to be loaded. This solves the problem in related technologies where users need to wait for the content to be displayed to load after clicking on it, resulting in low efficiency for users to view the displayed content. Based on the user's historical behavior information, the system determines the user's frequently used information to be loaded, and based on the user's visual information, it determines the user's visual focus and loads the frequently used information to be loaded from the visual focus. This achieves the goal of accurately determining the information to be loaded that is suitable for each user. Furthermore, by determining the user's focus, the system predicts the user's click position and preloads the information at the predicted position, thereby ensuring that the loaded content minimizes the memory usage.

[0071] Optionally, in the information preloading device provided in this application embodiment, the device further includes: a third acquisition unit, used to acquire information clicked by the user to obtain user browsing information; a first judgment unit, used to determine whether the user browsing information is information to be loaded; a fourth acquisition unit, used to acquire the coordinate information of the user browsing information on the terminal device when the user browsing information is not information to be loaded, to obtain first coordinate information; a fifth acquisition unit, used to acquire the coordinate information of the information to be loaded on the terminal device, to obtain second coordinate information; and a third determination unit, used to determine the coordinate deviation between the first coordinate information and the second coordinate information, and store the coordinate deviation in the user's historical behavior information, wherein the coordinate deviation is used to adjust the user's visual focus when the user uses the terminal device next time.

[0072] Optionally, in the information preloading device provided in this application embodiment, the first acquisition unit 61 includes: a first acquisition module, used to acquire user eye image information sent by the terminal device, wherein the terminal device captures the user's eye image through a camera and identifies the eye image information from the eye image; and an input module, used to input the eye image information into a first preset model to obtain the user's visual focus, wherein the first preset model is obtained by training a machine learning model through sample information, and the sample information includes multiple historical eye image information and the focus position corresponding to each eye image information.

[0073] Optionally, in the information preloading device provided in this application embodiment, the device further includes: a sixth acquisition unit, used to acquire the user's visual focus when using the terminal device at the previous moment, and determine the observation range of the visual focus on the terminal device to obtain an initial display area; a second judgment unit, used to judge whether the similarity between the initial display area and the target display area is greater than or equal to a preset similarity, wherein the similarity is determined by the overlap rate between the initial display area and the target display area; a first execution unit, used to execute the step of acquiring display information in the target display area to obtain multiple first candidate display information when the similarity is greater than or equal to the preset similarity; and a second execution unit, used to determine that the user is in a browsing state when the similarity is less than the preset similarity, and re-execute the step of acquiring the user's visual focus when using the terminal device at the current moment.

[0074] Optionally, in the information preloading device provided in this application embodiment, the second acquisition unit 62 includes: a second acquisition module, used to acquire coordinate information of the display area on the screen of the terminal device; a first determination module, used to determine the arrangement information of multiple display information of the terminal device at the current time; and a second determination module, used to determine multiple display information associated with the coordinate information in the arrangement information to obtain multiple first candidate display information.

[0075] Optionally, in the information preloading device provided in this application embodiment, the device further includes: a seventh acquisition unit, used to acquire multiple historical browsing information of the user, and sort the multiple historical browsing information in descending order of browsing count to obtain a target sequence; a third judgment unit, used to judge whether the maximum browsing count in the target sequence is greater than or equal to a preset number; a fourth determination unit, used to determine the historical browsing information in the target sequence with a browsing count greater than or equal to the preset number as preset display information when the maximum browsing count in the target sequence is greater than or equal to the preset number; and an eighth acquisition unit, used to acquire the user information of the user when the maximum browsing count in the target sequence is less than the preset number, and input the user information into a second preset model to obtain the preset display information corresponding to the user, wherein the second preset model is trained using multiple historical user information and the preset display information corresponding to each historical user information as sample data.

[0076] Optionally, in the information preloading device provided in the embodiments of this application, the device further includes: an expansion unit, used to expand the target display area with a preset position of the target display area as the center to obtain an updated target display area when there is no preset display information among the multiple first candidate display information; a fourth determination unit, used to obtain display information in the updated target display area to obtain multiple second candidate display information, and determine whether there is preset display information among the multiple second candidate display information; a fifth determination unit, used to determine the preset display information as the information to be loaded when there is preset display information among the multiple second candidate display information, and load the information content of the information to be loaded; and a sixth determination unit, used to determine the candidate display information located at a preset position of the target display area as the information to be loaded when there is no preset display information among the multiple second candidate display information, and load the information content of the information to be loaded.

[0077] The aforementioned information preloading device includes a processor and a memory. The first acquisition unit 61, the second acquisition unit 62, the first determination unit 63, the second determination unit 64, etc., are all stored in the memory as program units. The processor executes the aforementioned program units stored in the memory to realize the corresponding functions.

[0078] The processor contains a kernel, which retrieves the corresponding program unit from memory. One or more kernels can be configured, and adjusting kernel parameters can address the problem in related technologies where users have to wait for content to load after clicking on it, resulting in low efficiency when viewing displayed content.

[0079] The memory may include non-permanent memory in computer-readable media, such as random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM, and the memory includes at least one memory chip.

[0080] This invention provides a computer-readable storage medium storing a program thereon, which, when executed by a processor, implements the information preloading method.

[0081] This invention provides a processor for running a program, wherein the program executes the information preloading method during runtime.

[0082] like Figure 7 As shown, this embodiment of the invention provides an electronic device 70, which includes a processor, a memory, and a program stored in the memory and executable on the processor. When the processor executes the program, it performs the following steps: acquiring the user's visual focus when using the terminal device at the current moment, and determining the observation range of the visual focus on the terminal device to obtain a target display area; acquiring display information in the target display area to obtain multiple first candidate display information, and determining whether preset display information exists among the multiple first candidate display information, wherein the preset display information is determined through the user's historical behavior information; if preset display information exists among the multiple first candidate display information, determining the preset display information as information to be loaded, and loading the information content of the information to be loaded; if preset display information does not exist among the multiple first candidate display information, determining the first candidate display information located at a preset position in the target display area as information to be loaded, and loading the information content of the information to be loaded. The device in this document can be a server, PC, PAD, mobile phone, etc.

[0083] This application also provides a computer program product, which, when executed on a data processing device, is suitable for executing an initialization program with the following method steps: obtaining the user's visual focus when using the terminal device at the current moment, and determining the observation range of the visual focus on the terminal device to obtain a target display area; obtaining display information in the target display area to obtain multiple first candidate display information, and determining whether there is preset display information among the multiple first candidate display information, wherein the preset display information is determined through the user's historical behavior information; if preset display information exists among the multiple first candidate display information, determining the preset display information as information to be loaded, and loading the information content of the information to be loaded; if preset display information does not exist among the multiple first candidate display information, determining the first candidate display information located at a preset position in the target display area as information to be loaded, and loading the information content of the information to be loaded.

[0084] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0085] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart... Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0086] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0087] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0088] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0089] Memory may include non-persistent memory in computer-readable media, such as random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM. Memory is an example of computer-readable media.

[0090] Computer-readable media includes both permanent and non-permanent, removable and non-removable media that can store information using any method or technology. Information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, CD-ROM, digital versatile optical disc (DVD) or other optical storage, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transferable medium that can be used to store information accessible by a computing device. As defined herein, computer-readable media does not include transient computer-readable media, such as modulated data signals and carrier waves.

[0091] It should also be noted that the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.

[0092] The above are merely embodiments of this application and are not intended to limit the scope of this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the scope of the claims of this application.

Claims

1. An information preloading method, characterized in that, include: Obtain the user's visual focus when using the terminal device at the current moment, and determine the observation range of the visual focus on the terminal device to obtain the target display area; The display information in the target display area is obtained to obtain multiple first candidate display information, and it is determined whether there is preset display information among the multiple first candidate display information, wherein the preset display information is determined by the user's historical behavior information; The process of obtaining display information in the display area to obtain multiple first candidate display information includes: obtaining coordinate information of the display area on the screen of the terminal device; determining the arrangement information of multiple display information of the terminal device at the current time; determining multiple display information associated with the coordinate information in the arrangement information to obtain the multiple first candidate display information. If the preset display information exists among the plurality of first candidate display information, the preset display information is determined as the information to be loaded, and the information content of the information to be loaded is loaded. If the preset display information is not present among the plurality of first candidate display information, the first candidate display information located at a preset position in the target display area is determined as the information to be loaded, and the information content of the information to be loaded is loaded.

2. The method according to claim 1, characterized in that, After loading the information content of the information to be loaded, the method further includes: Obtain the user's click information to obtain the user's browsing information; Determine whether the user browsing information is the information to be loaded; If the user browsing information is not the information to be loaded, obtain the coordinate information of the user browsing information on the terminal device to obtain the first coordinate information; Obtain the coordinate information of the information to be loaded on the terminal device to obtain the second coordinate information; The coordinate deviation between the first coordinate information and the second coordinate information is determined, and the coordinate deviation is stored in the user's historical behavior information, wherein the coordinate deviation is used to adjust the user's visual focus when the user uses the terminal device next time.

3. The method of claim 1, wherein, Obtaining the user's visual focus when using the terminal device at the current moment includes: The terminal device acquires user eye image information sent by the terminal device, wherein the terminal device captures the user's eye image through a camera and identifies the eye image information from the eye image; The human eye image information is input into a first preset model to obtain the user's visual focus. The first preset model is obtained by training a machine learning model with sample information, which includes multiple historical human eye image information and the focus position corresponding to each human eye image information.

4. The method of claim 1, wherein, After determining the observation range of the visual focus on the terminal device and obtaining the target display area, the method further includes: The visual focus of the user when using the terminal device at the previous moment is obtained, and the observation range of the visual focus on the terminal device is determined to obtain the initial display area; Determine whether the similarity between the initial display area and the target display area is greater than or equal to a preset similarity, wherein the similarity is determined by the overlap rate between the initial display area and the target display area; If the similarity is greater than or equal to the preset similarity, the step of obtaining display information in the target display area to obtain multiple first candidate display information is performed; If the similarity is less than the preset similarity, it is determined that the user is in a browsing state, and the step of obtaining the user's visual focus when using the terminal device at the current moment is re-executed.

5. The method of claim 1, wherein, Before determining whether preset display information exists among the plurality of first candidate display information, the method further includes: Obtain multiple historical browsing information records of the user, and sort the multiple historical browsing information records from largest to smallest according to the number of browsing times to obtain the target sequence; Determine whether the maximum number of views in the target sequence is greater than or equal to a preset number; If the maximum number of views in the target sequence is greater than or equal to the preset number, the historical browsing information in the target sequence with the number of views greater than or equal to the preset number is determined as the preset display information; If the maximum number of views in the target sequence is less than the preset number, the user information of the user is obtained and the user information is input into the second preset model to obtain the preset display information corresponding to the user. The second preset model is trained using multiple historical user information and the preset display information corresponding to each historical user information as sample data.

6. The method of claim 1, wherein, After determining whether preset display information exists among the plurality of first candidate display information, the method further includes: If the preset display information is not found among the plurality of first candidate display information, the target display area is expanded with the preset position of the target display area as the center to obtain an updated target display area; Obtain the display information in the updated target display area to obtain multiple second candidate display information, and determine whether the preset display information exists among the multiple second candidate display information; If the preset display information exists among the plurality of second candidate display information, the preset display information is determined as the information to be loaded, and the information content of the information to be loaded is loaded. If the preset display information is not present among the plurality of second candidate display information, the candidate display information located at a preset position in the target display area is determined as the information to be loaded, and the information content of the information to be loaded is loaded.

7. An information preloading apparatus, characterized by comprising: include: The first acquisition unit is used to acquire the visual focus of the user when using the terminal device at the current moment, and determine the observation range of the visual focus on the terminal device to obtain the target display area; The second acquisition unit is used to acquire display information in the target display area, obtain multiple first candidate display information, and determine whether there is preset display information among the multiple first candidate display information, wherein the preset display information is determined by the user's historical behavior information; The second acquisition unit includes: a second acquisition module, used to acquire coordinate information of the display area on the screen of the terminal device; a first determination module, used to determine the arrangement information of multiple display information of the terminal device at the current time; and a second determination module, used to determine multiple display information associated with the coordinate information in the arrangement information to obtain the multiple first candidate display information. The first determining unit is configured to, when the preset display information exists among the plurality of first candidate display information, determine the preset display information as the information to be loaded, and load the information content of the information to be loaded. The second determining unit is configured to, when the preset display information is not present among the plurality of first candidate display information, determine the first candidate display information located at a preset position in the target display area as the information to be loaded, and load the information content of the information to be loaded.

8. A computer storage medium, characterized in that The computer storage medium is used to store a program, wherein the program, when running, controls the device where the computer storage medium is located to execute the information preloading method according to any one of claims 1 to 6.

9. An electronic device, comprising: It includes one or more processors and a memory, the memory being used to store one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors cause the one or more processors to implement the information preloading method according to any one of claims 1 to 6.

Images