Gaze point display method and device, computer device, readable storage medium and program product

Abstract

The application relates to a gaze point display method and device, computer equipment, a readable storage medium and a program product. The method is applied to an eye movement device and comprises the following steps: acquiring an image of a detection object, and determining the position of a gaze point corresponding to the detection object according to the image; in the case that the position is located within a preset range of a target object, acquiring the staying position and the staying time length of the gaze point within a preset time period; determining a target identification mode according to the staying position and the staying time length, marking the target object according to the target identification mode, and displaying the marked target object. The method can improve the positioning accuracy.

Description

Technical Field

[0001] This application relates to the field of computer vision technology, and in particular to a gaze point display method, apparatus, computer device, computer-readable storage medium, and computer program product. Background Technology

[0002] With the development of technology, eye-tracking detection and analysis technology has been widely used in fields such as virtual reality, human-computer interaction, and healthcare. Typically, when a user uses an eye tracker or similar device, the eye tracker identifies and displays the object when the user's gaze falls on it, allowing the user to intuitively grasp the object's location.

[0003] In related technologies, the object is circled and displayed to the user. However, this method suffers from low gaze point localization accuracy and a poor user experience. Summary of the Invention

[0004] Therefore, it is necessary to provide a gaze point display method, device, computer equipment, computer-readable storage medium, and computer program product that can improve positioning accuracy in response to the above-mentioned technical problems.

[0005] In a first aspect, this application provides a method for displaying gaze points, the method being applied to an eye-tracking device, comprising:

[0006] Acquire an image of the object to be detected, and determine the position of the gaze point corresponding to the object to be detected based on the image;

[0007] When the location is within a preset range of the target object, the position and duration of the gaze point within a preset time period are obtained;

[0008] Based on the location and duration of stay, a target identification method is determined, the target object is marked according to the target identification method, and the marked target object is displayed.

[0009] In one embodiment, determining the target identification method based on the dwell location and the dwell duration includes:

[0010] If the dwelling position is within a first preset range and the dwelling time is greater than a preset time, the target identification method is determined to be to mark the target object using a preset closed shape, so that the target object is located within the preset closed shape.

[0011] In one embodiment, determining the target identification method based on the dwell location and the dwell duration includes:

[0012] If the dwelling position is within a second preset range and the dwelling duration is greater than a preset duration, a sub-region corresponding to the dwelling position is determined, wherein the sub-region is obtained by dividing the target object according to the feature information of the target object;

[0013] The target identification method is determined by using a preset dot-shaped graphic to mark the center position of the sub-region.

[0014] In one embodiment, determining the target identification method based on the dwell location and the dwell duration includes:

[0015] If the dwelling location is within a third preset range and the dwelling duration is greater than a preset duration, the target identification method is to mark the dwelling location using a preset positioning identifier, wherein the positioning accuracy of the preset positioning identifier is greater than a preset accuracy.

[0016] In one embodiment, after marking the target object, the following is further included:

[0017] Based on the target identification method and the stopping position, determine the identification area corresponding to the target object;

[0018] Obtain the area information corresponding to the identified area and display the area information.

[0019] In one embodiment, the method for determining the target object includes:

[0020] Acquire images within the gaze range of the detected object;

[0021] The image is input into a preset recognition model, which outputs the target object within the gaze range. The preset recognition model is trained based on the correspondence between the image and the corresponding target object label.

[0022] Secondly, this application also provides a gaze point display device, which is applied to an eye-tracking device and includes:

[0023] The first acquisition module is used to acquire an image of the object to be detected and to determine the position of the gaze point corresponding to the object to be detected based on the image.

[0024] The second acquisition module is used to acquire the location and duration of the gaze point within a preset time period when the location is within a preset range of the target object.

[0025] The marking module is used to determine the target identification method based on the dwell position and the dwell time, mark the target object according to the target identification method, and display the marked target object.

[0026] In one embodiment, the marking module is further configured to:

[0027] If the dwelling position is within a first preset range and the dwelling time is greater than a preset time, the target identification method is determined to be to mark the target object using a preset closed shape, so that the target object is located within the preset closed shape.

[0028] In one embodiment, the marking module is further configured to:

[0029] If the dwelling position is within a second preset range and the dwelling duration is greater than a preset duration, a sub-region corresponding to the dwelling position is determined, wherein the sub-region is obtained by dividing the target object according to the feature information of the target object;

[0030] The target identification method is determined by using a preset dot-shaped graphic to mark the center position of the sub-region.

[0031] In one embodiment, the marking module is further configured to:

[0032] If the dwelling location is within a third preset range and the dwelling duration is greater than a preset duration, the target identification method is to mark the dwelling location using a preset positioning identifier, wherein the positioning accuracy of the preset positioning identifier is greater than a preset accuracy.

[0033] In one embodiment, the device is further used to:

[0034] Based on the target identification method and the stopping position, determine the identification area corresponding to the target object;

[0035] Obtain the area information corresponding to the identified area and display the area information.

[0036] In one embodiment, the apparatus further includes a target object determination module, the target object determination module being configured to:

[0037] Acquire images within the gaze range of the detected object;

[0038] The image is input into a preset recognition model, which outputs the target object within the gaze range. The preset recognition model is trained based on the correspondence between the image and the corresponding target object label.

[0039] Thirdly, embodiments of this disclosure also provide a computer device. The computer device includes a memory and a processor, the memory storing a computer program, and the processor executing the computer program to implement the steps of the method described in any one of the embodiments of this disclosure.

[0040] Fourthly, embodiments of this disclosure also provide a computer-readable storage medium. The computer-readable storage medium stores a computer program thereon, which, when executed by a processor, implements the steps of the method described in any one of the embodiments of this disclosure.

[0041] Fifthly, embodiments of this disclosure also provide a computer program product. The computer program product includes a computer program that, when executed by a processor, implements the steps of the method described in any one of the embodiments of this disclosure.

[0042] The aforementioned gaze point display method, apparatus, computer equipment, computer-readable storage medium, and computer program product acquire an image of the detected object and determine the position of the corresponding gaze point. When the gaze point is within a preset range of the target object, the method acquires the dwell position and dwell duration. Based on the dwell position and dwell duration, it determines the target identification method and marks the target object according to the identification method, then displays the marked target object. This allows for setting different identification methods based on specific gaze point dwell information when the gaze point of the detected object falls within the preset range of the target object, effectively improving the accuracy and reliability of the marking. Further determination of the dwell position and dwell duration enables precise display of the detected object's focus on the target object, improving the display effect and enhancing the user experience; it also further improves the positioning accuracy of the focus point, making it suitable for more application scenarios. Attached Figure Description

[0043] To more clearly illustrate the technical solutions in the embodiments of this application or related technologies, the drawings used in the description of the embodiments of this application or related technologies will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.

[0044] Figure 1 This is a flowchart illustrating a gaze point display method in one embodiment;

[0045] Figure 2 This is a flowchart illustrating the gaze point display method in another embodiment;

[0046] Figure 3 This is a flowchart illustrating how the target object is determined in one embodiment;

[0047] Figure 4 This is a structural block diagram of a gaze point display device in one embodiment;

[0048] Figure 5 This is an internal structural diagram of a computer device in one embodiment. Detailed Implementation

[0049] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.

[0050] In one embodiment, such as Figure 1 As shown, a method for displaying gaze points is provided, the method being applied to an eye-tracking device, comprising:

[0051] Step S110: Acquire an image of the object to be detected, and determine the position of the gaze point corresponding to the object to be detected based on the image;

[0052] In some possible implementations, the core principle of eye-tracking devices is to capture the characteristics of human eye movements using optical sensors (such as infrared cameras) and combine this with algorithms to calculate the direction of gaze or the position of the fixation point. Common techniques include corneal reflection: using infrared light to illuminate the eye, and calculating the eye rotation angle by detecting changes in the relative position of the corneal reflection point and the pupil center; pupil tracking: identifying changes in the pupil outline or center position and mapping them to screen coordinates using calibration data; and feature point analysis: combining iris texture, eyelid, or vascular features to assist tracking and improve robustness. When the eye tracker is connected to a terminal (such as a computer, mobile phone, or dedicated device), the terminal can be used for data processing and calculation. For example, it can receive raw data from the eye tracker in real time (such as pupil coordinates and blink frequency), convert it into fixation point coordinates or gaze path using algorithms, run calibration programs, and establish a mapping model between eye movements and screen positions. The terminal can also be used for user interaction and display, showing calibration interfaces, experimental tasks, or interactive content (such as web pages and videos) for users to gaze at or operate, and outputting visualization results (such as heatmaps and gaze trajectories) for researchers to analyze. The terminal can also be used for data storage and analysis, storing eye-tracking data (timestamps, gaze duration, saccade paths, etc.) to support subsequent statistical analysis or machine learning. The terminal can also be used for feedback and control; in medical or interactive scenarios, it can convert gaze signals into control commands (such as typing or manipulating a wheelchair); in VR / AR, it can dynamically adjust the rendered content based on gaze (such as foveated rendering technology).

[0053] For example, an image of the object to be detected is acquired, which can be obtained through a preset image acquisition device. The position of the gaze point corresponding to the object to be detected is determined based on the image. In one example, the biometric data of the object to be detected can be determined based on the image, and the position of the gaze point corresponding to the object to be detected is determined based on the correspondence between the biometric data and the gaze position.

[0054] Optionally, the image of the object to be detected can be an image containing the biometric data of the object to be detected. The biometric data may include, but is not limited to, pupil feature data, corneal feature data, etc., which can be determined according to the actual application scenario.

[0055] Step S120: If the position is within a preset range of the target object, obtain the location and duration of the gaze point within a preset time period;

[0056] For example, after obtaining the location of the gaze point, if the location of the gaze point is within a preset range of the target object, the location and duration of the gaze point within a preset time period are further obtained.

[0057] Optionally, the target object can be determined in advance based on the actual application scenario. In one example, the target object can be identified using a preset recognition model; in another example, the target object can be an object placed within the gaze range in advance. The preset time period can be determined based on the actual application scenario, and the attention level of the detected object to the target object can be judged by the gaze point information within the preset time period.

[0058] In some possible implementations, the fixation position is matched with the fixation duration, with different fixation positions corresponding to different fixation durations, which can be determined based on the actual application scenario. In one example, images of the detected object can be acquired and processed in real time within a preset time period to obtain the real-time position and fixation status of the object's gaze point. Based on the real-time position and fixation status, the fixation position and corresponding fixation duration are determined.

[0059] Step S130: Determine the target identification method based on the dwelling location and dwelling duration, mark the target object according to the target identification method, and display the marked target object.

[0060] For example, different dwell positions and dwell durations can correspond to different labeling methods. The target labeling method is determined based on the dwell position and dwell duration. In one example, the dwell position and dwell duration can be used to determine the level of attention the detected object pays to the target object. The target labeling method is determined based on the different levels of attention. Different labeling methods can correspond to different labeling images, labeling ranges, etc., which can be determined according to the actual application scenario.

[0061] Optionally, after determining the target identification method, the target object is marked according to the target identification method, and the marked target object is displayed. In one example, the marked target object can be displayed on the screen of the eye-tracking device. In another example, the marked target object can be sent to a preset account for subsequent analysis and processing.

[0062] This embodiment acquires an image of the detected object and determines the position of the corresponding gaze point. When the gaze point is within a preset range of the target object, the dwell position and dwell time are acquired. Based on the dwell position and dwell time, a target identification method is determined, and the target object is marked according to the identification method. The marked target object is then displayed. This allows for setting different identification methods based on specific gaze point dwell information when the gaze point of the detected object falls within the preset range of the target object, effectively improving the accuracy and reliability of the marking. Further determination of the dwell position and dwell time allows for precise display of the detected object's focus on the target object, improving the display effect and enhancing the user experience; it also further improves the positioning accuracy of the focus point, making it suitable for more application scenarios.

[0063] In one embodiment, determining the target identification method based on the dwell location and the dwell duration includes:

[0064] If the dwelling position is within a first preset range and the dwelling time is greater than a preset time, the target identification method is determined to be to mark the target object using a preset closed shape, so that the target object is located within the preset closed shape.

[0065] For example, when the dwell position is within a first preset range and the dwell time is greater than a preset time, it can be considered that the detected object is interested in the first preset range. The first preset range can be determined based on the actual application scenario. In one example, the first preset range can be a range corresponding to the target object that does not include the target object's detailed features or regional features. When the dwell time within this range is greater than the preset time, it can be considered that the detected object is interested in the target object as a whole. In this case, the target identification method is to mark the target object using a preset closed shape, so that the target object is located within the preset closed shape.

[0066] In some possible implementations, the target object can be identified and classified using a preset classification algorithm to obtain a first preset range, a second preset range, and a third preset range containing different features.

[0067] Optionally, the preset duration can be determined based on the actual application scenario. When the dwell time exceeds the preset duration, it can be considered that the detected object has a high level of attention to the dwell position. The preset closed shape can include, but is not limited to, circles, rectangles, etc., and can be specifically determined based on the shape of the target object. In one example, when the dwell position is within the first preset range and the dwell time exceeds the preset duration, the attention type can be determined as regional attention. Taking the advertising design evaluation scenario as an example, regional attention can correspond to the layout in advertising design. Through regional attention, it can be determined whether the target object focuses on the text or the image.

[0068] In this embodiment of the present disclosure, when the stopping position is within a first preset range, a preset closed shape is used to mark the target object so that the target object is located within the preset closed shape. This allows the target object to be enclosed by the closed image when the area of ​​interest is large, thus ensuring the marking effect.

[0069] In one embodiment, such as Figure 2 As shown, the method of determining the target identifier based on the dwelling location and the dwelling duration includes:

[0070] Step S121: When the dwelling position is within the second preset range and the dwelling time is greater than the preset time, determine the sub-region corresponding to the dwelling position, wherein the sub-region is obtained by dividing the target object according to the feature information of the target object;

[0071] Step S122: Determine the target identification method as using a preset dot-shaped graphic to mark the center position of the sub-region.

[0072] For example, when the dwell position is within a second preset range and the dwell time exceeds a preset time, it can be considered that the detected object is interested in the second preset range. The second preset range can be determined based on the actual application scenario. In one example, the second preset range can be the range corresponding to the target object that includes the regional features of the target object. When the dwell time within this range exceeds the preset time, it can be considered that the detected object is interested in a portion of the target object. In this case, the interested region can be marked to determine the sub-region corresponding to the dwell position. The sub-region can be divided based on the features of different regions of the target object.

[0073] Optionally, the target identification method can be determined by using a preset dot-shaped graphic to mark the center position of the sub-region.

[0074] Optionally, the preset duration can be determined based on the actual application scenario. When the dwell time exceeds the preset duration, it can be considered that the detected object has a high level of attention to the dwell position. The preset dot-shaped graphic can include, but is not limited to, dots, etc., and can be specifically determined based on the shape of the sub-region. In one example, when the dwell position is within the second preset range and the dwell time exceeds the preset duration, the attention type can be determined as high-precision attention. Taking the advertising design evaluation scenario as an example, high-precision attention can correspond to the text of the advertising slogan, the tagline, or a highlight logo in the image design.

[0075] In this embodiment of the present disclosure, when the dwell position is within a second preset range, a sub-region corresponding to the dwell position is determined, and the center position of the sub-region is marked using a preset dot-shaped graphic. This enables the corresponding sub-region to be accurately marked using a preset dot-shaped image when detecting a local area of ​​the target object, thereby improving the marking accuracy.

[0076] In one embodiment, determining the target identification method based on the dwell location and the dwell duration includes:

[0077] If the dwelling location is within a third preset range and the dwelling duration is greater than a preset duration, the target identification method is to mark the dwelling location using a preset positioning identifier, wherein the positioning accuracy of the preset positioning identifier is greater than a preset accuracy.

[0078] For example, when the dwell position is within a third preset range and the dwell time exceeds a preset time, it can be considered that the detected object is interested in the third preset range. The third preset range can be determined based on the actual application scenario. In one example, the third preset range can be a range corresponding to the target object that includes the detailed features of the target object. When the dwell time within this range exceeds the preset time, it can be considered that the detected object is interested in the fine details of the target object. In this case, the target identification method can be determined as marking the dwell position using a preset positioning identifier.

[0079] Optionally, the preset duration can be determined based on the actual application scenario. When the dwell time exceeds the preset duration, it can be considered that the detected object has a high level of attention to the dwell position. Preset positioning markers can include, but are not limited to, crosshairs, etc. These markers can accurately locate the gaze point, and their positioning accuracy is greater than the preset accuracy, which can be determined based on the actual application scenario. In one example, when the dwell position is within the third preset range and the dwell time exceeds the preset duration, the attention type can be determined as detail attention. Taking an advertising design evaluation scenario as an example, detail attention could correspond to a specific word in a slogan, a specific curve in a logo, etc.

[0080] In this embodiment of the disclosure, when the dwell position is within a third preset range, the dwell position is marked by a preset positioning identifier. This allows for direct marking of the dwell position of the gaze point when detecting details of the target object being focused on, ensuring the accuracy of the marking and making it applicable to more application scenarios.

[0081] In one embodiment, after marking the target object, the method further includes:

[0082] Based on the target identification method and the stopping position, determine the identification area corresponding to the target object;

[0083] Obtain the area information corresponding to the identified area and display the area information.

[0084] For example, after marking a target object, information such as metrics can also be displayed when showing the marked target object. In some possible implementations, a corresponding marking area is determined based on the target marking method and the stopping position. Different marking methods correspond to different marking area sizes, and different stopping positions correspond to different marking areas. The specifics can be determined according to the actual application scenario.

[0085] Optionally, the region information corresponding to the identified region can be obtained and displayed. This region information may include, but is not limited to, the size, color, and shape of the object within the identified region, which can be determined based on the specific application scenario. In one example, the region information can be obtained by identifying and detecting the target object using a preset recognition algorithm.

[0086] In this embodiment of the disclosure, the area information of the marked area is displayed together with the marking, so that the detected object or other objects can obtain specific information of the point of interest. This refines the display of information and, compared with displaying all the information of the target object together, effectively improves the efficiency and relevance of information display, enhances the user experience, and is applicable to more application scenarios.

[0087] In one embodiment, such as Figure 3 As shown, the method for determining the target object includes:

[0088] Step S310: Obtain an image within the gaze range of the detected object;

[0089] Step S320: Input the image into a preset recognition model, and output the target object within the gaze range through the preset recognition model. The preset recognition model is trained based on the correspondence between the image and the corresponding target object label.

[0090] For example, target objects are automatically identified using a preset recognition model. This preset recognition model can be built upon a target object detection algorithm and trained using the correspondence between image samples and their corresponding target object labels. In one example, the target object detection algorithm may include, but is not limited to, the YOLO algorithm, and can be determined based on the specific application scenario. In another example, a corresponding preset recognition model can be trained according to actual needs to identify different types of target objects.

[0091] Optionally, an image within the gaze range of the target object is acquired, and the image is input into a preset recognition model. The preset recognition model outputs the target object within the gaze range. The target object may include one or more objects, which can be determined according to the actual application scenario. In one example, the preset recognition model may also output information such as the category and size of the target object.

[0092] In this embodiment of the disclosure, an image within the gaze range is identified by a preset recognition model to obtain the corresponding target object. This enables the rapid and accurate automatic acquisition of the target image within the gaze range of the detected object, facilitating subsequent judgment of gaze points and execution of the marking process.

[0093] In some possible implementations, various identification methods can be used to identify and display the target object according to the actual application scenario.

[0094] For example, the regions can be categorized based on the range of different dwelling positions. These categories are: regional focus, high-precision focus, and detail focus. Regional focus is used to determine whether the viewpoint is on a target object, such as a button or image. High-precision focus is suitable for areas with multiple small targets or local features, such as icons or text. Detail focus precisely locates targets at the pixel level, such as a single character or image details.

[0095] This embodiment avoids the problem of unclear markings, quickly and accurately determines the attention status of the detected object, and is applicable to more application scenarios.

[0096] It should be understood that although the steps in the flowcharts of the embodiments described above are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowcharts of the embodiments described above may include multiple steps or multiple stages. These steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least a portion of the steps or stages of other steps.

[0097] Based on the same inventive concept, this application also provides a gaze point display device for implementing the gaze point display method described above. The solution provided by this device is similar to the solution described in the above method; therefore, the specific limitations in one or more gaze point display device embodiments provided below can be found in the limitations of the gaze point display method described above, and will not be repeated here.

[0098] In one exemplary embodiment, such as Figure 4 As shown, a gaze point display device 400 is provided, which is applied to an eye-tracking device and includes:

[0099] The first acquisition module 410 is used to acquire an image of the object to be detected and to determine the position of the gaze point corresponding to the object to be detected based on the image.

[0100] The second acquisition module 420 is used to acquire the location and duration of the gaze point within a preset time period when the location is within a preset range of the target object.

[0101] The marking module 430 is used to determine the target marking method according to the dwell position and the dwell time, mark the target object according to the target marking method, and display the marked target object.

[0102] In one embodiment, the marking module is further configured to:

[0103] If the dwelling position is within a first preset range and the dwelling time is greater than a preset time, the target identification method is determined to be to mark the target object using a preset closed shape, so that the target object is located within the preset closed shape.

[0104] In one embodiment, the marking module is further configured to:

[0105] If the dwelling position is within a second preset range and the dwelling duration is greater than a preset duration, a sub-region corresponding to the dwelling position is determined, wherein the sub-region is obtained by dividing the target object according to the feature information of the target object;

[0106] The target identification method is determined by using a preset dot-shaped graphic to mark the center position of the sub-region.

[0107] In one embodiment, the marking module is further configured to:

[0108] If the dwelling location is within a third preset range and the dwelling duration is greater than a preset duration, the target identification method is to mark the dwelling location using a preset positioning identifier, wherein the positioning accuracy of the preset positioning identifier is greater than a preset accuracy.

[0109] In one embodiment, the device is further used to:

[0110] Based on the target identification method and the stopping position, determine the identification area corresponding to the target object;

[0111] Obtain the area information corresponding to the identified area and display the area information.

[0112] In one embodiment, the apparatus further includes a target object determination module, the target object determination module being configured to:

[0113] Acquire images within the gaze range of the detected object;

[0114] The image is input into a preset recognition model, which outputs the target object within the gaze range. The preset recognition model is trained based on the correspondence between the image and the corresponding target object label.

[0115] The modules in the aforementioned gaze point display device can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in or independent of the processor in a computer device, or stored in the memory of a computer device as software, so that the processor can call and execute the operations corresponding to each module.

[0116] In one exemplary embodiment, a computer device is provided, which may be a server, and its internal structure diagram may be as follows: Figure 5As shown, the computer device includes a processor, memory, input / output (I / O) interfaces, and a communication interface. The processor, memory, and I / O interfaces are connected via a system bus, and the communication interface is also connected to the system bus via the I / O interfaces. The processor provides computational and control capabilities. The memory includes a non-volatile storage medium and internal memory. The non-volatile storage medium stores the operating system, computer programs, and a database. The internal memory provides an environment for the operation of the operating system and computer programs stored in the non-volatile storage medium. The database stores data related to the methods described in this embodiment, such as the position of the gaze point. The I / O interfaces are used for exchanging information between the processor and external devices. The communication interface is used for communicating with external terminals via a network connection. When the computer program is executed by the processor, it implements a gaze point display method.

[0117] Those skilled in the art will understand that Figure 5 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the computer device to which the present application is applied. Specific computer devices may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0118] In one embodiment, a computer device is also provided, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to implement the steps in the above method embodiments.

[0119] In one embodiment, a computer-readable storage medium is provided having a computer program stored thereon that, when executed by a processor, implements the steps in the above method embodiments.

[0120] In one embodiment, a computer program product is provided, including a computer program that, when executed by a processor, implements the steps in the above method embodiments.

[0121] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of the relevant data must comply with relevant regulations.

[0122] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. Any references to memory, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM). The databases involved in the embodiments provided in this application may include at least one type of relational database and non-relational database. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the embodiments provided in this application may be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, quantum computing-based data processing logic devices, artificial intelligence (AI) processors, etc., and are not limited to these.

[0123] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0124] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are specific and detailed, they should not be construed as limiting the scope of this patent application. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this application should be determined by the appended claims.

Claims

1. A method for displaying gaze points, characterized in that, The method is applied to eye-tracking devices, including: Acquire an image of the object to be detected, and determine the position of the gaze point corresponding to the object to be detected based on the image; When the location is within a preset range of the target object, the position and duration of the gaze point within a preset time period are obtained; Based on the location and duration of stay, a target identification method is determined, the target object is marked according to the target identification method, and the marked target object is displayed.

2. The method according to claim 1, characterized in that, The method of determining the target identification based on the dwell location and the dwell duration includes: If the dwelling position is within a first preset range and the dwelling time is greater than a preset time, the target identification method is determined to be to mark the target object using a preset closed shape, so that the target object is located within the preset closed shape.

3. The method according to claim 1, characterized in that, The method of determining the target identification based on the dwell location and the dwell duration includes: If the dwelling position is within a second preset range and the dwelling duration is greater than a preset duration, a sub-region corresponding to the dwelling position is determined, wherein the sub-region is obtained by dividing the target object according to the feature information of the target object; The target identification method is determined by using a preset dot-shaped graphic to mark the center position of the sub-region.

4. The method according to claim 1, characterized in that, The method of determining the target identification based on the dwell location and the dwell duration includes: If the dwelling location is within a third preset range and the dwelling duration is greater than a preset duration, the target identification method is to mark the dwelling location using a preset positioning identifier, wherein the positioning accuracy of the preset positioning identifier is greater than a preset accuracy.

5. The method according to claim 1, characterized in that, Following the labeling of the target object, the following is also included: Based on the target identification method and the stopping position, determine the identification area corresponding to the target object; Obtain the area information corresponding to the identified area and display the area information.

6. The method according to claim 1, characterized in that, The method for determining the target object includes: Acquire images within the gaze range of the detected object; The image is input into a preset recognition model, which outputs the target object within the gaze range. The preset recognition model is trained based on the correspondence between the image and the corresponding target object label.

7. A gaze point display device, characterized in that, The device is used in eye-tracking devices and includes: The first acquisition module is used to acquire an image of the object to be detected and to determine the position of the gaze point corresponding to the object to be detected based on the image. The second acquisition module is used to acquire the location and duration of the gaze point within a preset time period when the location is within a preset range of the target object. The marking module is used to determine the target identification method based on the dwell position and the dwell time, mark the target object according to the target identification method, and display the marked target object.

8. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that, When the processor executes the computer program, it implements the steps of the method according to any one of claims 1 to 6.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 6.

10. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 6.

Images