Light source coding method and device based on eye movement tracking, equipment and storage medium

Abstract

The invention discloses a light source coding method and device based on eye movement tracking, equipment and a storage medium, and relates to the technical field of data processing, and the light source coding method based on eye movement tracking comprises the steps: driving a plurality of light sources to emit light signals towards the eyes of a user, and collecting image data, the image data comprises a reflected light signal formed after the light signal is transmitted to the eyes of the user and is reflected; determining the pixel position of the reflected light signal in the image data, and coding according to the brightness change corresponding to the pixel position to obtain an actual code; matching the actual code with a light source code corresponding to each light source to obtain a matched light source code; and determining a flash point corresponding to the eyes of the user according to the pixel position, and constructing a corresponding relationship between a light source corresponding to the matched light source code and the flash point. The accuracy of determining the corresponding relation between the multiple light sources and the flashing points can be improved.

Description

Technical Field

[0001] The present application relates to the technical field of data processing, and particularly to a light source encoding method, device, equipment and storage medium based on eye tracking. Background Art

[0002] With the development of XR (Extended Reality) and VR (Virtual Reality) technologies, people have higher and higher requirements for head-mounted devices, putting forward higher requirements for battery life, high resolution, low latency, etc.

[0003] The head-mounted device includes an eye tracking system for determining the gaze direction of the user of the head-mounted device. The current eye tracking system uses a frequency division method to obtain the correspondence between the glint point (flash point) and the light source. However, the number of light sources that can be used is limited under the combined limitations of the total transmission bandwidth and the protection bandwidth. Therefore, a situation will occur where as the number of light sources increases, the total code length of the encoding will also increase, resulting in a decrease in the final available frequency, and thus the correspondence between the light source and the flash point cannot be accurately determined. Summary of the Invention

[0004] The main purpose of the present application is to provide a light source encoding method, device, equipment and storage medium based on eye tracking, aiming to solve the technical problem of how to improve the accuracy of determining the correspondence between multiple light sources and flash points.

[0005] To achieve the above object, the present application provides a light source encoding method based on eye tracking. The light source encoding method based on eye tracking includes the following steps:

[0006] Drive multiple light sources to emit optical signals towards the user's eyes, and collect image data, where the image data includes the reflected optical signals formed after the optical signals are emitted to the user's eyes and reflected.

[0007] Determine the pixel positions of the reflected optical signals in the image data, and perform encoding based on the brightness changes corresponding to the pixel positions to obtain the actual encoding.

[0008] Match the actual encoding with the light source encoding corresponding to each light source to obtain the matching light source encoding.

[0009] Determine the flash points corresponding to the user's eyes based on the pixel positions, and construct the correspondence between the light sources corresponding to the matching light source encoding and the flash points.

[0010] Optionally, the step of performing encoding based on the brightness changes corresponding to the pixel positions to obtain the actual encoding includes:

[0011] Determine the number of light sources among the multiple light sources, and divide the light source brightness of the light sources according to the number of light sources to obtain multiple brightness values;

[0012] Determine the initial brightness value corresponding to the reflected light signal at the pixel position according to each brightness value, and perform encoding according to the brightness change corresponding to the initial brightness value to obtain the actual encoding.

[0013] Optionally, the step of dividing the light source brightness of the light sources according to the number of light sources to obtain multiple brightness values includes:

[0014] Determine the code bits corresponding to the number of light sources, and determine the maximum light source brightness and the minimum light source brightness of the light sources;

[0015] Divide the brightness value range between the minimum light source brightness and the maximum light source brightness according to the code bits to obtain multiple brightness values.

[0016] Optionally, the step of performing encoding according to the brightness change corresponding to the initial brightness value to obtain the actual encoding includes:

[0017] Detect the brightness change of the initial brightness value. If the initial brightness value after detecting the brightness change matches the preset photosensitive threshold, generate a binary identifier, and continue to detect the brightness change of the initial brightness value after the brightness change until binary identifiers with the same number as the number of code bits are obtained, and construct the actual encoding according to all the obtained binary identifiers.

[0018] Optionally, the step of generating a binary identifier if the brightness value after detecting the brightness change matches the preset photosensitive threshold includes:

[0019] If it is detected that the brightness change corresponding to the initial brightness value is a decrease in brightness value, and the initial brightness value decreases to a first brightness value, determine the first brightness difference between the first brightness value and the initial brightness value;

[0020] If the first brightness difference matches the preset photosensitive threshold, generate a first identifier and use the first identifier as the binary identifier.

[0021] Optionally, the step of generating a binary identifier if the brightness value after detecting the brightness change matches the preset photosensitive threshold includes:

[0022] If it is detected that the brightness change corresponding to the initial brightness value is an increase in brightness value, and the initial brightness value increases to a second brightness value, determine the second brightness difference between the second brightness value and the initial brightness value;

[0023] If the second brightness difference matches a preset photosensitive threshold, a second identifier is generated and used as a binary identifier.

[0024] Optionally, the step of detecting the brightness change of the initial brightness value includes:

[0025] Determine the initial virtual image in each frame of virtual image included in the image data that matches the initial brightness value;

[0026] Based on the acquisition time corresponding to each frame of virtual image, determine other virtual images after the initial virtual image, and determine the target brightness value of the reflected light signal at the pixel position in the other virtual images;

[0027] Determine the brightness change based on the difference between the target brightness value and the initial brightness value, where the brightness change includes a decrease in brightness value and an increase in brightness value.

[0028] In addition, to achieve the above object, the present application also provides an eye movement tracking-based light source encoding device, and the eye movement tracking-based light source encoding device includes:

[0029] A driving module for driving a plurality of light sources to emit light signals towards the user's eyes and collecting image data, where the image data includes the reflected light signals formed after the light signals are emitted to the user's eyes and reflected;

[0030] An encoding module for determining the pixel position of the reflected light signal in the image data, encoding based on the brightness change corresponding to the pixel position to obtain an actual encoding;

[0031] A matching module for matching the actual encoding with the light source encoding corresponding to each light source to obtain a matching light source encoding;

[0032] A construction module for determining the flash point corresponding to the user's eyes based on the pixel position and constructing the corresponding relationship between the light source corresponding to the matching light source encoding and the flash point.

[0033] The present application also provides an eye movement tracking-based light source encoding device. The eye movement tracking-based light source encoding device is a physical device, and the eye movement tracking-based light source encoding device includes: a memory, a processor, and a program of the eye movement tracking-based light source encoding method stored on the memory and executable on the processor. When the program of the eye movement tracking-based light source encoding method is executed by the processor, the steps of the eye movement tracking-based light source encoding method as described above can be implemented.

[0034] The present application also provides a readable storage medium, which is the computer-readable storage medium. A program for implementing the light source encoding method based on eye tracking is stored on the computer-readable storage medium. The program for implementing the light source encoding method based on eye tracking is executed by a processor to implement the steps of the light source encoding method based on eye tracking as described above.

[0035] The present application also provides a computer program product, including a computer program, and the steps of the light source encoding method based on eye tracking as described above are implemented when the computer program is executed by a processor.

[0036] The technical solution of the present application is to drive multiple light sources to emit light signals towards the user's eyes, collect image data with reflected light signals formed after being reflected by the user's eyes, perform encoding according to the brightness change corresponding to the pixel position of the reflected light signal in the image data to obtain an actual encoding, match the actual encoding with the light source encoding corresponding to each light source to obtain a matching light source encoding, determine the flash point according to the pixel position, and construct a corresponding relationship between the light source corresponding to the matching light source encoding and the flash point. Thus, it is possible to achieve continuous encoding of different light sources based on the brightness change of the light source without adding hardware devices, and when determining the corresponding relationship between the light source and the flash point, it is possible to avoid the phenomenon that the current method using frequency discrimination cannot accurately determine the corresponding relationship between multiple light sources and flash points. By using the brightness change to distinguish the actual encoding corresponding to different flash points and constructing the corresponding relationship between the light source and the flash point based on the light source encoding matching the actual encoding, it is possible to not consider the frequency and distinguish the light sources through the brightness change, thereby improving the accuracy of determining the corresponding relationship between multiple light sources and flash points. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] The accompanying drawings here are incorporated into the specification and constitute a part of this specification, showing embodiments consistent with the present application, and are used together with the specification to explain the principles of the present application.

[0038] In order to more clearly illustrate the technical solutions in the embodiments or the prior art, the following will briefly introduce the accompanying drawings required for use in the description of the embodiments or the prior art. Obviously, for those of ordinary skill in the art, other accompanying drawings can be obtained based on these drawings without creative efforts.

[0039] Figure 1 It is a schematic flowchart of the first embodiment of the light source encoding method based on eye tracking in the present application;

[0040] Figure 2 It is a schematic diagram of the brightness value division scenario in the first embodiment of the light source encoding method based on eye tracking in the present application;

[0041] Figure 3 This is a schematic flowchart of the second embodiment in the light source encoding method based on eye tracking of the present application;

[0042] Figure 4 This is a schematic diagram of a module structure of the light source encoding device based on eye tracking of the present application;

[0043] Figure 5 This is a schematic diagram of the device structure of the hardware operating environment involved in the device in this embodiment.

[0044] The implementation, functional features, and advantages of the present application will be further described with reference to the embodiments and the accompanying drawings. Detailed implementation manners

[0045] To make the above objects, features, and advantages of the present application more obvious and understandable, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.

[0046] The embodiments of the present application can be a system for encoding the brightness of a light source (such as an LED light source) and using an event camera to collect the reflected flash points of the user's eyes, and can image the flash points during the eye tracking process of the event camera and distinguish the corresponding relationship between different flash points and the LED light source by encoding.

[0047] Optionally, the embodiments of the present application can encode the light source in combination with the signal characteristics of the event camera, and realize continuous encoding of the light source signal based on the light source brightness and the photosensitive threshold of the event camera without adding hardware devices. And under multiple light source conditions, the flash point information collected by the event camera can be corresponding to the light sources one by one. And by dividing the light source brightness, controlling the change of the light source intensity, controlling the event camera to output 0 and 1 encodings, and then aligning the encoding of the light source with the encoding of the flash point one by one, the corresponding relationship between multiple light sources and flash points can be accurately determined.

[0048] Embodiment 1

[0049] Based on this, please refer to Figure 1 , this embodiment provides a light source encoding method based on eye tracking, and the light source encoding method based on eye tracking includes:

[0050] Step S10 drives multiple light sources to emit light signals towards the user's eyes and collects image data, where the image data includes the reflected light signals formed after the light signals are emitted to and reflected by the user's eyes;

[0051] Step S20 determines the pixel positions of the reflected light signals in the image data, and encodes according to the brightness changes corresponding to the pixel positions to obtain the actual encoding;

[0052] Step S30 matches the actual encoding with the light source encoding corresponding to each light source to obtain the matching light source encoding;

[0053] Step S40 determines the flash points corresponding to the user's eyes according to the pixel positions, and constructs the corresponding relationship between the light sources corresponding to the matching light source encoding and the flash points.

[0054] This application can be applied to a head-mounted device, in which at least an event camera and a processor are provided. Among them, the characteristic of the event camera is that the information output by the event camera is different from that of a traditional CMOS sensor. The event camera captures "events", that is, the changes in pixel brightness. That is, the event camera outputs the changes in pixel brightness. And when the brightness change of a certain pixel accumulates to a certain threshold, an event is output. For example, when the brightness increases, the event camera outputs a 1 event. When the brightness decreases, the event camera outputs a 0 event. Then, encoding is performed according to the events output by the event camera to determine the actual encoding of the pixel position, that is, to determine the actual encoding of the flash point.

[0055] Optionally, it is necessary to divide the light source brightness. The required number of bits can be determined according to the number of light sources, and the light source brightness is divided according to the required number of bits. For example, according to the number of bits n, the brightness region between the maximum brightness and the minimum brightness corresponding to the light source brightness is divided into 2n segments. Taking the four-bit binary identification code from 0000 to 1111 as an example. If the divided brightness values are as Figure 2 shown, the lowest brightness of the light source is 0, the highest brightness is 8. After division, different brightness values are obtained, that is, the brightness values are 0, 1, 2, 3, 4, 5, 6, 7, 8. And it is assumed that if the intermediate brightness value of the light source is the initial state of the light source, then when increasing the light source brightness, a 1 event is output, and when decreasing the light source brightness, a 0 event is output. In this way, the complete encoding from 0000 to 1111 can be covered. And the bit information at the same position can be recognized by the event camera, so as to correspond to the encoding of the light source, and the one-to-one correspondence between the light source and the flash point is realized. For example, the light source encoding is 0000, and the brightness state corresponding to the light source is 4-3-2-1-0. The light source encoding is 1111, and the brightness state corresponding to the light source is 4-5-6-7-8. The light source encoding is 1010, and the brightness state corresponding to the light source is 4-5-4-5-4.

[0056] Optionally, the flash point may be a light point in a virtual image formed by specular reflection of the light source on the corneal surface inside the user's eye.

[0057] Optionally, in the head-mounted device, an eye tracking system is provided, and the eye tracking system can determine the gaze direction of the user's eye according to the position of the flash point (i.e., the pixel value position corresponding to the flash point) and the coding.

[0058] Optionally, for step S10, drive multiple light sources to emit light signals towards the user's eye, and collect image data, where the image data includes the reflected light signals formed after the light signals are emitted to the user's eye and reflected.

[0059] Optionally, the light source may be a light source provided on the head-mounted device, and the light source may be a light-emitting diode, a flash lamp, or each lamp tube in the display of the head-mounted device, etc.

[0060] Optionally, before the head-mounted device drives multiple light sources to emit light signals towards the user's eye, the multiple light sources may be set at different positions, and only one light source is set at each position. Optionally, the light signal may be a differential light signal, where the differential light signal includes a high state and a low state. The high state represents an illumination level greater than the low state, and the high state may be the illumination state when the light source is turned on and relatively bright. The low state may be the illumination state when the light source is turned on and relatively dim. Optionally, when the head-mounted device drives multiple light sources to emit differential light signals towards the user's eye, at least one pair of light sources among the multiple light sources may be driven to emit differential light signals to the user's eye first. And after determining the correspondence between this pair of light sources and the flash point, then drive another pair of light sources to emit differential signals to the user's eye until the correspondence between all the light sources and the flash point is determined.

[0061] Optionally, the head-mounted device may also drive one light source at a time to emit light signals towards the user's eye to determine the correspondence between the light source and the flash point, and then drive other light sources to emit light signals to the user's eye until the correspondence between all the light sources and the flash point is determined.

[0062] Optionally, the head-mounted device may also drive a preset number of light sources to emit light signals towards the user's eye according to a preset rule until the correspondence between all the light sources and the flash point is determined. Optionally, the preset rule may be to screen according to the brightness and blinking frequency of each light source. The preset number should be less than or equal to the number of light sources.

[0063] Optionally, image data can be collected by an event camera, and it can be the reflected light signals formed after the light signals emitted by the light source are reflected by the user's eye, and a corresponding virtual image is generated.

[0064] Optionally, when determining to drive multiple light sources to emit light signals towards the user's eyes, the event camera can be turned on, and the virtual image with the reflected light signals reflected by the user's eyes can be captured by the event camera. At least two virtual images within a preset time period can be captured and used as image data. Optionally, the preset time period can be a pre-set time period, such as 5s, 10s, etc.

[0065] Optionally, for step S20, determine the pixel positions of the reflected light signals in the image data, and encode according to the brightness changes corresponding to the pixel positions to obtain the actual encoding.

[0066] Optionally, for each virtual image in the image data, the pixel positions of the reflected light signals in the virtual image can be determined first. Optionally, the number of pixel positions is the same as the number of reflected light signals. Optionally, the first virtual image obtained by the event camera in the image data can be selected, and the pixel positions corresponding to the reflected light signals within the first virtual image can be determined. Then, the brightness change detection is performed on the pixel positions, that is, the brightness of the reflected light signals at the pixel positions is detected. The detection method can be to sequentially detect the brightness of the reflected light signals at the pixel positions according to the time sequence of capturing the virtual images to determine the brightness changes of the reflected light signals at the pixel positions, and generate corresponding events according to the generated events, and encode according to the generated events to obtain the actual encoding corresponding to the reflected light signals.

[0067] Optionally, it can also be to traverse each virtual image in the image data in the order of acquisition time to determine the pixel position points where the reflected light signals appear, perform brightness change detection on all pixel position points where the reflected light signals appear, generate corresponding events according to the detected brightness changes, and encode according to the generated events to obtain the actual encoding corresponding to the reflected light signals.

[0068] Optionally, the brightness corresponding to the pixel position points in each virtual image can be the same or different.

[0069] Optionally, for step S30, match the actual encoding with the light source encoding corresponding to each light source to obtain the matching light source encoding.

[0070] Optionally, a light source encoding corresponding to each light source can be set in advance. Optionally, the light source encodings corresponding to each light source are different. For example, the light source encoding corresponding to light source 1 is 0000, the light source encoding corresponding to light source 2 is 1111, and the encoding corresponding to light source 3 is 1010.

[0071] Optionally, when setting the light source encoding of the light source, the number of code bits can be determined according to the number of light sources, and then the light source encoding can be set according to the brightness change and the position of the light source.

[0072] Optionally, the actual encoding corresponding to each pixel position can be matched with the light source encoding corresponding to each light source to obtain the light source encoding matched with each actual encoding, and it can be used as the matching light source encoding. Optionally, the specific encoding content of the matching light source encoding can include the encoding content in the actual encoding. For example, if the actual encoding is 1010, the matching light source encoding can also be 1010.

[0073] Optionally, the number of code bits of the actual encoding is the same as the number of code bits of the light source encoding.

[0074] Optionally, for step S40, according to the pixel position, the flash point corresponding to the user's eyes is determined, and the corresponding relationship between the light source corresponding to the matching light source encoding and the flash point is constructed.

[0075] Optionally, the pixel position in the virtual image in the image data can be used as the flash point corresponding to the user's glasses, and then the corresponding relationship between the light source corresponding to this matching light source encoding and the flash point is constructed and stored. Subsequently, the head-mounted device can implement eye movement tracking of the user's eyes according to the corresponding relationship between each light source and the flash point.

[0076] Optionally, the corresponding relationship between each light source and the flash point can be constructed in the above manner.

[0077] In this embodiment, by driving multiple light sources to emit light signals towards the user's eyes, image data with reflected light signals formed after being reflected by the user's eyes is collected, encoded according to the brightness change corresponding to the pixel position of the reflected light signal in the image data to obtain the actual encoding, the actual encoding is matched with the light source encoding corresponding to each light source to obtain the matching light source encoding, and the flash point is determined according to the pixel position, and the corresponding relationship between the light source corresponding to the matching light source encoding and the flash point is constructed. Thus, it can be realized that without adding hardware devices, continuous encoding of different light sources is achieved according to the brightness change of the light source, and when determining the corresponding relationship between the light source and the flash point, the phenomenon that the corresponding relationship between multiple light sources and the flash point cannot be accurately determined due to the current method of frequency differentiation can be avoided. By using the brightness change to distinguish the actual encoding corresponding to different flash points and constructing the corresponding relationship between the light source and the flash point based on the light source encoding matched with the actual encoding, the frequency does not need to be considered, and the light sources are distinguished by the brightness change, thereby improving the accuracy of determining the corresponding relationship between multiple light sources and the flash point.

[0078] Embodiment 2

[0079] Based on the first embodiment of the present application, in another embodiment of the present application, the same or similar content as in the above-mentioned first embodiment can be referred to the above introduction and will not be repeated hereinafter. On this basis, please refer to Figure 3 , step S20, encoding according to the brightness change corresponding to the pixel position to obtain the actual encoding, including:

[0080] Step a, determining the number of light sources of the plurality of light sources, and dividing the light source brightness of the light sources according to the number of light sources to obtain a plurality of brightness values;

[0081] Step b, determining the initial brightness value corresponding to the reflected light signal at the pixel position according to each brightness value, and encoding according to the brightness change corresponding to the initial brightness value to obtain the actual encoding.

[0082] In this embodiment, the number of light sources in the head-mounted device can be determined first. Among them, the number of light sources can be the number of all light sources in the head-mounted device that are prepared to irradiate light signals to the user's eyes. Then, the brightness value corresponding to each light source is determined.

[0083] Optionally, for the brightness value of each light source, the light source brightness value can be divided according to the number of light sources to obtain a plurality of brightness values. Optionally, when dividing the light source brightness value, equal-ratio division, equal-division, or other methods can be used for division, which is not limited here.

[0084] Optionally, the virtual image where the reflected light signal first appears in the image data can be detected, and the virtual image where the reflected light signal first appears can be used as the initial virtual image, and the brightness of the pixel position point where the reflected light signal is aggregated in the initial virtual image is detected to obtain the actual brightness value, and the actual brightness value is compared with each brightness value after division of the light source corresponding to the reflected light signal (that is, the reflected light signal generated by the light source emitting a light signal to the user's eyes). The brightness value closest to the actual brightness value among each brightness value is determined, and this closest brightness value is used as the initial brightness value.

[0085] Optionally, for each light source, this method can be used to determine the initial brightness value of the reflected light signal corresponding to each light source.

[0086] Optionally, according to the chronological order of acquisition by the event camera, other virtual images after the initial virtual image can be determined, and the brightness values at the same pixel position (that is, the pixel position where the reflected light signal is located) in the other virtual images are used to determine the brightness change corresponding to the initial brightness value, and according to the brightness change, the event camera outputs corresponding events, such as 0 event or 1 event, and then encodes according to the events to obtain the actual encoding, such as 1111, 0000, etc.

[0087] In this embodiment, by dividing the light source brightness into brightness values according to the number of light sources, a plurality of brightness values are obtained. Based on each brightness value, the initial brightness value corresponding to the reflected light signal at the pixel position is determined, and encoding is performed according to the brightness change corresponding to the initial brightness value to obtain the actual encoding, thereby ensuring the accuracy of the obtained actual encoding.

[0088] Further, the step of dividing the light source brightness of the light source into brightness values according to the number of light sources includes:

[0089] Step c, determining the code bits corresponding to the number of light sources, and determining the maximum light source brightness value and the minimum light source brightness value of the light source;

[0090] Step d, dividing the brightness value range between the minimum light source brightness value and the maximum light source brightness value according to the code bits to obtain a plurality of brightness values.

[0091] In this embodiment, the code bits corresponding to the number of light sources can be determined first. Optionally, when determining the code bits, it is necessary to ensure that each light source corresponds to a light source code, and the light source code corresponding to each light source is unique. For example, if there are two light sources, the number of code bits can be determined to be 2, the light source code corresponding to light source 1 is 10, and the light source code corresponding to light source 2 is 01. If there are 8 light sources, the number of code bits can be determined to be 3. Therefore, the light source codes corresponding to these 8 light sources are 000, 001, 010, 011, 100, 101, 110, and 111 respectively.

[0092] Optionally, after determining the code bits, the maximum light source brightness value and the minimum light source brightness value of each light source can be determined. And determine the brightness value range between the minimum light source brightness value and the maximum light source brightness value, and then divide the brightness value range according to the code bits. For example, if the number of code bits is n, the brightness value range can be divided into 2^n. For example, if the number of code bits is 4, the divided brightness value range is 8, and the divided brightness value is 9.

[0093] In this embodiment, by determining the code bits corresponding to the number of light sources and dividing the brightness value range between the minimum light source brightness value and the maximum light source brightness value according to the code bits to obtain a plurality of brightness values, it is convenient to perform encoding according to different brightness values subsequently.

[0094] Further, the step of encoding according to the brightness change corresponding to the initial brightness value to obtain the actual encoding includes:

[0095] Step e: Detect the brightness change of the initial brightness value. If the initial brightness value after the detected brightness change matches the preset photosensitive threshold, generate a binary identifier, and continue to detect the brightness change of the initial brightness value after the brightness change until binary identifiers equal in number to the number of code bits are obtained, and construct an actual code based on all the obtained binary identifiers.

[0096] In this embodiment, it may be to detect the brightness change of the initial brightness value. Optionally, the detection method may be to determine the initial virtual image where the initial brightness value is located in the image data, and then sequentially determine all other virtual images whose acquisition times are sorted after the initial virtual image. Determine the brightness values of the pixel positions corresponding to the initial brightness value in all other virtual images, sort them according to the acquisition time, and determine the brightness change difference based on the sorting result. For example, if the initial brightness value is 4 and the brightness value after the brightness change is 5, it is determined that there is a brightness change in the light source corresponding to the initial brightness value, and a corresponding event is output by the event camera. Generate a binary identifier based on this event. For example, if the event is event 0, the generated binary identifier is 0. If the event is event 1, the generated binary identifier is 1.

[0097] Then continue to detect the brightness change of the brightness value after the brightness change. For example, if the initial brightness value is 4 and the brightness value after the brightness change is 5, and if the brightness value changes again, such as from 5 to 6, at this time the event camera can continue to generate a new event and generate a binary identifier based on the new event. The method of generating the binary identifier is the same and will not be elaborated here.

[0098] Optionally, after binary identifiers equal in number to the number of code bits are obtained, an actual code may be constructed based on all the obtained binary identifiers. For example, if the obtained binary identifiers are 1, 1, 1, 1, it can be determined that the actual code is 1111.

[0099] Optionally, detect the brightness change of the initial brightness value. If the initial brightness value after the detected brightness change matches the photosensitive threshold, generate a binary identifier, and use the initial brightness value after the brightness change as the new initial brightness value to detect the brightness change of the new initial brightness value. When it is detected that the new initial brightness value after the brightness change matches the photosensitive threshold, generate another binary identifier, and so on until binary identifiers equal in number to the number of code bits are obtained.

[0100] In this embodiment, by detecting the brightness change of the initial brightness value, generating a binary identifier when it is detected that the initial brightness value after the brightness change matches the photosensitive threshold, and continuing the brightness change detection until binary identifiers equal in number to the number of code bits are obtained, an actual code is constructed based on all the obtained binary identifiers.

[0101] Further, if the detected brightness value after the brightness change matches a preset photosensitive threshold, the step of generating a binary identifier includes:

[0102] Step f, if it is detected that the brightness change corresponding to the initial brightness value is a decrease in brightness value, and the initial brightness value decreases to a first brightness value, determine a first brightness difference between the first brightness value and the initial brightness value;

[0103] Step g, if the first brightness difference matches a preset photosensitive threshold, generate a first identifier and use the first identifier as the binary identifier.

[0104] In this embodiment, when it is detected that the brightness change corresponding to the initial brightness value is a decrease in brightness value, and according to the change of the virtual image in the image data, it can be determined that the initial brightness value decreases to a first brightness value. Here, the first brightness value is a brightness value set by the user and less than the initial brightness value. For example, if the initial brightness value is 4, the first brightness value can be 3.

[0105] Optionally, the absolute difference between the first brightness value and the initial brightness value can be determined first and used as the first brightness difference. Compare the first brightness difference with the photosensitive threshold set in advance in the event camera. Optionally, the photosensitive threshold can be a threshold set in advance in the event camera. For example, when the event camera detects that the brightness change reaches the photosensitive threshold, an event will be output.

[0106] Optionally, when it is detected that the first brightness difference is greater than or equal to the photosensitive threshold, it can be directly determined that the first brightness difference matches the photosensitive threshold. At this time, the event camera can output an event, and generate an identifier based on this event, that is, the first identifier, and use this first identifier as the binary identifier.

[0107] Optionally, when it is detected that the first brightness difference is less than the photosensitive threshold, it can be determined that the first brightness difference does not match the photosensitive threshold. At this time, the detection of the brightness change of the initial brightness value continues. If it is continuously detected that the brightness value decreases, and the brightness difference between the decreased brightness value and the initial brightness value matches the photosensitive threshold, a first identifier is generated. For example, if there are three frames of virtual images in the image data, if there is an initial brightness value of 6 corresponding to the reflected light signal at pixel position A in the first frame of virtual image, a brightness value of 5 corresponding to the reflected light signal at pixel position A in the second frame of virtual image, and a brightness value of 4 corresponding to the reflected light signal at pixel position A in the third frame of virtual image. If the photosensitive threshold is 2, when it is determined that the first brightness value is 5, it can be determined that the first brightness difference is 1. At this time, the first brightness difference and the photosensitive threshold do not match. At this time, the brightness value corresponding to the third frame of image can be continuously obtained, and the brightness difference between the brightness value corresponding to the third frame of image and the initial brightness value can be calculated. At this time, it can be determined that the brightness difference is equal to the photosensitive threshold. Therefore, it can be determined that the first brightness difference matches the photosensitive threshold, and a first identifier is generated, and the first identifier is used as a binary identifier.

[0108] In this embodiment, by detecting that the brightness change corresponding to the initial brightness value is a decrease in the brightness value, and the initial brightness value decreases to the first brightness value, the first brightness difference between the first brightness value and the initial brightness value is determined, and when the first brightness difference matches the photosensitive threshold, a binary identifier is generated, thereby ensuring the validity of the generated binary identifier.

[0109] Further, the step of generating a binary identifier if it is detected that the brightness value after the brightness change matches the preset photosensitive threshold includes:

[0110] Step h, if it is detected that the brightness change corresponding to the initial brightness value is an increase in the brightness value, and the initial brightness value increases to a second brightness value, determine the second brightness difference between the second brightness value and the initial brightness value;

[0111] Step i, if the second brightness difference matches the preset photosensitive threshold, generate a second identifier and use the second identifier as a binary identifier.

[0112] In this embodiment, when it is detected that the brightness change corresponding to the initial brightness value is an increase in the brightness value, and according to the change of the virtual image in the image data, it can be determined that the initial brightness value increases to the second brightness value. Among them, the second brightness value is a brightness value set by the user that is less than the initial brightness value. For example, if the initial brightness value is 4, the second brightness value can be 5.

[0113] Optionally, the absolute difference between the second brightness value and the initial brightness value can be determined first and used as the second brightness difference. The second brightness difference is compared with a pre-set photosensitive threshold in the event camera. Optionally, the photosensitive threshold can be a threshold pre-set in the event camera. For example, when the event camera detects that the brightness change reaches the photosensitive threshold, an event will be output.

[0114] Optionally, when it is detected that the second brightness difference is greater than or equal to the photosensitive threshold, it can be directly determined that the second brightness difference matches the photosensitive threshold. At this time, the event camera can output an event and generate an identifier based on this event, that is, the second identifier, and use this second identifier as the binary identifier.

[0115] Optionally, when it is detected that the second brightness difference is less than the photosensitive threshold, it can be determined that the second brightness difference does not match the photosensitive threshold. At this time, the brightness change of the initial brightness value continues to be detected. If it is continuously detected that the brightness value increases and the brightness difference between the increased brightness value and the initial brightness value matches the photosensitive threshold, a second identifier is generated.

[0116] Optionally, when it is detected that the second brightness difference is less than the photosensitive threshold, the step of detecting the brightness change of the initial brightness value continues to be executed. If it is detected that the brightness change changes from an increase in the brightness value to a decrease in the brightness value and the brightness difference between the decreased brightness value and the initial brightness value matches the photosensitive threshold, a second identifier can be generated.

[0117] Optionally, when it is detected that the first brightness difference is less than the photosensitive threshold, the step of detecting the brightness change of the initial brightness value continues to be executed. If it is detected that the brightness change changes from a decrease in the brightness value to an increase in the brightness value and the brightness difference between the increased brightness value and the initial brightness value matches the photosensitive threshold, a first identifier can be generated.

[0118] In this embodiment, by detecting that the brightness change corresponding to the initial brightness value is an increase in the brightness value and the initial brightness value decreases to the second brightness value, determining the second brightness difference between the second brightness value and the initial brightness value, and generating a binary identifier when the second brightness difference matches the photosensitive threshold, the validity of the generated binary identifier is ensured.

[0119] Further, the step of detecting the brightness change of the initial brightness value includes:

[0120] Step j, determining the initial virtual image that matches the initial brightness value in each frame of virtual image included in the image data;

[0121] Step k: Determine other virtual images after the initial virtual image based on the acquisition time corresponding to each frame of virtual image, and determine the target brightness value corresponding to the reflected light signal at the pixel position in the other virtual images.

[0122] Step l: Determine the brightness change based on the difference between the target brightness value and the initial brightness value, where the brightness change includes a decrease in brightness value and an increase in brightness value.

[0123] In this embodiment, when detecting the brightness change of a pixel position, each frame of virtual image included in the image data can be determined first, and then the initial virtual image matching the initial brightness value can be determined. The brightness value corresponding to the reflected light signal at the pixel position in the initial virtual image is the initial brightness value.

[0124] Optionally, determine the acquisition time when the event camera acquires each frame of virtual image, and sort each frame of virtual image according to the acquisition time. For all the sorted frames of virtual images, it can be to determine a frame of virtual image sorted after the initial virtual image, and detect whether there is a change update in the brightness value corresponding to the reflected light signal at the pixel position in this frame of virtual image. If there is no change update, continue to obtain the brightness value corresponding to the reflected light signal at the pixel position in the next frame of virtual image until the brightness value corresponding to the reflected light signal at the pixel position in the latest obtained frame of virtual image is different from the initial brightness value, that is, there is a brightness change. Optionally, if there is a change update, determine this frame of virtual image as other virtual images, and use the brightness value corresponding to the reflected light signal at the pixel position in this other virtual image as the target brightness value.

[0125] Optionally, the brightness change can be determined according to the difference between the target brightness value and the initial brightness value. For example, when the difference is positive, determine the brightness change as an increase in brightness value; when the difference is negative, determine the brightness change as a decrease in brightness value.

[0126] In this embodiment, by determining the initial virtual image matching the initial brightness value, determining other virtual images after the initial virtual image based on the acquisition time corresponding to each frame of virtual image, determining the target brightness value corresponding to the reflected light signal at the pixel position in the other virtual images, and determining the brightness change based on the difference between the target brightness value and the initial brightness value, the accuracy of the determined brightness change is ensured.

[0127] Embodiment III

[0128] This application embodiment also provides an eye movement tracking-based light source encoding device. Please refer to Figure 4 , the eye movement tracking-based light source encoding device includes:

[0129] The driving module A10 is used to drive multiple light sources to emit light signals towards the user's eyes and collect image data, where the image data includes the reflected light signals formed after the light signals are emitted to the user's eyes and reflected;

[0130] The encoding module A20 is used to determine the pixel positions of the reflected light signals in the image data, and perform encoding based on the brightness changes corresponding to the pixel positions to obtain the actual encoding;

[0131] The matching module A30 is used to match the actual encoding with the light source encodings corresponding to each light source to obtain the matching light source encoding;

[0132] The construction module A40 is used to determine the flash points corresponding to the user's eyes based on the pixel positions, and construct the corresponding relationship between the light sources corresponding to the matching light source encoding and the flash points.

[0133] Optionally, the encoding module A20 is used to:

[0134] Determine the number of light sources of the multiple light sources, and perform brightness value division on the light source brightness of the light sources according to the number of light sources to obtain multiple brightness values;

[0135] Determine the initial brightness value of the reflected light signal at the pixel position according to each brightness value, and perform encoding based on the brightness changes corresponding to the initial brightness value to obtain the actual encoding.

[0136] Optionally, the encoding module A20 is used to:

[0137] Determine the code positions corresponding to the number of light sources, and determine the maximum light source brightness and the minimum light source brightness of the light sources;

[0138] Divide the brightness value range between the minimum light source brightness and the maximum light source brightness according to the code positions to obtain multiple brightness values.

[0139] Optionally, the encoding module A20 is used to:

[0140] Detect the brightness changes of the initial brightness value. If the initial brightness value after detecting the brightness change matches the preset photosensitive threshold, generate a binary identifier, and continue to detect the brightness changes of the initial brightness value after the brightness change until the same number of binary identifiers as the number of code positions is obtained, and construct the actual encoding according to all the obtained binary identifiers.

[0141] Optionally, the encoding module A20 is used to:

[0142] If it is detected that the brightness change corresponding to the initial brightness value is a decrease in the brightness value, and the initial brightness value decreases to a first brightness value, determine a first brightness difference between the first brightness value and the initial brightness value;

[0143] If the first brightness difference matches a preset light-sensing threshold, generate a first identifier and use the first identifier as a binary identifier.

[0144] Optionally, the encoding module A20 is configured to:

[0145] If it is detected that the brightness change corresponding to the initial brightness value is an increase in the brightness value, and the initial brightness value increases to a second brightness value, determine a second brightness difference between the second brightness value and the initial brightness value;

[0146] If the second brightness difference matches a preset light-sensing threshold, generate a second identifier and use the second identifier as a binary identifier.

[0147] Optionally, the encoding module A20 is configured to:

[0148] Determine an initial virtual image in each frame of virtual image included in the image data that matches the initial brightness value;

[0149] According to the acquisition time corresponding to each frame of virtual image, determine other virtual images after the initial virtual image, and determine the target brightness value corresponding to the reflected light signal at the pixel position in the other virtual images;

[0150] Determine the brightness change according to the difference between the target brightness value and the initial brightness value, where the brightness change includes a decrease in the brightness value and an increase in the brightness value.

[0151] The light source encoding device based on eye movement tracking provided by the embodiments of the present application adopts the method for encoding a light source based on eye movement tracking in any one of the above Embodiment 1 to Embodiment 2, and can improve the accuracy of determining the correspondence between multiple light sources and the flash point. Compared with the prior art, the beneficial effects of the light source encoding device based on eye movement tracking provided by the embodiments of the present application are the same as those of the method for encoding a light source based on eye movement tracking provided by the above embodiments, and other technical features in the light source encoding device based on eye movement tracking are the same as the features disclosed in the above embodiment methods, and will not be elaborated here.

[0152] Embodiment 4

[0153] An embodiment of the present application provides an AR device, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute the eye movement tracking-based light source encoding method in the first embodiment above.

[0154] Reference is made below Figure 5 to, which shows a schematic structural diagram of an AR device suitable for implementing the embodiments of the present disclosure. Figure 5 The AR device shown is only an example and should not impose any limitation on the functions and usage scope of the embodiments of the present disclosure.

[0155] As Figure 5 shown, the AR device may include a processing device (such as a central processing unit, a graphics processing unit, etc.), which may perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) or a program loaded from a storage device into a random access memory (RAM). In the RAM, various programs and data required for the operation of the AR device are also stored. The processing device, the ROM, and the RAM are connected to each other via a bus. An input / output (I / O) interface is also connected to the bus.

[0156] Generally, the following systems may be connected to the I / O interface: input devices including, for example, a touch screen, a touchpad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; output devices including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; storage devices including, for example, magnetic tape, a hard disk, etc.; and a communication device. The communication device may allow the AR device to communicate with other devices wirelessly or wiredly to exchange data. Although the AR device with various systems is shown in the figure, it should be understood that it is not required to implement or have all the shown systems. More or fewer systems may be implemented or had alternatively.

[0157] Particularly, according to an embodiment of the present disclosure, the process described above with reference to the flowchart may be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes program codes for executing the method shown in the flowchart. In such an embodiment, the computer program may be downloaded and installed from the network through the communication device, or installed from the storage device, or installed from the ROM. When the computer program is executed by the processing device, the above-mentioned functions defined in the method of the embodiments of the present disclosure are executed.

[0158] The AR device provided by this application adopts the light source encoding method based on eye movement tracking in the above-mentioned embodiment, which can improve the accuracy of determining the correspondence between multiple light sources and the flashing points. Compared with the prior art, the beneficial effects of the AR device provided by the embodiment of this application are the same as those of the light source encoding method based on eye movement tracking provided by the above-mentioned embodiment, and other technical features in this AR device are the same as those disclosed in the method of the previous embodiment, which will not be elaborated here.

[0159] It should be understood that each part of the present disclosure can be implemented by hardware, software, firmware, or a combination thereof. In the description of the above embodiments, specific features, structures, materials, or characteristics can be combined in a suitable manner in any one or more embodiments or examples.

[0160] The above is only the specific implementation manner of this application, but the protection scope of this application is not limited thereto. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed by this application, and all should be covered within the protection scope of this application. Therefore, the protection scope of this application should be subject to the protection scope of the claimed rights.

[0161] Embodiment Five

[0162] The embodiment of this application provides a computer-readable storage medium having computer-readable program instructions stored thereon, and the computer-readable program instructions are used to execute the light source encoding method based on eye movement tracking in the above-mentioned embodiment.

[0163] The computer-readable storage medium provided by the embodiment of this application can be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or any combination of the above. More specific examples of the computer-readable storage medium can include, but are not limited to: electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the above. In this embodiment, the computer-readable storage medium can be any tangible medium that contains or stores a program, and this program can be used by or in combination with an instruction execution system, device, or device. The program code contained on the computer-readable storage medium can be transmitted by any appropriate medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0164] The above computer-readable storage medium can be included in the AR device; or it can exist separately without being assembled into the AR device.

[0165] The above computer-readable storage medium carries one or more programs, which, when executed by the AR device, enable the AR device to perform the various steps in the above embodiments.

[0166] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages or combinations thereof. The programming languages include object-oriented programming languages such as Java, Smalltalk, C++, and also include conventional procedural programming languages such as the "C" language or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, executed as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0167] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagram may represent a module, a program segment, or a part of code that contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order than marked in the accompanying drawings. For example, two consecutive blocks shown may actually be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram and / or flowchart, and the combinations of blocks in the block diagram and / or flowchart, may be implemented by a dedicated hardware-based system for performing the specified functions or operations, or may be implemented by a combination of dedicated hardware and computer instructions.

[0168] The modules described in the embodiments of the present disclosure may be implemented in software or in hardware. In some cases, the name of the module does not constitute a limitation on the unit itself.

[0169] The computer-readable storage medium provided by this application stores computer-readable program instructions for executing the above-mentioned light source encoding method based on eye tracking, which can improve the accuracy of determining the correspondence between multiple light sources and flash points. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided by the embodiments of this application are the same as those of the light source encoding method based on eye tracking provided in the above-mentioned Embodiment 1 or Embodiment 2, and will not be elaborated here.

[0170] Embodiment 6

[0171] The embodiments of this application also provide a computer program product, including a computer program, and when the computer program is executed by a processor, the steps of the light source encoding method based on eye tracking as described above are implemented.

[0172] The computer program product provided by this application can improve the accuracy of determining the correspondence between multiple light sources and flash points. Compared with the prior art, the beneficial effects of the computer program product provided by the embodiments of this application are the same as those of the light source encoding method based on eye tracking provided in any of the above embodiments, and will not be elaborated here.

[0173] The above are only the preferred embodiments of this application, and do not limit the patent scope of this application. Any equivalent structure or equivalent process transformation made by using the content of the specification and drawings of this application, or directly or indirectly applied to other related technical fields, is equally included in the patent scope of this application.

Claims

1. A light source encoding method based on eye tracking, characterized in that, the light source encoding method based on eye tracking comprises the following steps: Drive a plurality of light sources to emit light signals towards the user's eyes, and collect image data, wherein the image data includes the reflected light signals formed after the light signals are emitted to the user's eyes and reflected; Determine the pixel positions of the reflected light signals in the image data, and perform encoding according to the brightness changes corresponding to the pixel positions to obtain the actual encoding; Match the actual encoding with the light source encoding corresponding to each light source to obtain the matching light source encoding; Determine the flash points corresponding to the user's eyes according to the pixel positions, and construct the corresponding relationship between the light sources corresponding to the matching light source encoding and the flash points.

2. The light source encoding method based on eye tracking according to claim 1, characterized in that, the step of performing encoding according to the brightness changes corresponding to the pixel positions to obtain the actual encoding includes: Determine the number of light sources of the plurality of light sources, and divide the light source brightness of the light sources according to the number of light sources to obtain a plurality of brightness values; Determine the initial brightness value of the reflected light signal at the pixel position according to each brightness value, and perform encoding according to the brightness changes corresponding to the initial brightness value to obtain the actual encoding.

3. The light source encoding method based on eye tracking according to claim 2, characterized in that, the step of dividing the light source brightness of the light sources according to the number of light sources to obtain a plurality of brightness values includes: Determine the code bits corresponding to the number of light sources, and determine the maximum light source brightness and the minimum light source brightness of the light sources; Divide the brightness value range between the minimum light source brightness and the maximum light source brightness according to the code bits to obtain a plurality of brightness values.

4. The light source encoding method based on eye tracking according to claim 3, characterized in that, the step of performing encoding according to the brightness changes corresponding to the initial brightness value to obtain the actual encoding includes: Detect the brightness change of the initial brightness value. If the initial brightness value after detecting the brightness change matches a preset photosensitive threshold, generate a binary identifier, and continue to detect the brightness change of the initial brightness value after the brightness change until the number of binary identifiers obtained is the same as the number of code bits, and construct the actual encoding according to all the obtained binary identifiers.

5. The light source encoding method based on eye tracking according to claim 4, characterized in that, the step of generating a binary identifier if the brightness value after detecting the brightness change matches a preset photosensitive threshold includes: If it is detected that the brightness change corresponding to the initial brightness value is a decrease in brightness value, and the initial brightness value decreases to a first brightness value, determine the first brightness difference between the first brightness value and the initial brightness value; If the first brightness difference matches the preset photosensitive threshold, generate a first identifier and use the first identifier as the binary identifier.

6. The light source encoding method based on eye tracking according to claim 4, characterized in that, The step of generating a binary identifier if the detected brightness value after the brightness change matches a preset photosensitive threshold includes: If it is detected that the brightness change corresponding to the initial brightness value is an increase in the brightness value, and the initial brightness value increases to a second brightness value, then determine a second brightness difference between the second brightness value and the initial brightness value; If the second brightness difference matches the preset photosensitive threshold, generate a second identifier and use the second identifier as the binary identifier.

7. The method for encoding a light source based on eye movement tracking according to claim 4, wherein, The step of detecting the brightness change of the initial brightness value includes: Determine an initial virtual image in each frame of virtual image included in the image data that matches the initial brightness value; According to the acquisition time corresponding to each frame of virtual image, determine other virtual images after the initial virtual image, and determine the target brightness value corresponding to the reflected light signal at the pixel position in the other virtual images; Determine the brightness change according to the difference between the target brightness value and the initial brightness value, wherein the brightness change includes a decrease in the brightness value and an increase in the brightness value.

8. An apparatus for encoding a light source based on eye movement tracking, wherein, The apparatus for encoding a light source based on eye movement tracking includes: A driving module for driving a plurality of light sources to emit light signals towards the user's eyes and collecting image data, wherein the image data includes the reflected light signals formed after the light signals are emitted to the user's eyes and reflected; An encoding module for determining the pixel position of the reflected light signal in the image data and performing encoding according to the brightness change corresponding to the pixel position to obtain an actual encoding; A matching module for matching the actual encoding with the light source encoding corresponding to each light source to obtain a matching light source encoding; A construction module for determining the flash point corresponding to the user's eyes according to the pixel position and constructing a corresponding relationship between the light source corresponding to the matching light source encoding and the flash point.

9. An apparatus for encoding a light source based on eye movement tracking, wherein, The apparatus for encoding a light source based on eye movement tracking includes: At least one processor; and, A memory communicatively connected to the at least one processor; wherein, The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the steps of the method for encoding a light source based on eye movement tracking according to any one of claims 1 to 7.

10. A storage medium, wherein, The storage medium is a computer-readable storage medium, and a program for implementing the method for encoding a light source based on eye movement tracking is stored on the computer-readable storage medium. The program for implementing the method for encoding a light source based on eye movement tracking is executed by a processor to implement the steps of the method for encoding a light source based on eye movement tracking according to any one of claims 1 to 7.

Images