Light source control device, electronic apparatus, method, storage medium, and program product

Abstract

The invention provides a light source control device, electronic equipment, a method, a storage medium and a program product. The device comprises an eye movement tracking light source, a proximity detection light source and a control circuit, and the control circuit is connected with the eye movement tracking light source and the proximity detection light source. The control circuit is configured to control the eye movement tracking light source and the proximity detection light source to be turned on alternately. The control circuit controls the eye movement tracking light source and the proximity detection light source to be turned on alternately, so that the eye movement tracking light source and the proximity detection light source cannot be turned on at the same time, mutual light cannot interfere with each other, the accuracy of the detection result of the eye movement tracking light source is improved, and meanwhile the accuracy of the detection result of the proximity detection light source can be improved.

Description

Technical Field

[0001] The present application relates to the field of circuit control technology, and in particular to a light source control device, electronic equipment, method, storage medium and program product. Background Art

[0002] Some electronic devices need to be installed with both eye tracking and proximity sensors, and both devices need to be illuminated by light sources to achieve the corresponding required functions.

[0003] However, the lights of these two devices will interfere with each other, affecting their corresponding functions and causing low accuracy. Summary of the invention

[0004] In view of this, the purpose of the present application is to propose a light source control device, electronic device, method, storage medium and program product to solve or partially solve the above technical problems.

[0005] Based on the above purpose, a first aspect of the present application provides a light source control device, comprising: an eye tracking light source, a proximity detection light source and a control circuit, wherein the control circuit is connected to the eye tracking light source and the proximity detection light source respectively;

[0006] The control circuit is configured to control the eye tracking light source and the proximity detection light source to light up alternately.

[0007] Based on the same concept, the second aspect of the present application proposes an electronic device, including the light source control device described in the first aspect.

[0008] Based on the same concept, the third aspect of the present application proposes a light source control method, which is applied to a control circuit, wherein the control circuit is connected to an eye tracking light source and a proximity detection light source, respectively, and the method comprises:

[0009] The eye tracking light source and the proximity detection light source are controlled to light up alternately.

[0010] Based on the same concept, the fourth aspect of the present application proposes a non-transitory computer-readable storage medium, which stores computer instructions, and the computer instructions are used to enable a computer to execute the method described in the third aspect.

[0011] Based on the same concept, the fifth aspect of the present application proposes a computer program product, including computer program instructions, characterized in that when the computer program instructions are executed on a computer, the computer executes the method described in the third aspect.

[0012] From the above, it can be seen that the light source control device, electronic device, method, storage medium and program product provided by the present application control the eye tracking light source and the proximity detection light source to light up alternately through the control circuit, so that the eye tracking light source and the proximity detection light source will not light up at the same time, and the light of each other will not interfere with each other, thereby improving the accuracy of the detection results of the eye tracking light source, and at the same time also improving the accuracy of the detection results of the proximity detection light source. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] In order to more clearly illustrate the technical solutions in the present application or related technologies, the drawings required for use in the embodiments or related technical descriptions are briefly introduced below. Obviously, the drawings described below are only embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0014] Figure 1A This is a structural schematic diagram of a light source control device according to an embodiment of the present application;

[0015] Figure 1B This is a structural schematic diagram of a light source control device according to another embodiment of the present application;

[0016] Figure 1C This is a structural schematic diagram of a light source control device according to another embodiment of the present application;

[0017] Figure 2 This is a control timing diagram of the light source control device according to an embodiment of the present application;

[0018] Figure 3 A schematic diagram of the structure of an electronic device according to an embodiment of the present application;

[0019] Figure 4A This is a flow chart of a light source control method according to an embodiment of the present application;

[0020] Figure 4B This is a flow chart of a light source control method according to another embodiment of the present application.

[0021] Description of reference numerals:

[0022] 100. Light source control device;

[0023] 101. control circuit, 102. eye tracking light source, 1021. first eye tracking light source, 1022. second eye tracking light source, 103. proximity detection light source, 104. register, 105. integrated circuit bus.

[0024] 200. Electronic equipment. DETAILED DESCRIPTION

[0025] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and relevant provisions.

[0026] The principles and spirit of the present application will be described below with reference to several exemplary embodiments. It should be understood that these embodiments are provided only to enable those skilled in the art to better understand and implement the present application, and are not intended to limit the scope of the present application in any way. On the contrary, these embodiments are provided to make the present application more thorough and complete, and to fully convey the scope of the present application to those skilled in the art.

[0027] It should be understood herein that any number of elements in the drawings is for illustration rather than limitation, and any naming is only for distinction rather than having any limiting meaning.

[0028] Based on the above description, the principle and spirit of the present application are explained in detail below with reference to several representative implementations of the present application.

[0029] The present application embodiment provides a light source control device 100, such as Figure 1A As shown, it includes: an eye tracking light source 102, a proximity detection light source 103 and a control circuit 101, wherein the control circuit 101 is connected to the eye tracking light source 102 and the proximity detection light source 103 respectively;

[0030] The control circuit 101 is configured to control the eye tracking light source 102 and the proximity detection light source 103 to light up alternately.

[0031] In a specific implementation, both the eye tracking light source 102 and the proximity detection light source 103 are infrared light sources. During eye tracking, the eye tracking light source 102 is set on the eye tracking camera, the eye tracking light source 102 is turned on, and the proximity detection light source 103 is turned off. The light of the eye tracking light source 102 shines on the iris of the eye, so that the eye tracking camera can collect iris features, and then determine the focus position of the eye based on the collected iris features to perform eye tracking.

[0032] The proximity detection light source 103 generally adopts a photoelectric proximity detection light source 103. In the photoelectric proximity detection light source 103, the beam axis of the light emitting diode (or semiconductor laser tube) and the axis of the phototransistor are on the same plane. When the surface of the object to be detected is close to the intersection of the light sources of the proximity detection light source 103, the reflected light of the light emitting diode is received by the phototransistor to generate an electrical signal. When the object is far away from the intersection, the reflection area is not within the field of view of the phototransistor, and the detection circuit has no output. Generally, the driving current of the light emitting diode is not a direct current, but an alternating current of a certain frequency. When the proximity detection light source 103 emits light for proximity detection, the eye tracking light source 102 is turned off, so that the intensity of light returned after the detection light hits the obstacle determines whether there is an approaching object, thereby completing the proximity detection.

[0033] Through the above scheme, the control circuit 101 is used to control the eye tracking light source 102 and the proximity detection light source 103 to light up alternately, so that the eye tracking light source 102 and the proximity detection light source 103 will not light up at the same time, and the light of each other will not interfere with each other. This improves the accuracy of the detection result of the eye tracking light source 102, and at the same time, it can also improve the accuracy of the detection result of the proximity detection light source 103.

[0034] In some embodiments, the control circuit 101 is configured to:

[0035] Control the eye tracking light source 102 to light up for a first predetermined time and then turn off, and then control the proximity detection light source 103 to light up for a second predetermined time and then turn off; or,

[0036] The proximity detection light source 103 is controlled to light up for a second predetermined time and then turn off, and the eye tracking light source 102 is controlled to light up for a first predetermined time and then turn off.

[0037] Through the above solution, the purpose of alternately lighting the eye tracking light source 102 and the proximity detection light source 103 can be achieved, so that the two will not interfere with each other, thereby improving the accuracy of the two.

[0038] In some embodiments, Figure 1B As shown, the eye tracking light source 102 includes: a first eye tracking light source 1021 and a second eye tracking light source 1022;

[0039] The control circuit 101 is specifically configured as follows:

[0040] The first eye tracking light source 1021 is controlled to light up for a first predetermined time and then turn off, the proximity detection light source 103 is controlled to light up for a second predetermined time and then turn off, and the second eye tracking light source 1022 is controlled to light up for a third predetermined time and then turn off.

[0041] In a specific implementation, the first eye tracking light source 1021 is the left eye tracking light source 102 , and the second eye tracking light source 1022 is the right eye tracking light source 102 ; or, the first eye tracking light source 1021 is the right eye tracking light source 102 , and the second eye tracking light source 1022 is the left eye tracking light source 102 .

[0042] The first predetermined time length and the third predetermined time length may be the same or different. Preferably, the first predetermined time length and the third predetermined time length are the same. The specific time length may be set as required, for example, set to 2 ms.

[0043] In a specific implementation, during the time when the two eye tracking light sources 102 are alternately turned off and paused, the proximity detection light source 103 is controlled to light up for a second predetermined duration (for example, 0.37ms), thereby fully utilizing the pause time between the two eye tracking light sources 102, so that the two eye tracking light sources 102 can maintain normal frequency operation while ensuring the normal use of the proximity detection light source 103.

[0044] After the controller sends a lighting signal to the proximity detection light source 103 , the proximity detection light source 103 will be automatically turned off after being lit for a second predetermined time, without the need for the controller to send a closing signal to the proximity detection light source 103 again.

[0045] In some embodiments, Figure 1C As shown, the device further includes a register 104 connected to the control circuit 101;

[0046] The control circuit 101 is configured to: control the eye tracking light source 102 to light up for a first predetermined time and then turn off, and then control the register 104 to start and control the proximity detection light source 103 to light up for a second predetermined time and then turn off;

[0047] The register 104 is configured to receive the optical signal fed back by the proximity detection light source 103 and send the optical signal to the control circuit 101 for processing.

[0048] In a specific implementation, the start time of the register 104 is the same as the start time of the proximity detection light source 103. Setting the register 104 can cache the light signal detected by the proximity detection light source 103, and send the light signal to the control circuit 101, so that the control circuit 101 can analyze and process the light signal to determine whether there is a proximity signal of an object approaching, and then control other circuit devices to work in conjunction with the object approaching. For example, after determining that there is a proximity signal, control the display screen to light up.

[0049] In some embodiments, the register 104 is specifically configured to: receive a light signal when the proximity detection light source 103 is on, and receive a light noise signal when the proximity detection light source 103 is off, and send the light signal and the light noise signal to the control circuit 101;

[0050] The control circuit 101 is specifically configured to: after receiving the optical signal and the optical noise signal sent by the register 104, remove the optical noise signal from the optical signal to obtain an optical result signal.

[0051] In specific implementation, when the proximity detection light source 103 is in use, there is generally a period of IR (Infrared Spectroscopy) light emission time (for example, 0.37ms), and then the intensity of the IR reflected during the light emission period is detected as a light signal. Then the proximity detection light source 103 is controlled to be turned off, and the IR background light noise signal of the environment during the period when the IR is not emitting light (for example, 0.37ms) is detected; by subtracting the light noise signal from the detected light signal, the reflected IR light intensity at the detection time point is obtained as the light result signal.

[0052] In some embodiments, the eye tracking light source 102 is periodically illuminated according to a first cycle time.

[0053] In a specific implementation, the eye tracking light source 102 is provided with two corresponding left and right ones (i.e., the first eye tracking light source 1021 and the second eye tracking light source 1022). Both eye tracking light sources 102 are periodically lit according to a first cycle time, and the corresponding lighting cycle can be set according to the number of frames transmitted per second, for example 90fps, and the corresponding first cycle time is 11.1ms.

[0054] In some embodiments, the proximity detection light source 103 is periodically illuminated according to a second cycle time, wherein the second cycle time is N times the first cycle time, where N is a positive integer.

[0055] In specific implementation, since proximity detection does not need to be performed at a very high frequency, for example, it can be detected approximately once every 2 seconds, but since the lighting time of the proximity detection light source 103 is when the eye tracking light source 102 is turned off, the lighting cycle of the proximity detection light source 103 is N times (for example, 100 times) the first cycle time.

[0056] In some embodiments, the controller is connected to each electrical component through an integrated circuit bus 105 .

[0057] In a specific implementation, the integrated circuit bus 105 is connected to various electrical components (for example, the eye tracking light source 102, the proximity detection light source 103 or the register 104), so that various signals are sent and received through the integrated circuit bus 105, which is convenient for the controller to control and receive signals.

[0058] The control process of the light source control device 100 is described in detail below using an embodiment of a specific application scenario.

[0059] like Figure 2 As shown, the eye tracking IR LED light (i.e., the eye tracking light source 102, for example, Figure 2 The enabling of ET_R_IR (first eye tracking light source 1021) and ET_L_IR (second eye tracking light source 1022)) is enabled by ET_R_STROBE and ET_L_STROBE. That is, ET_R_STROBE enables ET_R_IR to light up, and ET_L_STROBE enables ET_L_IR to light up.

[0060] When ET_R_STROBE and ET_L_STROBE are high, ET_R_IR and ET_L_IR are on, and when they are low, ET_R_IR and ET_L_IR are off; at 90fps, the maximum lighting time of ET_R_IR and ET_L_IR is 2ms, and ET_R_IR and ET_L_IR are lit separately with an interval of 2.55ms in between. After the IR LED light of the eye tracking is lit, it hits the iris of the eye, so that the iris features can be extracted and the focus point of the eye can be determined based on the iris features.

[0061] The proximity sensor may include: an IR lamp of a proximity detection light source 103 and a register 104 (PS, Proximity Sensor, representing a register of the proximity sensor).

[0062] When the control circuit 101 detects the falling edge of ET_R_STROB (ie, ET_R_IR switches from on to off), the control circuit 101 sends a signal to the control circuit 101 via the integrated circuit bus 105 (eg, Figure 2 IIC in) enables register 104 (e.g., Figure 2 The PS in the embodiment starts and enables the IR light of the proximity detection light source 103 (e.g., Figure 2 After the register 104 is started, it can read the nearby light signal. The start-up time of the register 104 is 0.74ms (such as Figure 2 As shown, the PS started for 0.74ms).

[0063] For the 0.74ms when the register 104 is started, the specific scheme is as follows: the IR lamp (LED ON) of the proximity detection light source 103 is lit for 0.37ms, and at this time, the register 104 reads the optical signal of the IR lamp of the proximity detection light source 103 for 0.37ms. Since the start-up time of the register 104 (PS) is 0.74ms, the register 104 (PS) will continue to work for 0.37ms within 0.37ms after the IR lamp of the detection light source 103 is turned off, and the register 104 (PS) reads the optical noise signal within 0.37ms when the IR lamp of the proximity detection light source 103 is turned off. Among them, the optical noise signal read during the IR lamp off period (0.37ms) is an external optical noise signal that is not affected by the IR lamp.

[0064] Register 104 (PS) sends the data read out from the proximity detection light source 103 to the control circuit 101 through IIC, allowing the control circuit 101 to subtract the optical noise signal from the optical signal to obtain the optical result signal at the detection time point, and then determine whether there is an object approaching based on the optical result signal, and then control the operation of the corresponding electrical components.

[0065] Based on the same concept, the embodiment of the present application provides an electronic device 200, such as Figure 3 As shown, it includes the light source control device 100 described in the above embodiments. It has the same technical effects as the light source control device 100 in the above embodiments, and will not be described in detail here.

[0066] The electronic device may be at least one of a mobile phone, a computer, a tablet, a wearable device, and an extended reality device. Preferably, it is an extended reality device, XR (Extended Reality), which refers to combining the real and the virtual through a computer to create a virtual environment for human-computer interaction. This is also a general term for various technologies such as AR (Augmented Reality), VR (Virtual Reality), and MR (Mixed Reality). It can allow users to interact with the virtual digital world, thereby providing users with a richer experience. For example, for learning purposes, gaming purposes, content creation purposes, social media and interactive purposes, etc.

[0067] Extended reality device is a computer simulation device that can create and experience the virtual world. It uses computer programs to generate a simulated environment, providing a multi-source information fusion, interactive three-dimensional dynamic vision and entity behavior simulation, allowing users to immerse themselves in the virtual environment.

[0068] The extended reality device includes a main controller, DSP (Digital Signal Processing), memory, storage, position sensor, camera, RF wireless transmission circuit, antenna and other units. The spatial position information is collected through the camera, and the handle position is obtained through sensors and markers on the handle that indicate the relative position with the HMD (Helmet Mounted Display); the RF wireless transmission circuit obtains the angular velocity and gravity acceleration data of the handle, and the HMD processes the relevant data. The HMD calculates the 3D position and 3D angle information of the handle and HMD in space through the acquired data, and updates the image to display the handle model on the screen according to the calculated position and angle.

[0069] Based on the same concept, an embodiment of the present application proposes a light source control method, which is applied to a control circuit, wherein the control circuit is respectively connected to an eye tracking light source and a proximity detection light source.

[0070] like Figure 4A As shown, the method includes:

[0071] Step 401: Control the eye tracking light source and the proximity detection light source to light up alternately.

[0072] In some embodiments, the control circuit is connected to a register, and the register receives a light signal when the proximity detection light source is turned on, and receives a light noise signal when the proximity detection light source is turned off.

[0073] like Figure 4B As shown, the method also includes:

[0074] Step 402: Receive the optical signal and the optical noise signal sent by the register.

[0075] Step 403: remove the optical noise signal from the optical signal to obtain an optical result signal.

[0076] In some embodiments, step 401 includes:

[0077] The eye tracking light source is controlled to light up according to a first cycle time period, and / or the proximity detection light source is controlled to light up according to a second cycle time period, so as to complete the alternating lighting of the eye tracking light source and the proximity detection light source. The second cycle time is N times the first cycle time, where N is a positive integer.

[0078] Through the description of the above embodiments, the control circuit is used to control the eye tracking light source and the proximity detection light source to light up alternately, so that the eye tracking light source and the proximity detection light source will not light up at the same time, and the light of each other will not interfere with each other. This improves the accuracy of the detection result of the eye tracking light source, and at the same time improves the accuracy of the detection result of the proximity detection light source.

[0079] The control circuit in this embodiment is preferably the control circuit in the light source control device described in the above embodiments, and has the same connection relationship and function as the control circuit in the light source control device, which will not be described in detail here.

[0080] It should be noted that the above describes some embodiments of the present application. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the above embodiments and still achieve the desired results. In addition, the processes depicted in the accompanying drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0081] Based on the same concept, corresponding to any of the above-mentioned embodiments, the present application also provides a non-transitory computer-readable storage medium, wherein the non-transitory computer-readable storage medium stores computer instructions, and the computer instructions are used to enable the computer to execute the method described in any of the above embodiments.

[0082] The computer-readable medium of this embodiment includes permanent and non-permanent, removable and non-removable media, and information storage can be implemented by any method or technology. Information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, read-only compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device.

[0083] The computer instructions stored in the storage medium of the above embodiments are used to enable the computer to execute the method described in any of the above embodiments, and have the beneficial effects of the corresponding method embodiments, which will not be repeated here.

[0084] Based on the same concept, corresponding to any of the above-mentioned embodiment methods, the present application also provides a computer program product, including computer program instructions. When the computer program instructions are run on a computer, the computer executes the method described in any of the above embodiments, which has the beneficial effects of the corresponding method embodiments and will not be repeated here.

[0085] Those skilled in the art should understand that the discussion of any of the above embodiments is merely illustrative and is not intended to imply that the scope of the present application (including the claims) is limited to these examples. In line with the concept of the present application, the technical features in the above embodiments or different embodiments may be combined, the steps may be implemented in any order, and there are many other variations of the different aspects of the embodiments of the present application as described above, which are not provided in detail for the sake of simplicity.

[0086] In addition, to simplify the description and discussion, and in order not to make the embodiments of the present application difficult to understand, the known power supply / ground connection with the integrated circuit (IC) chip and other components may or may not be shown in the provided drawings. In addition, the device can be shown in the form of a block diagram to avoid making the embodiments of the present application difficult to understand, and this also takes into account the fact that the details of the implementation of these block diagram devices are highly dependent on the platform to be implemented in the embodiments of the present application (that is, these details should be fully within the scope of understanding of those skilled in the art). In the case of elaborating specific details (e.g., circuits) to describe exemplary embodiments of the present application, it is obvious to those skilled in the art that the embodiments of the present application can be implemented without these specific details or when these specific details are changed. Therefore, these descriptions should be considered to be illustrative rather than restrictive.

[0087] Although the present application has been described in conjunction with specific embodiments of the present application, many replacements, modifications and variations of these embodiments will be apparent to those skilled in the art from the foregoing description. For example, other memory architectures (e.g., dynamic RAM (DRAM)) may use the embodiments discussed.

[0088] The embodiments of the present application are intended to cover all such substitutions, modifications and variations that fall within the broad scope of the appended claims. Therefore, any omissions, modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the embodiments of the present application should be included in the scope of protection of the present application.

Claims

1. A light source control device, characterized in that: include: An eye tracking light source, a proximity detection light source and a control circuit, wherein the control circuit is connected to the eye tracking light source and the proximity detection light source respectively; The control circuit is configured to control the eye tracking light source and the proximity detection light source to light up alternately.

2. The device according to claim 1, characterized in that The control circuit is configured to: Control the eye tracking light source to light up for a first predetermined time and then turn off, and then control the proximity detection light source to light up for a second predetermined time and then turn off; or, The proximity detection light source is controlled to light up for a second predetermined time period and then turn off, and the eye tracking light source is controlled to light up for a first predetermined time period and then turn off.

3. The device according to claim 2, characterized in that The eye-tracking light source comprises: a first eye-tracking light source and a second eye-tracking light source; The control circuit is specifically configured as follows: The first eye tracking light source is controlled to light up for a first predetermined time and then turn off, the proximity detection light source is controlled to light up for a second predetermined time and then turn off, and the second eye tracking light source is controlled to light up for a third predetermined time and then turn off.

4. The device according to claim 2, characterized in that Also included is a register connected to the control circuit; The control circuit is configured to: control the eye tracking light source to light up for a first predetermined time and then turn off, and then control the register to start and control the proximity detection light source to light up for a second predetermined time and then turn off; The register is configured to: receive an optical signal fed back by the proximity detection light source, and send the optical signal to the control circuit for processing.

5. The device according to claim 4, characterized in that The register is specifically configured to: receive a light signal when the proximity detection light source is on, and receive a light noise signal when the proximity detection light source is off, and send the light signal and the light noise signal to the control circuit; The control circuit is specifically configured to: after receiving the optical signal and the optical noise signal sent by the register, remove the optical noise signal from the optical signal to obtain the optical result signal.

6. The device according to claim 1, characterized in that The eye tracking light source is periodically lit according to a first cycle time.

7. The device according to claim 6, characterized in that The proximity detection light source is periodically lit according to a second cycle time, wherein the second cycle time is N times the first cycle time, wherein N is a positive integer.

8. The device according to any one of claims 1 to 7, characterized in that The controller is connected to each electrical component through an integrated circuit bus.

9. An electronic device, characterized in that: The light source control device comprises the light source control device according to any one of claims 1 to 8.

10. A light source control method, characterized in that: Applied to a control circuit, the control circuit is connected to an eye tracking light source and a proximity detection light source respectively, the method comprises: The eye tracking light source and the proximity detection light source are controlled to light up alternately.

11. The method according to claim 10, characterized in that The control circuit is connected to a register, and the register receives a light signal when the proximity detection light source is on, and receives a light noise signal when the proximity detection light source is off; The method further comprises: receiving the optical signal and the optical noise signal sent by the register; The optical noise signal in the optical signal is removed to obtain an optical result signal.

12. The method according to claim 10, characterized in that The step of controlling the eye tracking light source and the proximity detection light source to light up alternately includes: Controlling the eye tracking light source to light up according to a first cycle time period, and / or controlling the proximity detection light source to light up according to a second cycle time period, so as to complete the alternating lighting of the eye tracking light source and the proximity detection light source; The second cycle time is N times the first cycle time, where N is a positive integer.

13. A non-transitory computer-readable storage medium storing computer instructions, characterized in that: The computer instructions are used to make a computer execute the method according to any one of claims 10 to 12.

14. A computer program product comprising computer program instructions, characterized in that When the computer program instructions are executed on a computer, the computer is caused to perform the method according to any one of claims 10 to 12.

Images