Camera scheduling method and device, electronic equipment and storage medium

By switching the infrared camera based on the pupil imaging information, the problem of high power consumption when the eye tracking function is turned on in virtual reality and augmented reality devices is solved, and precise tracking of the user's eyes and reducing power consumption is achieved.

CN118915914APending Publication Date: 2024-11-08VIVO MOBILE COMM CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411000313.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-24
Publication Date
2024-11-08

AI Technical Summary

Technical Problem

In virtual reality, augmented reality and mixed reality electronic devices, when eye tracking is turned on, multiple infrared cameras work simultaneously, resulting in high power consumption, causing heat and lag problems.

Method used

By collecting images of the user's eyeball infrared camera, and determining whether to switch to another infrared camera for acquisition based on the pupil imaging information, ensuring that each eyeball uses a camera with higher image quality, so that only two are controlled when the eye tracking function is turned on The infrared camera works simultaneously.

Benefits of technology

It reduces the power consumption of electronic devices, avoids heating and lag problems, and at the same time achieves accurate tracking of users' eyes.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118915914A_ABST
    Figure CN118915914A_ABST
Patent Text Reader

Abstract

The invention discloses a camera scheduling method and device, electronic equipment and a storage medium, and belongs to the technical field of electronic equipment, the camera scheduling method is applied to the electronic equipment, and the electronic equipment comprises at least two infrared cameras used for tracking the left eyeball of a user and at least two infrared cameras used for tracking the right eyeball of the user. The method comprises the steps that under the condition that a first user wears electronic equipment, for each eyeball of the first user, a first infrared camera corresponding to the eyeball is called for image collection, and a first eye image is obtained; determining first pupil imaging information in the first eye image; according to the first pupil imaging information, determining whether to switch from the first infrared camera to a second infrared camera for image acquisition; wherein the second infrared camera is an infrared camera in all the third infrared cameras, and the third infrared cameras are infrared cameras, except the first infrared camera, in the infrared cameras used for tracking each eyeball.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application belongs to the technical field of electronic equipment, and specifically relates to a camera scheduling method, device, electronic equipment and storage medium. Background Art

[0002] In the virtual reality (VR), augmented reality (AR) and mixed reality (MR) space, the choice of interaction method is crucial to the user experience. The main interaction methods currently include: handles, voice recognition, eye tracking and gesture tracking, among which eye tracking allows users to interact with the virtual environment through eye movements, thus providing a strong sense of immersion. Therefore, device control technology based on eye tracking has become one of the mainstream interaction technologies.

[0003] At present, mainstream electronic devices such as VR, AR and MR are equipped with multiple infrared cameras. Taking the configuration of four infrared cameras as an example, two infrared cameras are installed in the electronic device to track the position of the user's left eye, and the other two infrared cameras are installed in the electronic device to track the position of the user's right eye.

[0004] In the related art, after the eye tracking function of an electronic device is turned on, the electronic device controls all infrared cameras to work simultaneously to track the user's eye movements, which consumes high power and causes the electronic device to easily experience heating and freezing problems. Summary of the invention

[0005] The purpose of the embodiments of the present application is to provide a camera scheduling method, device, electronic device and storage medium, which can reduce the power consumption of the electronic device when the eye tracking function is turned on, thereby avoiding heating and lag problems.

[0006] In a first aspect, an embodiment of the present application provides a camera scheduling method, which is applied to an electronic device, wherein the electronic device includes: at least two infrared cameras for tracking a user's left eye and at least two infrared cameras for tracking a user's right eye, and the method includes:

[0007] When a first user wears the electronic device, for each eyeball of the first user, calling a first infrared camera corresponding to the eyeball to collect an image to obtain a first eye image;

[0008] Determining first pupil imaging information in the first eye image;

[0009] determining, according to the first pupil imaging information, whether to switch from the first infrared camera to the second infrared camera for image acquisition;

[0010] The second infrared camera is one of all third infrared cameras, and the third infrared camera is an infrared camera other than the first infrared camera among the infrared cameras used for tracking each of the eyeballs.

[0011] In a second aspect, an embodiment of the present application provides a camera scheduling device, which is applied to an electronic device, wherein the electronic device includes: at least two infrared cameras for tracking a user's left eye and at least two infrared cameras for tracking a user's right eye, and the device includes:

[0012] A calling module, configured to call a first infrared camera corresponding to each eyeball of the first user to perform image acquisition to obtain a first eye image when the first user wears the electronic device;

[0013] A first determination module, used to determine first pupil imaging information in the first eye image;

[0014] A second determination module, used to determine whether to switch from the first infrared camera to the second infrared camera for image acquisition according to the first pupil imaging information;

[0015] The second infrared camera is one of all third infrared cameras, and the third infrared camera is an infrared camera other than the first infrared camera among the infrared cameras used for tracking each of the eyeballs.

[0016] In a third aspect, an embodiment of the present application provides an electronic device, comprising a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, the steps of the camera scheduling method described in the first aspect are implemented.

[0017] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the camera scheduling method described in the first aspect are implemented.

[0018] In a fifth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the camera scheduling method as described in the first aspect.

[0019] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the camera scheduling method as described in the first aspect.

[0020] In an embodiment of the present application, when a first user wears an electronic device, for each eyeball of the first user, a first infrared camera corresponding to the eyeball is called to perform image acquisition to obtain a first eye image; first pupil imaging information in the first eye image is determined; and based on the first pupil imaging information, it is determined whether to switch from the first infrared camera to the second infrared camera for image acquisition, wherein the second infrared camera is one of all third infrared cameras, and the third infrared camera is an infrared camera other than the first infrared camera among the infrared cameras used to track each eyeball.

[0021] It can be seen that in the embodiments of the present application, since the pupil imaging information can reflect the quality of the eye image, and the device control function of the electronic device based on eye tracking requires high-quality eye images, and in most cases for a single eyeball, one infrared camera can capture high-quality eye images, therefore, according to the first pupil imaging information, it is determined whether to switch from the first infrared camera to the second infrared camera for image acquisition, so that it can be ensured that for each eyeball, the currently working infrared camera is the one that captures the fundus image with higher quality among all the infrared cameras corresponding to the eyeball, so that when the eye tracking function is turned on, the electronic device only needs to control two infrared cameras to work at the same time to achieve accurate tracking of the user's eyes. Compared with the related art in which all infrared cameras work at the same time, the power consumption of the electronic device is reduced, thereby avoiding heating and jamming problems. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Figure 1 is an example diagram of two eye images captured by two infrared cameras corresponding to a single eye provided in some embodiments of the present application;

[0023] Figure 2 is an example diagram of installation positions of four infrared cameras of an electronic device provided in some embodiments of the present application;

[0024] Figure 3 is a flowchart of a camera scheduling method provided by some embodiments of the present application;

[0025] Figure 4 are example diagrams of eye images in different states provided by some embodiments of the present application;

[0026] Figure 5 is an example diagram of a maximum outer contour circumscribed rectangle of a pupil edge provided in some embodiments of the present application;

[0027] Figure 6 It is one of the flowcharts of an implementation of step 303 provided in some embodiments of the present application;

[0028] Figure 7is an example diagram of different areas of a display screen of an electronic device provided by some embodiments of the present application;

[0029] Figure 8 This is a second flowchart of an implementation of step 303 provided in some embodiments of the present application;

[0030] Fig. 9 is a structural block diagram of a camera scheduling device provided by some embodiments of the present application;

[0031] Fig.10 is a schematic diagram of the structure of an electronic device provided by some embodiments of the present application;

[0032] Fig.11 It is a schematic diagram of the hardware structure of an electronic device provided in some embodiments of the present application. DETAILED DESCRIPTION

[0033] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0034] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the terms used in this way are interchangeable where appropriate, so that the embodiments of the present application can be implemented in an order other than those illustrated or described herein, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0035] At present, mainstream electronic devices such as VR, AR and MR are equipped with multiple infrared cameras. For example, four infrared cameras are configured, where two infrared cameras are installed in the electronic device to track the user's left eye, and the other two infrared cameras are installed in the electronic device to track the user's right eye. In the related art, taking the configuration of four infrared cameras as an example, after the eye tracking function of the electronic device is turned on, the electronic device controls the four infrared cameras to work simultaneously to track the user's left eye and right eye. However, since each infrared camera needs to generate 80mW to 100mW of hardware power consumption and 100mW to 120mW of software algorithm power consumption when working, that is, four infrared cameras work at the same time and generate a total of 800mW of power consumption. As a function that the electronic device needs to be turned on all the time, the eye tracking function has high power consumption, which makes the electronic device prone to heating and freezing problems.

[0036] In order to solve the above technical problems, the embodiments of the present application provide a camera scheduling method, device, electronic device and storage medium.

[0037] Taking the configuration of four infrared cameras as an example, considering that in the actual use of the eye tracking algorithm, in most scenarios, for a single eye, one infrared camera can achieve a good eye tracking effect, such as Figure 1 As shown, for a single eyeball, one of the two infrared cameras corresponding to the eyeball can capture high-quality fundus images. Therefore, a reliable infrared camera scheduling mechanism can be used to ensure that the eye diagram taken by the currently working infrared camera for each eyeball is the better of the two infrared cameras. In this way, the effect of the eye movement algorithm is guaranteed, and at the same time, about 400mW of power consumption can be saved for the entire machine.

[0038] A camera scheduling method provided in an embodiment of the present application is introduced below in conjunction with the accompanying drawings.

[0039] It should be noted that the camera scheduling method provided in the embodiment of the present application is applicable to an electronic device, which includes: at least two infrared cameras for tracking the left eye of a user and at least two infrared cameras for tracking the right eye of a user.

[0040] Taking an electronic device configured with four infrared cameras as an example, the electronic device includes four infrared cameras, wherein two infrared cameras are installed at positions in the electronic device that can track the user's left eye, and the other two infrared cameras are installed at positions in the electronic device that can track the user's right eye.

[0041] like Figure 2As shown, the electronic device 20 includes: an optomechanical lens 21, an optomechanical lens 22 and four infrared cameras 231 to 234 (not shown in the figure); wherein, the optomechanical lens 21 corresponds to the left eye of the user, the infrared camera 231 can be deployed at position 211 or position 212 on the inner side (or outer side) of the optomechanical lens 21, and the infrared camera 232 can be deployed at position 213, position 214 or position 215 on the inner side (or outer side) of the optomechanical lens 21, so that the infrared camera 231 and the infrared camera 232 can track the left eye of the user; the optomechanical lens 22 corresponds to the right eye of the user, the infrared camera 233 can be deployed at position 221 or position 222 on the inner side (or outer side) of the optomechanical lens 22, and the infrared camera 234 can be deployed at position 223, position 224 or position 225 on the inner side (or outer side) of the optomechanical lens 22, so that the infrared camera 233 and the infrared camera 234 can capture the right eye of the user. In practical applications, the above-mentioned electronic devices include but are not limited to: VR devices, AR devices and MR devices.

[0042] Figure 3 is a flowchart of a camera scheduling method provided by some embodiments of the present application, such as Figure 3 As shown, the method at least includes the following steps: step 301, step 302 and step 303;

[0043] In step 301, when a first user wears an electronic device, for each eyeball of the first user, a first infrared camera corresponding to the eyeball is called to collect images to obtain a first eye image.

[0044] In some embodiments, in order to reduce the complexity of scheduling, for each eyeball of the first user, an infrared camera can be randomly selected from at least two infrared cameras corresponding to the eyeball, and the randomly selected infrared camera can be determined as the first infrared camera.

[0045] In some embodiments, in order to improve the accuracy of scheduling, for each eye of the first user, a target infrared camera can be selected from at least two infrared cameras corresponding to the eye according to the historical eye movement information of the first user, and the selected target infrared camera can be determined as the first infrared camera.

[0046] In an embodiment of the present application, the historical eye movement information can reflect the eye movement habits of the first user when wearing the electronic device. In actual applications, the historical eye movement information may include: the rotation angle and rotation frequency of the left and right eyeballs.

[0047] In step 302, first pupil imaging information in a first eye image is determined.

[0048] In the embodiments of the present application, considering that the pupil-corneal reflection method is a widely used and mature eye movement algorithm solution on the market, the key to the algorithm is the positioning accuracy of the pupil and the glint (Glint) point, wherein the Glint point is a bright reflective point formed in the eye image after the infrared light is reflected by the human cornea, and is easier to segment; the pupil edge segmentation is relatively difficult, so the camera scheduling mechanism can be designed based on the first pupil imaging information in the eye image, wherein the first pupil imaging information is used to reflect the image quality of the first eye image.

[0049] In some embodiments, the first pupil imaging information may include: the aspect ratio of the maximum circumscribed rectangle of the outer contour of the pupil.

[0050] like Figure 4 As shown, the pupil is round in an ideal situation, and becomes a long and narrow line in an extreme situation. Specifically, the pupil imaging state can be judged by the aspect ratio of the maximum circumscribed rectangle of the pupil's outer contour. In an ideal situation, the aspect ratio of the maximum circumscribed rectangle of the pupil is close to 1, and in a better situation, the width and height of the circumscribed rectangle is between 0.4 and 0.7, and in an extreme situation, the aspect ratio is less than 0.2. The larger the aspect ratio of the maximum circumscribed rectangle of the pupil's outer contour, the higher the image quality of the eye image. Among them, Figure 5 The "rectangular box" in represents the maximum circumscribed rectangle of the pupil's outer contour. Figure 5 The "W" in represents the width of the maximum circumscribed rectangle of the pupil's outer contour. Figure 5 The "h" in represents the height of the maximum circumscribed rectangle of the pupil's outer contour.

[0051] In some embodiments, since the pupil center coordinates are easier to calculate from the eye image than the aspect ratio of the maximum circumscribed rectangle of the pupil's outer contour, the first pupil imaging information may include: the pupil center coordinates.

[0052] In step 303, based on the first pupil imaging information, it is determined whether to switch from the first infrared camera to the second infrared camera for image acquisition; wherein the second infrared camera is one of all third infrared cameras, and the third infrared camera is an infrared camera other than the first infrared camera among the infrared cameras used to track each eyeball.

[0053] In an embodiment of the present application, if the first pupil imaging information of the first eye image indicates that the image quality of the first eye image is high, image acquisition continues to be performed through the first infrared camera; if the first pupil imaging information of the first eye image indicates that the image quality of the first eye image is poor, the first infrared camera is switched to the second infrared camera, and image acquisition is performed through the second infrared camera.

[0054] In some embodiments, Figure 6As shown, the above step 303 may include the following steps: step 3031, step 3032 and step 3033;

[0055] In step 3031, a first relationship table is obtained; wherein the first relationship table includes: a plurality of different mapping relationships, each mapping relationship includes: a correspondence between the second pupil imaging information collected by the first infrared camera and the second pupil imaging information collected by each third infrared camera at the same time and the same eye rotation angle, the second pupil imaging information includes: the pupil center coordinates and the aspect ratio of the circumscribed rectangle of the maximum outer contour of the pupil edge, and different groups of mapping relationships correspond to different eye rotation angles.

[0056] In an embodiment of the present application, a first relationship table can be pre-constructed, and the first relationship table is indexed by the coordinates of the center of the pupil, and the entries under the index are the aspect ratios of the circumscribed rectangle of the maximum outer contour of the pupil edge. For example, taking an electronic device equipped with four infrared cameras as an example, for an eyeball, the first relationship table records multiple groups of different mapping relationships of the two infrared cameras corresponding to the eyeball, as shown in Table 1 below.

[0057]

[0058] Table 1

[0059] In an embodiment of the present application, in order to ensure the accuracy of camera scheduling, the first relationship table can be customized based on the pupil imaging situation of the first user. Accordingly, each set of mapping relationships in the first relationship table is pre-generated based on the fundus images captured by the first infrared camera and each third infrared camera at different eye rotation angles of the same eye of the first user. Different eye rotation angles correspond to different areas on the display screen of the electronic device.

[0060] For example, the first user watches the display screen of the electronic device at an interval of FOV5 degrees (5 degrees is a typical value, and theoretically can be any value from 0 to 30 degrees), and the position points of 8 directions (8 directions are a typical value, and theoretically can be any value from 4 to 360) are collected, such as Figure 7 As shown, there are 48 "black dots" on the display screen, each of which corresponds to an area on the display screen. The electronic device instructs the first user to look at different "black dots" on the display screen respectively, and the first infrared camera and each third infrared camera simultaneously capture eye images of the first user, and analyze the captured eye images. Specifically, the canny edge is used to detect pupil edge feature points, and the aspect ratio of the circumscribed rectangle of the maximum outer contour of the pupil edge in the eye image is calculated, and then the pupil center coordinates are obtained by averaging the pupil edge points, thereby generating a first relationship table.

[0061] In step 3032, according to the first relationship table, the aspect ratio of the maximum outer contour circumscribed rectangle of the first pupil edge of the first infrared camera corresponding to the pupil center coordinates in the first eye image and the aspect ratio of the maximum outer contour circumscribed rectangle of the second pupil edge of each third infrared camera are determined.

[0062] In the embodiment of the present application, considering that the larger the value of the aspect ratio of the maximum outer contour circumscribed rectangle of the pupil edge, the higher the image quality of the corresponding eye image, the aspect ratio of the first maximum outer contour circumscribed rectangle of the pupil edge corresponding to the first infrared camera and the aspect ratio of the second maximum outer contour circumscribed rectangle of the pupil edge corresponding to each third infrared camera are determined based on the pupil center coordinates in the first eye image and the first relationship table.

[0063] In step 3033, if the aspect ratios of the maximum outer contour circumscribed rectangle of the first pupil edge are greater than or equal to the aspect ratios of the maximum outer contour circumscribed rectangle of all second pupil edges, continue to collect images through the first infrared camera; if the aspect ratio of the maximum outer contour circumscribed rectangle of the first pupil edge is less than at least one second pupil edge maximum outer contour circumscribed rectangle aspect ratio, then the third infrared camera corresponding to the second pupil edge maximum outer contour circumscribed rectangle aspect ratio with the smallest value is determined as the second infrared camera, and the switch is made from the first infrared camera to the second infrared camera to collect images through the second infrared camera.

[0064] In an embodiment of the present application, if the aspect ratio of the circumscribed rectangle of the maximum outer contour of the first pupil edge is greater than or equal to the aspect ratio of the circumscribed rectangle of the maximum outer contour of all second pupil edges, it means that the imaging effect of the first infrared camera is better than the imaging effect of all third infrared cameras. At this time, image acquisition continues through the first infrared camera.

[0065] In an embodiment of the present application, if the aspect ratio of the circumscribed rectangle of the maximum outer contour of the first pupil edge is smaller than the aspect ratio of the circumscribed rectangle of the maximum outer contour of at least one second pupil edge, it means that the imaging effect of at least one third infrared camera is better than that of the first infrared camera. At this time, the third infrared camera with the best imaging effect is determined as the second infrared camera, and the first infrared camera is switched to the second infrared camera, and image acquisition is performed through the second infrared camera.

[0066] It can be seen that in the embodiment of the present application, in actual use, the pupil center coordinates of the first eye image can be used as a query index basis, and the aspect ratio of the circumscribed rectangle corresponding to the first infrared camera and each third infrared camera can be queried from the pre-constructed first relationship table. The infrared camera is scheduled by the aspect ratio of the circumscribed rectangle. The query method is relatively simple and fast, thereby improving the camera scheduling efficiency.

[0067] In some embodiments, Figure 8As shown, the above step 303 may include the following steps: step 3034, step 3035 and step 3036;

[0068] In step 3034, a second relationship table is obtained, wherein the second relationship table includes: a plurality of different mapping relationships, each mapping relationship includes: a correspondence between the third pupil imaging information collected by the first infrared camera and the third pupil imaging information collected by each third infrared camera at the same time and the same eye rotation angle, the third pupil imaging information includes: pupil center coordinates, aspect ratio of a rectangle circumscribing the maximum outer contour of the pupil edge, and pupil imaging level, different groups of mapping relationships correspond to different eye rotation angles, and there is a negative correlation between the aspect ratio of a rectangle circumscribing the maximum outer contour of the pupil edge and the pupil imaging level.

[0069] In the embodiment of the present application, a second relationship table can be pre-constructed, the second relationship table uses the pupil center coordinates as an index, and divides pupil imaging into n levels according to the value of the aspect ratio of the circumscribed rectangle of the maximum outer contour of the pupil edge, where n is greater than 2. Taking n=4 as an example, the aspect ratio is between 0.7 and 1, set to lever0, between 0.4 and 0.7 is set to lever1, between 0.2 and 0.4 is set to lever2, and less than 0.2 is set to lever3. For example, taking an electronic device equipped with four infrared cameras as an example, for one eyeball, the second relationship table records multiple groups of different mapping relationships of the two infrared cameras corresponding to the eyeball, as shown in Table 2 below.

[0070]

[0071] Table 2

[0072] In an embodiment of the present application, in order to ensure the accuracy of camera scheduling, the second relationship table can be customized based on the pupil imaging situation of the first user. Accordingly, each set of mapping relationships in the second relationship table is pre-generated based on the fundus images captured by the first infrared camera and each third infrared camera at different eye rotation angles of the same eye of the first user. Different eye rotation angles correspond to different areas on the display screen of the electronic device.

[0073] For example, the first user watches the display screen of the electronic device at an interval of FOV5 degrees (5 degrees is a typical value, and theoretically can be any value from 0 to 30 degrees), and the position points of 8 directions (8 directions are a typical value, and theoretically can be any value from 4 to 360) are collected, such as Figure 7As shown, there are 48 "black dots" on the display screen, each of which corresponds to an area on the display screen. The electronic device instructs the first user to look at different "black dots" on the display screen respectively, and the first infrared camera and each third infrared camera simultaneously capture the user's eye image, and analyze the captured eye image. Specifically, the canny edge is used to detect the pupil edge feature points, and the aspect ratio of the circumscribed rectangle of the maximum outer contour of the pupil edge in the eye image is calculated, and then the pupil center coordinates are obtained by averaging the pupil edge points, and finally a corresponding relationship with the pupil imaging level is established to generate a second relationship table.

[0074] In step 3035, according to the second relationship table, the first pupil imaging level of the first infrared camera corresponding to the pupil center coordinates in the first eye image and the second pupil imaging level of each third infrared camera are determined.

[0075] In the embodiment of the present application, considering that the lower the pupil imaging level, the higher the image quality of the corresponding eye image, the first pupil imaging level corresponding to the first infrared camera and the second pupil imaging level corresponding to each third infrared camera are determined according to the pupil center coordinates in the first eye image and the second relationship table.

[0076] In step 3036, if the first pupil imaging level is lower than or equal to all the second pupil imaging levels, image acquisition continues to be performed through the first infrared camera; if the first pupil imaging level is higher than at least one second pupil imaging level, the third infrared camera corresponding to the lowest second pupil imaging level is determined as the second infrared camera, and the first infrared camera is switched to the second infrared camera to perform image acquisition.

[0077] In the embodiment of the present application, if the first pupil imaging level is less than or equal to all the second pupil imaging levels, it means that the imaging effect of the first infrared camera is better than the imaging effect of all the third infrared cameras. At this time, the first infrared camera continues to be used for image acquisition.

[0078] In an embodiment of the present application, if the first pupil imaging level is greater than at least one second pupil imaging level, it means that the imaging effect of at least one third infrared camera is better than that of the first infrared camera. The third infrared camera with the best imaging effect is determined as the second infrared camera, and the first infrared camera is switched to the second infrared camera to collect images through the second infrared camera.

[0079] It can be seen that in the embodiment of the present application, in actual use, the pupil center coordinates of the first eye image can be used as a query index basis, and the pupil imaging levels corresponding to the first infrared camera and each third infrared camera can be queried from the pre-constructed second relationship table. The infrared cameras are scheduled according to the pupil imaging levels, and the query method is relatively simple and fast, thereby improving the camera scheduling efficiency.

[0080] It can be seen from the above embodiment that in this embodiment, when the first user wears the electronic device, for each eyeball of the first user, the first infrared camera corresponding to the eyeball is called to perform image acquisition to obtain a first eye image; first pupil imaging information in the first eye image is determined; based on the first pupil imaging information, it is determined whether to switch from the first infrared camera to the second infrared camera for image acquisition, wherein the second infrared camera is one of all third infrared cameras, and the third infrared camera is an infrared camera other than the first infrared camera among the infrared cameras used to track each eyeball.

[0081] It can be seen that in the embodiments of the present application, since the pupil imaging information can reflect the quality of the eye image, and the device control function of the electronic device based on eye tracking requires high-quality eye images, and in most cases for a single eyeball, one infrared camera can capture high-quality eye images, therefore, according to the first pupil imaging information, it is determined whether to switch from the first infrared camera to the second infrared camera for image acquisition, so that it can be ensured that for each eyeball, the currently working infrared camera is the one that captures the fundus image with higher quality among all the infrared cameras corresponding to the eyeball, so that when the eye tracking function is turned on, the electronic device only needs to control two infrared cameras to work at the same time to achieve accurate tracking of the user's eyes. Compared with the related art in which all infrared cameras work at the same time, the power consumption of the electronic device is reduced, thereby avoiding heating and jamming problems.

[0082] The camera scheduling method provided in the embodiment of the present application can be executed by a camera scheduling device. In the embodiment of the present application, the camera scheduling device provided in the embodiment of the present application is described by taking the camera scheduling method executed by the camera scheduling device as an example.

[0083] Fig. 9 is a structural block diagram of a camera scheduling device provided in an embodiment of the present application, which is applied to an electronic device, wherein the electronic device includes: at least two infrared cameras for tracking a user's left eye and at least two infrared cameras for tracking a user's right eye, and the camera scheduling device 900 may include: a calling module 901, a first determining module 902, and a second determining module 903;

[0084] The calling module 901 is used for calling a first infrared camera corresponding to each eyeball of the first user to collect an image when the first user wears the electronic device, so as to obtain a first eye image;

[0085] A first determining module 902, configured to determine first pupil imaging information in the first eye image;

[0086] A second determination module 903 is used to determine whether to switch from the first infrared camera to the second infrared camera for image acquisition according to the first pupil imaging information;

[0087] The second infrared camera is one of all third infrared cameras, and the third infrared camera is an infrared camera other than the first infrared camera among the infrared cameras used for tracking each of the eyeballs.

[0088] It can be seen from the above embodiment that in this embodiment, when the first user wears the electronic device, for each eyeball of the first user, the first infrared camera corresponding to the eyeball is called to perform image acquisition to obtain a first eye image; first pupil imaging information in the first eye image is determined; based on the first pupil imaging information, it is determined whether to switch from the first infrared camera to the second infrared camera for image acquisition, wherein the second infrared camera is one of all third infrared cameras, and the third infrared camera is an infrared camera other than the first infrared camera among the infrared cameras used to track each eyeball.

[0089] It can be seen that in the embodiments of the present application, since the pupil imaging information can reflect the quality of the eye image, and the device control function of the electronic device based on eye tracking requires high-quality eye images, and in most cases for a single eyeball, one infrared camera can capture high-quality eye images, therefore, according to the first pupil imaging information, it is determined whether to switch from the first infrared camera to the second infrared camera for image acquisition, so that it can be ensured that for each eyeball, the currently working infrared camera is the one that captures the fundus image with higher quality among all the infrared cameras corresponding to the eyeball, so that when the eye tracking function is turned on, the electronic device only needs to control two infrared cameras to work at the same time to achieve accurate tracking of the user's eyes. Compared with the related art in which all infrared cameras work at the same time, the power consumption of the electronic device is reduced, thereby avoiding heating and jamming problems.

[0090] Optionally, as an embodiment, the first pupil imaging information includes: pupil center coordinates.

[0091] Optionally, as an embodiment, the second determining module 903 may include:

[0092] A first acquisition submodule is used to acquire a first relationship table, wherein the first relationship table includes: a plurality of groups of different mapping relationships, each group of the mapping relationships includes: a correspondence between the second pupil imaging information collected by the first infrared camera and the second pupil imaging information collected by each of the third infrared cameras at the same time and the same eyeball rotation angle, the second pupil imaging information includes: pupil center coordinates and aspect ratio of a circumscribed rectangle of a maximum outer contour of a pupil edge, and different groups of mapping relationships correspond to different eyeball rotation angles;

[0093] A first determining submodule, configured to determine, according to the first relationship table, the aspect ratio of a maximum outer contour circumscribed rectangle of a first pupil edge of the first infrared camera corresponding to the pupil center coordinates in the first eye image, and the aspect ratio of a maximum outer contour circumscribed rectangle of a second pupil edge of each of the third infrared cameras;

[0094] A first acquisition submodule, configured to continue to acquire images through the first infrared camera if the aspect ratios of the rectangle circumscribed by the maximum outer contour of the first pupil edge are greater than or equal to the aspect ratios of the rectangle circumscribed by the maximum outer contour of all the second pupil edges;

[0095] The second acquisition submodule is used to determine the third infrared camera corresponding to the smallest aspect ratio of the circumscribed rectangle of the maximum outer contour of the second pupil edge as the second infrared camera if the aspect ratio of the circumscribed rectangle of the maximum outer contour of the first pupil edge is smaller than at least one aspect ratio of the circumscribed rectangle of the maximum outer contour of the second pupil edge, and switch from the first infrared camera to the second infrared camera to acquire images through the second infrared camera.

[0096] Optionally, as an embodiment, the second determining module 903 may include:

[0097] A second acquisition submodule is used to acquire a second relationship table, wherein the second relationship table includes: a plurality of different mapping relationships, each of which includes: a correspondence between the third pupil imaging information collected by the first infrared camera and the third pupil imaging information collected by each of the third infrared cameras at the same time and the same eyeball rotation angle, the third pupil imaging information includes: pupil center coordinates, aspect ratio of a rectangle circumscribed by the maximum outer contour of the pupil edge, and pupil imaging level, different groups of mapping relationships correspond to different eyeball rotation angles, and the aspect ratio of a rectangle circumscribed by the maximum outer contour of the pupil edge is negatively correlated with the pupil imaging level;

[0098] A second determining submodule, configured to determine, according to the second relationship table, a first pupil imaging level of the first infrared camera corresponding to the pupil center coordinates in the first eye image, and a second pupil imaging level of each of the third infrared cameras;

[0099] A third acquisition submodule, configured to continue to acquire images through the first infrared camera if the first pupil imaging levels are all lower than or equal to all the second pupil imaging levels;

[0100] The fourth acquisition submodule is used to determine the third infrared camera corresponding to the second pupil imaging level with the lowest level as the second infrared camera if the first pupil imaging level is higher than at least one of the second pupil imaging levels, and switch from the first infrared camera to the second infrared camera to acquire images through the second infrared camera.

[0101] Optionally, as an embodiment, each group of the mapping relationships is pre-generated based on fundus images captured by the first infrared camera and each of the third infrared cameras simultaneously at different eye rotation angles of the same eye of the first user, and the different eye rotation angles correspond to different areas on the display screen of the electronic device.

[0102] Optionally, as an embodiment, the camera scheduling device 900 may further include:

[0103] A third determining module is configured to randomly select an infrared camera from at least two infrared cameras corresponding to the eyeball, and determine the randomly selected infrared camera as the first infrared camera; or

[0104] The fourth determination module is used to select a target infrared camera from the at least two infrared cameras corresponding to the eyeball according to the historical eye movement information of the first user, and determine the selected target infrared camera as the first infrared camera.

[0105] The camera scheduling device in the embodiment of the present application can be an electronic device or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other devices other than a terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (Augmented Reality, AR) / virtual reality (Virtual Reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (Ultra-Mobile Personal Computer, UMPC), a netbook, or a personal digital assistant (Personal Digital Assistant, PDA), etc. It can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (Personal Computer, PC), a television (Television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0106] The camera scheduling device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an IOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0107] The camera scheduling device provided in the embodiment of the present application can achieve Figure 3 To avoid repetition, the various processes implemented by the method embodiment will not be described again here.

[0108] Alternatively, if Fig.10 As shown, an embodiment of the present application further provides an electronic device 1000, including a processor 1001 and a memory 1002, wherein the memory 1002 stores programs or instructions that can be executed on the processor 1001, and when the program or instructions are executed by the processor 1001, the various steps of the above-mentioned camera scheduling method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, they are not described here.

[0109] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.

[0110] Fig.11 It is a schematic diagram of the hardware structure of an electronic device provided in various embodiments of the present application.

[0111] The electronic device 1100 includes but is not limited to: a radio frequency unit 1101, a network module 1102, an audio output unit 1103, an input unit 1104, a sensor 1105, a display unit 1106, a user input unit 1107, an interface unit 1108, a memory 1109 and a processor 1110 and other components.

[0112] Those skilled in the art will appreciate that the electronic device 1100 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 1110 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig.11 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0113] Processor 1110 is used to call the first infrared camera corresponding to each eyeball of the first user to perform image acquisition to obtain a first eye image when the first user wears the electronic device; determine first pupil imaging information in the first eye image; and determine whether to switch from the first infrared camera to the second infrared camera for image acquisition based on the first pupil imaging information; wherein the second infrared camera is one of all third infrared cameras, and the third infrared camera is an infrared camera other than the first infrared camera among the infrared cameras used to track each of the eyeballs.

[0114] It can be seen that in the embodiments of the present application, since the pupil imaging information can reflect the quality of the eye image, and the device control function of the electronic device based on eye tracking requires high-quality eye images, and in most cases for a single eyeball, one infrared camera can capture high-quality eye images, therefore, according to the first pupil imaging information, it is determined whether to switch from the first infrared camera to the second infrared camera for image acquisition, so that it can be ensured that for each eyeball, the currently working infrared camera is the one that captures the fundus image with higher quality among all the infrared cameras corresponding to the eyeball, so that when the eye tracking function is turned on, the electronic device only needs to control two infrared cameras to work at the same time to achieve accurate tracking of the user's eyes. Compared with the related art in which all infrared cameras work at the same time, the power consumption of the electronic device is reduced, thereby avoiding heating and jamming problems.

[0115] Optionally, as an embodiment, the first pupil imaging information includes: pupil center coordinates.

[0116] Optionally, as an embodiment, the processor 1110 is specifically used to obtain a first relationship table, wherein the first relationship table includes: a plurality of groups of different mapping relationships, each group of the mapping relationships includes: a correspondence between the second pupil imaging information collected by the first infrared camera and the second pupil imaging information collected by each of the third infrared cameras at the same time and the same eyeball rotation angle, the second pupil imaging information includes: pupil center coordinates and aspect ratio of a circumscribed rectangle of a maximum outer contour of a pupil edge, and different groups of mapping relationships correspond to different eyeball rotation angles;

[0117] Determine, according to the first relationship table, the aspect ratio of the maximum outer contour circumscribed rectangle of the first pupil edge of the first infrared camera corresponding to the pupil center coordinates in the first eye image, and the aspect ratio of the maximum outer contour circumscribed rectangle of the second pupil edge of each of the third infrared cameras;

[0118] If the aspect ratios of the rectangle circumscribed by the maximum outer contour of the first pupil edge are greater than or equal to the aspect ratios of the rectangle circumscribed by the maximum outer contour of the second pupil edge, continue to collect images through the first infrared camera;

[0119] If the aspect ratio of the rectangle circumscribed by the maximum outer contour of the first pupil edge is smaller than at least one aspect ratio of the rectangle circumscribed by the maximum outer contour of the second pupil edge, the third infrared camera corresponding to the aspect ratio of the rectangle circumscribed by the maximum outer contour of the second pupil edge with the smallest value is determined as the second infrared camera, and the first infrared camera is switched to the second infrared camera to collect images through the second infrared camera.

[0120] Optionally, as an embodiment, the processor 1110 is specifically used to obtain a second relationship table, wherein the second relationship table includes: a plurality of groups of different mapping relationships, each group of the mapping relationships includes: a correspondence between the third pupil imaging information collected by the first infrared camera and the third pupil imaging information collected by each of the third infrared cameras at the same time and the same eyeball rotation angle, the third pupil imaging information includes: pupil center coordinates, aspect ratio of a rectangle circumscribed by the maximum outer contour of the pupil edge, and pupil imaging level, different groups of mapping relationships correspond to different eyeball rotation angles, and the aspect ratio of a rectangle circumscribed by the maximum outer contour of the pupil edge is negatively correlated with the pupil imaging level;

[0121] Determine, according to the second relationship table, a first pupil imaging level of the first infrared camera corresponding to the pupil center coordinates in the first eye image, and a second pupil imaging level of each of the third infrared cameras;

[0122] If the first pupil imaging levels are all lower than or equal to all the second pupil imaging levels, continue to collect images through the first infrared camera;

[0123] If the first pupil imaging level is higher than at least one of the second pupil imaging levels, the third infrared camera corresponding to the second pupil imaging level with the lowest level is determined as the second infrared camera, and the first infrared camera is switched to the second infrared camera to collect images through the second infrared camera.

[0124] Optionally, as an embodiment, each group of the mapping relationships is pre-generated based on fundus images captured by the first infrared camera and each of the third infrared cameras simultaneously at different eye rotation angles of the same eye of the first user, and the different eye rotation angles correspond to different areas on the display screen of the electronic device.

[0125] Optionally, as an embodiment, the processor 1110 is further used to randomly select an infrared camera from at least two infrared cameras corresponding to the eyeball, and determine the randomly selected infrared camera as the first infrared camera; or, based on the historical eye movement information of the first user, select a target infrared camera from at least two infrared cameras corresponding to the eyeball, and determine the selected target infrared camera as the first infrared camera.

[0126] It should be understood that in the embodiment of the present application, the input unit 1104 may include a graphics processor (Graphics Processing Unit, GPU) 11041 and a microphone 11042, and the graphics processor 11041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 1106 may include a display panel 11061, and the display panel 11061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 1107 includes a touch panel 11071 and at least one of other input devices 11072. The touch panel 11071 is also called a touch screen. The touch panel 11071 may include two parts: a touch detection device and a touch controller. Other input devices 11072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0127] The memory 1109 can be used to store software programs and various data. The memory 1109 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 1109 may include a volatile memory or a non-volatile memory, or the memory 1109 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 1109 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0128] The processor 1110 may include one or more processing units; optionally, the processor 1110 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 1110.

[0129] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned camera scheduling method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0130] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0131] The embodiment of the present application also provides a chip, the chip includes a processor and a communication interface, the communication interface is coupled to the processor, the processor is used to run a program or instruction, implement the various processes of the above-mentioned camera scheduling method embodiment, and can achieve the same technical effect, to avoid repetition, it will not be repeated here. It should be understood that the chip mentioned in the embodiment of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0132] An embodiment of the present application also provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned camera scheduling method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0133] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0134] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for enabling a terminal (such as a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0135] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. A camera scheduling method, applied to an electronic device, the electronic device comprising: At least two infrared cameras for tracking the user's left eye and at least two infrared cameras for tracking the user's right eye, wherein the method comprises: When a first user wears the electronic device, for each eyeball of the first user, calling a first infrared camera corresponding to the eyeball to collect an image to obtain a first eye image; Determining first pupil imaging information in the first eye image; determining, according to the first pupil imaging information, whether to switch from the first infrared camera to the second infrared camera for image acquisition; The second infrared camera is one of all third infrared cameras, and the third infrared camera is an infrared camera other than the first infrared camera among the infrared cameras used for tracking each of the eyeballs.

2. The method according to claim 1, characterized in that The first pupil imaging information includes: pupil center coordinates.

3. The method according to claim 2, characterized in that The determining, according to the first pupil imaging information, whether to switch from the first infrared camera to the second infrared camera for image acquisition includes: Obtaining a first relationship table, wherein the first relationship table includes: a plurality of groups of different mapping relationships, each group of the mapping relationships includes: a correspondence between the second pupil imaging information collected by the first infrared camera and the second pupil imaging information collected by each of the third infrared cameras at the same time and the same eyeball rotation angle, the second pupil imaging information includes: pupil center coordinates and aspect ratio of a circumscribed rectangle of a maximum outer contour of a pupil edge, and different groups of mapping relationships correspond to different eyeball rotation angles; Determine, according to the first relationship table, the aspect ratio of the maximum outer contour circumscribed rectangle of the first pupil edge of the first infrared camera corresponding to the pupil center coordinates in the first eye image, and the aspect ratio of the maximum outer contour circumscribed rectangle of the second pupil edge of each of the third infrared cameras; If the aspect ratios of the rectangle circumscribed by the maximum outer contour of the first pupil edge are greater than or equal to the aspect ratios of the rectangle circumscribed by the maximum outer contour of the second pupil edge, continue to collect images through the first infrared camera; If the aspect ratio of the rectangle circumscribed by the maximum outer contour of the first pupil edge is smaller than at least one aspect ratio of the rectangle circumscribed by the maximum outer contour of the second pupil edge, the third infrared camera corresponding to the aspect ratio of the rectangle circumscribed by the maximum outer contour of the second pupil edge with the smallest value is determined as the second infrared camera, and the first infrared camera is switched to the second infrared camera to collect images through the second infrared camera.

4. The method according to claim 2, characterized in that: The determining, according to the first pupil imaging information, whether to switch from the first infrared camera to the second infrared camera for image acquisition includes: Obtain a second relationship table, wherein the second relationship table includes: a plurality of different mapping relationships, each of the mapping relationships includes: a correspondence between the third pupil imaging information collected by the first infrared camera and the third pupil imaging information collected by each of the third infrared cameras at the same time and the same eyeball rotation angle, the third pupil imaging information includes: pupil center coordinates, a circumscribed rectangle aspect ratio of the maximum outer contour of the pupil edge, and a pupil imaging level, different groups of mapping relationships correspond to different eyeball rotation angles, and the circumscribed rectangle aspect ratio of the maximum outer contour of the pupil edge is negatively correlated with the pupil imaging level; Determine, according to the second relationship table, a first pupil imaging level of the first infrared camera corresponding to the pupil center coordinates in the first eye image, and a second pupil imaging level of each of the third infrared cameras; If the first pupil imaging levels are all lower than or equal to all the second pupil imaging levels, continue to collect images through the first infrared camera; If the first pupil imaging level is higher than at least one of the second pupil imaging levels, the third infrared camera corresponding to the second pupil imaging level with the lowest level is determined as the second infrared camera, and the first infrared camera is switched to the second infrared camera to collect images through the second infrared camera.

5. The method according to claim 3 or 4, characterized in that: Each group of mapping relationships is pre-generated based on fundus images captured simultaneously by the first infrared camera and each of the third infrared cameras at different eye rotation angles of the same eye of the first user, and the different eye rotation angles correspond to different areas on the display screen of the electronic device.

6. The method according to claim 1, characterized in that Before the step of calling the first infrared camera corresponding to the eyeball to collect images and obtain the first eye image, the method further includes: Randomly select an infrared camera from at least two infrared cameras corresponding to the eyeball, and determine the randomly selected infrared camera as the first infrared camera; or, According to the historical eye movement information of the first user, a target infrared camera is selected from the at least two infrared cameras corresponding to the eyeball, and the selected target infrared camera is determined as the first infrared camera.

7. A camera scheduling device, applied to an electronic device, the electronic device comprising: At least two infrared cameras for tracking the user's left eye and at least two infrared cameras for tracking the user's right eye, wherein the device comprises: A calling module, configured to call a first infrared camera corresponding to each eyeball of the first user to perform image acquisition to obtain a first eye image when the first user wears the electronic device; A first determination module, used to determine first pupil imaging information in the first eye image; A second determination module, used to determine whether to switch from the first infrared camera to the second infrared camera for image acquisition according to the first pupil imaging information; The second infrared camera is one of all third infrared cameras, and the third infrared camera is an infrared camera other than the first infrared camera among the infrared cameras used for tracking each of the eyeballs.

8. An electronic device, characterized in that: The method comprises a processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the camera scheduling method according to any one of claims 1 to 6 are implemented.

9. A readable storage medium, characterized in that: The readable storage medium stores a program or instruction, and when the program or instruction is executed by the processor, the steps of the camera scheduling method according to any one of claims 1 to 6 are implemented.

10. A computer program product, characterized in that The program product is stored in a storage medium, and the program product is executed by at least one processor to implement the camera scheduling method as described in any one of claims 1 to 6.