Method and apparatus for determining biometric data using an infrared illuminator array

Abstract

The present application describes methods, devices, and systems for determining biometric data using an infrared IR illuminator array. In an example, a method may include: projecting a plurality of IR dots onto a user using a dot projector and an IR illuminator array; capturing an IR image of the plurality of IR dots using an IR camera; comparing a plurality of pixels of the captured IR image with a plurality of corresponding pixels of a baseline IR image using a processing resource; and determining biometric data of the user based at least in part on comparing the captured IR image with the baseline IR image using the processing resource.

Description

[0001] Information about divisional applications

[0002] This application is a divisional application of the Chinese invention patent application with application number 202111305144.4, application date November 5, 2021, and invention name “Method and device for determining biometric data using an infrared illuminator array”. Technical Field

[0003] The present disclosure relates generally to infrared (IR) illuminator arrays, and more particularly, to methods, devices, and systems related to determining biometric data of a user using an IR illuminator array. Background Art

[0004] An IR illuminator can be, for example, a device that emits IR light. IR is a region of the electromagnetic radiation spectrum. The wavelengths in the IR region range from about 700 nanometers (NM) to 1 millimeter (mm). A dot projector can project IR light as a grid pattern. An IR camera, also called a thermal imaging camera or a thermal imaging camera, can capture IR light and use the IR light to form an image of a thermal region. Summary of the invention

[0005] In one aspect, the present disclosure relates to a method comprising: projecting a plurality of infrared (IR) dots onto a user using a dot projector and an array of infrared (IR) illuminators; capturing an IR image of the plurality of IR dots using an IR camera; comparing a plurality of pixels of the captured IR image with a plurality of corresponding pixels of a baseline IR image using processing resources; and determining biometric data of the user based at least in part on comparing the captured IR image with the baseline IR image using the processing resources.

[0006] On the other hand, the present disclosure relates to a device comprising: an infrared (IR) illuminator array, the IR illuminator array being configured to generate IR light; a dot projector, the dot projector being configured to project a plurality of IR dots onto a user using the IR light generated by the IR illuminator array; an IR camera, the IR camera being configured to capture an IR image of the plurality of IR dots; processing resources, the processing resources being configured to: compare a plurality of pixels of the captured IR image with a plurality of corresponding pixels of a baseline IR image; and determine biometric data of the user based at least in part on comparing the captured IR image with the baseline IR image; and a user interface, the user interface being used to display a video.

[0007] On the other hand, the present disclosure relates to a device, comprising: an infrared (IR) illuminator array, the IR illuminator array being configured to generate IR light; a dot projector, the dot projector being configured to project a plurality of IR dots onto a user using the IR light generated by the IR illuminator array; an IR camera, the IR camera being configured to capture an IR image of the plurality of IR dots; processing resources, the processing resources being configured to: compare a plurality of pixels of the captured IR image with a plurality of corresponding pixels of a baseline IR image; determine biometric data of the user based at least in part on comparing the captured IR image with the baseline IR image; and an AI accelerator, the AI ​​accelerator being configured to perform AI operations using the biometric data. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] Figure 1 An example of a device for determining biometric data of a user according to several embodiments of the present disclosure is shown.

[0009] Figure 2 An example of a device for determining biometric data of a user according to several embodiments of the present disclosure is shown.

[0010] Figure 3 An example of a device for determining biometric data of a user according to several embodiments of the present disclosure is shown.

[0011] Figure 4 is a flow chart of a method for determining biometric data of a user according to several embodiments of the present disclosure. DETAILED DESCRIPTION

[0012] The present disclosure includes methods, devices, and systems related to determining biometric data using an IR illuminator array. An example method includes: projecting a number of IR dots onto a user using a dot projector and an IR illuminator array; capturing an IR image of the number of IR dots using an IR camera; comparing a number of pixels of the captured IR image with a number of corresponding pixels of a baseline IR image using a processing resource; and determining the user's biometric data based at least in part on comparing the captured IR image with the baseline IR image using the processing resource. The determined biometric data may include the user's heart rate, temperature, calorie burn rate (e.g., number of calories burned over a period of time), physical state, and / or emotional state. The user's health (e.g., physical state) may be determined based on the heat distribution (e.g., intensity parameters per pixel) in the IR image of the user's face, and the user's motion state (e.g., physical state) may be determined based on the heat distribution in the IR image of the user's muscles. For example, a muscle that is being exercised will generate more heat than a muscle that is not being exercised. In some instances, the user's emotional state may be determined based at least in part on the user's posture, facial expression, voice, and / or gesture.

[0013] As used herein, a user may be one or more users. The IR image of a user may include the entire body of the user or a portion of the user's body. A portion of the user's body may be, for example, a face, head, eye, ear, nose, leg, arm, or hand.

[0014] The baseline IR image may also include the whole body or a part of the body.The baseline IR image may be, for example, the user's neutral state, an average IR image of the user created from several previously taken IR images of the user, or an IR image of an average person from a library.

[0015] A single IR illuminator can emit IR light over an area, and an IR illuminator array (e.g., multiple IR illuminators) can emit IR light over a larger area. For example, where a single IR illuminator can emit IR light on the user's face, an IR illuminator array can emit IR light over the user's entire body. Covering the user's entire body with IR light can allow the IR camera to capture IR images of the user's entire body.

[0016] In several embodiments, a first portion of several IR dots may be projected by a dot projector onto a first portion of a user's body, and a second portion of several IR dots may be projected by a dot projector onto a second portion of a user's body. In some instances, the first portion of several IR dots may be a first diameter, and the second portion of several IR dots may be a second diameter. When the dots are projected onto a portion of a user's body that requires more detail in the IR image, the dot diameter may be smaller, and when the dots are projected onto a portion of a user's body that requires less detail in the IR image, the dot diameter may be larger. The dot projector may project dots having a smaller diameter onto a portion of a user's body where the user's body has more variations in contour, color, and / or shape. For example, the dot projector may project dots having a smaller diameter onto a user's face, and dots having a larger diameter onto a user's torso. In some instances, reducing the IR dot diameter allows more dots to be projected in an area, which creates a more detailed IR image of the user in that area.

[0017] In this way, the number of IR dots that the dot projector projects onto a portion of the user's body can depend on where more detail in the IR image is needed. The dot projector can project a first portion of a plurality of IR dots onto a first portion of the user's body and a second portion of a plurality of IR dots onto a second portion of the user's body, wherein the first portion of the number of IR dots is greater than the second portion of the number of IR dots. The dot projector can project a greater number of IR dots onto a portion of the user's body, wherein the user's body has more variation in contour, color, and / or shape. For example, the dot projector can project a greater number of IR dots onto the user's ears than onto the user's chin, because the user's ears have more contour than the user's chin.

[0018] In several embodiments, an axicon or an axicon array can be used in conjunction with an IR illuminator array, a dot projector, and / or an IR camera. An axicon is a tapered optical element with a circular aperture. An axicon can prevent light diffraction. IR light can diffract and lose its intensity with distance. Placing an axicon in front of a dot projector will prevent the IR light from diffracting and allow the IR light to maintain its intensity at a greater distance. In some instances, a device including an IR illuminator array, a dot projector, an axicon array, and an IR camera can project and capture IR images of several IR dots at a greater distance from the device than a device including an IR illuminator array, a dot projection, and an IR camera without an axicon array.

[0019] The IR camera can capture the IR light emitted by the IR illuminator array and form an IR image (e.g., a hotspot image) using several IR points. In several embodiments, several IR cameras can be used to capture several IR images. For example, each of the several IR cameras can be located at a different position to capture IR images of the user at different sides of the user and / or different angles of the user.

[0020] As used herein, "a number of" something may refer to one or more such things. For example, a number of computing devices may refer to one or more computing devices. "A plurality of" something means two or more. Additionally, as used herein, designators such as "X" and "Y," particularly with respect to reference numerals in the accompanying drawings, indicate that a number of a particular feature so designated may be included in several embodiments of the present disclosure.

[0021] The figures herein follow a numbering convention in which the first digit or digits correspond to the figure number and the remaining digits identify an element or component in the figure. Similar elements or components between different figures may be identified by using similar numerals. For example, reference number 102 may represent Figure 1 , and similar elements can be represented as Figure 2 202 in the drawings. In some cases, multiple similar but functionally and / or structurally distinguishable elements or components in the same figure or in different figures may be referred to by the same element number (e.g., Figure 1 104-1, 104-2 and 104-X) in the figure are sequentially referenced. As will be understood, the elements shown in the various embodiments herein can be added, exchanged and / or eliminated to provide several additional embodiments of the present disclosure. In addition, the proportions and relative proportions of the elements provided in the drawings are intended to illustrate various embodiments of the present disclosure and are not intended to be limiting.

[0022] Figure 1 An example of a device 110 for determining biometric data of a user 106 according to several embodiments of the present disclosure is shown. The device 110 may be, but is not limited to, a television, a smart television, a gaming system, a piece of fitness equipment, a smart mirror, a computing device, a personal laptop computer, a desktop computer, a smart phone, a tablet computer, a wristband device, a digital camera, and / or redundant combinations thereof. Figure 1 As shown, the device 110 may include an infrared illuminator 100 , a dot projector 102 , a number of axicons 104 - 1 , 104 - 2 . . . 104 -X, and an IR camera 108 .

[0023] For example, biometric data may include the user's heart rate, temperature, calorie burn rate, physical state, and / or emotional state. The user's emotional state may be determined based at least in part on the user's posture, facial expression, voice, and / or gestures.

[0024] The one or more IR images may be used to determine the user's heart rate, temperature, calorie burn rate, posture, facial expression, and / or gesture. The one or more IR images may be created by projecting a plurality of IR dots 105-1, 105-2, ... 105-Y onto the user 106 using a dot projector 102 and an IR illuminator 100 and capturing IR images of the plurality of IR dots 105-1, 105-2, ... 105-Y using an IR camera 108.

[0025] The IR illuminator 100 can emit IR light. The IR illuminator 100 can be a single IR illuminator and / or an IR illuminator array. As previously described, an IR illuminator array can emit IR light over a larger area than a single IR illuminator. For example, a single IR illuminator can emit IR light over a portion of a user's body, while an IR illuminator array can emit IR light over several users.

[0026] The dot projector 102 using IR light emitted by the IR illuminator 100 may project the plurality of dots 105-1, 105-2, ... 105-Y directly onto the user 106 and / or onto the plurality of users from the dot projector 102 through the plurality of axicons 104-1, 104-2, ... 104-X6666. For example, a first portion of the plurality of IR dots 105-1, 105-2, ... 105-Y may be projected onto a first user by the dot projector 102, and a second portion of the plurality of IR dots 105-1, 105-2, ... 105-Y may be projected onto a second user by the dot projector 102.

[0027] In some embodiments, a first portion of the plurality of IR spots 105-1, 105-2, ... 105-Y may be projected by the dot projector 102 onto a first portion of the body of the user 106, and a second portion of the plurality of IR spots 105-1, 105-2, ... 105-Y may be projected by the dot projector 102 onto a second portion of the body of the user 106. For example, the first portion of the plurality of IR spots 105-1, 105-2, ... 105-Y may include IR spots 105-1 and 105-2, and the second portion of the plurality of IR spots 105-1, 105-2, ... 105-Y may include IR spot 105-Y.

[0028] A first portion of the plurality of IR dots 105-1, 105-2, ... 105-Y may be a first diameter, and a second portion of the plurality of IR dots 105-1, 105-2, ... 105-Y may be a second diameter. In some examples, the diameter of the IR dots may be determined by the distance that the IR light travels from the IR projector 102. For example, the farther the IR light travels, the larger the IR dots, so that the IR projector 102 may project a smaller IR dot when the user 106 is farther away, and a larger IR dot when the user 106 is closer to the IR projector 102.

[0029] Although not in Figure 1 , but the IR dot diameter may be smaller when the IR dots are projected onto a portion of the user's body that requires more detail in the IR image, and may be larger when the IR dots are projected onto a portion of the user's body that requires less detail in the IR image. The dot projector 102 may project dots with a smaller diameter onto a portion of the user's body where the user's body has more variations in contour, color, and / or shape. For example, the dot projector 102 may project IR dots with a smaller diameter onto the user's face and IR dots with a larger diameter onto the user's body, e.g., the neck, shoulders, chest, torso, arms, and / or legs. In some instances, reducing the IR dot diameter allows more IR dots to be projected in an area, which creates a more detailed IR image of the user 106 in that area.

[0030] The number of IR dots 105-1, 105-2, ... 105-Y that the dot projector 102 projects onto a portion of the user's body may depend on the location where more detail in the IR image is desired. The dot projector 102 may project a first portion of the plurality of IR dots 105-1, 105-2, ... 105-Y onto a first portion of the user's body, and a second portion of the plurality of IR dots 105-1, 105-2, ... 105-Y onto a second portion of the user's body. The dot projector 102 may project a greater number of IR dots 105-1, 105-2, ... 105-Y onto a portion of the user's body where the user's body has more variations in contour, color, and / or shape. For example, the dot projector 102 may project a greater number of IR dots 105-1, 105-2, ... 105-Y onto the ears of the user 106 rather than onto the chin of the user 106 because the user's ears have more contours than the user's chin.

[0031] In several embodiments, the axicon 104 or an axicon array 104-1, 104-2, ... 104-X may be used in conjunction with the IR illuminator 100, the dot projector 102, and / or the IR camera 108. The axicon 104 is a tapered optical element with a circular aperture. The axicon 104 may prevent light diffraction. IR light may diffract and lose its intensity over distance. Placing the axicon 104 in front of the dot projector 102 will prevent the IR light from diffracting and allow the IR light to maintain its intensity over a greater distance. In some instances, device 110 including IR illuminator 100, dot projector 102, axicon arrays 104-1, 104-2, ... 104-X, and IR camera 108 may project and capture images of several IR dots 105-1, 105-2, ... 105-Y at a greater distance from device 110 than a device without axicon arrays 104-1, 104-2, ... 104-X.

[0032] The IR camera 108 can capture the IR light emitted by the IR illuminator 100 and capture IR images of the plurality of IR points 105-1, 105-2, ... 105-Y. In several embodiments, the plurality of IR cameras 108 can be used to capture the plurality of IR points 105-1, 105-2, ... 105-Y. For example, each of the plurality of IR cameras 108 can be located at a different position to capture the plurality of IR points 105-1, 105-2, ... 105-Y on different sides of the user 106.

[0033] Figure 2 2 shows an example of a device 210 for determining biometric data of a user according to several embodiments of the present disclosure. The device 210 may correspond to Figure 1 The device 110 in FIG. 210 may include an infrared illuminator 200, a dot projector 202, and an IR camera 208. The infrared illuminator 200, the dot projector 202, and the IR camera 208 may correspond to Figure 1 The infrared illuminator 100, the dot projector 102 and the IR camera 108 are shown in FIG. Figure 2 As shown, device 210 may further include processing resources 212 and memory 222 .

[0034] The memory 222 can be any type of storage medium that can be accessed by the processing resource 212 to perform various examples of the present disclosure. For example, the memory 222 can be a non-transitory computer-readable medium having computer-readable instructions (e.g., computer program instructions) stored thereon that can be executed by the processing resource 212 to generate IR light via an IR illuminator, project a number of IR dots onto a user via a dot projector using the IR light generated by the IR illuminator, capture an IR image of the number of IR dots via an IR camera, compare a number of pixels of the captured IR image with a number of corresponding pixels of a baseline IR image, and determine biometric data of the user based at least in part on the comparison of the captured IR image with the baseline IR image.

[0035] In several embodiments, Figure 2 One or more sensors not shown in the figure may be included in device 210. For example, device 210 may include a visible light camera for capturing visible light images. The captured visible light images may be used together with the captured IR images to determine the biometric data of the user. For example, the captured visible light images may include facial expressions that can be used to determine the emotional state of the user. However, facial expressions may mean different emotional states based on the person's geographic location, race, and / or culture. Therefore, the captured IR images may be used in combination with the captured visible light images to determine the user's true emotional state.

[0036] The processing resource 212 may receive one or more IR images from the IR camera 208 and / or from the memory 222. In some instances, the processing resource 212 may combine the IR image from the IR camera 208 with the IR image from the memory 222. For example, the IR image from the IR camera 208 may be less detailed than the IR image from the memory 222 because it is captured from a greater distance from the user than the IR image from the memory 222. The processing resource 212 may use the IR image from the memory 222 and the IR image from the IR camera 208 to create more accurate biometric data for the user.

[0037] In several embodiments, memory 222 can store biometric data of the user. In some instances, the biometric data can be used when playing video games, watching movies, watching instructional videos, and / or fitness videos.

[0038] The memory 222 may be a volatile or non-volatile memory. The memory 222 may also be a removable (e.g., portable) memory or a non-removable (e.g., internal) memory. For example, the memory 222 may be a random access memory (RAM) (e.g., a dynamic random access memory (DRAM) and / or a phase change random access memory (PCRAM)), a read-only memory (ROM) (e.g., an electrically erasable programmable read-only memory (EEPROM) and / or a compact disc read-only memory (CD-ROM)), a flash memory, a laser disk, a digital versatile disk (DVD), or other optical storage and / or a magnetic medium such as a cassette, a tape, or a disk, as well as other types of memory.

[0039] In addition, although the memory 222 is shown as being located within the device 200, embodiments of the present disclosure are not limited thereto. For example, the memory 222 may be located on an external device (eg, enabling computer readable instructions to be downloaded via the Internet or other wired or wireless connection).

[0040] Figure 3 2 shows an example of a device 310 for determining biometric data of a user according to several embodiments of the present disclosure. The device 310 may correspond to Figure 2 Device 210 in. Device 310 may include IR illuminator 300, dot projector 302, axicon 304, IR camera 308, processing resources 312, and memory 322. IR illuminator 300, dot projector 302, IR camera 308, processing resources 312, and memory 322 may correspond to Figure 2 The infrared illuminator 200, the dot projector 202, the IR camera 208, the processing resources 212 and the memory 222 in FIG. The axicon 304 may correspond to Figure 1 Axis prism 104 in FIG. Figure 3 As shown, device 310 may also include a user interface 314 , an acoustic sensor 316 , a proximity sensor 320 , an AI accelerator 324 , a speaker 328 , and a light 329 .

[0041] The AI ​​accelerator 324 may include hardware, software, and / or firmware configured to use one or more AI models to perform operations (e.g., logical operations, etc.) associated with AI operations. The AI ​​model may be stored in the memory 322 and / or outside the device 310. In several embodiments, the AI ​​model may be trained on and / or outside the device 310. Data or sample data from a user may be used to train the AI ​​model. In some instances, several heart rates, heart rate conditions (e.g., frequency and / or amplitude of heartbeats), temperatures, calorie burn rates, physical states, and / or emotional states of people with corresponding baseline IR images may be used to train the AI ​​model. For example, a baseline IR image of a person identified as having an angry emotional state may be used to train the AI ​​model. Compared to an IR image of a relaxed person, a baseline IR image of an angry person will include more heat generated by blood flow. For example, a baseline IR image of an angry person will include several pixels within a specific color value range.

[0042] The AI ​​accelerator 324 may include training parameters to train the AI ​​model. The training parameters may include intensity and brightness distribution, intensity or thermal distribution at different wavelengths (e.g., spectrum), spatial distribution comparison on high pass and / or low pass filtered data, difference between two IR images in the Fourier domain, and / or feature extraction and classification.

[0043] Data from the captured IR image can be input into the AI ​​model. The data may include a color value for each pixel of the captured IR image. The color value of each of the several pixels may be compared with the color value of each of the several pixels from one or more baseline IR images. For example, the AI ​​model may compare several pixels of the captured IR image with several corresponding pixels of the baseline IR image. For example, if several pixels of the captured image and several pixels of the baseline IR image are from the same specific area of ​​the face, the several pixels of the captured IR image may correspond to several pixels of the baseline IR image. If several pixels of the captured IR image are within a specific color value range of several pixels of the baseline image, the user's biometric data (e.g., heart rate, temperature, calorie burn rate, physical state, and / or emotional state) may be the same or similar to the biometric data identified with the baseline IR image.

[0044] In some instances, the biometric data of the user in the captured IR image can be determined by extrapolating the biometric data of the baseline IR image. For example, the baseline IR image can be associated with a temperature. The temperature associated with the captured IR image can be determined by comparing the captured IR image with the baseline IR image to determine a difference and using the difference and the temperature associated with the baseline IR image to calculate the temperature associated with the captured IR image. The user interface 314 can be generated by the device 310. The user interface 314 can be a graphical user interface (GUI) capable of providing information to a user of the device 310 and / or receiving information from a user of the device. The user interface 314 can be displayed on a display of the device 310.

[0045] In several embodiments, user interface 314 can be generated in response to input from a user. User input to generate user interface 314 can include, for example, powering on device 310 and / or selecting an application.

[0046] Once the user interface 314 is generated on the device 310, the user interface 314 can display a video. In some instances, the video can be a video game, a movie, an instructional video, or a fitness video. In several embodiments, an AI operation can be performed on the biometric data using an AI accelerator 324, and the video can be modified in response to the output of the AI ​​operation.

[0047] The video may be modified in response to the user's biometric data. For example, the AI ​​accelerator 324 may output a command to slow down, speed up, and / or turn off the video in response to performing an AI operation on the user's biometric data. In several embodiments, the video may be slowed down or accelerated in response to a determination that the user's biometric data is outside a specific range. The specific range may be a healthy heart rate range, for example, if the user's heart rate is below the specific range, the video may be accelerated, and if the user's heart rate is above the specific range, the video may be slowed down. The IR images may capture the size of the veins, and track the veins getting larger and smaller over several IR images to determine the user's heart rate.

[0048] The AI ​​accelerator 324 may determine that the user is getting bored with the video game by analyzing one or more captured IR images and speeding up the video game. The AI ​​accelerator 324 may determine that the user is getting bored by quantifying the rate at which the user views from the user interface 314. For example, the AI ​​accelerator 324 may determine a first number of times the user has left the user interface 314 using a first number of IR images over a first time period, and determine a second number of times the user has left the user interface 314 using a second number of IR images over a second time period. If the second number of times the user has left the user interface 314 is greater than the first number, the AI ​​accelerator 324 may output a command to speed up the game, thereby attempting to reengage the user in the video game.

[0049] In some instances, the story, mission, and / or goal of the video can be changed in response to the user's biometric data. For example, the processing resource 312 can determine that the user has reached their heart rate goal by calculating the user's heart rate using several IR images over a period of time. In response to the user meeting their heart rate goal, the AI ​​accelerator 324 can create a new fitness goal for the exercise video.

[0050] The user interface 314 may also display a message. The message may be displayed in response to the output of the AI ​​operation. For example, the AI ​​accelerator 324 may determine that the user's heart rate is irregular and that the user needs medical attention. In response to the AI ​​operation determining that the user needs medical attention, a message that the user needs medical attention may be displayed on the user interface 314.

[0051] The device 310 may include an acoustic sensor 316. The acoustic sensor 316 may detect sounds generated by a user. The detected sounds may include, for example, but are not limited to, speaking, breathing, and / or footsteps. The language, volume, and / or pitch of the sounds captured by the acoustic sensor 316 may be analyzed by the AI ​​accelerator 324. In several embodiments, the AI ​​accelerator 324 may be used to perform AI operations on the sound data. For example, the AI ​​accelerator 324 may determine that the user is tired by performing AI operations on the sound data. The sound data may include a record of the user's breathing over a period of time. For example, in response to the AI ​​accelerator 324 determining that the user's breathing has accelerated during the time period, the AI ​​accelerator 324 may output a command to slow down the video and / or change the target of the video.

[0052] The user's movement may be detected using proximity sensor 320. AI operations may be performed on data collected by proximity sensor 320 from the user's movement. AI accelerator 324 may determine the speed of the user's movement, the force of the user's movement, and / or the direction of the user's movement. In some instances, AI accelerator 324 may determine the outcome of a story, task, and / or goal based on the determined speed, the determined force, and / or the determined direction of the user's movement. For example, in a golf video game, the user's swing may have been in the right direction and had enough power to sink the putt and take the user to a new hole.

[0053] A speaker 328 may be included in the device 310. The speaker 328 may generate a sound and / or multiple sounds based on the output of the AI ​​operation. For example, the AI ​​accelerator 324 may perform an AI operation on the user's biometric data and determine the user's physical and / or emotional state. The biometric data may include an IR image of the user, which has a lazy posture and / or a frowning facial expression. Based on the IR image, the AI ​​accelerator 324 may determine that the user is sad. For example, in response to the AI ​​accelerator 324 determining that the user is sad, the speaker 328 may play a cheerful song and / or play a song that the user likes.

[0054] Device 310 may include light 329. Similar to speaker 328, light 329 may emit a type of light based on the output of an AI operation. For example, AI accelerator 324 may perform an AI operation on the user's biometric data and determine the user's physical and / or emotional state. The biometric data may include several IR images of the user's eyes closed. Based on the several IR images, AI accelerator 324 may determine that the user is sleeping. In response to AI accelerator 324 determining that the user is sleeping, light 329 may emit a soft night light glow.

[0055] Figure 4 is a flow chart of a method 430 for determining biometric data of a user according to several embodiments of the present disclosure. At block 432, the method 430 may include projecting a number of IR dots onto the user using a dot projector and an array of IR illuminators.

[0056] The IR illuminator may emit IR light. In some instances, the IR illuminator may emit IR light of varying intensities. The dot projector may project a plurality of dots onto a user and / or a plurality of users using the IR light emitted by the IR illuminator. The dot projector may project a plurality of dots at varying sizes. In some instances, the dot projector may vary the number of dots projected.

[0057] At block 434, method 430 may include capturing an IR image of several IR points using an IR camera. The IR camera may capture IR light emitted by the IR illuminator. For example, the IR image may be a hotspot image.

[0058] At block 436, method 430 may include using processing resources to compare a number of pixels of the captured IR image with a number of corresponding pixels of the baseline IR image. In some examples, one or more captured IR images may be compared with one or more baseline IR images. The one or more captured IR images and / or the one or more baseline IR images may be from an IR camera and / or a memory.

[0059] At block 438, method 430 may include determining biometric data of the user based at least in part on comparing the captured IR image to a baseline IR image using processing resources. In several embodiments, the biometric data may be used when playing a video game, watching a movie, watching an instructional video, and / or a fitness video. For example, the video game, movie, instructional video, and / or fitness video may be modified in response to the biometric data.

[0060] Although specific embodiments have been shown and described herein, it will be appreciated by those skilled in the art that the specific embodiments shown may be replaced with arrangements calculated to achieve the same results. The present disclosure is intended to cover modifications or variations of one or more embodiments of the present disclosure. It should be understood that the above description is provided in an illustrative manner, rather than a restrictive manner. By reading the above description, the combination of the above-described embodiments and other embodiments not particularly described herein will be apparent to those skilled in the art. The scope of one or more embodiments of the present disclosure includes other applications in which the above-described structures and methods are used. Therefore, the scope of one or more embodiments of the present disclosure should be determined with reference to the appended claims and the full scope of equivalents to which these claims are authorized.

[0061] In the foregoing detailed description, some features are combined in a single embodiment for the purpose of simplifying the present disclosure. The disclosed method should not be interpreted as reflecting the intention that the disclosed embodiments of the present disclosure must use more features than the features explicitly recited in each claim. On the contrary, as reflected in the following claims, the subject matter of the invention lies in less than all the features of a single disclosed embodiment. Therefore, the following claims are hereby incorporated into the detailed description, wherein each claim independently serves as a separate embodiment.

Claims

1. A method for determining biometric data, the method comprising: projecting a first portion of a plurality of IR dots onto a first portion of a body of a user using a dot projector and an array of infrared (IR) illuminators, wherein the first portion of the plurality of IR dots has a first dot diameter; projecting a second portion of the plurality of IR dots onto a second portion of the user's body using the dot projector and the array of infrared (IR) illuminators, wherein the second portion of the plurality of IR dots has a second dot diameter that is different than the first dot diameter; capturing, using an IR camera, IR images of the plurality of IR points; comparing, using processing resources, a plurality of pixels of the captured IR image to a plurality of corresponding pixels of a baseline IR image; determining biometric data of the user based at least in part on comparing the captured IR image to the baseline IR image using the processing resources; as well as A video displayed on a user interface is modified based on the determined biometric data of the user.

2. The method of claim 1, further comprising modifying the video displayed on the user interface by slowing down the video in response to the determined biometric data of the user being above a certain range.

3. The method of claim 2, further comprising modifying the video displayed on the user interface by speeding up the video in response to the determined biometric data of the user being below the specific range. The method according to claim 3 , wherein the specific range is a healthy heart rate range. 5 . The method of claim 4 , further comprising capturing a size of the user's veins in each of a plurality of IR images including the captured IR image. The method of claim 5 , further comprising determining a heart rate of the user based on the plurality of IR images.

7. The method of claim 1, further comprising capturing a face of the user in each of a plurality of IR images including the captured IR image.

8. The method of claim 7, further comprising determining a rate at which the user leaves the video based on the plurality of IR images.

9. The method of claim 8, further comprising comparing the rate at which the user leaves the video to a previous rate.

10. The method of claim 9, further comprising speeding up the video in response to the rate at which the user leaves the video being greater than the previous rate.

11. The method of claim 1 , further comprising modifying the video displayed on the user interface by turning off the video in response to the determined biometric data of the user based on the determined biometric data.

12. An apparatus for determining biometric data, the apparatus comprising: an infrared (IR) illuminator array configured to generate IR light; a dot projector configured to use the IR light generated by the array of IR illuminators: projecting a first portion of the plurality of IR spots onto a first portion of a body on a user, wherein the first portion of the plurality of IR spots has a first spot diameter; and projecting a second portion of the plurality of IR dots onto a second portion of the user's body, wherein the second portion of the plurality of IR dots has a second dot diameter different from the first dot diameter; an IR camera configured to capture IR images of the plurality of IR points; A processing resource configured to: comparing a plurality of pixels of the captured IR image to a plurality of corresponding pixels of a baseline IR image; and determining biometric data of the user based at least in part on comparing the captured IR image to the baseline IR image; and A user interface for displaying a video based on the determined biometric data of the user.

13. The apparatus of claim 12, further comprising a proximity sensor configured to collect data including motion of the user.

14. The apparatus of claim 13, wherein the processing resource is configured to determine at least one of: a speed, a force, or a direction of the motion of the user.

15. The device of claim 14, wherein the video displayed on the user interface is based on at least one of: the speed, the force, or the direction of the motion of the user.

16. An apparatus according to claim 14, wherein the processing resource is configured to determine at least one of the following based on at least one of the speed, the force, or the direction of the motion of the user: an outcome, a task, or a goal of the video displayed on the user interface.

17. An apparatus for determining biometric data, the apparatus comprising: an infrared (IR) illuminator array configured to generate IR light; a dot projector configured to use the IR light generated by the array of IR illuminators: projecting a first portion of the plurality of IR spots onto a first portion of a body on a user, wherein the first portion of the plurality of IR spots has a first spot diameter; and projecting a second portion of the plurality of IR dots onto a second portion of the user's body, wherein the second portion of the plurality of IR dots has a second dot diameter different from the first dot diameter; an IR camera configured to capture IR images of the plurality of IR points; A processing resource configured to: comparing a plurality of pixels of the captured IR image to a plurality of corresponding pixels of the baseline IR image; determining biometric data of the user based at least in part on comparing the captured IR image to the baseline IR image; as well as A target is determined for the user based on the determined biometric data.

18. The apparatus of claim 17, wherein the target is a heart rate target.

19. The apparatus of claim 17, wherein the processing resources are configured to determine the goal for the user in response to the user satisfying a previous goal.

Images