Interactive and adaptive learning, neurocognitive disorder diagnosis, and noncompliance detection systems using pupillary response and face tracking and emotion detection with associated methods

Abstract

A system for detection of noncompliance including substance abuse, driving under influence, and untruthful testimony giving under law enforcement setting, comprising optical sensors for capturing a subject's pupillary responses, blinking eye movements, point-of-gaze, facial expression, and head pose during a compliance test session. The system can also be applied in neurocognitive disorder diagnosis. The subject's affective and cognitive states estimation based on the captured sensory data during a diagnosis test is feedback to the system to drive the course of the compliance or cognitive test, adaptively change the test materials, and influence the subject's affective and cognitive states. The estimated affective and cognitive states in turn provide a more accurate reading of the subject's condition.

Description

CROSS-REFERENCES TO RELATED APPLICATIONS[0001]This is a national phase entry of International Patent Application no. PCT / IB2018 / 059653 filed on Dec. 5, 2018 which claims priority to U.S. Patent Application No. 62 / 594,557 filed 5 Dec. 2017; U.S. Patent Application No. 62 / 622,888 filed 27 Jan. 2018; U.S. Patent Application No. 62 / 627,734 filed 7 Feb. 2018; U.S. Patent Application No. 62 / 646,365 filed 21 Mar. 2018; U.S. Patent Application No. 62 / 716,935 filed 9 Aug. 2018; and U.S. Patent Application No. 62 / 741,527 filed 4 Oct. 2018; the disclosures of which are incorporated herein by reference in their entirety.FIELD OF THE INVENTION[0002]The present invention relates generally to methods and systems for interactive and adaptive learning, neurocognitive disorder diagnosis, and electronic commerce and retailing. Particularly, the present invention relates to the techniques and applications of pupillary response detection face tracking and emotion detection and analysis in aforementioned...

AI Technical Summary

Benefits of technology

[0021]Embodiments of the present invention can also be adapted to law enforcement applications, including real-time detection of substance abuse in suspects, DUI, unreliable witnesses, and untruthful testimony. The detection of substance abuse or DUI comprises a delivery of a test which can be a series of textual, pictorial, and/or video based contextual questions, light stimulus (to the subject's eyes), and/or physical task performance (e.g. handwriting, passage reading, repeating directed hand gesture, and walking with directions). Built-in or peripheral cameras in desktop computers, laptop computers, tablet computers, and/or smartphones, standalone cameras, and/or infrared cameras (under low light conditions) can be used to track and image and/or video-capture the subject's iris, or more specifically pupils, of one or both eyes, eye movements, blinking, point-of-gaze, facial expression, and head po

Problems solved by technology

For example, the subject's excessive toggling between given choices and slow response speed in

Images