Systems and methods for detecting and classifying objects in video captured using mobile devices

Abstract

A method includes invoking an image capture interface via a mobile device; and analyzing video data captured via the capture interface. The analysis includes determining whether an object exhibiting one or more defining characteristics is depicted within the viewfinder; and if so, whether that object satisfies one or more predetermined quality control criteria. The method further includes displaying an indication of success or failure to satisfy the predetermined control criteria on the mobile device display. Where the object depicted within the viewfinder satisfies the one or more predetermined quality control criteria, the method also includes: displaying an indication that the object depicted in the viewfinder exhibits the one or more defining characteristics; automatically capturing an image of the object; and / or automatically storing to memory one or more of the frames in which the object is depicted in the viewfinder. Systems and computer program products are also disclosed.

Description

PRIORITY CLAIM[0001]This application claims priority to U.S. Provisional Patent Application No. 61 / 819,463, filed May 3, 2013, which is herein incorporated by reference.RELATED APPLICATIONS[0002]This application is related to U.S. Pat. No. 6,370,277, granted Apr. 9, 2002 (U.S. patent application Ser. No. 09 / 206,753, filed Dec. 7, 1998) as well as copending U.S. patent application Ser. No. 13 / 740,123, filed Jan. 11, 2013; Ser. No. 13 / 802,226, filed Mar. 13, 2013; Ser. No. 14 / 209,825, filed Mar. 13, 2014; Ser. No. 14 / 259,866 filed Apr. 23, 2014; Ser. No. 14 / 177,136, filed Feb. 10, 2014; Ser. No. 14 / 175,999, filed Feb. 7, 2014; Ser. No. 14 / 220,016, filed Mar. 19, 2014; Ser. No. 14 / 220,023, filed Mar. 19, 2014 and Ser. No. 14 / 220,029, filed Mar. 19, 2014; and Provisional U.S. Patent Application No. 61 / 883,865, filed Sep. 27, 2013, and 61 / 905,063, filed Nov. 15, 2013, each of which are herein incorporated by reference.FIELD OF INVENTION[0003]The present invention relates to digital video...

AI Technical Summary

Benefits of technology

The invention allows for the use of video data to create composite images from multiple frames. This has various benefits, such as improving image clarity and super-resolution.

Problems solved by technology

However, limitations of the mobile device hardware and practical limitations of capturing images using a mobile device present major challenges to efficient and effective digital image processing.

For example, digital images captured using a mobile device are often of insufficient quality for subsequent processing due to one or more artifacts such as blur, uneven illumination, insufficient illumination, oversaturated illumination, insufficient resolution, projective effects, etc.

Attempts to process digital images including such artifacts may fail completely or produce inadequate quality results for the desired application.

At best, the user may be required to repeat the capture operation and attempt to improve the quality of the image, but in some cases recapturing the image may be impossible, resulting in lost opportunity for acquiring images of important but transient circumstances, such as the location or condition of a person or vehicle before, during, and / or after an automobile accident.

Images