Method and system for light source diagnostics - Patent Application 20070122997

Abstract

A method for use in testing the operational status of a light source for illuminating a scene includes capturing a first image using a camera when a light source having a fixed spatial relationship to the camera is disabled and capturing a second image using the camera when the light source is enabled. The method includes determining a test result indicative of the operational status of the light source based at least in part on a light source setting at the time the camera captured each of the first and second images, the light source setting indicating whether the light source was disabled or enabled when the camera captured the first and second images, and on at least one of one or more camera settings at the time the camera captured the first and second images and one or more image characteristics of the first and second images. Such a method can be used to test the operational status of the light source, particularly, but not limited to, for use in automatically testing the operational status of a camera flash of a mobile electronic device.

Description

[Technical Field]

[0001] The present disclosure relates to methods, systems, diagnostic applications, and devices, such as mobile electronic devices, for use in testing the operational status of light sources, and particularly, but not exclusively, for use in automatically testing the operational status of a camera flash on a mobile electronic device. [Background technology]

[0002] It is known to perform manual diagnostic tests or inspections of a mobile electronic device's camera flash, where a user or operator of the mobile electronic device is required to provide feedback indicating whether the mobile electronic device's camera flash actually works when enabled. However, such manual diagnostic tests or inspections are time consuming and susceptible to human error or fraud. Summary of the Invention [Means for solving the problem]

[0003] According to one aspect of the present disclosure, there is provided a method for use in testing the operational status of a light source for illuminating a scene, the light source having a fixed spatial relationship to a camera, the method comprising: capturing a first image using the camera while the light source is disabled; capturing a second image using the camera when the light source is enabled; and a light source setting at which the camera captures each of the first and second images, the light source setting indicating whether the light source is disabled or enabled at the time the camera captures the first and second images; and one or more camera settings when the camera captures the first and second images; and one or more image characteristics of the first and second images At least one of determining a test result indicative of an operational status of the light source based at least in part on: Includes:

[0004] Such a method may be used to test the operational status of a light source, particularly, but not exclusively, for use in automatically testing the operational status of a camera flash on a mobile electronic device.

[0005] The one or more camera settings may include an ISO setting of the camera's image sensor, an exposure index of the camera's image sensor, a sensitivity setting of the camera's image sensor, or a gain setting of the camera's image sensor.

[0006] The one or more camera settings may include a shutter speed or exposure time of the camera.

[0007] The one or more camera settings may include an aperture setting, an f-stop, or an f-number of the camera.

[0008] The one or more image characteristics may include an image brightness parameter.

[0009] The image brightness parameters may include the average brightness of the image or the average intensity of the image, or the average brightness or intensity of a predetermined portion or area of ​​the image.

[0010] The one or more image characteristics may include an image file size.

[0011] The method can include reading first and second images from a camera.

[0012] The method can include determining a light source setting, one or more camera settings, and one or more image characteristics for each of the first and second images.

[0013] The method may include extracting a light source setting, one or more camera settings, and one or more image characteristics for each of the first and second images from metadata associated with or stored in each of the first and second images.

[0014] The method can include reading from the camera a light source setting, one or more camera settings, and one or more image characteristics for the first and second images.

[0015] The method can include determining image characteristics of the first and second images from image data of the first and second images.

[0016] The method can include determining whether the first and second images are images of the same scene.

[0017] Here's how: For each of one or more camera settings, determining whether a camera setting difference between the camera setting associated with the first image and the camera setting associated with the second image meets a corresponding predetermined camera setting criterion; and determining, for each of one or more image characteristics, whether an image characteristic difference between an image characteristic value associated with the first image and an image characteristic value associated with the second image meets a corresponding predetermined image characteristic criterion; may include:

[0018] The method can include selecting each predetermined camera setting criterion and each predetermined image characteristic criterion based at least in part on corresponding camera setting values ​​and / or corresponding image characteristic values ​​when the camera captures the first image, which can be advantageous when the first image captures a relatively bright scene.

[0019] Here's how: determining that the first and second images are images of the same scene; One or more of the camera setting differences meet a corresponding predetermined criterion; and One or more of the image characteristic differences meets the corresponding predetermined criteria. If so, this may include determining a positive test result indicating that the light source is operational or that the light source is operating correctly or in compliance with predetermined performance specifications.

[0020] Here's how: The first and second images are determined to be images of the same scene; and One or more of the camera setting differences do not meet the corresponding predetermined criteria; and One or more of the image characteristic differences do not meet a corresponding predetermined standard; At least one of In this case, determining a negative test result indicating that the light source is not operational or that the light source is faulty or not in compliance with predetermined performance specifications may be included.

[0021] Here's how: determining that the first and second images are images of the same scene; the second image has local features or artifacts that are higher in intensity than one or more adjacent areas or regions of the second image; and The first image does not have local features or artifacts that are higher in intensity than one or more adjacent areas or regions of the first image, where the local features or artifacts of the first image are at locations in the first image that correspond to locations of the local features or artifacts in the second image. If so, this may include determining a positive test result indicating that the light source is operational or that the light source is operating correctly or in compliance with predetermined performance specifications.

[0022] Here's how: determining that the first and second images are images of the same scene; the second image has local features or artifacts that are higher in intensity than one or more adjacent areas or regions of the second image; and A first image has local features or artifacts that are higher in intensity than one or more adjacent areas or regions of the first image, where the local features or artifacts of the first image are at locations in the first image that correspond to locations of the local features or artifacts in the second image. In this case, determining a negative test result indicating that the light source is not operational or that the light source is faulty or not in compliance with predetermined performance specifications may be included.

[0023] The method may include using an image processing algorithm, such as a machine learning algorithm, to identify any local features or artifacts that are more intense than one or more adjacent areas or regions of the first and / or second images.

[0024] The method may include determining an inconclusive test result regarding the operational state of the light source if it is determined that the first and second images are not images of the same scene.

[0025] Determining whether the first and second images are images of the same scene includes: comparing the first and second images; and determining whether the first and second images correspond to images of the same scene based on a result of the comparison of the first and second images; may include:

[0026] Determining whether the first and second images are images of the same scene includes: Identifying an object in the first image; and Identifying the same subject in a second image; and may include:

[0027] Determining whether the first and second images are images of the same scene can include using an image processing algorithm to identify an object in the first image and to identify the same object in the second image, which can be based on a machine learning algorithm.

[0028] Determining whether the first and second images are images of the same scene includes: determining, for each of one or more characteristics of the object, a first value for the characteristic of the object from the first image and a second value for the characteristic of the object from the second image; and determining, for each of one or more characteristics of the object, that the first and second images are images of the same scene if the first and second values ​​for the characteristic of the object meet corresponding predetermined criteria; may include:

[0029] Determining whether the first and second images are images of the same scene includes: determining, for each of one or more characteristics of the object, a difference between first and second values ​​determined for the characteristic of the object; and determining, for each of one or more characteristics of the object, that the first and second images are images of the same scene if the determined difference between the first and second values ​​determined for the characteristic of the object is less than a corresponding predetermined threshold; may include:

[0030] The one or more characteristics of the object may include one or more of the following: object size, object aspect ratio, object position, and object orientation.

[0031] Determining whether the first and second images are images of the same scene includes: determining a quantitative similarity between the first and second images; and determining that the first and second images are images of the same scene if a quantitative similarity between the first and second images meets a predetermined image similarity criterion; may include:

[0032] Determining whether the first and second images are images of the same scene may include determining that the first and second images are images of the same scene if a difference in quantitative similarity between the first and second images is less than a predetermined threshold.

[0033] The quantitative similarity between the first and second images may include a cross-correlation between the first and second images, or a cross-correlation between corresponding portions of the first and second images.

[0034] Determining whether the first and second images are images of the same scene includes: Determining a distance from the camera to an object at a predetermined position in the first image; determining a distance from the camera to an object at a predetermined location in the second image, the predetermined location in the second image corresponding to the predetermined location in the first image; and determining that the first and second images are images of the same scene if a determined distance from the camera to an object at a predetermined location in the first image and a determined distance from the camera to an object at a predetermined location in the second image meet a predetermined distance criterion; may include:

[0035] Determining whether the first and second images are images of the same scene may include determining that the first and second images are images of the same scene if a difference between a determined distance from the camera to an object at a predetermined location in the first image and a determined distance from the camera to an object at a predetermined location in the second image is less than a predetermined threshold.

[0036] Determining whether the first and second images are images of the same scene includes: measuring the distance from the camera to the subject at the time the first image was captured; and measuring a distance from the camera to the subject at the time of capturing the second image; may include:

[0037] Measuring the distance from the camera to the subject at the time of capturing each of the first and second images may include running an augmented reality (AR) application on the computing device. Such an application may include a third-party AR library, such as ARCore®, that provides an application programming interface (API) to the AR application. The computing device may be configured to communicate with the camera. Further, the camera may form part of, be defined by, or be fixed or attached to the computing device.

[0038] Measuring the distance from the camera to the subject at the time of capturing each of the first and second images includes: transmitting modulated electromagnetic radiation from an emitter to a subject and receiving modulated electromagnetic radiation reflected from the subject with a detector; and determining a delay between emitting modulated electromagnetic radiation from an emitter and detecting reflected modulated electromagnetic radiation at a receiver; where The emitter and detector have a fixed spatial relationship to each other.

[0039] The emitter and detector may have a fixed spatial relationship to the camera. The emitter and detector may be fixed or attached to the camera.

[0040] The modulated electromagnetic radiation may include amplitude modulated electromagnetic radiation.

[0041] The modulated electromagnetic radiation may include a stream of pulses of electromagnetic radiation.

[0042] The modulated electromagnetic radiation may include frequency modulated electromagnetic radiation.

[0043] Electromagnetic radiation can include light, for example, visible light or infrared (IR) light.

[0044] The emitter may include a light emitter.

[0045] The light emitter may comprise a light emitting diode (LED). The light emitter may comprise a source of coherent light, such as a laser, e.g., a laser diode.

[0046] The emitter can include one or more LEDs.

[0047] The emitter may include one or more laser diodes.

[0048] The detector may include a photodetector such as a photodiode.

[0049] The detector may include a time-of-flight (ToF) camera.

[0050] Determining whether the first and second images are images of the same scene includes: Measuring any movement of the camera between the time the first image was taken and the time the second image was taken; and determining that the first and second images are images of the same scene if the magnitude of any movement of the camera meets one or more predetermined movement criteria; may include:

[0051] Determining whether the first and second images are images of the same scene may include determining that the first and second images are images of the same scene if a magnitude of any movement of the camera is less than one or more predetermined thresholds.

[0052] Determining whether the first and second images are images of the same scene includes: determining the position and orientation of the camera at the time of capturing each of the first and second images; and determining that the first and second images are images of the same scene if the determined camera positions at the time of capturing the first and second images meet predetermined position criteria and if the determined camera orientations at the time of capturing the first and second images meet corresponding predetermined orientation criteria; may include:

[0053] Determining whether the first and second images are images of the same scene may include determining that the first and second images are images of the same scene if a difference between the determined camera positions at the time the first and second images were captured is less than a corresponding predetermined position threshold and a difference between the determined camera orientations at the time the first and second images were captured is less than a corresponding predetermined orientation threshold.

[0054] The light source may include a camera flash provided with, housed in, or affixed or attached to the camera.

[0055] The camera and light source may form part of, be defined by, or be fixed or attached to a device, such as a computing device.

[0056] The computing device may be, for example, a mobile electronic device including a mobile phone, smartphone, mobile telephone, or tablet. The computing device may be a desktop computer, laptop computer, or workstation. The computing device may be an Internet-of-Things (IoT) device, such as a smart appliance or a smart security device.

[0057] The camera and light source may form part of, be defined by, or be fixed or attached to a security system for a building, fixed structure, or enclosed area or space.

[0058] The camera and light source may form part of, be defined by, or be fixed or attached to the vehicle.

[0059] The light source may include or be defined by a light source provided with a vehicle, such as a headlight or taillight of the vehicle.

[0060] According to one aspect of the present disclosure, there is provided an application for a mobile electronic device including a camera and a light source, or for a server configured for communication with a mobile electronic device including a camera and a light source, which when executed by a processor of the mobile electronic device or a processor of the server causes the mobile electronic device to perform any of the methods described above.

[0061] According to one aspect of the present disclosure, there is provided a mobile electronic device including the above-described application.

[0062] According to one aspect of the present disclosure, there is provided a server including the above-described application.

[0063] It should be understood that any one or more features of any one of the foregoing aspects of the present disclosure may be combined with any one or more features of any other of the foregoing aspects of the present disclosure.

[0064] Various apparatus and methods for use in testing the operating condition of a light source will now be described, by way of non-limiting example only, with reference to the following drawings: [Brief explanation of the drawings]

[0065] [Figure 1]1 is a schematic diagram of a mobile electronic device and system for use in automatically testing the operational status of a camera flash of a mobile electronic device; [Figure 2] 2 is a flowchart illustrating the initial steps of a method for automatically testing the operational status of a camera flash of a mobile electronic device shown in FIG. 1; [Figure 3] 1 shows a first image captured when the camera flash of the mobile electronic device shown in FIG. 1 is disabled along with some associated camera settings and image characteristics, and a second image captured when the camera flash of the mobile electronic device shown in FIG. 1 is enabled along with some associated camera settings and image characteristics; [Figure 4] 1 is a flowchart illustrating steps of a method for automatically testing the operational status of a camera flash of a mobile electronic device, the steps including determining whether first and second images are images of the same scene; [Figure 5] 2 is a flowchart illustrating the final steps of the method for automatically testing the operational status of the camera flash of the mobile electronic device shown in FIG. 1 ; [Figure 6] 2 is a flowchart illustrating some alternative final steps of a method for automatically testing the operational status of a camera flash of a mobile electronic device shown in FIG. 1; and [Figure 7] 10 is a flowchart illustrating an alternative method for determining whether a first and second image are images of the same scene. DETAILED DESCRIPTION OF THE INVENTION

[0066] 1 , there is shown a system, generally designated 1, for use in automatically testing the operational status of a camera flash of a mobile electronic device 2. The mobile electronic device 2 includes a memory 4, a processor 6, a communications interface 7, a user interface in the form of a touchscreen 8, a camera 10, a light source in the form of a camera flash 12, an infrared (IR) light source in the form of an infrared light emitting diode (LED) 14, a photodiode 16 configured to detect infrared light emitted by and reflected back from the LED 14, a motion sensor in the form of an accelerometer 17, and an antenna 18. The memory 4 stores a diagnostic application 19.

[0067] System 1 includes a server, generally designated 22, located remotely from mobile electronic device 2. Server 22 includes memory 24, a processor 26, a communications interface 27, and a user interface 28. Memory 24 stores a computer program in the form of a diagnostic application 30, data 32 relating to one or more images captured by mobile electronic device 2, and diagnostic information 34 relating to the operational status of camera flash 12 of mobile electronic device 2.

[0068] As shown in FIG. 1, the mobile electronic device 2 and the server 22 are configured to communicate via the cloud 50 via the communication interface 7 and antenna 18 of the mobile electronic device 2 and the communication interface 27 of the server 22.

[0069] When executed by the processor 6 of the mobile electronic device 2, the diagnostic application 19 causes the mobile electronic device 2 to perform a method for automatically testing the operational status of the camera flash 12 of the mobile electronic device 2.

[0070] 2, method 100 begins at step 101, where mobile electronic device 2 disables camera flash 12 and prompts a user of mobile electronic device 2, via user interface 8, to capture a first image 60 of a scene using camera 10. The method proceeds to step 102, where mobile electronic device 2 enables camera flash 12 and prompts the user, via user interface 8, to capture a second image 62 of the same scene using camera 10.

[0071] As described in more detail below, processor 6 of mobile electronic device 2 then determines a test result indicative of the operational status of camera flash 12 based at least in part on a light source setting indicating that camera flash 12 is disabled when camera 10 captures the first image, a light source setting indicating that the light source is enabled when camera 10 captures the second image, one or more camera settings when camera 10 captures the first and second images, and one or more image characteristics of the first and second images.

[0072] Specifically, in step 104, processor 6 of mobile electronic device 2 extracts, from metadata provided with the image data of the first and second images, light source settings associated with the first and second images, camera settings at the time camera 10 captured the first and second images, and one or more image characteristics of the first and second images. Specifically, processor 6 of mobile electronic device 2 programmatically extracts or accesses the metadata provided with the image data of the first and second images via an application programming interface (API) for camera 10.

[0073] 3, the camera settings include an ISO setting and a shutter speed or exposure time used by the camera 10 when it captures the first and second images 60, 62, and the image characteristics include image brightness parameter values ​​associated with the first and second images 60, 62 and image file sizes of the first and second images 60, 62. The one or more brightness parameter values ​​for each of the first and second images 60, 62 may include, for example, an average brightness or intensity of each of the first and second images 60, 62, or an average brightness or intensity of a predetermined portion or area of ​​each of the first and second images 60, 62.

[0074] The method proceeds to step 106 of FIG. 2 , where the processor 6 of the mobile electronic device 2 then determines whether the first and second images are images of the same scene. Specifically, the processor 6 of the mobile electronic device 2 compares the first and second images 60, 62 and determines whether the first and second images correspond to images of the same scene based on the results of the comparison of the first and second images. More specifically, referring to FIG. 4 , the processor 6 of the mobile electronic device 2 determines the distance from the camera 10 to the object 64 at a predetermined position in the first image 60, and the processor 6 determines the distance from the camera 10 to the object 64 at a predetermined position in the second image 62, where the predetermined position in the second image 62 corresponds to the predetermined position in the first image 60. The processor 6 then determines that the first and second images 60, 62 are images of the same scene if the determined distance from the camera 10 to the object 64 at the predetermined position in the first image 60 and the determined distance from the camera 10 to the object 64 at the predetermined position in the second image 62 meet a predetermined distance criterion. For example, processor 6 determines that first and second images 60, 62 are images of the same scene if the difference between the determined distance from camera 10 to object 64 at a predetermined location in first image 60 and the determined distance from camera 10 to object 64 at a predetermined location in second image 62 is less than a predetermined threshold. Processor 6 causes camera 10 to measure the distance from camera 10 to object 64 at the time the first image 60 is captured, and also causes camera 10 to measure the distance from camera 10 to object 64 at the time the second image 62 is captured. More specifically, processor 6 causes LED 14 to transmit modulated infrared light toward object 64, and processor 6 causes photodiode 16 to detect the portion of the transmitted modulated infrared light that is reflected from object 64. Processor 6 then determines the distance from camera 10 from the delay between the transmission of the modulated infrared light from LED 14 and the detection of the reflected modulated infrared light by photodiode 16. Those skilled in the art will appreciate that a variety of distance measurement techniques are possible using modulated infrared light.

[0075] For example, the modulated infrared light may be amplitude modulated, and the distance from camera 10 to subject 64 may be determined from the delay between the transmission of an amplitude-modulated characteristic of the amplitude-modulated infrared light from LED 14 and the arrival of the same amplitude-modulated characteristic of the amplitude-modulated infrared light at photodiode 16. The amplitude-modulated infrared light may include, for example, a stream of pulses of infrared light, and the distance from camera 10 to subject 64 may be determined from the delay between the transmission of a pulse of infrared light from LED 14 and the arrival of the same pulse of infrared light at photodiode 16. Alternatively, the modulated infrared light may be frequency modulated, and the distance from camera 10 to subject 64 may be determined from a delay determined from the difference between the frequency of the frequency-modulated infrared light transmitted from LED 14 and the frequency of the frequency-modulated infrared light arriving at photodiode 16. Additionally or alternatively, processor 6 may cause an augmented reality (AR) application to measure the distance from camera 10 to subject 64 at the time the first image 60 was captured and also to measure the distance from camera 10 to subject 64 at the time the second image 62 was captured. More specifically, the processor 6 executes an AR application that causes the camera to first quantify the dimensional space between the camera 10 and the subject 64, and then measure the distance from the camera 10 to the subject 64. Such an application may include a third-party AR library, such as ARCore®, that provides an application programming interface (API) to the AR application.

[0076] 5, the method proceeds to step 108 where processor 6 determines, for each of one or more camera settings, whether a camera setting difference between the camera setting value associated with first image 60 and the camera setting value associated with second image 62 meets a corresponding predetermined camera setting criterion. Similarly, at step 110, processor 6 determines, for each of one or more image characteristics, whether an image characteristic difference between the image characteristic value associated with first image 60 and the image characteristic value associated with second image 62 meets a corresponding predetermined image characteristic criterion.

[0077] In step 112, processor 6 determines whether one or more of the camera setting differences meet corresponding predetermined criteria and whether one or more of the image characteristic differences meet corresponding predetermined criteria.

[0078] If the processor 6 determines that one or more of the camera setting differences meet the corresponding predetermined criteria and one or more of the image characteristic differences meet the corresponding predetermined criteria, then in step 114 the processor 6 determines a positive test result indicating that the light source is operational or that the light source is operating correctly or in compliance with predetermined performance specifications, and returns the positive test result to the user of the mobile electronic device 2 via the user interface 8 and / or returns the positive test result to the server 22 via the communications interfaces 7, 27 and the cloud 50 for storage as diagnostic information 34 in the memory 24 of the server 22.

[0079] If the processor 6 determines that one or more of the camera setting differences or one or more of the image characteristic differences do not meet the corresponding predetermined criteria, then in step 116 the processor 6 determines a negative test result indicating that the light source is not operational or that the light source is faulty or does not comply with predetermined performance specifications, and returns the negative test result to the user of the mobile electronic device 2 via the user interface 8 and / or returns the negative test result to the server 22 via the communications interfaces 7, 27 and the cloud 50 and stores it as diagnostic information 34 in the memory 24 of the server 22.

[0080] If, in step 106c, processor 6 determines that the determined distances from camera 10 to subject 64 at predetermined locations in first and second images 60, 62 do not meet the corresponding predetermined criteria, then processor 6 determines, in step 106e, that the first and second images 60, 62 are images of different scenes. Then, in step 118, processor 6 determines that the test result is inconclusive and returns the inconclusive test result to the user of mobile electronic device 2 via user interface 8 and / or to server 22 via communications interfaces 7, 27 and cloud 50 for storage as diagnostic information 34 in memory 24 of server 22.

[0081] In one particular example of the method for automatically testing the operational status of the camera flash 12 of the mobile electronic device 2 described with reference to Figures 2 to 5, the one or more camera settings extracted from the metadata of the first and second images 60, 62 may include an ISO setting of the camera 10 and a shutter speed setting of the camera 10, the one or more image characteristics extracted from the metadata of the first and second images 60, 62 may include a brightness parameter and an image file size, and experiments with several different makes and models of smartphones have demonstrated that the camera flash 12 can be considered operational if at least two of the following predetermined criteria are met: (i) the ISO setting of the camera 10 when it captures the first image 60 is lower than the ISO setting of the camera 10 when it captures the second image 62; (ii) the shutter speed setting when the camera 10 captures the first image 60 is less than the shutter speed setting when the camera 10 captures the second image 62; (iii) the image brightness parameter value when the camera 10 captures the first image 60 is greater than the image brightness parameter value when the camera 10 captures the second image 62; and (iv) The image file size value when the camera 10 captures the first image 60 is greater than the image file size value when the camera 10 captures the second image 62.

[0082] Conversely, the camera flash 12 may be considered inoperative if one or none of the above predetermined criteria (i)-(iv) are met.

[0083] In a variation of the method for automatically testing the operational status of the camera flash 12 of the mobile electronic device 2 described with reference to Figures 2-5, steps 108, 110, 112, 114, 116, and 118 shown in Figure 5 can be replaced with steps 208, 210, 214, 216, and 218 shown in Figure 6. Specifically, in step 208, the processor 6 determines whether the second image 62 has local features or artifacts that are brighter than one or more adjacent areas or regions of the second image 62. Such local features or artifacts that are brighter than one or more adjacent areas or regions of the second image 62 may result from reflections, such as specular reflections, of the camera flash 12 from objects in the scene.

[0084] If the processor 6 determines in step 208 that the second image 62 has a local feature or artifact that is more intense than one or more adjacent areas or regions of the second image 62, the method proceeds to step 210, where the processor 6 determines whether the first image 60 has a local feature or artifact that is more intense than one or more adjacent areas or regions of the first image 60, where the local feature or artifact of the first image 60 is at a location in the first image 60 that corresponds to the location of the local feature or artifact in the second image 62.

[0085] If the processor 6 determines in step 210 that the first image 60 has a local feature or artifact that is brighter than one or more adjacent areas or regions of the first image 60 and that the local feature or artifact of the first image 60 is located at a position in the first image 60 that corresponds to the position of the local feature or artifact in the second image 62, the method returns a negative test result in step 216 indicating that the camera flash 12 is not activated.

[0086] If the processor 6 determines in step 210 that the first image 60 does not have local features or artifacts that are brighter than one or more adjacent areas or regions of the first image 60 and that the local features or artifacts of the first image 60 are located in a position in the first image 60 that corresponds to the position of the local features or artifacts in the second image 62, the method returns a positive test result in step 214 indicating that the camera flash 12 is operational.

[0087] If processor 6 determines that second image 62 does not have local features or artifacts that are higher in brightness than one or more adjacent areas or regions of second image 62, the method returns an indeterminate test result in step 218. Similarly, if processor 6 determines in step 106c that, for each of one or more characteristics of object 64, the first and second values ​​determined for the characteristic of object 64 do not meet the corresponding predetermined criteria, processor 6 determines in step 106e that first and second images 60, 62 are images of different scenes, and processor 6 determines an indeterminate test result in step 218.

[0088] In a first alternative example of the method for determining whether the first and second images are images of the same scene, steps 106a-106e shown in FIG. 4, processor 6 determines a quantitative similarity between first and second images 60, 62. Processor 6 determines that the first and second images 60, 62 are images of the same scene if the quantitative similarity between the first and second images 60, 62 meets a predetermined image similarity criterion. For example, processor 6 determines that the first and second images are images of the same scene if the difference in the quantitative similarity between the first and second images is less than a predetermined threshold. More specifically, processor 6 determines the cross-correlation between the first and second images 60, 62 or the cross-correlation between corresponding portions of the first and second images 60, 62. Processor 6 determines that the first and second images 60, 62 are images of the same scene if the cross-correlation between the first and second images 60, 62 meets a predetermined cross-correlation criterion. For example, processor 6 determines that the first and second images are images of the same scene if the difference in cross-correlation between the first and second images is less than a predetermined threshold.

[0089] In a second alternative example of the method for determining whether the first and second images are images of the same scene, steps 106a-106e shown in Figure 4, processor 6 uses accelerometer 17 to measure any movement of mobile electronic device 2 (and therefore camera 10) between the time the first image 60 was captured and the time the second image 62 was captured, and processor 6 determines that the first and second images 60, 62 are images of the same scene if the magnitude of any movement of camera 10 meets one or more predetermined movement criteria. For example, processor 6 determines that the first and second images 60, 62 are images of the same scene if the magnitude of any movement of camera 10 is less than one or more corresponding predetermined thresholds.

[0090] In a third alternative example of the method for determining whether the first and second images 60, 62 are images of the same scene, steps 106a-106e shown in Figure 4, processor 6 determines the position and orientation of mobile electronic device 2 (and thus camera 10) at the time of capturing each of first and second images 60, 62 from one or more signals received wirelessly by antenna 18 from one or more cellular base stations and / or from one or more satellites, such as one or more GPS satellites. Processor 6 then determines that the first and second images 60, 62 are images of the same scene if the determined position of camera 10 at the time of capturing the first and second images 60, 62 conforms to predetermined position criteria and the determined orientation of camera 10 at the time of capturing the first and second images 60, 62 conforms to corresponding predetermined orientation criteria. For example, the processor 6 determines that the first and second images 60, 62 are images of the same scene if the difference between the determined positions of the camera 10 at the time the first and second images 60, 62 were taken is less than a corresponding predetermined position threshold and the difference between the determined orientations of the camera 10 at the time the first and second images 60, 62 were taken is less than a corresponding predetermined orientation threshold.

[0091] A fourth alternative example of the method for determining whether the first and second images are images of the same scene in steps 106a-106e shown in FIG. 4 is described below with reference to FIG. 7. In the fourth alternative method for determining whether the first and second images are images of the same scene, in step 306a, processor 6 identifies an object 64 in the first image 60 and identifies the same object 64 in the second image 62. For example, processor 6 can use an image processing algorithm to identify the object 64 in the first image 60 and identify the same object 64 in the second image 62. The image processing algorithm can be based on, for example, a machine learning algorithm. In step 306b, processor 6 determines, for each of one or more characteristics of the object 64, a first value for the characteristic of the object 64 from the first image 60 and a second value for the characteristic of the object 64 from the second image 62. The one or more characteristics of the object can include, for example, one or more of the size of the object 64, the aspect ratio of the object 64, the position of the object 64, and the orientation of the object 64.

[0092] Then, in step 306c, processor 6 determines, for each of one or more characteristics of object 64, whether the determined first and second values ​​of the characteristic of object 64 meet a corresponding predetermined criterion. For example, processor 6 determines, for each of one or more characteristics of object 64, a difference between the determined first and second values ​​of the characteristic of object 64, and processor 6 determines, for each of one or more characteristics of object 64, whether the determined difference between the determined first and second values ​​of the characteristic of object 64 is less than a corresponding predetermined threshold. If, in step 306c, processor 6 determines that the determined first and second values ​​of the characteristic of object 64 meet the corresponding predetermined criterion for each of one or more characteristics of object 64, processor 6 determines, in step 306d, that first and second images 60, 62 are images of the same scene. If in step 306c the processor 6 determines that, for each of one or more characteristics of the subject 64, the first and second values ​​determined for the characteristics of the subject 64 do not meet the corresponding predetermined criteria, then in step 306e the processor 6 determines that the first and second images 60, 62 are images of different scenes.

[0093] Various modifications may be made to the above-described apparatus and method without departing from the scope defined by the appended claims. For example, in an alternative to any of the methods described with reference to FIGS. 2-7 for automatically testing the operational status of the camera flash 12 of a mobile electronic device 2, the mobile electronic device 2 may enable the camera flash 12 and prompt a user of the mobile electronic device 2 to capture a first image of a scene using the camera 10. In this alternative, the mobile electronic device 2 may subsequently disable the camera flash 12 and prompt the user to capture a second image of the same scene using the camera 10. An advantage of this alternative is that any technical limitations that prevent normal operation of the camera flash 12 may be detected before any images are captured. Such technical limitations may include, for example, a low battery state of the mobile electronic device 2 or any limitations placed on the use of the camera flash 12 by the diagnostic application 19.

[0094] Rather than the processor 6 of the mobile electronic device 2 executing the diagnostic application 19 and thereby causing the mobile electronic device 2 to perform the method for automatically testing the operational state of the camera flash 12 of the mobile electronic device 2 as described with reference to FIGS. 2 to 7 , the processor 26 of the server 22 executes the diagnostic application 30 and thereby causes the server 22 to communicate with the mobile electronic device 2 via the communication interfaces 7, 27 and the cloud 50 and cause the mobile electronic device 2 to perform the method for automatically testing the operational state of the camera flash 12 of the mobile electronic device 2 as described with reference to FIGS. 2 to 7 .

[0095] The one or more camera settings may include an aperture setting, an f-stop, or an f-number.

[0096] The method can include reading from the camera a light source setting, one or more camera settings, and one or more image characteristics of the first and second images.

[0097] The method can include capturing first and second images from a camera.

[0098] The method can include determining image characteristics of the first and second images from image data of the first and second images.

[0099] The method may include selecting each predetermined camera setting criterion and each predetermined image characteristic criterion based at least in part on corresponding camera setting values ​​and / or corresponding image characteristic values ​​when the camera captures the first image, which may be advantageous when the first image captures a relatively bright scene.

[0100] The mobile electronic device may include a mobile phone, a smartphone, a mobile phone, or a tablet.

[0101] The camera and light source may be fixed or attached in a fixed spatial relationship to the subject or to a device other than a mobile electronic device.

[0102] The camera and light source may form part of, be defined by, or be fixed or attached to a security system for a building, fixed structure, or enclosed area or space.

[0103] The camera and light source may form part of, be defined by, or be fixed or attached to the vehicle.

[0104] The light source may include or be defined by a light source provided with a vehicle, such as a headlight or taillight of the vehicle.

[0105] Those skilled in the art will understand that one or more of the features of the embodiments of the present disclosure described above with reference to the drawings may produce effects or provide advantages when used in isolation from one or more other features of the embodiments of the present disclosure, and that different combinations of features are possible other than the specific combinations of features of the embodiments of the present disclosure described above.

Claims

1. 1. A method for use in testing the operational state of a light source for illuminating a scene, the light source having a fixed spatial relationship to a camera, the method comprising: capturing a first image using the camera while the light source is disabled; capturing a second image using the camera when the light source is enabled; and a light source setting when the camera captures each of the first and second images, the light source setting indicating whether the light source is disabled or enabled when the camera captures the first and second images; and one or more camera settings when the camera captures the first and second images; and one or more image characteristics of the first and second images. At least one of determining a test result indicative of the operational status of the light source based at least in part on the determining whether the first and second images are images of the same scene; Including, Determining whether the first and second images are images of the same scene includes: determining a distance from the camera to an object at a predetermined location in the first image; determining a distance from the camera to an object at a predetermined location in the second image, the predetermined location in the second image corresponding to the predetermined location in the first image; and determining that the first and second images are images of the same scene if a determined distance from the camera to the object at the predetermined location in the first image and a determined distance from the camera to the object at the predetermined location in the second image meet a predetermined distance criterion; A method comprising:

2. The one or more camera settings are: an ISO setting of the camera's image sensor, an exposure index of the camera's image sensor, a sensitivity setting of the camera's image sensor, or a gain setting of the camera's image sensor; the shutter speed or exposure time of the camera; and the aperture setting, f-stop, or f-number of said camera; The method of claim 1 , comprising at least one of:

3. The one or more image characteristics are: an image brightness parameter representing the average brightness of the image or the average intensity of the image, or an image brightness parameter representing the average brightness or average intensity of a predetermined portion or a predetermined area of ​​the image; and Image file size, The method according to claim 1 or 2, comprising at least one of the following:

4. 4. A method according to any preceding claim, comprising reading the first and second images from the camera.

5. 5. The method of claim 1, further comprising extracting the light source settings, the one or more camera settings, and the one or more image characteristics for each of the first and second images from metadata associated with or stored in each of the first and second images.

6. For each of the one or more camera settings, determining whether a camera setting difference between a camera setting value associated with the first image and a camera setting value associated with the second image meets a corresponding predetermined camera setting criterion; and determining, for each of the one or more image characteristics, whether an image characteristic difference between an image characteristic value associated with the first image and an image characteristic value associated with the second image meets a corresponding predetermined image characteristic criterion; 6. The method of claim 1, comprising:

7. The method of claim 6, further comprising selecting each predetermined camera setting criterion and each predetermined image characteristic criterion based at least in part on the corresponding camera setting value and / or the corresponding image characteristic value when the camera captures the first image.

8. determining that the first and second images are images of the same scene; one or more of the camera setting differences meet the corresponding predetermined criteria; and one or more of the image characteristic differences meet the corresponding predetermined criteria; 8. The method of claim 6 or 7, further comprising determining a positive test result indicating that the light source is operational or that the light source is operating correctly or in compliance with predetermined performance specifications if the test result indicates that the light source is operational.

9. the first and second images are determined to be images of the same scene; and one or more of the camera setting differences do not meet the corresponding predetermined criteria; and one or more of the image characteristic differences do not meet the corresponding predetermined criteria; At least one of 9. The method of claim 6, further comprising determining a negative test result indicating that the light source is inoperable or that the light source is faulty or does not comply with predetermined performance specifications if:

10. determining that the first and second images are images of the same scene; the second image has local features or artifacts that are higher in brightness than one or more adjacent areas or regions of the second image; and The first image does not have local features or artifacts of higher brightness than one or more adjacent areas or regions of the first image, where the local features or artifacts of the first image are at locations in the first image that correspond to locations of the local features or artifacts in the second image.

10. The method of claim 1, further comprising determining a positive test result indicating that the light source is operational or that the light source is operating correctly or in compliance with predetermined performance specifications if the test result indicates that the light source is operational.

11. determining that the first and second images are images of the same scene; the second image has local features or artifacts that are higher in brightness than one or more adjacent areas or regions of the second image; and The first image has local features or artifacts that are higher in brightness than one or more adjacent areas or regions of the first image, where the local features or artifacts of the first image are at locations in the first image that correspond to locations of the local features or artifacts in the second image.

11. The method of claim 1, further comprising determining a negative test result if the light source is inoperative or indicates that the light source is faulty or does not comply with predetermined performance specifications.

12. 12. The method of claim 10 or 11, comprising using an image processing algorithm that is a machine learning algorithm to identify any local features or artefacts that are more intense than one or more adjacent areas or regions of the first and / or second images.

13. 13. The method of claim 1, comprising determining an inconclusive test result for the operating state of the light source if it is determined that the first and second images are not images of the same scene.

14. Determining whether the first and second images are images of the same scene includes: identifying objects in the first image using an image processing algorithm, the image processing algorithm being a machine learning algorithm; identifying the same object in the second image using an image processing algorithm, the image processing algorithm being a machine learning algorithm; For each of one or more characteristics of the object, determining a first value for the characteristic of the object from the first image and a second value for the characteristic of the object from the second image; and for each of the one or more characteristics of the object, determining that the first and second images are images of the same scene if the first and second values ​​for the characteristic of the object meet corresponding predetermined criteria; 14. The method of any one of claims 1 to 13, comprising:

15. The method of claim 14 , wherein the one or more characteristics of the object include one or more of the following: a size of the object, an aspect ratio of the object, a position of the object, and an orientation of the object.

16. Determining whether the first and second images are images of the same scene includes: determining a quantitative similarity that is a cross-correlation between the first and second images; and determining that the first and second images are images of the same scene if the quantitative similarity between the first and second images meets a predetermined image similarity criterion; 16. The method of any one of claims 1 to 15, comprising:

17. Determining whether the first and second images are images of the same scene includes: measuring the distance from the camera to the subject at the time the first image was captured; and measuring a distance from the camera to the subject at the time of capturing the second image; 2. The method of claim 1, comprising:

18. Measuring the distance from the camera to the subject at the time of capturing each of the first and second images includes: transmitting modulated electromagnetic radiation from an emitter to the object, the modulated light being modulated light, and detecting the modulated electromagnetic radiation reflected from the object with a detector; and determining a delay between emitting the modulated electromagnetic radiation from the emitter and detecting the reflected modulated electromagnetic radiation with the detector; where 20. The method of claim 17, wherein the emitter and the detector have a fixed spatial relationship with respect to each other.

19. 1. A method for use in testing the operational state of a light source for illuminating a scene, the light source having a fixed spatial relationship to a camera, the method comprising: capturing a first image using the camera while the light source is disabled; capturing a second image using the camera when the light source is enabled; a light source setting when the camera captures each of the first and second images, the light source setting indicating whether the light source is disabled or enabled when the camera captures the first and second images; and one or more camera settings when the camera captures the first and second images; and one or more image characteristics of the first and second images. At least one of determining a test result indicative of the operational status of the light source based at least in part on the determining whether the first and second images are images of the same scene; Including, Determining whether the first and second images are images of the same scene includes: measuring any movement of the camera between the time the first image was captured and the time the second image was captured; and determining that the first and second images are images of the same scene if the magnitude of any movement of the camera meets one or more predetermined movement criteria; A method comprising:

20. 1. A method for use in testing the operational state of a light source for illuminating a scene, the light source having a fixed spatial relationship to a camera, the method comprising: capturing a first image using the camera while the light source is disabled; capturing a second image using the camera when the light source is enabled; a light source setting when the camera captures each of the first and second images, the light source setting indicating whether the light source is disabled or enabled when the camera captures the first and second images; and one or more camera settings when the camera captures the first and second images; and one or more image characteristics of the first and second images. At least one of determining a test result indicative of the operational status of the light source based at least in part on the determining whether the first and second images are images of the same scene; Including, Determining whether the first and second images are images of the same scene includes: determining the position and orientation of the camera at the time of capturing each of the first and second images; and determining that the first and second images are images of the same scene if the determined camera positions at the time of capturing the first and second images meet predetermined position criteria and if the determined camera orientations at the time of capturing the first and second images meet corresponding predetermined orientation criteria; A method comprising:

21. 21. A method according to any preceding claim, wherein the light source comprises a camera flash provided with, housed in, or fixed or attached to the camera.

22. 22. The method of any one of claims 1 to 21, wherein the camera and the light source form part of, are defined by, or are fixed or attached to a computing device, the computing device being a mobile phone, a smartphone, a mobile phone, a tablet, a desktop computer, a laptop computer, a workstation, or an Internet of Things (IoT) device.

23. 23. An application for a mobile electronic device comprising a camera and a light source, or an application for a server configured to communicate with a mobile electronic device comprising a camera and a light source, wherein when executed by a processor of the mobile electronic device or a processor of the server, the application causes the mobile electronic device to perform a method according to any one of claims 1 to 22.

Images