Recognition control method and device and electronic equipment

Abstract

The invention discloses a recognition control method and device and electronic equipment, which are applied to the electronic equipment, the electronic equipment comprises a camera and an infrared light supplement lamp, the camera is used for recognizing an image, and the infrared light supplement lamp is used for supplementing light when the camera recognizes the image. When the application needs to use the camera function, due to the fact that the camera is in the normally-open state, it is not needed to wait for opening the camera, the recognition speed of the camera is high, the infrared light supplement lamp is turned on based on the infrared light supplement requirement, and therefore the infrared light supplement lamp is correspondingly turned on according to the infrared light supplement requirement; according to the technical scheme, the infrared light supplement lamp is turned on only when needed, the infrared light supplement lamp does not need to be turned on along with turning-on of the camera, the problem that hardware is overheated and prone to damage due to the fact that the infrared light supplement lamp is normally turned on is solved, the infrared light supplement lamp is better used for supplementing light when the camera recognizes an image, and the image recognition efficiency is improved. Therefore, the identification speed of the camera is improved, and the imaging precision of the camera is ensured.

Description

Technical Field

[0001] The present invention relates to the field of fill light control, and in particular to an identification control method, device and electronic equipment. Background Art

[0002] Electronic devices need to use cameras for identification when performing scenarios such as scanning codes, face recognition, and scanning, and fill lights are needed for fill lighting when using cameras for recognition.

[0003] However, in the related art, when using a camera for recognition, it is not possible to simultaneously solve the problem that the camera recognition time is very long and the fill light is very easy to be damaged. Summary of the invention

[0004] The technical problem to be solved by the present invention is to provide a recognition control method, device and electronic equipment, which can improve the camera recognition speed while ensuring the imaging accuracy of the camera.

[0005] In order to solve the above technical problems, a technical solution adopted by the present invention is: A recognition control method is applied to an electronic device, wherein the electronic device comprises a camera and an infrared fill light, wherein the camera is used to recognize an image, and the infrared fill light is used to provide fill light when the camera recognizes an image, and the method comprises: Turning on the camera and keeping it in a normally open state; Acquiring an infrared fill light requirement, where the infrared fill light requirement includes a requirement for turning on the infrared fill light when the electronic device calls the camera to perform image recognition; The infrared fill light is turned on based on the infrared fill light requirement.

[0006] In order to solve the above technical problems, another technical solution adopted by the present invention is: An identification control device includes a camera normally-on module, a demand acquisition module, and an infrared fill light on module; The camera normally-on module is used to turn on the camera and put the camera in a normally-on state; The demand acquisition module is used to acquire the infrared fill light demand, wherein the infrared fill light demand includes the demand for turning on the infrared fill light when the electronic device calls the camera to perform image recognition; The infrared fill light turning on module is used to turn on the infrared fill light based on the infrared fill light requirement.

[0007] In order to solve the above technical problems, another technical solution adopted by the present invention is: An electronic device comprises a memory, a processor and a computer program stored in the memory and running on the processor, wherein the processor implements each step of the above-mentioned identification control method when executing the computer program.

[0008] The beneficial effects of the present invention are as follows: the present application turns on the camera and keeps the camera in a normally-on state. When an application needs to use the camera function, since the camera is in a normally-on state, there is no need to wait for the camera to be turned on. The camera recognition speed is fast, which solves the problem of long camera recognition time. The present application also obtains the infrared fill light demand and turns on the infrared fill light based on the infrared fill light demand. The infrared fill light is turned on accordingly according to the infrared fill light demand, that is, the infrared fill light is turned on only when needed, and there is no need to keep the infrared fill light in a normally-on state as the camera is turned on. This avoids the problem of hardware overheating and easy damage caused by the infrared fill light being always on. The infrared fill light can be better utilized for fill light when the camera recognizes an image, thereby improving the camera recognition speed while ensuring the imaging accuracy of the camera. At the same time, the problem of long camera recognition time and easy damage of the fill light is solved. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] Figure 1 A flowchart of a recognition control method provided by an embodiment of the present invention; Figure 2 An internal control framework diagram of an identification control method provided by an embodiment of the present invention; Figure 3 A control flow chart of an identification control method provided by an embodiment of the present invention; Figure 4 A structural diagram of an identification control device provided by an embodiment of the present invention; Figure 5 A schematic diagram of the structure of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0010] In order to make the technical problems, technical solutions and beneficial effects to be solved by the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0011] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present application.

[0012] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, wholes, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or combinations thereof.

[0013] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0014] In the related art, the control of the infrared fill light originally belonged to the function of the internal system control of the camera firmware. As for the camera itself, its control logic is very simple. The infrared fill light is turned on when the camera is turned on, and the infrared fill light is turned off when the camera is turned off.

[0015] Through research, the present application has found that in some other camera application scenarios, the solution of the camera itself controlling the infrared fill light can no longer meet the use requirements. When the camera is always on, the infrared fill light will remain always on. The reason for the camera to be always on is that turning on the camera is a time-consuming operation, usually taking 1 to 2 seconds. The camera is turned on once every time scanning or face recognition is performed, and the user will feel stuck, which cannot meet the user experience requirements. Therefore, the present application chooses to turn on the camera, but the impact of turning on the camera is that the infrared fill light is forced to be always on. The infrared fill light has high power consumption and low heat dissipation efficiency. If it is always on, the local temperature of the hardware will be too high, and the temperature of the LED board will reach about 90 degrees. While increasing energy consumption, it will also affect the life of the equipment, causing the infrared fill light to be easily damaged, and will interfere with the operation of the DSP (digital signal processor) to cause color cast, indirectly causing the camera imaging accuracy to decrease, affecting face recognition or other scanning-related services. Therefore, the present application solves the problems of long camera recognition time and easy damage of the fill light through the following method.

[0016] In order to solve the above problems, the present application provides an identification control method, device and electronic device. The following specifically introduces an identification control method of the present application.

[0017] The recognition control method in the present application can be applied to electronic devices, which include cameras and infrared fill lights. The camera is used to recognize images, and the infrared fill light is used to provide fill light when the camera recognizes images. The electronic device can be an electronic device with a face recognition function, a barcode scanner, or a scanner, etc. For example, the camera and infrared fill light of the electronic device with a face recognition function are controlled, or the camera and infrared fill light of the barcode scanner are controlled, or the camera and infrared fill light of the barcode scanner are controlled, or the camera and infrared fill light of the barcode scanner are controlled, and so on.

[0018] The following is a detailed description of the identification control method of the present invention. Figure 1 , including steps 110 to 130.

[0019] Step 110: Turn on the camera and keep it in a normally open state.

[0020] For example, when the camera needs to be turned on, the electronic device sends an on command to the camera module without sending a off command, so that the camera is in a normally on state.

[0021] Step 120: Obtain infrared fill light requirements, where the infrared fill light requirements include requirements for turning on infrared fill light when the electronic device uses a camera to perform image recognition.

[0022] For example, when the electronic device is an electronic device with a face recognition function and face recognition is needed, the infrared fill light requirement for face recognition is obtained; or when the electronic device is a barcode scanner or a barcode scanner and the barcode scanning function of the barcode scanner or the barcode scanner is needed, the infrared fill light requirement for scanning is obtained.

[0023] Step 130: Turn on the infrared fill light based on the infrared fill light requirement.

[0024] Continuing with the above example, when the electronic device uses the face recognition function, the infrared fill light is turned on based on the infrared fill light demand for face recognition, or when a barcode scanner or barcode scanner is used to scan a code, the infrared fill light is turned on based on the infrared fill light demand for scanning a code.

[0025] In this way, the present application turns on the camera and keeps the camera in a normally-on state. When the application needs to use the camera function, since the camera is in a normally-on state, there is no need to wait for the camera to be turned on. The camera recognition speed is fast, which solves the problem of long camera recognition time. The present application also obtains the infrared fill light demand and turns on the infrared fill light based on the infrared fill light demand. The infrared fill light is turned on accordingly according to the infrared fill light demand, that is, the infrared fill light is turned on only when needed, and there is no need to keep the infrared fill light in a normally-on state as the camera is turned on. This avoids the problem of hardware overheating and easy damage caused by the infrared fill light being always on, and can better utilize the infrared fill light for fill light when the camera recognizes the image, thereby improving the camera recognition speed while ensuring the imaging accuracy of the camera, and at the same time solving the problems of long camera recognition time and the fill light being extremely easy to be damaged.

[0026] In one embodiment of the present application, step 120 includes: Gets the on / off status of the image recognition interface of the application corresponding to the camera.

[0027] For example, the on / off status of the face recognition interface of the application corresponding to the camera is obtained, or the on / off status of the code scanning interface of the application corresponding to the camera is obtained.

[0028] In this way, by obtaining the open and closed state of the image recognition interface of the application corresponding to the camera, it is possible to simply and effectively determine whether the camera is actually needed at present, so as to serve as a basis for turning on or off the infrared fill light.

[0029] In one embodiment of the present application, please refer to Figure 2 In step 120, obtaining the on / off state of the image recognition interface of the application corresponding to the camera includes: The camera preview service of the application layer is monitored by the Activity Manager Service (AMS) of the framework layer to obtain the on / off status of the image recognition interface of the application corresponding to the camera. The camera preview service of the application layer can run in the background.

[0030] For example, when using a barcode scanner to scan, the application opens the scanning interface, registers the data frame callback interface with the camera preview service, obtains the preview data frame, and then performs recognition or various other operations. At this time, the AMS at the framework layer can monitor the opening or closing of the scanning interface.

[0031] In this way, by automatically monitoring the camera preview service of the application layer, the on and off status of the image recognition interface can be obtained with higher reliability.

[0032] In one embodiment of the present application, step 130 includes: If the switch status is on, turn on the infrared fill light; If the on / off state is off, the infrared fill light is turned off.

[0033] In this way, the infrared fill light is only turned on when image recognition operation is performed. If no image recognition operation is performed, the infrared fill light is turned off. This can avoid the infrared fill light being turned on all the time, reduce energy consumption, extend the service life of the infrared fill light, and ensure that the infrared fill light can be turned on as needed, thereby ensuring the imaging accuracy of the camera.

[0034] In one embodiment of the present application, after step 120, the following steps are further included: If the on / off state is on, the infrared fill light on / off property in the camera preview service of the application layer is set to on through the activity management service of the framework layer; If the on / off state is off, the infrared fill light on / off property in the camera preview service of the application layer is set to off through the activity management service of the framework layer.

[0035] For example, please refer to Figure 2 When the AMS at the framework layer monitors the opening or closing of the scanning interface, the on / off attribute of the infrared fill light is set. The on / off attribute of the infrared fill light is open and is not limited to the AMS.

[0036] In this way, the on / off property of the infrared fill light in the camera preview service of the application layer will be automatically set according to the on / off state of the monitored application's image recognition interface, so as to more accurately identify and control the infrared fill light later.

[0037] In one embodiment of the present application, turning on the infrared fill light in step 130 includes: Get the on / off properties of the infrared fill light in the data frame callback timer in the camera preview service through the hardware abstraction layer (HAL); If the infrared fill light on / off property is on, the infrared fill light is turned on through the hardware abstraction layer; If the infrared fill light on / off property is off, the infrared fill light is turned off through the hardware abstraction layer.

[0038] For example, please refer to Figure 2 , through the ExternalCameraDeviceSession session object of the hardware abstraction layer, poll the 66.67ms data frame callback timer in the camera preview service to obtain the on and off properties of the infrared fill light.

[0039] In this way, when it is preliminarily determined that the infrared fill light needs to be turned on, the on-off properties of the infrared fill light are obtained in the data frame callback timer in the camera preview service through the hardware abstraction layer, and the on-off of the infrared fill light is reconfirmed according to the on-off properties of the infrared fill light to avoid misjudgment and ensure that the infrared fill light can fill light in time when the camera recognizes the image.

[0040] In one embodiment of the present application, turning on the infrared fill light through the hardware abstraction layer includes: A control interface for the infrared fill light is added to the kernel control protocol through the hardware abstraction layer, and the video control interface of the camera's firmware is called through the USB control message module to turn on the infrared fill light.

[0041] For example, please refer to Figure 2 If the USB camera uses the v4l2 framework protocol, a new infrared fill light control interface is added to the kernel control protocol v4l2_control through the hardware abstraction layer, and the camera firmware video control interface Video Control is called through the USB control message module usb_control_msg to turn on the infrared fill light.

[0042] In this way, the turning on of the infrared fill light can be accurately controlled through the control interface of the infrared fill light and the video control interface of the camera firmware.

[0043] In one embodiment of the present application, after step 110, the following steps are further included: Get the configuration information of the infrared fill light; If the start configuration information is automatic start, then the step 130 of starting the infrared fill light includes: Turn on the infrared fill light directly.

[0044] If the opening configuration information is manual opening, then the opening of the infrared fill light in step 130 includes: Outputting confirmation information of whether the infrared fill light is turned on, and receiving a confirmation result corresponding to the confirmation information of whether the infrared fill light is turned on; Determine whether the confirmation result is confirmation to turn on, if so, turn on the infrared fill light, if not, do not turn on the infrared fill light.

[0045] For example, the user can set the infrared fill light's on configuration information in advance. When the on / off state of the application's image recognition interface is on and the on configuration information is automatically on, the infrared fill light is directly turned on. When the on / off state of the application's image recognition interface is on and the on configuration information is manually on, the infrared fill light's on / off confirmation information is output for the user to choose whether to turn on the infrared fill light, and the infrared fill light is turned on according to the user's confirmation result.

[0046] In this way, the infrared fill light can be set to be turned on automatically, that is, the infrared fill light is automatically turned on when the camera is used to recognize an image, or the infrared fill light can be set to be turned on manually, that is, when it is determined that the camera is used to recognize an image, the user confirms whether to turn on the infrared fill light, so as to improve the flexibility of the infrared fill light control.

[0047] The following is a detailed introduction to the application embodiments of the present application. The present application can apply the above solution to the scene where the camera and infrared fill light need to be controlled. Please refer to Figure 3 , including the following steps (1) to (5).

[0048] (1) Turn on the camera and keep it in the normally open state.

[0049] (2) Obtain the configuration information for turning on the infrared fill light.

[0050] (3) The camera preview service of the application layer is monitored through the activity management service of the framework layer to obtain the open and closed status of the image recognition interface of the application corresponding to the camera.

[0051] (4) If the switch status is open, execute steps (4-1) to (4-5): (4-1) Set the infrared fill light on / off property in the camera preview service of the application layer to on through the activity management service of the framework layer.

[0052] (4-2) Obtaining the on / off property of the infrared fill light in the data frame callback timer in the camera preview service through the hardware abstraction layer.

[0053] (4-3) If the infrared fill light on / off attribute is on and the on configuration information is automatically on, the infrared fill light is directly turned on through the hardware abstraction layer.

[0054] Specifically, a control interface of the infrared fill light is added to the kernel control protocol through the hardware abstraction layer, and the video control interface of the camera firmware is called through the USB control message module to turn on the infrared fill light.

[0055] (4-4) If the infrared fill light on / off attribute is on and the on configuration information is manual on, then output the infrared fill light on / off confirmation information and receive the confirmation result corresponding to the infrared fill light on / off confirmation information; determine whether the confirmation result is confirmed on / off, if so, turn on the infrared fill light, if not, do not turn on the infrared fill light.

[0056] (4-5) If the infrared fill light on / off attribute is off, the infrared fill light is turned off through the hardware abstraction layer.

[0057] (5) If the switch status is closed, execute steps (5-1) to (5-5): (5-1) Set the infrared fill light on / off property in the camera preview service of the application layer to off through the activity management service of the framework layer.

[0058] (5-2) Get the on / off properties of the infrared fill light in the data frame callback timer in the camera preview service through the hardware abstraction layer.

[0059] (5-3) If the infrared fill light on / off attribute is off, the infrared fill light is turned off through the hardware abstraction layer.

[0060] (5-4) If the infrared fill light on / off attribute is on and the on configuration information is automatically on, the infrared fill light is turned on directly through the hardware abstraction layer.

[0061] (5-5) If the infrared fill light on / off attribute is on and the on configuration information is manual on, then output the infrared fill light on / off confirmation information and receive the confirmation result corresponding to the infrared fill light on / off confirmation information; determine whether the confirmation result is confirmed on / off, if so, turn on the infrared fill light, if not, do not turn on the infrared fill light.

[0062] Please refer to Figure 2The application layer includes a camera preview service that can run in the background. When scanning, the application opens the scanning interface, and the interface registers the data frame callback interface to the camera preview service to obtain the preview data frame, and then performs recognition or various other operations. At this time, the AMS of the framework layer will listen to the opening or closing of the scanning interface, and set the on and off properties of the infrared fill light. The on and off properties are open and not limited to AMS. The HAL layer ExternalCameraDeviceSession session object polls and determines the on and off properties of the infrared fill light in the 66.67ms data frame callback timer of the camera preview. At this time, the on and off actions of the infrared fill light can be captured by the HAL layer. Then, according to the infrared fill light control interface exposed by the camera manufacturer in the driver (if the manufacturer does not expose it, it needs to be customized), since the USB camera uses the v4l2 framework protocol, the kernel v4l2_control control protocol is modified (the kernel source code does not have it by default), and a control interface for the infrared fill light is added, and then the usb_control_msg module is called to the video of the camera firmware itself. The infrared fill light can be turned on and off through the control interface.

[0063] The present invention also provides an identification control device. Figure 4 , including the camera always-on module, demand acquisition module and infrared fill light on module; The camera normally-on module is used to turn on the camera and keep the camera in a normally-on state; A demand acquisition module is used to acquire infrared fill light demand, where the infrared fill light demand includes the demand for turning on the infrared fill light when the electronic device calls the camera for image recognition; The infrared fill light on module is used to turn on the infrared fill light based on the infrared fill light demand.

[0064] Please refer to Figure 5 The present invention also provides an electronic device 300, including a memory 301 and a processor 302, and a computer program stored in the memory 301 and running on the processor 302. When the processor 302 executes the computer program, it implements the various steps in the above-mentioned identification control method.

[0065] The beneficial effects of the electronic device of the present invention are the same as those of the above method and will not be described in detail here.

[0066] In summary, the present invention provides an identification control method, device and electronic device. The present application turns on the camera and keeps the camera in a normally-on state. When the application needs to use the camera function, since the camera is in a normally-on state, there is no need to wait for the camera to be turned on. The camera recognition speed is fast, which solves the problem of long camera recognition time. The present application also obtains the infrared fill light demand and turns on the infrared fill light based on the infrared fill light demand. In this way, the infrared fill light is turned on accordingly according to the infrared fill light demand, that is, the infrared fill light is turned on only when needed, and there is no need to keep the infrared fill light in a normally-on state when the camera is turned on, thereby avoiding the infrared The problem that the infrared fill light is often turned on, causing the hardware to overheat and be easily damaged, can be solved by better utilizing the infrared fill light to provide fill light when the camera recognizes the image, thereby improving the camera recognition speed while ensuring the camera's imaging accuracy, and solving the problem that the camera recognition time is very long and the fill light is extremely easy to be damaged. In addition, the infrared fill light can be set to be turned on automatically, that is, the infrared fill light is automatically turned on when the camera is used to recognize the image, or the infrared fill light can be set to be turned on manually, that is, when it is determined that the camera is used to recognize the image, the user confirms whether to turn on the infrared fill light, so as to improve the flexibility of the infrared fill light control.

[0067] The above are only embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent transformations made using the contents of the specification and drawings of the present invention, or directly or indirectly applied in related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. An identification control method, characterized in that: Applied to an electronic device, the electronic device includes a camera and an infrared fill light, the camera is used to recognize an image, and the infrared fill light is used to provide fill light when the camera recognizes an image, the method includes: Turning on the camera and keeping it in a normally open state; Acquiring an infrared fill light requirement, where the infrared fill light requirement includes a requirement for turning on the infrared fill light when the electronic device calls the camera to perform image recognition; The infrared fill light is turned on based on the infrared fill light requirement.

2. The identification control method according to claim 1, characterized in that: The requirements for obtaining infrared fill light include: Obtaining the on / off status of the image recognition interface of the application corresponding to the camera; Turning on the infrared fill light based on the infrared fill light requirement includes: If the opening and closing state is open, turning on the infrared fill light; If the on / off state is closed, the infrared fill light is turned off.

3. The identification control method according to claim 2, characterized in that: The step of obtaining the on / off state of the image recognition interface of the application corresponding to the camera includes: The camera preview service of the application layer is monitored by the activity management service of the framework layer to obtain the opening and closing status of the image recognition interface of the application corresponding to the camera.

4. The identification control method according to claim 3, characterized in that: After obtaining the on / off state of the image recognition interface of the application corresponding to the camera, the method further includes: If the on / off state is on, setting the on / off attribute of the infrared fill light in the camera preview service of the application layer to on through the activity management service of the framework layer; If the on / off state is off, the on / off property of the infrared fill light in the camera preview service of the application layer is set to off through the activity management service of the framework layer.

5. The identification control method according to claim 4, characterized in that: After turning on the camera and putting the camera in a normally-on state, the method further includes: Obtaining the activation configuration information of the infrared fill light; If the activation configuration information is automatic activation, then the activation of the infrared fill light includes: Directly turn on the infrared fill light.

6. The identification control method according to claim 5, characterized in that: If the activation configuration information is manual activation, then the activation of the infrared fill light includes: Outputting confirmation information of whether the infrared fill light is turned on, and receiving a confirmation result corresponding to the confirmation information of whether the infrared fill light is turned on; Determine whether the confirmation result is confirmation to turn on, if so, turn on the infrared fill light, if not, do not turn on the infrared fill light.

7. The identification control method according to claim 4, characterized in that: The step of turning on the infrared fill light comprises: Obtaining the on / off property of the infrared fill light in the data frame callback timer in the camera preview service through the hardware abstraction layer; If the on / off attribute of the infrared fill light is on, turning on the infrared fill light through the hardware abstraction layer; If the on / off attribute of the infrared fill light is off, the infrared fill light is turned off through the hardware abstraction layer.

8. The identification control method according to claim 7, characterized in that: The step of turning on the infrared fill light through the hardware abstraction layer includes: A control interface of the infrared fill light is added to the kernel control protocol through the hardware abstraction layer, and a video control interface of the camera firmware is called through a USB control message module to turn on the infrared fill light.

9. An identification control device, characterized in that: Including camera always-on module, demand acquisition module and infrared fill light on module; The camera normally-on module is used to turn on the camera and put the camera in a normally-on state; The demand acquisition module is used to acquire the infrared fill light demand, wherein the infrared fill light demand includes the demand for turning on the infrared fill light when the electronic device calls the camera to perform image recognition; The infrared fill light turning on module is used to turn on the infrared fill light based on the infrared fill light requirement.

10. An electronic device comprising a memory, a processor, and a computer program stored in the memory and running on the processor, wherein the processor implements each step of an identification control method as described in any one of claims 1 to 8 when executing the computer program.

Images