Image acquisition method and device, electronic terminal and computer readable storage medium

Abstract

The invention provides an image acquisition method and device, an electronic terminal and a computer readable storage medium, and the method comprises the steps: carrying out the distance detection of a target object through a detection module, and carrying out the focus adjustment based on a distance detection result through a zooming module, and obtaining an optical parameter of the target object; and in response to the received trigger signal, controlling the acquisition module to perform image acquisition on the target object based on the optical parameter corresponding to the target object. According to the invention, distance detection and focus adjustment are completed before the trigger signal arrives, so that the obtained optical parameters can be directly used for image acquisition after triggering, thereby remarkably shortening the response time from triggering to acquisition and reducing the trigger delay on the premise of ensuring the imaging definition.

Description

Technical Field

[0001] This application relates to the field of image technology, and in particular to an image acquisition method, apparatus, electronic terminal, and computer-readable storage medium. Background Technology

[0002] In industrial barcode reader applications, the height differences of objects being photographed on conveyor belts may exceed the depth of field of the lens. Although using time-of-flight ranging combined with liquid lens technology can dynamically adjust the focus based on ranging information before triggering image acquisition when the depth of field is exceeded, thus obtaining a clear image, this solution has significant limitations. The time-of-flight ranging and liquid lens zooming processes are time-consuming, resulting in overall response delays, severely impacting system real-time performance, and limiting its applicability in high-speed scenarios. Summary of the Invention

[0003] The main technical problem addressed by this application is to provide an image acquisition method, device, electronic terminal, and computer-readable storage medium, thereby solving the problem of image acquisition response delay caused by the long zooming process in the prior art.

[0004] To solve the above-mentioned technical problems, the first technical solution adopted in this application is: to provide an image acquisition method applied to an electronic device, the electronic device including a detection module, a zoom module, and an acquisition module, the image acquisition method including: Before receiving the trigger signal, the target object is detected by the detection module and the optical parameters of the target object are obtained by the zoom module based on the distance detection result. Upon receiving a trigger signal, the acquisition module is controlled to acquire images of the target object based on the optical parameters corresponding to the target object.

[0005] The optical parameters of the target object are obtained by detecting the distance to the target object through a detection module and adjusting the focus based on the distance detection result through a zoom module, including: In t n During the focusing cycle, the detection module performs distance detection on the target object to obtain the corresponding detection distance of the target object; In t n+1 During the focusing cycle, the zoom module is driven by the detection distance of the target object to adjust the focus and obtain the optical parameters that match the target object. The duration of the focusing cycle is the larger of the single detection time of distance detection and the single zoom time of focus adjustment.

[0006] Among them, in t n+1 During the focusing cycle, the zoom module is driven by the detection distance of the target object to adjust the focus and obtain optical parameters that match the target object, including: In t n+1During the focusing cycle, the zoom module is driven to adjust the focus based on the detection distance of the i-th target object, and at the same time, the detection module is activated to detect the distance of the (i+1)-th target object.

[0007] Specifically, in response to receiving a trigger signal, the acquisition module is controlled to acquire an image of the target object based on the optical parameters corresponding to the target object, including: Upon receiving a trigger signal, determine whether the zoom module is currently in the focus adjustment process; the current focus adjustment process involves focusing on the i-th target object. In response to the zoom module being in the focus adjustment process, after the zoom module completes the focus adjustment of the i-th target object, the acquisition module is controlled to acquire the image of the i-th target object based on the optical parameters of the i-th target object.

[0008] The system, which responds to receiving a trigger signal by controlling the acquisition module to acquire an image of the target object based on the optical parameters corresponding to the target object, also includes: In response to the zoom module completing focus adjustment and being in an idle state, the acquisition module is directly controlled to acquire an image of the i-th target object based on the optical parameters of the i-th target object.

[0009] The image acquisition methods also include: Obtain the detection distance of the (i+1)th target object obtained by the detection module; Determine whether the distance difference between the detection distance corresponding to the (i+1)th target and the detection distance corresponding to the ith target is less than a preset value; When the distance difference is less than a preset value and a trigger signal is received, the acquisition module is controlled to acquire images of the (i+1)th target based on the optical parameters of the i-th target.

[0010] The acquisition module, which controls the acquisition of images of the target object based on the optical parameters corresponding to the target object, includes: Based on the optical parameters corresponding to the target object, the acquisition module is controlled to perform exposure operations and image output to obtain image information of the target object.

[0011] To solve the above-mentioned technical problems, the second technical solution adopted in this application is: to provide an image acquisition device, the image acquisition device comprising: The preprocessing module is used to detect the distance of the target object through the detection module and adjust the focus based on the distance detection result through the zoom module to obtain the optical parameters of the target object before receiving the trigger signal; The post-processing module is used to control the acquisition module to acquire images of the target object based on the optical parameters corresponding to the target object when a trigger signal is received.

[0012] To solve the above-mentioned technical problems, the third technical solution adopted in this application is: to provide an electronic terminal, which includes a memory and a processor coupled to each other, the processor being used to execute program instructions stored in the memory, and the processor being used to execute program data to implement the steps in the image acquisition method.

[0013] To solve the above-mentioned technical problems, the fourth technical solution adopted in this application is: to provide a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, it implements the steps in the image acquisition method.

[0014] The beneficial effects of this application are as follows: Unlike existing technologies, this application provides an image acquisition method, apparatus, electronic terminal, and computer-readable storage medium. The image acquisition method includes: before receiving a trigger signal, performing distance detection on a target object using a detection module and adjusting the focus based on the distance detection result using a zoom module to obtain the optical parameters of the target object; in response to receiving the trigger signal, controlling the acquisition module to acquire an image of the target object based on the corresponding optical parameters. By completing distance detection and focus adjustment before the trigger signal arrives, this application allows for direct image acquisition using the acquired optical parameters after triggering, thereby significantly shortening the response time from triggering to acquisition and reducing trigger delay while ensuring image clarity. Attached Figure Description

[0015] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0016] Figure 1 This is a schematic diagram of the timing flow of image acquisition methods in the prior art; Figure 2 This is a flowchart illustrating the image acquisition method provided in this application; Figure 3 This is a flowchart illustrating a specific embodiment of step S1 in the image acquisition method provided in this application; Figure 4 This is a schematic diagram of the timing flow of the image acquisition method provided in this application; Figure 5 This is a schematic diagram of the framework of an embodiment of the image acquisition device provided in this application; Figure 6 This is a schematic diagram of the framework of an embodiment of the electronic terminal provided in this application; Figure 7This is a schematic diagram of a framework of an embodiment of the computer-readable storage medium provided in this application. Detailed Implementation

[0017] The embodiments of this application will now be described in detail with reference to the accompanying drawings.

[0018] In the following description, specific details such as particular system architectures, interfaces, and technologies are presented for illustrative purposes rather than for limiting purposes, in order to provide a thorough understanding of this application.

[0019] In this article, the term "and / or" simply describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone. Additionally, the character " / " generally indicates that the preceding and following related objects have an "or" relationship. Furthermore, "more" in this article means two or more objects.

[0020] To enable those skilled in the art to better understand the technical solution of this application, the image acquisition method provided by this application will be described in further detail below with reference to the accompanying drawings and specific embodiments.

[0021] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing embodiments of this application only and is not intended to limit this application.

[0022] Before providing a further detailed description of the embodiments of this application, the nouns and terms involved in the embodiments of this application will be explained, and the nouns and terms involved in the embodiments of this application shall be interpreted as follows.

[0023] Currently, based on the technical characteristics of time-of-flight ranging, to achieve real-time autofocus in trigger mode, the software control must strictly follow the timing sequence of "trigger—range measurement—zoom—exposure—image readout" to ensure accurate focus at the moment of image acquisition, thereby obtaining clear imaging results. However, due to the long time consumption of time-of-flight ranging and the zoom process of the liquid lens, the overall response delay is caused, which seriously affects the real-time performance of the system and limits its applicability in high-speed scenarios.

[0024] Please see Figure 1 , Figure 1 This is a schematic diagram of the timing flow of image acquisition methods in existing technologies.

[0025] according to Figure 1As shown, in the existing image acquisition process, the timing sequence of "trigger-range measurement-zoom-exposure-image readout" takes 15ms for range measurement, 10ms for zooming, 5ms for exposure, and 15ms for image readout, for a total of 45ms.

[0026] Time-of-flight (ToF) ranging is an active ranging technology that measures distance based on the time it takes for a light signal to travel.

[0027] The zoom principle of liquid lenses is mainly based on physical mechanisms such as electrowetting or dielectrophoresis. By changing the shape of the liquid, the optical focal length is adjusted, thereby completing the autofocus or zoom function.

[0028] This application provides an electronic device, which includes a detection module, a zoom module, an acquisition module, and a control module. The control module is signal-connected to the detection module, the zoom module, and the acquisition module. Specifically, the electronic device can be a Time-of-Flight (TOF) camera. The TOF camera can obtain depth information of the scene by emitting near-infrared light into the scene, receiving the reflected near-infrared light, calculating the time difference or phase difference of the reflected near-infrared light, and representing different distances by using different colors to represent the outline of the scene, thereby obtaining a depth image.

[0029] The image acquisition method provided in this application can be implemented by a server or terminal alone, or by a server and terminal working together. In some embodiments, the terminal or server can implement the image acquisition method provided in this application by running a computer program. For example, the computer program can be a native program or software module in an operating system; it can be a native application (APP), i.e., a program that needs to be installed in the operating system to run, such as a client that supports virtual scenes, such as a game APP; it can also be a mini-program, i.e., a program that only needs to be downloaded to a browser environment to run; or it can be a mini-program that can be embedded in any APP. In short, the above-mentioned computer program can be any form of application, module, or plugin.

[0030] The following uses the control module in an electronic device as an example to illustrate the image acquisition method provided in this application.

[0031] Please see Figure 2 , Figure 2 This is a flowchart illustrating the image acquisition method provided in this application.

[0032] This embodiment provides an image acquisition method, which includes the following steps.

[0033] S1: Before receiving the trigger signal, the target object is detected by the detection module and the optical parameters of the target object are obtained by the zoom module adjusting the focus based on the distance detection result.

[0034] S2: In response to receiving a trigger signal, the acquisition module is controlled to acquire images of the target object based on the optical parameters corresponding to the target object.

[0035] Please see Figure 3 , Figure 3 This is a flowchart illustrating a specific embodiment of step S1 in the image acquisition method provided in this application.

[0036] Specifically, the specific implementation of step S1, in which the target object is detected by the detection module and the optical parameters of the target object are obtained by the zoom module by adjusting the focus based on the distance detection result, is as follows.

[0037] S11: In t n During the focusing cycle, the detection module performs distance detection on the target object to obtain the corresponding detection distance of the target object.

[0038] S12: In t n+1 During the focusing cycle, the zoom module is driven by the detection distance of the target object to adjust the focus and obtain the optical parameters that match the target object. The duration of the focusing cycle is the larger of the single detection time of distance detection and the single zoom time of focus adjustment.

[0039] In this application, the electronic device is positioned relative to the target object to facilitate image acquisition of the target object. For example, the electronic device may be located above the target object to facilitate image acquisition of target objects at different heights. Alternatively, the electronic device may be located to the side of the target object to facilitate image acquisition of target objects of different volumes.

[0040] Before receiving a trigger signal, the detection module continuously performs distance detection on different target objects placed on the production line. Different target objects pass through the detection module in sequence, allowing the detection module to detect the corresponding detection distance for each target object. The detection distance is the physical distance between the target object and the detection module.

[0041] Specifically, in t n+1 During the focusing cycle, the zoom module is driven to adjust the focus based on the detection distance of the i-th target object, and at the same time, the detection module is activated to detect the distance of the (i+1)-th target object.

[0042] By performing operations simultaneously on the detection module and the zoom module, the zoom process time is shortened.

[0043] Specifically, in step S2, the specific implementation of controlling the acquisition module to acquire images of the target object based on the optical parameters corresponding to the target object when the trigger signal is received is as follows.

[0044] Specifically, in response to receiving a trigger signal, it is determined whether the zoom module is in the focus adjustment process at the current moment; the focus adjustment process at the current moment adjusts the focus of the i-th target object.

[0045] In response to the zoom module being in the focus adjustment process, the acquisition module will be controlled to acquire an image of the i-th target object based on the optical parameters of the i-th target object after the zoom module completes the focus adjustment of the i-th target object. At this time, the trigger delay does not exceed the duration of a complete single zoom cycle.

[0046] Once the zoom module completes focus adjustment and enters an idle state, the acquisition module is directly controlled to acquire an image of the i-th target object based on its optical parameters. This saves a complete focusing cycle and achieves zero-delay triggering.

[0047] The image acquisition method also includes the following specific implementation methods.

[0048] In one specific implementation, the detection distance of the (i+1)th target object detected by the detection module is obtained.

[0049] Determine whether the distance difference between the detection distance of the (i+1)th target and the detection distance of the ith target is less than a preset value. The preset value can be zero or set according to actual conditions.

[0050] In response to a distance difference less than a preset value and upon receiving a trigger signal, the acquisition module is controlled to acquire an image of the (i+1)th target based on the optical parameters of the i-th target. In other words, when the distance difference between the (i+1)th target and the detection distances corresponding to the i-th target is less than the preset value, focus adjustment based on the detection distance of the (i+1)th target is unnecessary; redundant zooming is skipped, and the acquisition module can acquire an image of the (i+1)th target directly.

[0051] In response to the distance difference being not less than a preset value, the focus is adjusted by driving the zoom module through the detection distance of the (i+1)th target object to obtain the optical parameters that match the (i+1)th target object; then, the acquisition module is controlled to acquire an image of the (i+1)th target object based on the optical parameters of the (i+1)th target object.

[0052] Specifically, the specific implementation method of controlling the acquisition module to acquire images of the target object based on the optical parameters corresponding to the target object in step S2 is as follows.

[0053] In one embodiment, the acquisition module is controlled to perform exposure operations and image output based on the optical parameters corresponding to the target object, thereby obtaining image information of the target object.

[0054] Please see Figure 4 , Figure 4 This is a schematic diagram of the timing flow of the image acquisition method provided in this application.

[0055] In one specific embodiment, the single detection duration for distance detection is 15ms, and the single zoom duration for focus adjustment is 10ms, therefore the focus cycle duration is 15ms. Before receiving the trigger signal, at t... n+1 During the focusing cycle, the zoom module adjusts the focus based on the detection distance of the i-th target object, while the detection module simultaneously detects the distance to the (i+1)-th target object. Upon receiving a trigger signal, it is determined whether the zoom module is currently in the focus adjustment process. If the zoom module is in the focus adjustment process, the focus is adjusted after the zoom module completes the focus adjustment of the i-th target object, at time t. n+1 During the focusing cycle, the exposure operation is directly controlled by the acquisition module based on the optical parameters corresponding to the i-th target object, at t n+2 During the focusing cycle, the image information corresponding to the i-th target object is output. Using the method provided in this embodiment, the response time from triggering to acquisition is shortened to at least 30ms. Specifically, when a trigger signal is received and the zoom module has just completed focus adjustment for the i-th target object, the response time from triggering to acquisition is shortened by 25ms.

[0056] The image acquisition method provided in the above embodiments significantly reduces the average trigger delay while ensuring image clarity, thereby improving the response performance and applicability of electronic devices in high-speed, real-time industrial code reading scenarios.

[0057] The image acquisition method provided in this application, before receiving a trigger signal, performs distance detection on the target object through a detection module and adjusts the focus based on the distance detection result using a zoom module to obtain the optical parameters of the target object; in response to receiving the trigger signal, it controls the acquisition module to acquire an image of the target object based on the corresponding optical parameters. By completing distance detection and focus adjustment before the arrival of the trigger signal, this application allows for direct image acquisition using the acquired optical parameters after triggering, thereby significantly shortening the response time from triggering to acquisition and reducing trigger delay while ensuring image clarity.

[0058] Please see Figure 5 , Figure 5 This is a schematic diagram of the framework of an embodiment of the image acquisition device provided in this application.

[0059] This embodiment provides an image acquisition device 60, which includes a preprocessing module 61 and a postprocessing module 62.

[0060] The preprocessing module 61 is used to detect the distance of the target object through the detection module and adjust the focus based on the distance detection result through the zoom module before receiving the trigger signal to obtain the optical parameters of the target object.

[0061] The post-processing module 62 is used to control the acquisition module to acquire images of the target object based on the optical parameters corresponding to the target object when a trigger signal is received.

[0062] The image acquisition device provided in this application completes distance detection and focus adjustment before the trigger signal arrives, so that image acquisition can be performed directly using the acquired optical parameters after triggering. This significantly shortens the response time from triggering to acquisition and reduces trigger delay while ensuring image clarity.

[0063] Please see Figure 6 , Figure 6 This is a schematic diagram of the framework of an embodiment of the electronic terminal provided in this application. The electronic terminal 80 includes a memory 81 and a processor 82 coupled to each other. The processor 82 is used to execute program instructions stored in the memory 81 to implement the steps of any of the above-described image acquisition method embodiments. In a specific implementation scenario, the electronic terminal 80 may include, but is not limited to, a microcomputer or a server. In addition, the electronic terminal 80 may also include mobile devices such as laptops and tablets, which are not limited here.

[0064] Specifically, processor 82 controls itself and memory 81 to implement the steps of any of the above-described image acquisition method embodiments. Processor 82 can also be referred to as a CPU (Central Processing Unit). Processor 82 may be an integrated circuit chip with signal processing capabilities. Processor 82 can also be a general-purpose processor, digital signal processor (DSP), application-specific integrated circuit (ASIC), field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. A general-purpose processor can be a microprocessor or any conventional processor. Furthermore, processor 82 can be implemented using integrated circuit chips.

[0065] Please see Figure 7 , Figure 7This is a schematic diagram of a framework of an embodiment of the computer-readable storage medium provided in this application. The computer-readable storage medium 90 stores program instructions 901 that can be executed by a processor. The program instructions 901 are used to implement the steps of any of the above-described image acquisition method embodiments.

[0066] In some embodiments, the functions or modules of the apparatus provided in this disclosure can be used to perform the methods described in the above method embodiments. The specific implementation can be referred to the description of the above method embodiments, and for the sake of brevity, it will not be repeated here.

[0067] The description of the various embodiments above tends to emphasize the differences between the various embodiments. The similarities or similarities between them can be referred to, and for the sake of brevity, they will not be repeated here.

[0068] In the several embodiments provided in this application, it should be understood that the disclosed methods and apparatus can be implemented in other ways. For example, the apparatus implementations described above are merely illustrative. For instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection of devices or units may be electrical, mechanical, or other forms.

[0069] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0070] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) or processor to execute all or part of the steps of the methods of various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0071] The above are merely embodiments of this application and do not limit the scope of patent protection of this application. Any equivalent structural or procedural changes made using the content of this application’s specification and drawings, or direct or indirect applications in other related technical fields, are similarly included within the scope of patent protection of this application.

Claims

1. An image acquisition method, characterized in that, Applied to an electronic device, the electronic device includes a detection module, a zoom module, and an acquisition module, and the image acquisition method includes: Before receiving the trigger signal, the detection module performs distance detection on the target object and the zoom module adjusts the focus based on the distance detection result to obtain the optical parameters of the target object; In response to receiving the trigger signal, the acquisition module is controlled to acquire an image of the target object based on the optical parameters of the target object.

2. The image acquisition method according to claim 1, characterized in that, The process of obtaining the optical parameters of the target object by detecting the distance to the target object through the detection module and adjusting the focus based on the distance detection result through the zoom module includes: In t n During the focusing cycle, the detection module performs distance detection on the target object to obtain the detection distance corresponding to the target object; In t n+1 During the focusing cycle, the zoom module is driven by the detection distance of the target object to adjust the focus and obtain optical parameters that match the target object; the duration of the focusing cycle is the larger of the single detection duration of the distance detection and the single zoom duration of the focus adjustment.

3. The image acquisition method according to claim 2, characterized in that, The in t n+1 During the focusing cycle, the zoom module is driven by the detection distance of the target object to adjust the focus and obtain optical parameters that match the target object, including: In the t n+1 During the focusing cycle, the zoom module is driven to adjust the focus based on the detection distance of the i-th target object, and at the same time, the detection module is activated to detect the distance of the (i+1)-th target object.

4. The image acquisition method according to claim 1, characterized in that, In response to receiving the trigger signal, the acquisition module is controlled to acquire an image of the target object based on the optical parameters of the target object, including: In response to receiving the trigger signal, it is determined whether the zoom module is currently in the focus adjustment process; the focus adjustment process at the current moment is to adjust the focus of the i-th target object; In response to the zoom module being in the focus adjustment process, after the zoom module completes the focus adjustment of the i-th target object, the acquisition module is controlled to acquire an image of the i-th target object based on the optical parameters of the i-th target object.

5. The image acquisition method according to claim 4, characterized in that, The step of controlling the acquisition module to acquire an image of the target object based on the optical parameters of the target object upon receiving the trigger signal further includes: In response to the zoom module completing focus adjustment and being in an idle state, the acquisition module is directly controlled to acquire an image of the i-th target object based on the optical parameters of the i-th target object.

6. The image acquisition method according to claim 1, characterized in that, The image acquisition method further includes: Obtain the detection distance of the (i+1)th target object detected by the detection module; Determine whether the distance difference between the detection distance corresponding to the (i+1)th target and the detection distance corresponding to the ith target is less than a preset value; In response to the distance difference being less than the preset value and upon receiving the trigger signal, the acquisition module is controlled to acquire an image of the (i+1)th target based on the optical parameters of the i-th target.

7. The image acquisition method according to claim 1, characterized in that, The step of controlling the acquisition module to acquire images of the target object based on the optical parameters of the target object includes: Based on the optical parameters of the target object, the acquisition module is controlled to perform exposure operations and image output to obtain image information of the target object.

8. An image acquisition device, characterized in that, The image acquisition device includes: The preprocessing module is used to obtain the optical parameters of the target object by detecting the distance of the target object through the detection module and adjusting the focus based on the distance detection result through the zoom module before receiving the trigger signal; The post-processing module is used to control the acquisition module to acquire images of the target object based on the optical parameters of the target object when the trigger signal is received.

9. An electronic terminal, characterized in that, The electronic terminal includes a memory and a processor coupled to each other. The processor is used to execute program instructions stored in the memory and to execute program data to implement the steps in the image acquisition method as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, implements the steps of the image acquisition method as described in any one of claims 1 to 7.

Images