Image acquisition method, device, equipment and computer readable storage medium

Abstract

The application provides an image acquisition method and device, equipment and a computer readable storage medium, which are applied to an image acquisition device, the image acquisition device comprising at least two image sensors with different light-sensitive wave bands; the method comprises the following steps: controlling the at least two image sensors to move to a target position for image acquisition in turn; when each image sensor moves to the target position, stopping moving the at least two image sensors, and acquiring an image through the image sensor at the target position to obtain corresponding image data; performing parameter alignment processing on the at least two acquired image data to obtain parameter-aligned image data as target image data. Through the application, multiple target image data can be obtained in alignment, and the calculation resources are saved.

Description

Technical Field

[0001] This application relates to image processing technology, and more particularly to an image acquisition method, apparatus, device, and computer-readable storage medium. Background Technology

[0002] With the continuous development of computer technology, image processing is being used more and more widely. In order to improve the accuracy of image processing, multiple image sensors are usually used to acquire images.

[0003] In related technologies, multiple image sensors are usually arranged horizontally, and the position of each image sensor is fixed. This results in the image data collected by multiple image sensors being able to be aligned only at a certain distance, while the image data cannot be aligned at other distances. Summary of the Invention

[0004] This application provides an image processing method, apparatus, device, and computer-readable storage medium that can obtain aligned target image data while saving computing resources.

[0005] The technical solution of this application embodiment is implemented as follows:

[0006] This application provides an image acquisition method applied to an image acquisition device, the image acquisition device comprising at least two image sensors with different photosensitive wavelengths, including:

[0007] Control the at least two image sensors to move sequentially to the target position for image acquisition;

[0008] When each of the image sensors moves to the target position, the movement of at least two image sensors is stopped, and image acquisition is performed by the image sensor at the target position to obtain corresponding image data;

[0009] At least two of the acquired image data are subjected to parameter alignment processing to obtain parameter-aligned image data as the acquired target image data.

[0010] This application provides an image acquisition device, disposed in an image acquisition equipment, the image acquisition equipment including at least two image sensors with different photosensitive wavelengths, including:

[0011] The control module is used to control the at least two image sensors to move sequentially to the target position for image acquisition;

[0012] The acquisition module is used to stop moving at least two image sensors when each of the image sensors moves to the target position, and to acquire images through the image sensors at the target position to obtain corresponding image data;

[0013] An alignment module is used to perform parameter alignment processing on at least two acquired image data sets to obtain parameter-aligned image data as the acquired target image data.

[0014] In the above scheme, the image acquisition device further includes a base, and the at least two image sensors are horizontally fixed on the base;

[0015] The control module is also used to control the base to move, and the movement of the base drives the at least two image sensors to move sequentially to the target position for image acquisition.

[0016] The step of stopping the movement of at least two image sensors when each of the image sensors moves to the target position includes:

[0017] When each of the image sensors moves to the target position, the base is controlled to stop moving.

[0018] In the above solution, the image acquisition device further includes a sliding component for sliding the base. The sliding component is a slide groove or a slide rail. The base is located on the sliding component and is slidably connected to the sliding component.

[0019] The control module is also used to control the base to slide on the sliding component.

[0020] In the above scheme, the control module is also used to control the base to translate along the straight line when the at least two image sensors are arranged in a straight line on the base.

[0021] In the above scheme, the control module is also used to control the base to rotate when the at least two image sensors are arranged in a ring on the base.

[0022] In the above scheme, the image acquisition device includes a slide rail, and the at least two image sensors are horizontally arranged on the slide rail and slidably connected to the slide rail;

[0023] The control module is also used to control the at least two image sensors to slide along the slide rail, and slide sequentially to the target position for image acquisition.

[0024] In the above scheme, the control module is also used to acquire the movement time points of each of the image sensors;

[0025] When the movement time point of each of the image sensors is reached, the corresponding image sensor is controlled to move from its initial position to the target position for image acquisition;

[0026] Move the image sensor at the target location to the initial position of the image sensor.

[0027] In the above scheme, the image acquisition device also includes a lens;

[0028] The control module, before stopping the movement of the at least two image sensors, further includes:

[0029] When the image sensor is aligned with the lens, it is determined that the image sensor has moved to the target position;

[0030] The acquisition module is also used to acquire images through the lens using an image sensor aligned with the lens, thereby obtaining corresponding image data.

[0031] In the above scheme, the acquisition module is further configured to emit infrared light through the infrared sensor when the image sensor at the target location is an infrared sensor;

[0032] When the infrared light shines on the object being photographed and diffuse reflection occurs, the infrared light is captured by the infrared photosensitive element in the infrared sensor to obtain the corresponding infrared image data.

[0033] In the above scheme, the acquisition module is further configured to capture visible light through the visible light photosensitive element in the color sensor when the image sensor at the target position is a color sensor, and obtain the corresponding color image data.

[0034] In the above scheme, the alignment module is further used to acquire the sensor parameters corresponding to each image data when the parameter is a sensor parameter, and the sensor parameter includes at least one of the field of view and resolution;

[0035] The sensor parameters of each image data are adjusted to be the same as those of the image data with the lowest sensor parameters, so that the parameter-aligned image data is used as the acquired target image data.

[0036] In the above scheme, the device further includes: a sending module, used to send at least two target image data obtained by parameter alignment to the terminal;

[0037] The target image data is used to identify objects contained in the target image data and obtain the identification result corresponding to the target image data.

[0038] This application provides a computer device, including:

[0039] Memory, used to store executable instructions;

[0040] The processor, when executing executable instructions stored in the memory, implements the image acquisition method provided in the embodiments of this application.

[0041] This application provides a computer-readable storage medium storing executable instructions, which, when executed by a processor, implement the image acquisition method provided in this application.

[0042] The embodiments of this application have the following beneficial effects:

[0043] Applying the above embodiments, the at least two image sensors are controlled to move sequentially to a target position for image acquisition. When each image sensor reaches the target position, the movement of the at least two image sensors is stopped, and image acquisition is performed using the image sensor at the target position to obtain corresponding image data. The acquired image data is then subjected to parameter alignment processing to obtain parameter-aligned image data as the acquired target image data. Thus, since the image acquisition device includes at least two image sensors with different photosensitive wavelengths, different image data can be acquired by controlling the movement of the image sensors. Since the image data acquired by each image sensor is acquired at the same position, only parameter alignment is needed to obtain multiple perfectly aligned image data sets. Attached Figure Description

[0044] Figure 1 This is a schematic diagram of an optional architecture of the image acquisition system provided in the embodiments of this application;

[0045] Figure 2 This is a schematic diagram of the structure of the computer device 500 provided in the embodiments of this application;

[0046] Figure 3 This is a schematic flowchart of the image acquisition method provided in the embodiments of this application;

[0047] Figure 4 This is a schematic diagram of the movement process of the image sensor provided in the embodiments of this application;

[0048] Figure 5 This is a schematic diagram of the structure of the image acquisition device provided in the embodiments of this application;

[0049] Figure 6 This is a schematic diagram of the structure of the image acquisition device provided in the embodiments of this application;

[0050] Figure 7 This is a schematic diagram of the structure of the image acquisition device provided in the embodiments of this application;

[0051] Figure 8 This is a schematic diagram of the movement process of the image sensor provided in the embodiments of this application;

[0052] Figure 9 This is a schematic diagram of the structure of the image acquisition device provided in the embodiments of this application;

[0053] Figure 10 This is a schematic diagram of the structure of the image acquisition device provided in the embodiments of this application;

[0054] Figure 11 This is a schematic diagram of the architecture of the image acquisition device provided in the embodiments of this application. Detailed Implementation

[0055] To make the objectives, technical solutions, and advantages of this application clearer, the application will be further described in detail below with reference to the accompanying drawings. The described embodiments should not be regarded as limitations on this application. All other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0056] In the following description, references are made to “some embodiments,” which describe a subset of all possible embodiments. However, it is understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0057] In the following description, the terms "first, second, third" are used merely to distinguish similar objects and do not represent a specific ordering of objects. It is understood that "first, second, third" may be interchanged in a specific order or sequence where permitted, so that the embodiments of this application described herein can be implemented in an order other than that illustrated or described herein.

[0058] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing embodiments of this application only and is not intended to limit this application.

[0059] Before providing a further detailed description of the embodiments of this application, the nouns and terms involved in the embodiments of this application will be explained, and the nouns and terms involved in the embodiments of this application shall be interpreted as follows.

[0060] 1) Image sensors utilize the photoelectric conversion function of optoelectronic devices to convert the light image on the photosensitive surface into an electrical signal that is proportional to the light image.

[0061] Based on the above explanation of the nouns and terms used in the embodiments of this application, the image acquisition system provided in the embodiments of this application will be described first, see below. Figure 1 , Figure 1This is an optional architecture diagram of the image acquisition system provided in this application embodiment. To support an exemplary application, the image acquisition system includes: a server 200, an image acquisition device 400, and a terminal 500. The image acquisition device 400 can be integrated into the terminal 500 or can be independent of the terminal 500. The terminal 500 is connected to the server 200 through a network 300, which can be a wide area network, a local area network, or a combination of both.

[0062] In actual implementation, the image acquisition device 400 includes at least two image sensors with different photosensitive wavelengths;

[0063] The image acquisition device 400 is configured to stop moving at least two image sensors when each of the image sensors moves to the target position, and acquire images through the image sensors at the target position to obtain corresponding image data; perform parameter alignment processing on the acquired at least two image data to obtain parameter-aligned image data as the acquired target image data; and send the target image data to the terminal 400.

[0064] Terminal 400 is used to upload target image data to server 200;

[0065] Server 200 is used to store target image data or to identify objects in the target image data.

[0066] As an example, when applied to an access control system, the server identifies objects in the image data to obtain the object's identity information. Based on the identity information, it determines whether the object is a stored legitimate object. If the object is a legitimate object, the door lock is opened; otherwise, the door lock is kept closed.

[0067] In some embodiments, server 200 may be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks (CDNs), and big data and artificial intelligence platforms. Terminals may be smartphones, tablets, laptops, desktop computers, smart speakers, smartwatches, in-vehicle devices, smart TVs, etc., but are not limited to these.

[0068] See Figure 2 , Figure 2 This is a schematic diagram of the structure of the computer device 500 provided in the embodiments of this application. In practical applications, the computer device 500 can be... Figure 1The image acquisition device 400, terminal 500, or server 200 in the middle are computer equipment. Figure 1 Taking the image acquisition device 400 shown as an example, the computer device implementing the image acquisition method of the present application will be described. Figure 2 The computer device 500 shown includes at least one processor 510, a memory 550, at least one network interface 520, and a user interface 530. The various components in the computer device 500 are coupled together via a bus system 540. It is understood that the bus system 540 is used to implement communication between these components. In addition to a data bus, the bus system 540 also includes a power bus, a control bus, and a status signal bus. However, for clarity, ... Figure 2 The general labeled all buses as Bus System 540.

[0069] The processor 510 can be an integrated circuit chip with signal processing capabilities, such as a general-purpose processor, a digital signal processor (DSP), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor, etc.

[0070] User interface 530 includes one or more output devices 531 that enable the presentation of media content, including one or more speakers and / or one or more visual displays. User interface 530 also includes one or more input devices 532, including user interface components that facilitate user input, such as a keyboard, mouse, microphone, touch screen display, camera, other input buttons and controls.

[0071] The memory 550 may be removable, non-removable, or a combination thereof. Exemplary hardware devices include solid-state storage, hard disk drives, optical disk drives, etc. The memory 550 may optionally include one or more storage devices physically located away from the processor 510.

[0072] The memory 550 may include volatile memory or non-volatile memory, or both. The non-volatile memory may be read-only memory (ROM), and the volatile memory may be random access memory (RAM). The memory 550 described in this application embodiment is intended to include any suitable type of memory.

[0073] In some embodiments, memory 550 is capable of storing data to support various operations, examples of which include programs, modules, and data structures or subsets or supersets thereof, as illustrated below.

[0074] Operating system 551 includes system programs for handling various basic system services and performing hardware-related tasks, such as the framework layer, core library layer, driver layer, etc., for implementing various basic business functions and handling hardware-based tasks;

[0075] The network communication module 552 is used to reach other computing devices via one or more (wired or wireless) network interfaces 520, exemplary network interfaces 520 including: Bluetooth, WiFi, and Universal Serial Bus (USB), etc.

[0076] Presentation module 553 is configured to enable the presentation of information (e.g., a user interface for operating peripheral devices and displaying content and information) via one or more output devices 531 (e.g., a display screen, a speaker, etc.) associated with user interface 530;

[0077] The input processing module 554 is used to detect and translate one or more user inputs or interactions from one or more input devices 532.

[0078] In some embodiments, the image acquisition device provided in this application can be implemented in software. Figure 2 An image acquisition device 555 stored in memory 550 is shown. It can be software in the form of programs and plug-ins, including the following software modules: control module 5551, acquisition module 5552 and alignment module 5553. These modules are logical and can therefore be arbitrarily combined or further split according to the functions they implement.

[0079] The functions of each module will be explained below.

[0080] In other embodiments, the image acquisition device provided in this application can be implemented in hardware. As an example, the image acquisition device provided in this application can be a processor in the form of a hardware decoding processor, which is programmed to execute the image acquisition method provided in this application. For example, the processor in the form of a hardware decoding processor can be one or more application-specific integrated circuits (ASICs), DSPs, programmable logic devices (PLDs), complex programmable logic devices (CPLDs), field-programmable gate arrays (FPGAs), or other electronic components.

[0081] Based on the foregoing description of the image acquisition system and computer equipment according to the embodiments of this application, the image acquisition method provided in the embodiments of this application is described below. This image acquisition method is applied to the image acquisition equipment. See also Figure 3 , Figure 3 This is a flowchart illustrating the image acquisition method provided in this application embodiment. The image acquisition method provided in this application embodiment includes:

[0082] Step 301: The image acquisition device controls at least two image sensors to move sequentially to the target position for image acquisition.

[0083] Here, the image acquisition device includes at least two image sensors with different photosensitive wavelengths. These image sensors can be infrared sensors, color sensors, ultraviolet sensors, millimeter-wave radar sensors, etc.

[0084] In practice, the positions of the image sensors can change. When the image acquisition device receives an image acquisition command, it moves at least two image sensors sequentially to the target position for image acquisition, following the order in which at least two image sensors acquire data. It should be noted that only one image sensor is located at the target position at any given time.

[0085] In practical applications, the image acquisition order of at least two image sensors can be preset. Following this order, the at least two image sensors are moved sequentially to the target position for image acquisition. Alternatively, the positions of the at least two image sensors when the image acquisition command is received can be obtained. Based on these positions, the image acquisition order can be determined. For example, upon receiving the image acquisition command, the distance between each image sensor's position and the target position can be obtained. The image sensors can be sorted from smallest to largest distance, and then moved sequentially to the target position according to the sorting result. For instance, the image sensor with the smallest distance between its current position and the target position can be moved to the target position first.

[0086] In some embodiments, the image acquisition device further includes a base, on which at least two image sensors are horizontally fixed; the at least two image sensors are controlled to move sequentially to a target position for image acquisition; the base is controlled to move, and the movement of the base drives the at least two image sensors to move sequentially to the target position for image acquisition; when each image sensor moves to the target position, the movement of at least two image sensors is stopped; when each image sensor moves to the target position, the base is controlled to stop moving.

[0087] Here, the movement of the base includes at least one of translation and rotation. In actual implementation, at least two image sensors are horizontally fixed on the base. When the base moves, the image sensors will be displaced along with the base; that is, at least two image sensors move synchronously. For example, when the base translates to the right, at least two image sensors also translate to the right, and each image sensor moves the same distance.

[0088] In practical applications, the position of each image sensor is obtained, and then the movement of the image sensors is controlled based on their relative positions to the target position. For example, when an image sensor is located to the right of the target position, the base is controlled to translate to the left to move the image sensor to the target position.

[0089] In some embodiments, when the number of image sensors is at least three, the at least three image sensors may be arranged at equal intervals; here, by arranging the at least three image sensors at equal intervals, it is convenient to calculate the motion parameters of the base, such as translation distance, rotation angle, etc.

[0090] In some embodiments, the image acquisition device further includes a sliding component for sliding the base, the base being located on the sliding component and slidably connected to the sliding component; correspondingly, the image acquisition device can control the base to move by controlling the base to slide on the sliding component.

[0091] Here, the sliding component can be a slide rail or a groove, and the base is slidably connected to the sliding component. The image acquisition device controls the base to slide based on the sliding component. The base can slide along the sliding component to either end of the sliding component.

[0092] In actual implementation, for each image sensor to be moved to the target position, the following operations are performed: control the base to slide at a preset acceleration until the sliding speed of the base reaches the preset speed, control the base to slide at the preset speed, and during the sliding process, the base drives the image sensor to move; when the distance between the image sensor and the target position is a preset distance, control the base to gradually reduce the sliding speed so that the image sensor stops at the target position.

[0093] In some embodiments, the image acquisition device can control the base to move in the following manner: when at least two image sensors are arranged in a straight line on the base, the base is controlled to translate along a straight line.

[0094] In practical implementation, when at least two image sensors are arranged in a straight line on the base, the order in which each image sensor moves to the target position is obtained. Based on the order in which the image sensors move to the target position, the base is controlled to translate along a straight line to move the image sensors to the target position in sequence. Here, the direction of the base translation can be determined based on the relative position between the image sensor to be moved and the target position.

[0095] As an example, Figure 4 This is a schematic diagram of the movement process of the image sensor provided in the embodiments of this application. See also: Figure 4 The image acquisition device 40 includes a first image sensor 401, a second image sensor 402, and a base 403. The first image sensor 401 and the second image sensor 402 are horizontally fixed to the base 403, with the first image sensor 401 located to the left of the second image sensor 402. The base 403 can be moved left or right to sequentially move the first image sensor 401 and the second image sensor 402 to the target position. For example, if the second image sensor 402 is currently at the target position, image acquisition is performed using the second image sensor. After acquisition, the base 403 is moved to the right to move the first image sensor 401 to the target position.

[0096] As an example, Figure 5 This is a schematic diagram of the structure of the image acquisition device provided in the embodiments of this application. See also: Figure 5 The image acquisition device 50 includes a first image sensor 501, a second image sensor 502, a third image sensor 503, and a base 504. The first image sensor 501, the second image sensor 502, and the third image sensor 503 are horizontally fixed to the base 504 and are arranged in a straight line. Here, the first image sensor 501, the second image sensor 502, and the third image sensor 503 can be moved sequentially to the target position by controlling the base 403 to move to the left or right.

[0097] For example, if the first image sensor 501 is located at the target position, then image acquisition is performed through the first image sensor. After acquisition is completed, the control base 504 moves to the left. Here, the distance to the left is the distance between the first image sensor 501 and the second image sensor 502, so that the second image sensor 502 moves to the target position. When the second image sensor 502 moves to the target position, the control base 504 stops moving and image acquisition is performed through the second image sensor 502. After the second image sensor 502 completes image acquisition, the control base 504 continues to move to the left so that the third image sensor 503 moves to the target position. The control base 504 stops moving and image acquisition is performed through the third image sensor 503.

[0098] In some embodiments, the image acquisition device can control the base to move: when at least two image sensors are arranged in a ring on the base, the base is controlled to rotate.

[0099] Here, when at least two image sensors are arranged in a ring on the base, the base can be controlled to rotate clockwise or counterclockwise, thereby displacing at least two image sensors. Specifically, the lines connecting each image sensor to the center of the ring are determined, and the included angles between these lines are obtained. The base is then rotated based on these included angles to move the image sensors sequentially to the target positions.

[0100] As an example, Figure 6 This is a schematic diagram of the structure of the image acquisition device provided in the embodiments of this application. See also: Figure 6 The image acquisition device includes a first image sensor 601, a second image sensor 602, a third image sensor 603, and a base 604. The first image sensor 601, the second image sensor 602, and the third image sensor 603 are arranged in a ring on the base, and are equidistant from each other. Therefore, the angle between the line connecting the first image sensor and the line connecting the second image sensor is 60 degrees. If the first image sensor 601 is currently at the target position, image acquisition is performed through the first image sensor 601. After acquisition, the base 604 is rotated 60 degrees counterclockwise, causing the second image sensor 602 to move to the target position.

[0101] In some embodiments, the image acquisition device includes a slide rail, and at least two image sensors are horizontally disposed on the slide rail and slidably connected to the slide rail; the image acquisition device can control at least two image sensors to move sequentially to a target position for image acquisition by controlling at least two image sensors to slide along the slide rail sequentially to the target position for image acquisition.

[0102] In practice, each image sensor can be controlled independently. That is, each image sensor is independently set on the slide rail, and its sliding state is not affected by other image sensors. For example, when one image sensor slides along the slide rail, the other image sensors can remain stationary; or, the sliding direction or sliding speed of each image sensor is different.

[0103] As an example, Figure 7 This is a schematic diagram of the structure of the image acquisition device provided in the embodiments of this application. See also: Figure 7 The image acquisition device includes a first image sensor 701, a second image sensor 702, and a slide rail 703; wherein the first image sensor 701 and the second image sensor 702 are mounted on the slide rail 703. When the area indicated by the dashed frame 704 is the target position, the first image sensor 701 is controlled to move along the slide rail into the dashed frame 704. When the first image sensor 701 moves into the dashed frame 704, the first image sensor 701 stops moving and image acquisition is performed through the first image sensor 701. When the acquisition is completed, the first image sensor 701 is controlled to move out of the dashed frame, and the second image sensor 702 is controlled to move into the dashed frame 704. When the second image sensor 702 moves into the dashed frame 704, the second image sensor 702 stops moving and image acquisition is performed through the second image sensor 702.

[0104] In some embodiments, the image acquisition device can control at least two image sensors to move sequentially to a target position for image acquisition by: acquiring the movement time point of each image sensor; when the movement time point of each image sensor is reached, controlling the corresponding image sensor to move from the initial position of the image sensor to the target position for image acquisition; after the image acquisition device acquires an image through the image sensor at the target position, it can also move the image sensor at the target position back to the initial position of the image sensor.

[0105] In practical applications, when no image acquisition command is received, each image sensor is located at its initial position. Upon receiving the command, a timing sequence is established to control at least two image sensors to sequentially move to the target position for image acquisition. This timing sequence indicates the movement time point of each image sensor. Based on the acquired movement time points, each image sensor is sequentially moved to the target position. Here, since only one image sensor can be placed at the target position, after the image sensor at that position completes image acquisition, it needs to be moved away from the target position to its initial position.

[0106] As an example, Figure 8This is a schematic diagram of the movement process of the image sensor provided in the embodiments of this application. See also: Figure 8 The position shown in the dashed box 801 is the target position. When an image acquisition command is received, the first image sensor 802 is first controlled to move into the dashed box 801 and remain stationary within the dashed box to acquire the image data corresponding to the first image sensor. After obtaining the image data corresponding to the first image sensor, the first sensor is controlled to move back to its initial position, and the second sensor 803 is controlled to move into the dashed box 801.

[0107] In practice, for two image sensors that move in adjacent order, the preceding image sensor can be controlled to move towards its initial position while the following image sensor moves towards its target position; or the following image sensor can be controlled to move towards its target position only after the preceding image sensor has reached its initial position.

[0108] Step 302: When each image sensor moves to the target position, stop moving at least two image sensors and acquire images through the image sensor at the target position to obtain the corresponding image data.

[0109] In practice, at least two image sensors move to the target position sequentially, and correspondingly, at least two image sensors also acquire images sequentially. That is, whenever one image sensor moves to the target position, it acquires an image; after that image sensor completes its image acquisition, it then controls the other image sensor to move to the target position.

[0110] In some embodiments, the image acquisition device further includes a lens; before stopping the movement of at least two image sensors, the image acquisition device may also determine that the image sensors have moved to a target position when the image sensors are aligned with the lens; the image acquisition device may acquire images through the image sensors at the target position to obtain corresponding image data by: acquiring images through the lens via the image sensors aligned with the lens to obtain corresponding image data.

[0111] In practice, the image sensor can only capture images through the lens when it is aligned with the lens; when the image sensor is not aligned with the lens, it will be blocked and image capture will not be possible.

[0112] As an example, Figure 9 This is a schematic diagram of the structure of the image acquisition device provided in the embodiments of this application. See also: Figure 9The image acquisition device includes an infrared sensor 901, a color sensor 902, and a lens 903. When the infrared sensor 901 moves directly below the lens, it is determined that the infrared sensor 901 is aligned with the lens 903, and image acquisition is performed through the infrared sensor 901. When the color sensor 902 moves directly below the lens, it is determined that the color sensor 902 is aligned with the lens, and image acquisition is performed through the color sensor 902.

[0113] In some embodiments, the image acquisition device can acquire images and obtain corresponding image data by means of an image sensor located at the target position: when the image sensor at the target position is an infrared sensor, infrared light is emitted by the infrared sensor; when the infrared light illuminates the object being photographed and diffuse reflection occurs, the diffusely reflected infrared light is captured by the infrared photosensitive element in the infrared sensor to obtain the corresponding infrared image data.

[0114] In practical applications, when the image sensor at the target location is an infrared sensor, the sensor senses infrared light, which possesses properties such as reflection, refraction, scattering, interference, and absorption. When infrared light shines on the object being photographed, such as an object, the infrared light undergoes diffuse reflection. The infrared photosensitive element in the infrared sensor captures the diffusely reflected infrared light, forming image data to obtain infrared image data.

[0115] In some embodiments, the image acquisition device can acquire images and obtain corresponding image data by means of an image sensor located at the target position: when the image sensor at the target position is a color sensor, visible light is captured by the visible light photosensitive element in the color sensor to obtain corresponding color image data.

[0116] Here, visible light is the part of the electromagnetic spectrum that the human eye can perceive. Electromagnetic waves with different frequencies cause different color sensations in the human eye. For example, the frequency of red is 385-482 THz and the wavelength is 780-622 nm.

[0117] In actual implementation, when visible light shines on the subject and is reflected, the visible light photosensitive element in the color sensor captures the visible light and the reflected visible light to form image data, thereby obtaining the corresponding color image data.

[0118] Step 303: Perform parameter alignment processing on at least two acquired image data to obtain parameter-aligned image data as the acquired target image data.

[0119] In actual implementation, the parameters to be adjusted and the corresponding target values ​​are determined. Based on the target values, the parameters to be adjusted for each image data are adjusted to the target values, and the parameter-aligned image data is used as the acquired target image data.

[0120] In some embodiments, parameter alignment processing is performed on at least two acquired image data to obtain parameter-aligned image data as acquired target image data: when the parameter is a sensor parameter, and the sensor parameter includes at least one of the field of view and resolution, the sensor parameter corresponding to each image data is obtained; the sensor parameter of each image data is adjusted to be the same as the sensor parameter of the image data with the lowest sensor parameter, so as to obtain parameter-aligned image data as acquired target image data.

[0121] In practical implementation, when the parameters are sensor parameters, the image data with the lowest sensor parameters is used as a benchmark, and the sensor parameters of other image data are adjusted to be the same as those of the image data with the lowest sensor parameters. For example, when the sensor parameters include the field of view, the field of view corresponding to each image data is obtained, and the time angle of each image data is adjusted to be the same as the field of view of the image data with the smallest field of view.

[0122] Here, when the sensor parameters include field of view and resolution, the field of view and resolution can be adjusted separately. That is, the image data with the smallest field of view and the image data with the lowest resolution can be acquired separately. Then, the field of view of each image data is adjusted to be the same as the field of view of the image data with the smallest field of view, and the resolution of each image data is adjusted to be the same as the resolution of the image data with the lowest resolution.

[0123] In some embodiments, after the image acquisition device performs parameter alignment processing on at least two acquired image data to obtain parameter-aligned image data as acquired target image data, it can also send the at least two parameter-aligned target image data to the terminal; wherein, the target image data is used to identify objects contained in the target image data and obtain the recognition result of the corresponding target image data.

[0124] Here, the image acquisition method provided in this application embodiment can be applied to scenarios such as access control and smart reading. After obtaining target image data, image recognition is performed based on at least two target image data to improve the accuracy of image recognition. The image acquisition device can be integrated into the terminal or be independent of the terminal; the operation of recognizing the target image data can be performed by the terminal or by a server.

[0125] In practice, when the image recognition operation on the target image data is performed by the server, the terminal can be equipped with a client, such as an image client. After the terminal receives at least two target image data sent by the image acquisition device, it sends the at least two target image data to the server, which then identifies the objects contained in the target object data.

[0126] In some embodiments, the identification of objects contained in target image data can be achieved by: identifying the objects contained in each target image data separately to obtain multiple identification results; and determining the final identification result based on the multiple identification results.

[0127] Here, when multiple recognition results are the same, the recognition result is taken as the final recognition result; when there are different recognition results among the multiple recognition results, the recognition is considered to have failed and an error message is returned.

[0128] In some embodiments, object recognition in target image data can be achieved by fusing multiple target image data to obtain fused image data; and by recognizing objects in the fused image data to obtain recognition results.

[0129] As an example, taking access control as an example, the image acquisition device here includes an infrared sensor and a color sensor. When a user needs to enter the gate, the image acquisition device controls the infrared sensor to move to the target position, and stops moving the infrared sensor when it reaches the target position. The infrared sensor then captures an image of the user's face, obtaining infrared image data containing the face. Then, the device controls the color sensor to move to the target position, and stops moving the color sensor when it reaches the target position. The color sensor then captures an image of the user's face, obtaining color image data containing the face. The infrared image data and the color image data are then combined. The field of view and resolution are adjusted to be the same to obtain aligned infrared and color image data. The aligned infrared and color image data are sent to the terminal, which then sends them to the server. The server identifies faces in the infrared and color image data respectively to obtain identity information for the corresponding infrared and color image data. If the identity information for the corresponding infrared and color image data is the same, and the object indicated by the identity information is a legitimate object, the door lock is opened to allow the user to enter the gate; otherwise, the door lock is kept closed.

[0130] As an example, taking a smart reading device as an example, the image acquisition device here includes an infrared sensor and a color sensor. During the operation of the smart reading device, the image acquisition device controls the infrared sensor to move to the target position. When the infrared sensor reaches the target position, it stops moving and acquires an image of the user's face, obtaining infrared image data containing the face. The aligned infrared image data and color image data are fused to obtain fused image data. Fingers are identified in the fused image data, and the position pointed to by the fingertip is obtained after finger identification. Here, by repeatedly performing the above operations during the operation of the smart reading device, multiple consecutive fused image data can be obtained.

[0131] Applying the above embodiments, the at least two image sensors are controlled to move sequentially to a target position for image acquisition; when each image sensor moves to the target position, the movement of the at least two image sensors is stopped, and image acquisition is performed by the image sensor at the target position to obtain corresponding image data; the acquired at least two image data are subjected to parameter alignment processing to obtain parameter-aligned image data as the acquired target image data; since the image data acquired by each image sensor is acquired at the same position, multiple perfectly aligned image data can be obtained simply by aligning the image data parameters.

[0132] The following will describe an exemplary application of the embodiments of this application in a real-world application scenario.

[0133] In practical implementation, the image acquisition method provided in this application embodiment is applied to an image acquisition device. Figure 10 This is a schematic diagram of the structure of the image acquisition device provided in the embodiments of this application. Figure 10 The image acquisition device includes: a lens 1001, an infrared sensor 1002, a color sensor 1003, a base 1004, and a high-frequency vibration unit 1005.

[0134] The infrared sensor and the color sensor are horizontally fixed on the base, forming a dual-sensor structure. The base is controlled to vibrate rapidly by a high-frequency vibration unit, so that the infrared sensor and the color sensor move left and right with the vibration of the base.

[0135] Here, during the vibration of the base, there are three states: when the base is moving, neither the infrared sensor nor the color sensor will work; when the infrared sensor is aligned with the lens (located directly below the lens), it enters the infrared light-sensing state and the infrared sensor works; when the color sensor is aligned with the lens (located directly below the lens), it enters the color light-sensing state and the color sensor works.

[0136] Figure 11 This is a schematic diagram of the architecture of the image acquisition device provided in the embodiments of this application. See also: Figure 11 The image acquisition device provided in this application includes: a timing control unit, a self-aligned digital signal processing (DSP) unit, a universal serial bus (USB) controller, and a host computer.

[0137] In practical applications, the core workflow is controlled by a timing control unit. The timing control unit is responsible for controlling the operation of the high-frequency vibration unit, infrared sensor, and color sensor. The timing control unit controls the high-frequency vibration unit to move the base according to a certain timing sequence, so that the infrared sensor and color sensor move left and right with the vibration of the base. When the color sensor moves to below the lens, it controls the color sensor to start sensing light to collect color image data and stops moving the base. When the infrared sensor moves to below the lens, it controls the infrared sensor to start sensing light to collect infrared image data and stops moving the base.

[0138] Here, after acquiring the acquisition data and infrared image data, the data is transmitted to the self-aligning DSP via the timing control unit. The self-aligning DSP performs unified operations on the field of view (FOV) and resolution of the infrared image data and color image data. For example, it acquires the lower-resolution image data from the infrared image data and color image data, and adjusts the resolution of the other image data to be the same as the resolution of the lower-resolution image data based on the lower-resolution image data. Finally, the data is transmitted to the host computer via the USB controller.

[0139] By applying the above embodiments, naturally self-aligned infrared and color image data can be obtained, and these data are naturally aligned at any distance without any deviation.

[0140] The following description continues to illustrate the exemplary structure of the image acquisition device 555 provided in the embodiments of this application as a software module. In some embodiments, such as Figure 2 As shown, the software modules stored in the image acquisition device 555 in the memory 550 may include:

[0141] Control module 5551 is used to control the at least two image sensors to move sequentially to the target position for image acquisition;

[0142] The acquisition module 5552 is used to stop moving at least two image sensors when each of the image sensors moves to the target position, and to acquire images through the image sensors at the target position to obtain corresponding image data;

[0143] Alignment module 5553 is used to perform parameter alignment processing on at least two acquired image data to obtain parameter-aligned image data as acquired target image data.

[0144] In some embodiments, the image acquisition device further includes a base, on which the at least two image sensors are horizontally fixed;

[0145] The control module 5551 is also used to control the base to move, and the movement of the base drives the at least two image sensors to move sequentially to the target position for image acquisition.

[0146] When each of the image sensors moves to the target position, the base is controlled to stop moving.

[0147] In some embodiments, the image acquisition device further includes a sliding component for sliding the base, the sliding component being a slide groove or a slide rail, the base being located on the sliding component and slidably connected to the sliding component;

[0148] The control module 5551 is also used to control the base to slide on the sliding component.

[0149] In some embodiments, the control module is further configured to control the base to translate along the straight line when the at least two image sensors are arranged in a straight line on the base.

[0150] In some embodiments, the control module 5551 is further configured to control the base to rotate when the at least two image sensors are arranged in a ring on the base.

[0151] In some embodiments, the image acquisition device includes a slide rail, and at least two image sensors are horizontally disposed on the slide rail and slidably connected to the slide rail;

[0152] The control module 5551 is also used to acquire the target location of the image, including:

[0153] The at least two image sensors are controlled to slide along the slide rail, and then slide sequentially to the target position for image acquisition.

[0154] In some embodiments, the control module 5551 is further configured to acquire the movement time points of each of the image sensors;

[0155] When the movement time point of each of the image sensors is reached, the corresponding image sensor is controlled to move from its initial position to the target position for image acquisition;

[0156] After acquiring the image using an image sensor located at the target position, the process further includes:

[0157] Move the image sensor at the target location to the initial position of the image sensor.

[0158] In some embodiments, the image acquisition device further includes a lens;

[0159] The control module 5551 is further configured to include, before stopping the movement of the at least two image sensors:

[0160] When the image sensor is aligned with the lens, it is determined that the image sensor has moved to the target position;

[0161] The acquisition module 5552 is also used to acquire images through the lens using an image sensor aligned with the lens, thereby obtaining corresponding image data.

[0162] In some embodiments, the acquisition module is further configured to emit infrared light through the infrared sensor when the image sensor at the target location is an infrared sensor;

[0163] When the infrared light shines on the object being photographed and diffuse reflection occurs, the infrared light is captured by the infrared photosensitive element in the infrared sensor to obtain the corresponding infrared image data.

[0164] In some embodiments, the acquisition module 5552 is further configured to, when the image sensor at the target location is a color sensor, capture visible light through the visible light photosensitive element in the color sensor to obtain corresponding color image data.

[0165] In some embodiments, the alignment module 5553 is further configured to acquire sensor parameters corresponding to each image data when the parameter is a sensor parameter, and the sensor parameter includes at least one of field of view and resolution;

[0166] The sensor parameters of each image data are adjusted to be the same as those of the image data with the lowest sensor parameters, so that the parameter-aligned image data is used as the acquired target image data.

[0167] In some embodiments, the apparatus further includes: a transmitting module, configured to transmit at least two target image data obtained by parameter alignment to a terminal;

[0168] The target image data is used to identify objects contained in the target image data and obtain the identification result corresponding to the target image data.

[0169] Applying the above embodiments, the at least two image sensors are controlled to move sequentially to a target position for image acquisition; when each image sensor moves to the target position, the movement of the at least two image sensors is stopped, and image acquisition is performed by the image sensor at the target position to obtain corresponding image data; the acquired at least two image data are subjected to parameter alignment processing to obtain parameter-aligned image data as the acquired target image data; since the image data acquired by each image sensor is acquired at the same position, multiple perfectly aligned image data can be obtained simply by aligning the image data parameters.

[0170] This application provides a computer program product or computer program that includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the image acquisition method described in this application.

[0171] This application provides a computer-readable storage medium storing executable instructions. When these executable instructions are executed by a processor, they cause the processor to perform the method provided in this application, for example... Figure 3 The method shown.

[0172] In some embodiments, the computer-readable storage medium may be a memory such as FRAM, ROM, PROM, EP ROM, EEPROM, flash memory, magnetic surface memory, optical disk, or CD-ROM; or it may be a variety of devices including one or any combination of the above-mentioned memories.

[0173] In some embodiments, executable instructions may take the form of a program, software, software module, script, or code, written in any form of programming language (including compiled or interpreted languages, or declarative or procedural languages), and may be deployed in any form, including as a standalone program or as a module, component, subroutine, or other unit suitable for use in a computing environment.

[0174] As an example, executable instructions may, but do not necessarily, correspond to files in a file system. They may be stored as part of a file that holds other programs or data, for example, in one or more scripts in a Hyper Text Markup Language (HTML) document, in a single file dedicated to the program in question, or in multiple co-located files (e.g., files that store one or more modules, subroutines, or code sections).

[0175] As an example, executable instructions can be deployed to execute on a single computing device, or on multiple computing devices located in one location, or on multiple computing devices distributed across multiple locations and interconnected via a communication network.

[0176] The above description is merely an embodiment of this application and is not intended to limit the scope of protection of this application. Any modifications, equivalent substitutions, and improvements made within the spirit and scope of this application are included within the scope of protection of this application.

Claims

1. An image acquisition method, characterized in that, The method is applied to an image acquisition device, which includes a lens, at least two image sensors with different photosensitive wavelengths, a base, a high-frequency vibration unit, a timing control unit, and a self-aligning digital signal processing unit, wherein at least two of the image sensors are fixed to the base; the method includes: The timing control unit controls the high-frequency vibration unit to move the base according to the order in which at least two of the image sensors acquire images, and controls the image sensor to follow the base to move for each of the image sensors. When the image sensor moves to directly below the lens, it is determined that the image sensor is aligned with the lens; when the image sensor moves to a position aligned with the lens, it is determined that the image sensor has moved to the target position; only one image sensor is in the target position at any given time. When the image sensor is controlled to move with the base, it first accelerates to a preset speed with a preset acceleration. When the distance between the image sensor and the target position is a preset distance, it gradually decelerates until it stops at the target position. The order in which images are acquired is determined as follows: Upon receiving an image acquisition command, the distance between the location of each image sensor and the target location is obtained, and the image sensors are sorted in ascending order of the distance to obtain the order of image acquisition. When each of the image sensors moves to the target position, the movement of the image sensor stops, and image acquisition is performed by the image sensor at the target position to obtain the corresponding image data; For each of the image sensors, after obtaining the corresponding image data, the image sensor is controlled to move away from the target position; The timing control unit sends the image data to the self-aligned digital signal processing unit, and the self-aligned digital signal processing unit obtains the sensor parameters corresponding to each image data. The sensor parameters include at least one of the field of view and resolution. The sensor parameters of each image data are adjusted to be the same as those of the image data with the lowest sensor parameters, and the image data with the aligned parameters is used as the acquired target image data.

2. The method as described in claim 1, characterized in that, At least two of the image sensors are horizontally fixed to the base; The step of stopping the movement of each image sensor when it moves to the target position includes: When each of the image sensors moves to the target position, the base is controlled to stop moving.

3. The method as described in claim 2, characterized in that, The image acquisition device further includes a sliding component for sliding the base, the base being located on the sliding component and slidably connected to the sliding component; The control of the high-frequency vibration unit to move the base includes: The high-frequency vibration unit is controlled to drive the base to slide on the sliding assembly.

4. The method as described in claim 2, characterized in that, The control of the high-frequency vibration unit to move the base includes: When at least two of the image sensors are arranged in a straight line on the base, the high-frequency vibration unit is controlled to drive the base to translate along the straight line.

5. The method as described in claim 1, characterized in that, The step of acquiring image data through an image sensor located at the target position includes: Image data is obtained by capturing images through the lens using an image sensor aligned with the lens.

6. The method as described in claim 1, characterized in that, The step of acquiring image data through an image sensor located at the target position includes: When the image sensor at the target location is an infrared sensor, infrared light is emitted through the infrared sensor; When the infrared light shines on the object being photographed and diffuse reflection occurs, the infrared light is captured by the infrared photosensitive element in the infrared sensor to obtain the corresponding infrared image data.

7. The method as described in claim 1, characterized in that, The step of acquiring image data through an image sensor located at the target position includes: When the image sensor at the target location is a color sensor, visible light is captured by the visible light photosensitive element in the color sensor to obtain the corresponding color image data.

8. The method as described in claim 1, characterized in that, After using the parameter-aligned image data as the acquired target image data, the process further includes: Send at least two target image data obtained by parameter alignment to the terminal; The target image data is used to identify objects contained in the target image data and obtain the identification result corresponding to the target image data.

9. An image acquisition device, characterized in that, The image acquisition device includes a lens, at least two image sensors with different photosensitive wavelengths, a base, a high-frequency vibration unit, a timing control unit, and a self-aligning digital signal processing unit, wherein at least two of the image sensors are fixed to the base; the device includes: The control module is used to control the high-frequency vibration unit to move the base according to the image acquisition sequence of at least two image sensors via the timing control unit. For each image sensor, the control module controls the image sensor to follow the base. When the image sensor moves directly below the lens, the control module determines that the image sensor is aligned with the lens. When the image sensor moves to the position aligned with the lens, the control module determines that the image sensor has moved to the target position. Only one image sensor is at the target position at any given time. When controlling the image sensor to follow the base, the control module first accelerates to a preset speed with a preset acceleration. When the distance between the image sensor and the target position is a preset distance, the control module gradually decelerates until it stops at the target position. The order in which images are acquired is determined as follows: Upon receiving an image acquisition command, the distance between the location of each image sensor and the target location is obtained, and the image sensors are sorted in ascending order of the distance to obtain the order of image acquisition. The acquisition module is used to stop moving each image sensor when it moves to the target position, and to acquire images through the image sensor at the target position to obtain corresponding image data; The control module is also used to control each image sensor to move away from the target position after obtaining the corresponding image data; The alignment module is used to send the image data to the self-aligning digital signal processing unit through the timing control unit, obtain the sensor parameters corresponding to each image data through the self-aligning digital signal processing unit, and the sensor parameters include at least one of field of view and resolution; adjust the sensor parameters of each image data to be the same as the sensor parameters of the image data with the lowest sensor parameters, and use the image data after parameter alignment as the acquired target image data.

10. The apparatus according to claim 9, characterized in that, At least two of the image sensors are horizontally fixed to the base; The control module is also used to control the base to stop moving when each of the image sensors moves to the target position.

11. A computer device, characterized in that, include: Memory, used to store executable instructions; A processor, when executing executable instructions stored in the memory, implements the image acquisition method according to any one of claims 1 to 8.

12. A computer-readable storage medium, characterized in that, It stores executable instructions for use by a processor to implement the image acquisition method according to any one of claims 1 to 8.

13. A computer program product comprising computer-executable instructions or a computer program, characterized in that, When the computer-executable instructions or computer program are executed by a processor, the image acquisition method according to any one of claims 1 to 8 is implemented.

Images