Method and device for dynamically adjusting ADC sampling frame rate, product, medium and equipment

Abstract

The invention discloses a method, a device, a product, a medium and equipment for dynamically adjusting an ADC sampling frame rate, and relates to the technical field of image processing, and the method comprises the steps: obtaining two continuous image frames of an area where the equipment ADC is located during sampling; calculating the displacement between two continuous image frames through a digital signal processor; calculating the speed and acceleration of the equipment based on the displacement; and dynamically adjusting the ADC sampling frame rate according to the speed and the acceleration of the equipment. According to the method and device for dynamically adjusting the ADC sampling frame rate, the product, the medium and the equipment, the power consumption can be effectively reduced while the equipment performance is ensured.

Description

Technical Field

[0001] The present application relates to the field of image processing technology, and in particular to a method, device, product, medium and equipment for dynamically adjusting ADC sampling frame rate. Background Art

[0002] In order to reduce the power consumption of the optical mouse, it is usually necessary to adjust the sampling frame rate according to the speed and acceleration of the optical mouse. In the existing related sampling frame rate adjustment technology, when the optical mouse moves at a low speed, since the target moves slowly, there is no need to worry about the target disappearing quickly in the image, so a low image frame rate, such as 500fps, is used. In this case, the sensor sensor core has sufficient time to perform data processing and DSP operations; but when the optical mouse moves at a high speed or has a high acceleration, due to the fast movement speed, the displacement mv between the two consecutive frames sampled is greater than 28. At this time, the overlap interval between the two frames is too small, and the probability of matching error is high. For this situation, the sampling frame rate needs to be increased. Specifically, when the displacement between two consecutive frames is small (mv=2), the optical mouse suddenly accelerates, and the actual displacement of the two frames collected is mv=8, and the search range of the current matching method does not exceed one pixel distance. At this time, the frame rate needs to be increased by 8 times, that is, the sampling frame rate is 4000fps to ensure correct matching. But usually, in order to improve the performance of optical mouse devices, a large image array, such as 36×36, is used. When the image array is large, the sensor core does not have enough time to process a large amount of data and cannot increase the sampling frame rate, which causes the performance of the optical mouse device to decline. Summary of the invention

[0003] The purpose of this application is to provide a method, device, product, medium and equipment for dynamically adjusting ADC sampling frame rate, which can effectively reduce power consumption while ensuring device performance.

[0004] To achieve the above objectives, this application provides the following solutions:

[0005] In a first aspect, the present application provides a method for dynamically adjusting an ADC sampling frame rate, comprising:

[0006] Get two consecutive image frames of the area where the device ADC is sampling;

[0007] The displacement between two consecutive image frames is calculated by a digital signal processor;

[0008] Calculate the speed and acceleration of the device based on the displacement;

[0009] Dynamically adjust the ADC sampling frame rate based on the speed and acceleration of the device.

[0010] Optionally, acquiring two consecutive image frames of the area where the device ADC is located when sampling specifically includes:

[0011] Two continuous surface images of the area where the device is located are collected by an image sensor in the device, and the two continuous surface images are converted into two grayscale images as two continuous image frames through ADC sampling.

[0012] Optionally, the image sensor is composed of a series of photosensitive elements; the photosensitive elements include photodiodes, phototransistors and photoresistors.

[0013] Optionally, the grayscale image is an 8-bit grayscale image.

[0014] Optionally, dynamically adjusting the ADC sampling frame rate according to the speed and acceleration of the device specifically includes:

[0015] The speed of the device is compared with preset speed thresholds th1 and th3, and th1>th3; the acceleration of the device is compared with preset acceleration thresholds th2 and th4, and th2>th4; when the speed of the device is <th3 and the acceleration of the device is <th4, the ADC sampling frame rate of the device is lowered; when the speed of the device is >th1 or the acceleration of the device is >th2, the ADC sampling frame rate of the device is increased.

[0016] Optionally, the ADC sampling frame rate of the device is lowered by increasing the number of sampling points when the device ADC samples; and the ADC sampling frame rate of the device is increased by decreasing the number of sampling points when the device ADC samples.

[0017] In a second aspect, the present application provides a device for dynamically adjusting an ADC sampling frame rate, comprising:

[0018] The image frame acquisition module is used to acquire two consecutive image frames of the area where the device ADC is sampling;

[0019] A displacement calculation module, used to calculate the displacement between two consecutive image frames through a digital signal processor;

[0020] A velocity and acceleration calculation module is used to obtain the velocity and acceleration of the device based on the displacement;

[0021] The dynamic adjustment module is used to dynamically adjust the ADC sampling frame rate according to the speed and acceleration of the device.

[0022] In a third aspect, the present application provides a computer program product, including a computer program, which implements the method for dynamically adjusting the ADC sampling frame rate when executed by a processor.

[0023] In a fourth aspect, the present application provides a computer-readable storage medium having a computer program stored thereon, which implements the method for dynamically adjusting the ADC sampling frame rate when executed by a processor.

[0024] In a fifth aspect, the present application provides a computer device, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the method for dynamically adjusting the ADC sampling frame rate.

[0025] According to the specific embodiments provided in this application, this application discloses the following technical effects:

[0026] The present application provides a method, device, product, medium and equipment for dynamically adjusting the ADC sampling frame rate. Based on two continuous image frames of the area where the device ADC is sampled, a digital signal processor (DSP) is used to calculate the speed and acceleration of the device through DSP operation, and the ADC sampling of the device is dynamically adjusted according to the speed and acceleration of the device to obtain arrays of different sizes, thereby adjusting the ADC sampling frame rate, improving the performance of devices such as optical mice, so that the optical mouse can be accurately positioned and identified even at high speeds. Therefore, the method, device, product, medium and equipment for dynamically adjusting the ADC sampling frame rate of the present application can effectively reduce power consumption while ensuring device performance. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0028] Figure 1 A schematic diagram of the process flow of the method for dynamically adjusting the ADC sampling frame rate provided in this application;

[0029] Figure 2 A schematic diagram showing the principle of the method for dynamically adjusting the ADC sampling frame rate provided in this application;

[0030] Figure 3 Schematic diagram of three cases of ADC sampling frame rate provided for this application;

[0031] Figure 4 A schematic diagram of the process of dynamically adjusting the ADC sampling frame rate provided in this application. DETAILED DESCRIPTION

[0032] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0033] In order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, the present application is further described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0034] like Figure 1 and Figure 2 As shown, the present application discloses a method for dynamically adjusting ADC sampling frame rate, comprising:

[0035] Step 1: Get two consecutive image frames of the area where the device ADC is sampling.

[0036] The device of the present application takes an optical mouse as an example. An infrared LED arranged at the bottom of the optical mouse emits an invisible infrared beam, which will irradiate a working surface such as a mouse pad or a desktop. The texture, pits or color changes of the working surface will cause reflection and scattering of the infrared beam, generating reflected light. At this time, the image sensor arranged in the optical mouse will collect the reflected light. The image sensor is used to capture the surface image of the bottom of the optical mouse containing the movement information of the optical mouse, that is, to collect two continuous surface images of the area where the optical mouse is located. And because the image sensor is composed of a series of photosensitive elements, the reflected light is converted into an electrical signal by photosensitive elements such as photodiodes, phototransistors and photoresistors in the image sensor.

[0037] After the surface image is collected by the image sensor, an analog-to-digital converter (ADC) is used for ADC sampling, the electrical signal in the image sensor is collected and the analog signal (electrical signal) is converted into a digital signal, and the surface image is converted into a grayscale image, thereby generating a frame of 8-bit grayscale image, and the generated grayscale image is used as the image frame. 8-bit grayscale images are usually arranged in a square matrix with equal number of rows and columns (for example, 16 rows by 16 columns, a total of 16×16=256 pixels).

[0038] Step 2: Calculate the displacement between two consecutive image frames through a digital signal processor.

[0039] After obtaining two continuous image frames (a pair of images) F1 and F2 of the area where the optical mouse ADC is sampling through step 1, the image data is processed and DSP operation is performed to obtain the displacement between the two continuous image frames.

[0040] Step 3: Calculate the velocity and acceleration of the device based on the displacement.

[0041] The displacement of the optical mouse obtained in step 2 above is used to calculate the current speed of the device, and then the current acceleration of the device is calculated based on the current speed of the device. Among them, the acceleration a is determined by kinematics, as shown below:

[0042]

[0043] Where a is the acceleration from frame N to frame N+1; V N is the initial velocity of the Nth frame; V N+1 is the final speed of the N+1th frame; t is the time between the Nth frame and the N+1th frame.

[0044] Step 4: Dynamically adjust the ADC sampling frame rate based on the speed and acceleration of the device.

[0045] The ADC sampling frame rate of the optical mouse is the number of times the LED lights up per second, that is, the number of image frames collected per second. When the movement speed of the optical mouse decreases, the frame rate should be reduced, and when the movement speed increases, the frame rate should be increased. Specifically, the speed of the device is compared with the preset speed thresholds th1 and th3, and th1>th3; the acceleration of the device is compared with the preset acceleration thresholds th2 and th4, and th2>th4; when the speed of the device is <th3 and the acceleration of the device is <th4, the ADC sampling frame rate of the device is lowered to enter the low frame rate mode; when the speed of the device is >th1 or the acceleration of the device is >th2, the ADC sampling frame rate of the device is increased to enter the high frame rate mode.

[0046] This application dynamically adjusts ADC sampling according to the speed and acceleration of the device, and obtains arrays of different sizes by increasing or decreasing the number of sampling points when the device ADC samples, thereby decreasing or increasing the ADC sampling frame rate of the device.

[0047] Figure 3 It shows three situations of ADC sampling frame rate adjustment. The first two situations from top to bottom are when the speed is low, and a low image frame rate is used so that the image sensor core has sufficient time for data processing and DSP operations. The third situation is when the speed or acceleration is very large, a higher frame rate is required, but there is not enough time to process a large amount of data, the frame rate cannot be increased, and the device performance decreases.

[0048] Figure 4What is shown is that the number of sampling points and frequency of ADC sampling are dynamically adjusted to obtain images of different size arrays to achieve the purpose of adjusting the frame rate. First, the frame rate is increased from 1000fps to 2000fps, then reduced to 1000fps, and finally increased to 8000fps. The speed obtained according to different frame rates and their corresponding image array sizes during the dynamic adjustment process is shown in Table 1.

[0049] Table 1 Image array size and speed corresponding to different frame rates

[0050] Frame rate (fps) Image Array Speed ​​(ips) 500 36 22 1000 36 44 2000 32 76 4000 28 126 8000 22 176 14000 16 176

[0051] The larger the image array and the higher the frame rate, the better the performance of the optical mouse, and the faster the speed and acceleration of the optical mouse. The maximum detectable speed of the optical mouse = maximum detectable movement displacement × pixel size × frame rate. For example, in Table 1, assuming that the size of each pixel is 40×40 microns, the maximum detectable movement displacement = image array-8, when the image array is 36×36 and the frame rate is 500fps, the maximum speed of the optical mouse is 22 (inches / second, ips). When the frame rate is increased to 1000fps, the maximum speed is 44ips.

[0052] like Figure 4 As shown in the figure, when the image array is 36×36, two frames of 1000fps images A and B are continuously collected for matching. A large speed is detected and the frame rate needs to be increased to 2000fps. Since the time required for ADC and DSP is related to the size of the image array, the ADC and DSP time required by the current image array cannot be increased to 2000fps. Figure 3 The first two cases in the figure. At this time, reduce ADC sampling and obtain two 32×32 frames of images C and D for matching. When the speed is detected to be reduced, the frame rate needs to be reduced to 1000fps, increase ADC sampling, obtain two 36×36 frames of images E and F for matching, and the displacement is 1. At this time, the optical mouse suddenly accelerates, and the actual displacement of images E and F is 8. The frame rate needs to be increased to 8000fps to match correctly. However, the time between two frames at 8000fps is very short, so reduce ADC sampling and obtain two 22×22 frames of images G and H for matching.

[0053] Because when the frame rate is the same, the larger the image array, the larger the search interval, the less likely the match is to go wrong, and the faster the speed. When the image array is the same, the faster the frame rate, the smaller the displacement between two consecutive frames, the less likely the match is to go wrong, and the faster the speed and acceleration. As can be seen from the data in Table 1, the method of dynamically adjusting the ADC sampling frame rate of this application can achieve synchronous changes in the frame rate and speed by dynamically adjusting the size of the image array obtained by ADC sampling, effectively reducing power consumption while ensuring device performance.

[0054] Based on the provided method for dynamically adjusting the ADC sampling frame rate, the present application also provides a device for dynamically adjusting the ADC sampling frame rate, including:

[0055] The image frame acquisition module is used to acquire two consecutive image frames of the area where the device ADC is sampling.

[0056] The displacement calculation module is used to calculate the displacement between two consecutive image frames through a digital signal processor.

[0057] The velocity and acceleration calculation module is used to obtain the velocity and acceleration of the device based on the displacement.

[0058] The dynamic adjustment module is used to dynamically adjust the ADC sampling frame rate according to the speed and acceleration of the device.

[0059] In some embodiments, the present application also provides a computer program product, including a computer program, which implements the method for dynamically adjusting the ADC sampling frame rate when executed by a processor.

[0060] In some embodiments, the present application also provides a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the method for dynamically adjusting the ADC sampling frame rate is implemented.

[0061] In some embodiments, the present application also provides a computer device, including a processor, a memory, an input / output interface (Input / Output, referred to as I / O), a communication interface, and a computer program stored in the memory and executable on the processor, and the processor executes the computer program to implement the method of dynamically adjusting the ADC sampling frame rate.

[0062] Wherein, the processor, memory and input / output interface are connected through a system bus, and the communication interface is connected to the system bus through the input / output interface. Wherein, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store pending transactions. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, the method for dynamically adjusting the ADC sampling frame rate is implemented.

[0063] It should be noted that the object information (including but not limited to object device information, object personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the object or fully authorized by all parties, and the collection, use and processing of relevant data need to comply with relevant laws, regulations and standards of relevant countries and regions.

[0064] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ReadOnlyMemory, ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., but are not limited to this.

[0065] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0066] This article uses specific examples to illustrate the principles and implementation methods of this application. The description of the above embodiments is only used to help understand the method and core ideas of this application. At the same time, for those skilled in the art, according to the ideas of this application, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as limiting this application.

Claims

1. A method for dynamically adjusting ADC sampling frame rate, characterized in that: include: Get two consecutive image frames of the area where the device ADC is sampling; The displacement between two consecutive image frames is calculated by a digital signal processor; Calculate the speed and acceleration of the device based on the displacement; Dynamically adjust the ADC sampling frame rate based on the speed and acceleration of the device.

2. The method for dynamically adjusting ADC sampling frame rate according to claim 1, characterized in that: The acquiring device ADC samples two consecutive image frames in the area where the device is located, specifically including: Two continuous surface images of the area where the device is located are collected by an image sensor in the device, and the two continuous surface images are converted into two grayscale images as two continuous image frames through ADC sampling.

3. The method for dynamically adjusting ADC sampling frame rate according to claim 2, characterized in that: The image sensor is composed of a series of photosensitive elements; the photosensitive elements include photodiodes, phototransistors and photoresistors.

4. The method for dynamically adjusting ADC sampling frame rate according to claim 2, characterized in that: The grayscale image is an 8-bit grayscale image.

5. The method for dynamically adjusting ADC sampling frame rate according to claim 1, characterized in that: The dynamically adjusting the ADC sampling frame rate according to the speed and acceleration of the device specifically includes: The speed of the device is compared with preset speed thresholds th1 and th3, and th1>th3; the acceleration of the device is compared with preset acceleration thresholds th2 and th4, and th2>th4; when the speed of the device is <th3 and the acceleration of the device is <th4, the ADC sampling frame rate of the device is lowered; when the speed of the device is >th1 or the acceleration of the device is >th2, the ADC sampling frame rate of the device is increased.

6. The method for dynamically adjusting ADC sampling frame rate according to claim 5, characterized in that: By increasing the number of sampling points when the device ADC samples, the ADC sampling frame rate of the device is lowered; by reducing the number of sampling points when the device ADC samples, the ADC sampling frame rate of the device is increased.

7. A device for dynamically adjusting ADC sampling frame rate, characterized in that: include: The image frame acquisition module is used to acquire two consecutive image frames of the area where the device ADC is sampling; A displacement calculation module, used to calculate the displacement between two consecutive image frames through a digital signal processor; A velocity and acceleration calculation module is used to obtain the velocity and acceleration of the device based on the displacement; The dynamic adjustment module is used to dynamically adjust the ADC sampling frame rate according to the speed and acceleration of the device.

8. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the method for dynamically adjusting the ADC sampling frame rate according to any one of claims 1 to 7 is implemented.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method for dynamically adjusting the ADC sampling frame rate according to any one of claims 1 to 7 is implemented.

10. A computer device comprising: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the method for dynamically adjusting the ADC sampling frame rate according to any one of claims 1 to 7.

Images