Image data processing method, system, device, storage medium and oral scanner

Abstract

The present invention provides an image data processing method, which is applied to an oral scanner, wherein the oral scanner is built with an image data acquisition unit and a heterogeneous programmable logic chip; the method comprises: acquiring and sending a plurality of oral image data by the image data acquisition unit; receiving and parsing a plurality of oral image data by the heterogeneous programmable logic chip to obtain a plurality of parallel oral image data; processing a plurality of parallel oral image data to obtain target image data, wherein the target image data is image data in a preset picture format; and sending the target image data to a server. The oral scanner integrates a plurality of hardware modules such as an image data acquisition unit, an image data processing unit, and a heterogeneous programmable logic chip; the degree of integration is high; the heterogeneous programmable logic chip can quickly process and send the oral image data, effectively improving the efficiency of data processing and transmission.

Description

Technical Field

[0001] The embodiments of the present invention relate to the field of oral medicine technology, and in particular to an image data processing method, system, device, storage medium and oral scanner. Background Art

[0002] At present, oral scanners are mainly composed of a handheld scanning unit and a host, wherein the scanning unit is composed of hardware modules such as a light source module, a light control module, an imaging module, an image data acquisition module, an image data processing module, an image output and transmission module, and a data transmission module. The above-mentioned oral scanner has many hardware modules and a complex structure. In addition, the connection relationship between the hardware modules in the above-mentioned oral scanner is complex, which easily leads to the problem of low efficiency in data processing based on the above-mentioned oral scanner. Summary of the invention

[0003] In view of this, the purpose of the present invention is to provide an image data processing method, system, computer equipment, computer storage medium and oral scanner, which are used to solve the problem of low data processing efficiency of current oral scanners.

[0004] The embodiment of the present invention solves the above technical problems through the following technical solutions:

[0005] One aspect of an embodiment of the present invention provides an image data processing method, which is applied to an oral scanner, wherein the oral scanner has an image data acquisition unit and a heterogeneous programmable logic chip built therein; the method comprises:

[0006] Collecting a plurality of oral cavity image data by the image data acquisition unit, and sending the plurality of oral cavity image data;

[0007] Receiving the plurality of oral image data through the heterogeneous programmable logic chip, parsing the plurality of oral image data, and obtaining a plurality of parallel oral image data;

[0008] Processing the plurality of parallel oral image data through the heterogeneous programmable logic chip to obtain target image data, wherein the target image data is image data in a preset picture format; and

[0009] The target image data is sent to a server through the heterogeneous programmable logic chip.

[0010] Optionally, the heterogeneous programmable logic chip includes a central processing unit; the oral scanner also includes a light source unit; and the collecting of a plurality of oral image data by the image data collecting unit includes:

[0011] Sending a light source control signal to the light source unit via the central processor;

[0012] Receiving the light source control signal through the light source unit, and generating a target light source according to the light source control signal, wherein the target light source is used to illuminate the oral cavity of a target user to scan the oral cavity of the target user;

[0013] Collecting reflected light information through the image data acquisition unit, wherein the reflected light information is light information reflected after the target light source contacts tissue in the oral cavity of the target user; and

[0014] The reflected light information is converted into the plurality of oral image data by the image data acquisition unit.

[0015] Optionally, the image data acquisition unit includes at least two image sensors;

[0016] The sending the target image data to the server through the heterogeneous programmable logic chip also includes:

[0017] Receiving a synchronous exposure signal sent by the heterogeneous programmable logic chip through the at least two image sensors; and

[0018] The plurality of oral image data are synchronously sent to the heterogeneous programmable logic chip according to the synchronous exposure signal.

[0019] Optionally, the heterogeneous programmable logic chip further includes a programmable logic array; the programmable logic array includes a serial data parsing circuit, a parallel data parsing circuit, an output buffer circuit and an alignment circuit; the multiple oral image data are serial oral image data; the parallel oral image data are pixel data that meet a preset parallel format;

[0020] The receiving the plurality of oral image data by the heterogeneous programmable logic chip, parsing the plurality of oral image data, and obtaining a plurality of parallel oral image data also includes:

[0021] Converting the serial oral image data into a plurality of parallel data by the serial data analysis circuit;

[0022] Arranging and combining the plurality of parallel data according to the preset parallel format through the parallel data analysis circuit, and obtaining a plurality of original parallel oral image data;

[0023] Cache the plurality of original parallel oral image data by the output cache circuit;

[0024] Detecting the lead-lag relationship between the plurality of cached original parallel oral image data through the alignment circuit, and determining the field signal, line signal and pixel data of the most lagging original parallel oral image data as the alignment reference signal according to the lead-lag relationship; and

[0025] The field signal, line signal and pixel data of the remaining original parallel oral image data are aligned with the alignment reference signal through the alignment circuit, and the plurality of parallel oral image data are output.

[0026] Optionally, the method further comprises:

[0027] Receiving a configuration signal sent by the central processor through each image sensor; and

[0028] The output row start address of the corresponding image sensor is configured according to each configuration signal.

[0029] One aspect of an embodiment of the present invention provides an image data processing system, which is applied to an oral scanner, wherein the oral scanner has an image data acquisition unit and a heterogeneous programmable logic chip built in, and the heterogeneous programmable logic chip is used to process image data; the system includes:

[0030] An acquisition module, used for acquiring a plurality of oral cavity image data through the image data acquisition unit, and sending the plurality of oral cavity image data;

[0031] A parsing module, used for receiving the plurality of oral image data through the heterogeneous programmable logic chip, parsing the plurality of oral image data, and obtaining a plurality of parallel oral image data;

[0032] a processing module, configured to process the plurality of parallel oral image data through the heterogeneous programmable logic chip and obtain target image data, wherein the target image data is image data in a preset picture format; and

[0033] A sending module is used to send the target image data to a server through the heterogeneous programmable logic chip.

[0034] One aspect of an embodiment of the present invention provides an oral scanner, comprising: an image data acquisition unit, a heterogeneous programmable logic chip, and a light source unit, wherein:

[0035] The image data acquisition unit is used to acquire oral image data of the user;

[0036] The image data acquisition unit is electrically connected to the heterogeneous programmable logic chip; the heterogeneous programmable logic chip is used to process the oral image data sent by the image data acquisition unit;

[0037] The heterogeneous programmable logic chip is electrically connected to and controls the light source unit, so that the light source unit generates and outputs a target light source.

[0038] Optionally, the heterogeneous programmable logic chip includes a central processing unit, a programmable logic array, a bus interconnection controller, a serial bus controller and a memory controller; the bus interconnection controller is electrically connected to the central processing unit, the programmable logic array, the serial bus controller and the memory controller respectively.

[0039] An aspect of an embodiment of the present invention further provides a computer device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the image data processing method described above when executing the computer program.

[0040] An aspect of an embodiment of the present invention further provides a computer-readable storage medium, in which a computer program is stored. The computer program can be executed by at least one processor to enable the at least one processor to perform the steps of the image data method as described above.

[0041] The embodiments of the present invention provide an image data processing method, system, computer device, computer-readable storage medium and oral scanner, wherein the oral scanner integrates multiple hardware modules such as an image data acquisition unit, an image data processing unit, a light source unit and a lens unit, and an image data sending module and a light source control module for controlling the light source unit are integrated on a heterogeneous programmable logic chip; the degree of integration is high; and the oral image data can be quickly processed and sent through the heterogeneous programmable logic chip, effectively improving the efficiency of data processing and transmission.

[0042] The present invention is described in detail below with reference to the accompanying drawings and specific embodiments, but is not intended to limit the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] Figure 1 An exemplary flow chart of the method for processing image data according to the present invention is schematically shown;

[0044] Figure 2 The hardware structure diagram of the oral scanner according to the embodiment of the present invention is schematically shown;

[0045] Figure 3 The hardware circuit block diagram of the oral scanner according to the embodiment of the present invention is schematically shown;

[0046] Figure 4 A schematic flowchart showing the steps of collecting oral image data in the image data processing method according to the present invention is shown;

[0047] Figure 5 A flowchart schematically shows the steps of synchronously sending oral image data in the image data processing method according to the present invention;

[0048] Figure 6 A flowchart schematically shows the steps of configuring an image sensor in the method for image data processing according to the present invention;

[0049] Figure 7-1 Schematically shows an output timing diagram of image data output by the image sensor when the row start address configured by the image sensor starts with an odd address;

[0050] Figure 7-2 Schematically shows an output timing diagram of image data output by the image sensor when the row start address configured by the image sensor starts with an even address;

[0051] Figure 7-3 A flowchart schematically shows the steps of analyzing oral image data in the image data processing method according to the present invention;

[0052] Figure 7-4 Schematically shows a timing diagram of image data input by a serial data analysis circuit;

[0053] Figure 7-5 Schematically shows a timing diagram of image data output by a serial data analysis circuit;

[0054] Figure 7-6 Schematically shows a timing diagram of parallel oral image data;

[0055] Figure 7-7 The schematic diagram of the image sensor output data analysis circuit is shown schematically;

[0056] Figure 7-8-1 The schematic diagram shows the lead-lag relationship between the image sensor A and B data;

[0057] Figure 7-8-2 schematically shows a timing diagram of image sensor A and B data after alignment;

[0058] Figure 7-9-1 The schematic diagram shows the lead-lag relationship between the image sensor A and B data;

[0059] Figure 7-9-2 schematically shows a timing diagram of image sensor A and B data after alignment;

[0060] Figure 7-10 The circuit diagram for realizing the alignment function is schematically shown;

[0061] Figure 8 A block diagram of an image data processing system according to a third embodiment of the present invention is schematically shown;

[0062] Fig. 9The hardware structure diagram of a computer device suitable for implementing the image data processing method according to the fourth embodiment of the present invention is schematically shown. DETAILED DESCRIPTION

[0063] In order to make the purpose, technical scheme and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present invention.

[0064] It should be noted that the descriptions involving "first", "second", etc. in the embodiments of the present invention are only for descriptive purposes and cannot be understood as indicating or suggesting their relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include multiple such features. In addition, the technical solutions between the various embodiments can be combined with each other, but they must be based on the ability of ordinary technicians in the field to implement them. When the combination of technical solutions is contradictory or cannot be implemented, it should be deemed that such combination of technical solutions does not exist and is not within the scope of protection required by the present invention.

[0065] In the description of the present invention, it should be understood that the numerical labels before the steps do not identify the order of executing the steps, but are only used to facilitate the description of the present invention and distinguish each step, and therefore cannot be understood as a limitation of the present invention.

[0066] Embodiment 1

[0067] See also Figure 1 , showing a flowchart of the steps of the image data processing method according to an embodiment of the present invention. It is understood that the flowchart in the embodiment of the present method is not used to limit the order of executing the steps. The image data processing method is applied to an oral scanner, which has an image data acquisition unit and a heterogeneous programmable logic chip built in.

[0068] The following is an exemplary description using an oral scanner as the execution subject, as follows:

[0069] like Figure 1 As shown, the image data processing method may include steps S100 to S106, and the method includes:

[0070] Step S100: collecting a plurality of oral cavity image data through the image data collecting unit, and sending the plurality of oral cavity image data.

[0071] Step S102: receiving the plurality of oral image data through the heterogeneous programmable logic chip, parsing the plurality of oral image data, and obtaining a plurality of parallel oral image data.

[0072] Step S104, processing the plurality of parallel oral image data by the heterogeneous programmable logic chip to obtain target image data, wherein the target image data is image data in a preset picture format.

[0073] Specifically, a compression operation is performed on multiple parallel oral image data through a heterogeneous programmable logic chip to obtain target image data.

[0074] Step S106: sending the target image data to a server through the heterogeneous programmable logic chip.

[0075] In an embodiment of the present invention, the oral scanner integrates multiple hardware modules such as an image data acquisition unit, an image data processing unit, a light source unit and a lens unit, and the heterogeneous programmable logic chip integrates an image data sending module and a light source control module for controlling the light source unit; the degree of integration is high; and the heterogeneous programmable logic chip can quickly process and send oral image data, effectively improving the efficiency of data processing and transmission.

[0076] In the embodiment of the present invention, the image data acquisition unit includes at least two image sensors, for example, image sensor A and image sensor B. The image sensor is used to acquire light signals reflected by tissues in the oral cavity of the target user and convert the light signals into digital signals.

[0077] like Figure 2 and Figure 3 As shown, the oral scanner also includes: an image data processing unit, a lens unit, a light source unit and a transmission interface, the lens unit is arranged in the light source unit, the lens unit is connected to the image data acquisition unit, the image data acquisition unit is connected to the image data processing unit, the image data processing unit is connected to the light source unit, and the image data processing unit is connected to the transmission interface; the image data processing unit includes a heterogeneous programmable logic chip; the heterogeneous programmable logic chip includes a central processing unit.

[0078] See also Figure 3In order to more conveniently understand the image data processing method described in the embodiment of the present invention, the image data processing method will be described exemplarily from the data interaction between the four units of the oral scanner; wherein: the four units include: an image data acquisition unit, an image data processing unit, a light source unit and a power supply unit. The image data processing unit includes a heterogeneous programmable logic chip, and the heterogeneous programmable logic chip includes a central processing unit (i.e., a processor core); the central processing unit includes at least four processor cores, and the four processor cores execute a light source unit control program, an image sensor configuration program, an image sensor synchronous exposure generation program and an image data processing program (such as an image data compression program).

[0079] 1. In the optical unit:

[0080] The optical unit includes a light source generating circuit and a lens unit (ie, an optical lens). The interaction between the light source unit and the image data processing unit is realized through the processor core.

[0081] In order to improve the practicality and applicability of the oral scanner, Figure 4 , the acquisition of multiple oral image data by the image data acquisition unit may also include the following steps S400 to S406, wherein: step S400, sending a light source control signal to the light source unit by the processor core; step S402, receiving the light source control signal by the light source unit, and generating a target light source according to the light source control signal, wherein the target light source is used to irradiate the oral cavity of the target user to scan the oral cavity of the target user; step S404, acquiring reflected light information by the image data acquisition unit, wherein the reflected light information is light information reflected after the target light source contacts the tissue in the oral cavity of the target user; and step S406, converting the reflected light information into the multiple oral image data by the image data acquisition unit. In this embodiment, when the processor core executes the light source unit control program and outputs the corresponding light source control signal, the light source generation circuit in the light source unit can generate a light source (i.e., a target light source) that meets the product requirements according to the light source control signal. The light source unit includes an optical lens, which gathers light signals reflected by objects for image sensor A and image sensor B. The lens unit can collect the light information reflected by the target light source contacting the tissue in the oral cavity of the target user into the pixel area of ​​the image sensor (e.g., two-way image sensor). By adjusting the light source output by the oral scanner through the control signal, different product requirements can be met, effectively improving the practicality and applicability of the oral scanner.

[0082] 2. In the image data acquisition unit:

[0083] The image data acquisition unit includes two image sensors (i.e., image sensor A and image sensor B) and a first clock circuit (i.e., clock circuit 1). In an embodiment of the present invention, the output interface of the image sensor is an SLVS interface (Sony's image sensor interface), and the SLVS interface of the image sensor outputs multiple channels of image data and one clock signal based on the SLVS protocol; wherein the multiple channels of image data include image data of data channel 1, image data of data channel 2, image data of data channel 3, and image data of data channel 4; one clock signal is output by clock circuit 1. The interaction between the image data acquisition unit and the image data processing unit is realized by a heterogeneous programmable logic chip; for example, the interaction based on the synchronous exposure signal and the interaction based on the configuration signal.

[0084] (1) Interaction based on synchronous exposure signal

[0085] For product requirements, please refer to Figure 5 , the sending of the multiple oral image data can also be obtained by the following operations, wherein: step S500, receiving the synchronous exposure signal sent by the heterogeneous programmable logic chip through the at least two image sensors; and step S502, synchronously sending the multiple oral image data to the heterogeneous programmable logic chip according to the synchronous exposure signal. In this embodiment, the synchronous exposure generation program of the image sensor is executed by the processor core, and the synchronous exposure signal sent can realize the synchronous sending of the multiple oral image data collected by image sensor A and image sensor B to the image data processing unit. In other embodiments of the embodiments, if the product has no need for synchronous data transmission, any image sensor can send data to the image data processing unit by itself after collecting the oral image data.

[0086] (2) Interaction based on configuration signals

[0087] To meet product requirements and achieve different configurations of the product, please refer to Figure 6 , the method further includes: step S600, receiving the configuration signal sent by the processor core respectively through each image sensor; and step S602, configuring the output row start address of the corresponding image sensor according to each configuration signal. In this embodiment, the image sensor configuration program is executed by the processor core, and the configuration signal sent is used to implement the configuration of the row start address of image sensor A and image sensor B. The timing relationship of the image pixel data output by the image sensor is related to the row start address configured by the corresponding image sensor. In the case where the row start address configured by the image sensor starts with an odd address, the output timing of the image data output by the image sensor is as follows: Figure 7-1 As shown; when the row start address of the image sensor configuration starts with an even address, the output timing of the image data output by the image sensor is as follows Figure 7-2 See Figure 7-1 to Figure 7-2 , each image sensor includes at least four channels of image data: the first channel of image data output by the first data channel (i.e., data channel 1), the second channel of image data output by the second data channel (i.e., data channel 2), the third channel of image data output by the third data channel (i.e., data channel 3), and the fourth channel of image data output by the fourth data channel (i.e., data channel 4). The image data output by image sensors A and B will also execute the synchronization code (Sync code) in the data synchronization code channel in image sensors A and B to synchronize the data code (data code) according to the synchronous exposure signal. A row start address corresponds to two data time slots, time slot 0 and time slot 1.

[0088] (3) About clock circuit 1

[0089] The clock circuit 1 is an active clock circuit with two clock fan-outs, which provide clock signals for the image sensor A and the image sensor B respectively.

[0090] 3. In the image data processing unit:

[0091] The image data processing unit is mainly used to receive oral image data and parse the oral image data into parallel oral image data, realize pixel data alignment, preprocessing, compression, storage, transmission and other operations, and generate configuration signals for the image sensor and light source control signals for the light source unit.

[0092] The image data processing unit includes a level conversion circuit in a level conversion chip, the heterogeneous programmable logic chip, a second clock circuit (i.e., clock circuit 2), a bus interconnection controller, a USB PHY chip, and a DDR memory chip (a cache product of computer memory specifications). Among them:

[0093] (1) Application of level conversion circuit

[0094] In the embodiment of the present invention, the heterogeneous programmable logic chip does not support the level interface based on the SLVS protocol, and the level signal based on the SLVS protocol sent by the SLVS-EC interface of the image sensor is converted into a level signal based on the LVDS (Low Voltage Differential Signaling) protocol supported by the heterogeneous programmable logic chip through a level conversion circuit. Among them, the SLVS-EC interface is used for high frame rate and high resolution image acquisition and transmission.

[0095] (2) Application of heterogeneous programmable logic chips

[0096] The heterogeneous programmable logic chip (FPGA, mainly used for receiving and preprocessing image data) package; the heterogeneous programmable logic chip includes a programmable logic array, a processor core, a bus interconnection controller, a universal serial bus controller and a DDR (Double Data Rate, double data rate synchronous dynamic random access) memory controller.

[0097] The programmable logic array includes a clock delay circuit, a clock management circuit, a data delay circuit, a serial data analysis circuit, a parallel image data analysis circuit, an output buffer circuit, a dual-path image data alignment circuit and an image data preprocessing circuit.

[0098] The processor core includes a light source unit control program, an image sensor configuration program, an image sensor synchronous exposure generation program and an image data compression program; the light source unit control program is used to control the light source output by the light source circuit; the image sensor configuration program is used to implement the configuration of the image sensor; the image sensor synchronous exposure generation program is used to support the synchronization of dual-channel image data; the image sensor compression program is used to support the compression of oral image data in a picture format, and the compressed data is transmitted to an external server (such as a host) through a universal serial bus interface.

[0099] For example, the image data can be compressed by a JPEG (Joint Photographic Experts Group) encoder in the image compression algorithm. The JPEG encoder includes at least the following parts: two-dimensional discrete cosine transform (2D-DCT), quantization, Z-scan, run-length / predictive coding, Huffman coding, etc. Figure 4 The principle block diagram is shown in the figure. The input is the original brightness Y data of the image, and finally the code stream is output through the Huffman encoder.

[0100] The specific operation of compressing oral image data is as follows: the image data is first subjected to one-dimensional DCT transformation (discrete cosine transformation) by row, and then the transformation result is subjected to a second one-dimensional DCT transformation by column, so as to obtain a two-dimensional DCT transformation result; the coefficient value after 2D-DCT transformation is divided by the quantization value in the quantization table to obtain the quantized coefficient; the quantized coefficient is converted into a one-dimensional ZIG-ZAG (sawtooth) sequence by a Z-type scanner, and the first value of the sequence represents the direct current (DC) component, and the subsequent 63 values ​​represent the alternating current (AC) component. The DC component is coded with one-dimensional differential previous value prediction, that is, the DC component is subtracted from the DC component of the previous sub-block. The AC component is run-length coded, and the upper four bits of a byte are used to represent the number of consecutive 0 values ​​of the AC component, and the lower four bits represent the number of bits required for the next non-zero coefficient. In this way, the maximum number of 0 values ​​that can be represented is 15. If the number of 0 values ​​in the AC component is more than 15, (15, 0) is used to represent it. (0, 0) represents EOB, indicating that the following component values ​​are all 0. In this way, the run-length / predictive coding compresses the value of coefficient 0. The DC and AC coefficients are Huffman encoded using the Huffman table through the Huffman encoder, and the JPEG image code stream is output; thus, the image can be compressed in JPEG format.

[0101] In order to improve the efficiency of data processing, in an exemplary embodiment, the plurality of oral image data are serial oral image data; the parallel oral image data are pixel data that meet the preset parallel format; see Figure 7-3 , the step S102 of receiving the multiple oral image data through the heterogeneous programmable logic chip, parsing the multiple oral image data, and obtaining multiple parallel oral image data can also further include the following steps S700 to S708, wherein: step S700, converting the serial oral image data into multiple parallel data through the serial data parsing circuit; step S702, arranging and combining the multiple parallel data according to the preset parallel format through the parallel data parsing circuit, and obtaining multiple original parallel oral image data; step S704, caching the multiple original parallel oral image data through the output buffer circuit; step S706, detecting the lead-lag relationship between the cached multiple original parallel oral image data through the alignment circuit, and determining the field signal, line signal and pixel data of the most lagging original parallel oral image data as the alignment reference signal according to the lead-lag relationship; and step S708, aligning the field signal, line signal and pixel data of the remaining original parallel oral image data with the alignment reference signal through the alignment circuit, and outputting the multiple parallel oral image data.

[0102] ①Application of clock delay circuit

[0103] Provide a delay function for the clock to eliminate the impact of delay on signal timing. Provide a delay function for the lvds_clk (lvds clock) signal received by the heterogeneous programmable logic chip through the clock delay circuit.

[0104] ②Application of data delay circuit

[0105] Provide a delay function for the data to eliminate the impact of delay on signal timing. Provide a delay function for the lvds_data data received by the heterogeneous programmable logic chip through the data delay circuit.

[0106] ③Application of clock management circuit

[0107] Provide clock signals for the serial data analysis circuit, the parallel image data analysis circuit and other functional circuits of the system. Exemplarily, provide a high-speed clock signal for the serial data analysis circuit and a low-speed clock signal for the parallel image data analysis circuit.

[0108] ④Application of serial data analysis circuit

[0109] As described in step S700, the serial oral image data is converted into multiple parallel data. The image data output by the image sensor is 1:4 double rate serial data. The function of converting serial data into parallel data can be realized by using the IDDR device resources of the FPGA. The timing diagram of the image data input by the serial data analysis circuit is shown in FIG. Figure 7-4 As shown, the timing diagram of the image data output by the serial data analysis circuit is as follows Figure 7-5 As shown, CH0 represents data channel 1; CH1 represents data channel 2; CH2 represents data channel 3; CH3 represents data channel 4; SYNC represents data synchronization code channel. The clock CLK_S of serial image data is 4 times that of parallel image data CLK_P, D0-D7 of serial image data is 1 bit wide data, PD0-PDM of parallel data is 8 bit wide data, PD = {D7, D6, D5, D4, D3, D2, D1, D0}.

[0110] ⑤Application of parallel image data analysis circuit

[0111] The parallel image data analysis circuit is used to analyze, combine, and arrange the multiple parallel data output by the serial data analysis circuit into image pixel data in a preset parallel format. The timing relationship of the image pixel data output by the image sensor is related to the row start address configured by the corresponding image sensor. In the case where the row start address configured by the image sensor starts with an odd address, the output timing of the image data output by the image sensor is as follows: Figure 7-1As shown; when the row start address of the image sensor configuration starts with an even address, the output timing of the image data output by the image sensor is as follows Figure 7-2 The image data output by the image sensor is alternating according to the odd and even row start addresses, and 16 data are used as an alternating cycle. In this embodiment, regardless of whether the row start address of the image sensor is configured to start with an odd address or an even address, the oral image data output by the image sensor can be processed by the parallel image data analysis circuit to obtain correct parallel oral image data. The timing of the parallel oral image data is as follows: Figure 7-6 As shown, CLK_P represents the timing signal of parallel oral image data; HS represents the row signal of parallel oral image data, VS represents the field signal of parallel oral image data; pixel(0,0)~pixel(M,N) represents the pixel points of parallel oral image data, wherein pixel represents pixel; the pixel resolution of parallel oral image data is M rows and N columns.

[0112] For example, the working principle of the parallel image data parsing circuit is as follows:

[0113] Combination Figure 7-7, the sampling output controller performs pipeline cache processing on the parallel data for 2 cycles for each data channel (such as CH0, CH1, CH2 and CH3) according to the parity configuration information of the row start address of the image sensor and the field signal and row signal of the image data, performs 4-beat cycle counting during the row validity period, and outputs the image data in parallel through the output cache circuit. If the image sensor is configured to output the row start address starting with an even address, when the counter value is 0 and 1, the first cycle and second cycle data of the sampling cache CH0 are used as pixel (0,0) and pixel (0,1) of the parallel oral image data, the first cycle and second cycle data of the sampling CH1 are used as pixel (0,2) and pixel (0,3), and the sampling cache CH2 is used as pixel (0,0) and pixel (0,1) of the parallel oral image data. The first cycle and second cycle data of CH3 are used as pixel (0,4) and pixel (0,5) of the parallel oral image data, and the first cycle and second cycle data of CH3 are used as pixel (0,6) and pixel (0,7); when the counter values ​​are 2 and 3, the second cycle and first cycle data of the sampling cache CH3 are used as pixel (0,8) and pixel (0,9) of the parallel oral image data, the second cycle and first cycle data of CH2 are used as pixel (0,10) and pixel (0,11), the second cycle and first cycle data of the sampling cache CH1 are used as pixel (0,12) and pixel (0,13) of the parallel oral image data, and the second cycle and first cycle data of CH0 are used as pixel (0,14) and pixel (0,15); the processing is repeated with 16 pixels (pixels) as one cycle until the parallel oral data is visualized as an observation image.

[0114] If the image sensor is configured to output a row starting address starting with an odd address, when the counter value is 0 and 1, the second cycle and first cycle data of the sampling buffer CH3 are used as pixel (0,0) and pixel (0,1) of the parallel oral image data, the second cycle and first cycle data of the sampling buffer CH2 are used as pixel (0,2) and pixel (0,3), the second cycle and first cycle data of the sampling buffer CH1 are used as pixel (0,4) and pixel (0,5) of the parallel oral image data, and the second cycle and first cycle data of the sampling buffer CH0 are used as pixel (0,6) and pixel (0,7); when the counter value is 2 and 3, the sampling buffer CH0 is used as pixel (0,0) and pixel (0,1) of the parallel oral image data. The first cycle and second cycle data of CH1 are used as pixel (0,8) and pixel (0,9) of the parallel oral image data, the first cycle and second cycle data of CH1 are used as pixel (0,10) and pixel (0,11), the first cycle and second cycle data of CH2 are sampled as pixel (0,12) and pixel (0,13) of the parallel oral image data, and the first cycle and second cycle data of CH3 are sampled as pixel (0,14) and pixel (0,15); 16 pixels are used as one cycle, and the processing is repeated until the parallel oral data is visualized as an observation image.

[0115] When the counter counts 0 and 1 for sampling, the output buffer circuit outputs the count values ​​2 and 3 for sampling image data; when the counter counts 2 and 3 for sampling, the output buffer circuit outputs the count values ​​0 and 1 for sampling image data.

[0116] Exemplarily, within a cycle consisting of 16 pixels, when sampling is performed during the period when the counter value of the counter is 0 and 1, by sampling the image data in CH0, CH1, CH2 and CH3, the output buffer circuit outputs the image data of the CH0 and CH2 sampling buffers when the previous count values ​​are 2 and 3, as well as the image data of the CH0 and CH2 sampled in this sampling.

[0117] Exemplarily, within a cycle consisting of 16 pixels, when sampling is performed during the period when the counter value of the counter is 2 and 3, by sampling the image data in CH0, CH1, CH2 and CH3, the output buffer circuit outputs the image data of the CH1 and CH3 sampling buffers when the previous count value is 0 and 1, as well as the image data of CH1 and CH3 sampled in this sampling.

[0118] ⑥Application of dual-channel image data alignment circuit

[0119] The alignment circuit includes a dual-channel image alignment circuit; wherein the dual-channel image alignment circuit can realize the function of automatically aligning the row signals, field signals, and pixel data of the parallel oral image data of the two-channel image sensors. In the embodiment of the present invention, even if the two-channel image sensors are synchronously triggered and synchronously output the oral image data, in the actual application process, the data is still not synchronized. Therefore, in order to facilitate the subsequent data processing and improve the data processing efficiency, the method can also align the two-channel data through the dual-channel image alignment circuit.

[0120] For example, see Figure 7-8-1 to Figure 7-8-2 The lead-lag relationship between the data of image sensors A and B is: the data of image sensor A leads, and the data of image sensor B lags; the field signal (VS) and line signal (HS) of the lagging image sensor B are used as alignment reference signals; the data of image sensor A is aligned with the alignment reference signal through a dual-path image alignment circuit, and multiple parallel oral image data are output.

[0121] For example, see Figure 7-9-1 to Figure 7-9-2 The lead-lag relationship between the data of image sensors A and B is: the data of image sensor B leads, and the data of image sensor A lags; the field signal (VS) and line signal (HS) of the lagging image sensor A are used as alignment reference signals; the data of image sensor B is aligned with the alignment reference signal through a dual-path image alignment circuit, and multiple parallel oral image data are output.

[0122] To more easily understand the application of alignment circuits, see Figure 7-10 , as follows:

[0123] The cache circuit caches the VS and HS signals of image sensor A and caches the VS and HS signals of image sensor B; at the same time, the lead-lag circuit detects the lead-lag relationship between the two-way image data. When the lead-lag relationship is detected, the read data control circuit generates a read signal according to the lead-lag relationship, and reads the cache data in the cache circuit according to the read signal, and then outputs two parallel oral image data through the dual-way image alignment circuit sharing VS and HS.

[0124] ⑦Application of image data preprocessing circuit

[0125] In the embodiment of the present invention, the image data preprocessing circuit mainly realizes functions such as black level correction, shadow correction, image data noise reduction, white balance, bilinear interpolation distortion correction, RGB interpolation, etc.

[0126] Exemplarily, regarding black level correction (BLC): black level correction is achieved by integrating a BLC module in the image sensor; if the parallel oral image data plane tends to be flat, the global mean calculation method is selected to achieve black level correction; if there is a peak in the parallel oral image data, the median calculation method is selected to achieve black level correction; if there is a corner with a higher value in the parallel oral image data, the local mean calculation method is selected to achieve black level correction.

[0127] For example, regarding the shading correction (Lens Shading Correction): it is used to solve the problem of shadows around the lens caused by uneven optical refraction of the optical lens. The four channels of the parallel oral data image are independently corrected.

[0128] Exemplarily, regarding image data denoising: it is an inverse problem of image processing. Image data denoising includes at least the following methods: filtering methods, sparse expression methods, external prior methods, clustering low-rank methods, deep learning methods, etc.

[0129] For example, regarding white balance: it is used to solve the problems related to color reproduction and tone processing. White balance includes at least the following methods: preset white balance method, automatic tracking white balance adjustment method, etc.

[0130] Exemplarily, regarding bilinear interpolation distortion correction: the grayscale of four adjacent pixels of the pixel to be determined is used for linear interpolation in two directions, and the grayscale value of the position of the pixel to be determined is obtained by the optical flow method, wherein the optical flow method also uses two-dimensional linear interpolation.

[0131] Exemplarily, regarding RGB interpolation: RGB interpolation algorithms include at least a dual-line new interpolation algorithm, an edge-guided interpolation algorithm, an adaptive color layer interpolation algorithm, a median filter interpolation algorithm, a color smoothing interpolation algorithm, and the like.

[0132] ⑧About the application of bus interconnection controller and universal serial bus controller

[0133] The bus interconnect controller connects the programmable logic array, the processor core, the universal serial controller and the DDR (double data rate synchronous dynamic random access memory) memory controller. The bus interconnect controller is used to manage the reading and writing of each device bus.

[0134] The universal serial bus controller can realize the control of USB devices based on USB2.0 and USB3.0 protocols. That is, a corresponding USB PHY chip is connected to the interface of the universal serial bus controller, and the USB PHY chip is connected to the USB interface. The connection with the USB device and data transmission are realized through the USB PHY chip and the USB interface. In the embodiment of the present invention, the image data output by the oral scanner is transmitted to the host end through the USB interface, and the command data sent by the host end is also received. In the embodiment of the present invention, due to the large amount of data transmitted, the USB3.0 protocol is adopted.

[0135] ⑨About the application of DDR memory controller

[0136] The DDR memory controller is used to manage and plan the data transmission between each device and DRAM (Dynamic Random Access Memory). The DDR memory controller is connected to an external DDR chip. In the embodiment of the present invention, due to the requirement of faster transmission rate, an external DDR4 memory chip is connected.

[0137] ⑩Power supply module: includes system power supply circuit, which provides power with required voltage and current for the entire hardware circuit of the oral scanner.

[0138] The embodiments of the present invention have at least the following beneficial effects:

[0139] (1) In the embodiment of the present invention, the oral scanner integrates multiple hardware modules such as an image data acquisition unit, an image data processing unit, a light source unit and a lens unit, and the heterogeneous programmable logic chip integrates an image data sending module and a light source control module for controlling the light source unit; the degree of integration is high; the hardware design is effectively simplified, the material cost of the product is reduced, and the size of the handheld part of the oral scanner can also be designed to be smaller, which is more in line with the operator's usage requirements.

[0140] (2) Image data is compressed and processed in picture format based on heterogeneous programmable logic chips to improve image data transmission efficiency.

[0141] (3) Image processing operations are realized based on the integration of multiple functional hardware modules on heterogeneous programmable logic chips; and oral image data can be quickly processed and sent through heterogeneous programmable logic chips, effectively improving the efficiency of data processing and transmission. The product structure is effectively optimized, and the application of multiple functional hardware modules effectively improves the user experience.

[0142] Embodiment 2

[0143] Please continue reading Figure 8, schematically showing a block diagram of the image data processing system of the present invention. In this embodiment, the image data processing system may include or be divided into one or more program modules, one or more program modules are stored in a storage medium, and are executed by one or more processors to complete the present invention and implement the above-mentioned image data processing method. The program module referred to in the embodiment of the present invention refers to a series of computer program instruction segments that can complete specific functions, which is more suitable for describing the execution process of the image data processing system in a storage medium than the program itself. The following description will specifically introduce the functions of each program module of this embodiment. The image data processing system is used in an oral scanner; the oral scanner is equipped with an image data acquisition unit and a heterogeneous programmable logic chip, and the heterogeneous programmable logic chip is used to process image data.

[0144] like Figure 8 As shown, the image data processing system may include a collection module 800, a parsing module 802, a processing module 804 and a sending module 806, wherein:

[0145] The acquisition module 800 is used to acquire a plurality of oral image data through the image data acquisition unit and send the plurality of oral image data;

[0146] The parsing module 802 is used to receive the multiple oral image data through the heterogeneous programmable logic chip, parse the multiple oral image data, and obtain multiple parallel oral image data;

[0147] A processing module 804 is used to process the plurality of parallel oral image data through the heterogeneous programmable logic chip and obtain target image data, wherein the target image data is image data in a preset picture format; and

[0148] The sending module 806 is used to send the target image data to the server through the heterogeneous programmable logic chip.

[0149] In an exemplary embodiment, the heterogeneous programmable logic chip includes a central processing unit; the oral scanner also includes a light source unit. The acquisition module 800 is further used to: send a light source control signal to the light source unit through the central processing unit; receive the light source control signal through the light source unit, and generate a target light source according to the light source control signal, wherein the target light source is used to illuminate the oral cavity of the target user to scan the oral cavity of the target user; acquire reflected light information through the image data acquisition unit, wherein the reflected light information is light information reflected after the target light source contacts the tissue in the oral cavity of the target user; and convert the reflected light information into the plurality of oral image data through the image data acquisition unit.

[0150] In an exemplary embodiment, the image data acquisition unit includes at least two image sensors. The sending module 806 is further configured to: receive a synchronous exposure signal sent by the heterogeneous programmable logic chip through the at least two image sensors; and synchronously send the plurality of oral image data to the heterogeneous programmable logic chip according to the synchronous exposure signal.

[0151] In an exemplary embodiment, the heterogeneous programmable logic chip further includes a programmable logic array; the programmable logic array includes a serial data parsing circuit, a parallel data parsing circuit, an output buffer circuit and an alignment circuit; the multiple oral image data are serial oral image data; the parallel oral image data are pixel data that meet a preset parallel format. The parsing module 802 is also used to: convert the serial oral image data into multiple parallel data through the serial data parsing circuit; arrange and combine the multiple parallel data according to the preset parallel format through the parallel data parsing circuit, and obtain multiple original parallel oral image data; cache the multiple original parallel oral image data through the output buffer circuit; detect the lead-lag relationship between the cached multiple original parallel oral image data through the alignment circuit, and determine the field signal, line signal and pixel data of the most lagging original parallel oral image data as the alignment reference signal according to the lead-lag relationship; and align the field signal, line signal and pixel data of the remaining original parallel oral image data with the alignment reference signal through the alignment circuit, and output the multiple parallel oral image data.

[0152] In an exemplary embodiment, the image data processing system further includes a configuration module (not identified), the configuration module being configured to: receive a configuration signal sent by the central processor through each image sensor respectively; and configure an output row start address of the corresponding image sensor according to each configuration signal.

[0153] Embodiment 3

[0154] See also Figure 2 , schematically shows a hardware structure diagram of an oral scanner according to an embodiment of the present invention. Figure 3 , schematically shows a hardware circuit block diagram of an oral scanner according to an embodiment of the present invention.

[0155] like Figure 2 and Figure 3 As shown, the oral scanner comprises: an image data acquisition unit, a heterogeneous programmable logic chip and a light source unit, wherein:

[0156] The image data acquisition unit is used to acquire oral image data of the user;

[0157] The image data acquisition unit is electrically connected to the heterogeneous programmable logic chip; the heterogeneous programmable logic chip is used to process the oral image data sent by the image data acquisition unit;

[0158] The heterogeneous programmable logic chip is electrically connected to and controls the light source unit, so that the light source unit generates and outputs a target light source.

[0159] See also Figure 3 The heterogeneous programmable logic chip includes a central processing unit, a programmable logic array, a bus interconnection controller, a serial bus controller and a memory controller; the bus interconnection controller is electrically connected to the central processing unit, the programmable logic array, the serial bus controller and the memory controller respectively.

[0160] Embodiment 4

[0161] See also Fig. 9 , is a schematic diagram of the hardware architecture of a computer device 10000 suitable for implementing the image data processing method according to the fourth embodiment of the present invention. In this embodiment, the computer device 10000 is a device that can automatically perform numerical calculations and / or information processing according to pre-set or stored instructions. The computer device 10000 can be a smart phone, a tablet computer, a laptop computer, a desktop computer, a rack server, a blade server, a tower server or a cabinet server (including an independent server, or a server cluster composed of multiple servers), a gateway, etc. Fig. 9 As shown, the computer device 10000 at least includes, but is not limited to, a memory 10010, a processor 10020, and a network interface 10030 that can be interconnected and communicated via a system bus. Among them:

[0162] In this embodiment, the memory 10010 includes at least one type of computer-readable storage medium, and the readable storage medium includes a flash memory, a hard disk, a multimedia card, a card-type memory (e.g., an SD or DX memory, etc.), a random access memory (RAM), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, an optical disk, etc. In some embodiments, the memory 10010 may be an internal storage unit of the computer device 10000, such as a hard disk or a memory of the computer device 10000. In other embodiments, the memory 10010 may also be an external storage device of the computer device 10000, such as a plug-in hard disk equipped on the computer device 10000, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. Of course, the memory 10010 may also include both the internal storage unit of the computer device 10000 and its external storage device. In this embodiment, the memory 10010 is generally used to store the operating system and various application software installed in the computer device 10000, such as the program code of the image data processing system in the above embodiment. In addition, the memory 10010 can also be used to temporarily store various data that have been output or will be output.

[0163] In some embodiments, the processor 10020 may be a central processing unit (CPU), a controller, a microcontroller, a microprocessor, or other data processing chips. The processor 10020 is generally used to control the overall operation of the computer device 10000, such as performing control and processing related to data interaction or communication with the computer device 10000. In this embodiment, the processor 10020 is used to run the program code stored in the memory 10010 or process data, such as running the image data processing system to implement the image data processing method of the above embodiment.

[0164] The network interface 10030 may include a wireless network interface or a wired network interface, and the network interface 10030 is generally used to establish a communication connection between the computer device 10000 and other electronic devices. For example, the network interface 10030 is used to connect the computer device 10000 to an external terminal through a network, and to establish a data transmission channel and a communication connection between the computer device 10000 and the external terminal. The network may be a wireless or wired network such as an intranet, the Internet, the Global System of Mobilecommunication (GSM), Wideband Code Division Multiple Access (WCDMA), 4G network, 5G network, Bluetooth, Wi-Fi, etc.

[0165] It should be pointed out that Fig. 9 Only computer device 10000 having components 10010 - 10030 is shown, but it should be understood that implementation of all of the components shown is not a requirement, and more or fewer components may be implemented instead.

[0166] In this embodiment, the image data processing system stored in the memory 10010 can also be divided into one or more program modules, and the one or more program modules are stored in the memory 10010 and executed by one or more processors (processor 10020 in this embodiment) to complete the present invention.

[0167] For example, Figure 8 The schematic diagram of the program module for implementing the second embodiment of the image data processing system is shown. In this embodiment, the image data processing system can be divided into an acquisition module 800, an analysis module 802, a processing module 804 and a sending module 806. The program module referred to in the present invention refers to a series of computer program instruction segments that can complete specific functions, which is more suitable for describing the execution process of the image data processing system in the computer device 10000 than a program. The specific functions of the program modules 800-806 have been described in detail in the second embodiment and will not be repeated here.

[0168] Embodiment 5

[0169] This embodiment further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by at least one processor, the steps of the image data processing method in the embodiment are implemented.

[0170] In this embodiment, the computer-readable storage medium includes flash memory, hard disk, multimedia card, card-type memory (for example, SD or DX memory, etc.), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, disk, CD, server, App application store, etc. In some embodiments, the computer-readable storage medium can be an internal storage unit of a computer device, such as a hard disk or memory of the computer device. In other embodiments, the computer-readable storage medium can also be an external storage device of a computer device, such as a plug-in hard disk equipped on the computer device, a smart memory card (Smart Media Card, referred to as SMC), a secure digital (Secure Digital, referred to as SD) card, a flash card (Flash Card), etc. Of course, the computer-readable storage medium can also include both the internal storage unit of the computer device and its external storage device. In this embodiment, the computer-readable storage medium is generally used to store the operating system and various application software installed on the computer device, such as the program code of the jam detection method in the embodiment. In addition, the computer-readable storage medium can also be used to temporarily store various types of data that have been output or are to be output.

[0171] Obviously, those skilled in the art should understand that the modules or steps of the above-mentioned embodiments of the present invention can be implemented by a general computing device, they can be concentrated on a single computing device, or distributed on a network composed of multiple computing devices, and optionally, they can be implemented by a program code executable by a computing device, so that they can be stored in a storage device and executed by the computing device, and in some cases, the steps shown or described can be executed in a different order from that here, or they can be made into individual integrated circuit modules, or multiple modules or steps therein can be made into a single integrated circuit module for implementation. In this way, the embodiments of the present invention are not limited to any specific combination of hardware and software.

[0172] The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.

[0173] The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. A method for processing image data, characterized in that: Applied to an oral scanner, the oral scanner has an image data acquisition unit, a heterogeneous programmable logic chip and a light source unit built in, the heterogeneous programmable logic chip is electrically connected to and controls the light source unit so that the light source unit generates and outputs a target light source; the method comprises: Collecting a plurality of oral cavity image data by the image data acquisition unit, and sending the plurality of oral cavity image data; Receiving the plurality of oral image data through the heterogeneous programmable logic chip, parsing the plurality of oral image data, and obtaining a plurality of parallel oral image data; The heterogeneous programmable logic chip further includes a programmable logic array; the programmable logic array includes a serial data parsing circuit, a parallel data parsing circuit, an output buffer circuit and an alignment circuit, and the alignment circuit includes a dual-path image data alignment circuit; the multiple oral image data are serial oral image data; the parallel oral image data are pixel data that meet a preset parallel format; The receiving the plurality of oral image data through the heterogeneous programmable logic chip, parsing the plurality of oral image data, and obtaining a plurality of parallel oral image data, comprises: Converting the serial oral image data into a plurality of parallel data by the serial data analysis circuit; Arranging and combining the plurality of parallel data according to the preset parallel format through the parallel data analysis circuit, and obtaining a plurality of original parallel oral image data; Cache the plurality of original parallel oral image data by the output cache circuit; Detecting the lead-lag relationship between the plurality of cached original parallel oral image data through the alignment circuit, and determining the field signal, line signal and pixel data of the most lagging original parallel oral image data as the alignment reference signal according to the lead-lag relationship; and The alignment circuit aligns the field signals, line signals and pixel data of the remaining original parallel oral image data with the alignment reference signal, and outputs the plurality of parallel oral image data; Processing the plurality of parallel oral image data through the heterogeneous programmable logic chip to obtain target image data, wherein the target image data is image data in a preset picture format; and The target image data is sent to a server through the heterogeneous programmable logic chip.

2. The image data processing method according to claim 1, characterized in that: The heterogeneous programmable logic chip includes a central processing unit; the oral scanner also includes a light source unit; the collecting of a plurality of oral image data by the image data collecting unit includes: Sending a light source control signal to the light source unit via the central processor; Receiving the light source control signal through the light source unit, and generating a target light source according to the light source control signal, wherein the target light source is used to illuminate the oral cavity of a target user to scan the oral cavity of the target user; Collecting reflected light information through the image data acquisition unit, wherein the reflected light information is light information reflected after the target light source contacts tissue in the oral cavity of the target user; and The reflected light information is converted into the plurality of oral image data by the image data acquisition unit.

3. The image data processing method according to claim 2, characterized in that: The image data acquisition unit includes at least two image sensors; The sending the target image data to the server through the heterogeneous programmable logic chip also includes: Receiving a synchronous exposure signal sent by the heterogeneous programmable logic chip through the at least two image sensors; and The plurality of oral image data are synchronously sent to the heterogeneous programmable logic chip according to the synchronous exposure signal.

4. The image data processing method according to claim 3, characterized in that: The method further comprises: Receiving a configuration signal sent by the central processor through each image sensor; and The output row start address of the corresponding image sensor is configured according to each configuration signal.

5. An image data processing system, characterized in that: Applied to an oral scanner, the oral scanner is equipped with an image data acquisition unit, a heterogeneous programmable logic chip and a light source unit, the heterogeneous programmable logic chip is used to process image data, the heterogeneous programmable logic chip is electrically connected to and controls the light source unit, so that the light source unit generates and outputs a target light source; the system includes: An acquisition module, used for acquiring a plurality of oral cavity image data through the image data acquisition unit, and sending the plurality of oral cavity image data; A parsing module, used for receiving the plurality of oral image data through the heterogeneous programmable logic chip, parsing the plurality of oral image data, and obtaining a plurality of parallel oral image data; The heterogeneous programmable logic chip further includes a programmable logic array; the programmable logic array includes a serial data parsing circuit, a parallel data parsing circuit, an output buffer circuit and an alignment circuit, and the alignment circuit includes a dual-path image data alignment circuit; the multiple oral image data are serial oral image data; the parallel oral image data are pixel data that meet a preset parallel format; The receiving the plurality of oral image data through the heterogeneous programmable logic chip, parsing the plurality of oral image data, and obtaining a plurality of parallel oral image data, comprises: Converting the serial oral image data into a plurality of parallel data by the serial data analysis circuit; Arranging and combining the plurality of parallel data according to the preset parallel format through the parallel data analysis circuit, and obtaining a plurality of original parallel oral image data; Cache the plurality of original parallel oral image data by the output cache circuit; Detecting the lead-lag relationship between the plurality of cached original parallel oral image data through the alignment circuit, and determining the field signal, line signal and pixel data of the most lagging original parallel oral image data as the alignment reference signal according to the lead-lag relationship; and The alignment circuit aligns the field signals, line signals and pixel data of the remaining original parallel oral image data with the alignment reference signal, and outputs the plurality of parallel oral image data; a processing module, configured to process the plurality of parallel oral image data through the heterogeneous programmable logic chip and obtain target image data, wherein the target image data is image data in a preset picture format; and A sending module is used to send the target image data to a server through the heterogeneous programmable logic chip.

6. An oral scanner, characterized in that: include: Image data acquisition unit, heterogeneous programmable logic chip and light source unit, wherein: The image data acquisition unit is used to acquire oral image data of the user; The image data acquisition unit is electrically connected to the heterogeneous programmable logic chip; the heterogeneous programmable logic chip is used to process the oral image data sent by the image data acquisition unit; The heterogeneous programmable logic chip further includes a programmable logic array; the programmable logic array includes a serial data parsing circuit, a parallel data parsing circuit, an output buffer circuit and an alignment circuit, and the alignment circuit includes a dual-path image data alignment circuit; the plurality of oral image data are serial oral image data; the parallel oral image data are pixel data that meet a preset parallel format; Receiving the plurality of oral image data through the heterogeneous programmable logic chip, parsing the plurality of oral image data, and obtaining a plurality of parallel oral image data, including: Converting the serial oral image data into a plurality of parallel data by the serial data analysis circuit; Arranging and combining the plurality of parallel data according to the preset parallel format through the parallel data analysis circuit, and obtaining a plurality of original parallel oral image data; Cache the plurality of original parallel oral image data by the output cache circuit; Detecting the lead-lag relationship between the plurality of cached original parallel oral image data through the alignment circuit, and determining the field signal, line signal and pixel data of the most lagging original parallel oral image data as the alignment reference signal according to the lead-lag relationship; and The alignment circuit aligns the field signals, line signals and pixel data of the remaining original parallel oral image data with the alignment reference signal, and outputs the plurality of parallel oral image data; The heterogeneous programmable logic chip is electrically connected to and controls the light source unit, so that the light source unit generates and outputs a target light source.

7. The oral scanner according to claim 6, characterized in that: The heterogeneous programmable logic chip includes a central processing unit, a programmable logic array, a bus interconnection controller, a serial bus controller and a memory controller; the bus interconnection controller is electrically connected to the central processing unit, the programmable logic array, the serial bus controller and the memory controller respectively.

8. A computer device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the computer program, the steps of the image data processing method according to any one of claims 1 to 4 are implemented.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and the computer program can be executed by at least one processor to enable the at least one processor to perform the steps of the image data processing method according to any one of claims 1 to 4.

Images