Method and system for processing shooting data of spectrum camera based on multiple MEMS chips and medium

Abstract

The invention discloses a spectral camera shooting data processing method and system based on multiple MEMS chips and a medium, and can be applied to the technical field of spectral data processing. According to the method and the device, the current working mode of the plurality of MEMS chip spectrum cameras is controlled according to the photographing trigger instruction, so that the plurality of MEMS chip spectrum cameras execute the photographing process in the current working mode and perform primary processing on the first spectrum image data in the photographing process; then, after multiple pieces of first spectral image data uploaded by MEMS chip spectral cameras are received, all the first spectral image data are preprocessed to obtain second spectral image data, so that different shooting requirements can be met by controlling the working modes of multiple MEMS chip spectral cameras; spectral image data of multiple wavebands can be obtained without repeatedly executing switching operation, so that the shooting workload and the shooting time consumption are effectively reduced; meanwhile, shooting time data of each wave band can be obtained through analysis.

Description

Technical Field

[0001] The present application relates to the technical field of spectral data processing, and in particular to a method and system and medium for processing data captured by a multi-MEMS chip spectral camera. Background Art

[0002] In the related art, near-infrared spectrum curve inspection is a non-invasive detection technology for the composition and characteristics of detergents. This detection technology uses the light absorption and scattering characteristics of the near-infrared spectrum region to obtain information about the spectral characteristics in the sample. At present, when shooting multiple infrared bands through MEMS (microcontroller), there is only a fixed serial working mode, which cannot meet various shooting needs. And this fixed serial working mode requires repeated execution of the process of switching MEMS → exposure → shooting. When the number of bands to be acquired is large, the shooting workload is large and time-consuming, and the shooting time data of each band cannot be obtained.

[0003] In summary, the technical problems existing in the relevant technologies need to be improved. Summary of the invention

[0004] The main purpose of the embodiments of the present application is to propose a method, system and medium for processing shooting data based on a multi-MEMS chip spectral camera, which can effectively reduce the shooting workload and time consumption, and at the same time can timely obtain the shooting time data of each band.

[0005] To achieve the above purpose, one aspect of an embodiment of the present application proposes a method for processing data captured by a multi-MEMS chip spectral camera, the method comprising the following steps:

[0006] In response to a photographing trigger instruction, controlling the current working mode of the plurality of MEMS chip spectral cameras according to the photographing trigger instruction, so that the plurality of MEMS chip spectral cameras execute a photographing process in the current working mode and preliminarily process the first spectral image data in the photographing process;

[0007] Receiving a plurality of first spectral image data uploaded by the MEMS chip spectral camera;

[0008] Preprocessing all the first spectral image data to obtain second spectral image data;

[0009] The shooting time data of the second spectral image data is analyzed to obtain a shooting time consumption report.

[0010] In some embodiments, controlling the current working mode of the plurality of MEMS chip spectral cameras according to the photographing trigger instruction includes:

[0011] Determining target operating modes of the plurality of MEMS chip spectral cameras from the selectable operating modes according to the photographing trigger instruction;

[0012] Acquire the exposure band of each MEMS chip spectral camera in the target working mode;

[0013] The target operating mode and the exposure band are used as the target operating mode of the MEMS chip spectral camera.

[0014] In some embodiments, the method of causing the plurality of MEMS chip spectral cameras to perform a photographing process in the current working mode includes:

[0015] When the target working mode is a serial working mode, each of the MEMS chip spectral cameras is controlled to sequentially execute the photographing process corresponding to the exposure band;

[0016] When the target working mode is a parallel working mode, all the MEMS chip spectral cameras are controlled to synchronously execute the photographing process corresponding to the exposure band.

[0017] In some embodiments, the preliminary processing of the first spectral image data in the photographing process includes:

[0018] Acquire first spectral image data in a photographing process and identification information and a real-time exposure wavelength corresponding to the first spectral image data;

[0019] The identification information and the real-time exposure wavelength are written into an image header of the first spectral image data.

[0020] In some embodiments, the receiving of the plurality of first spectral image data uploaded by the MEMS chip spectral camera includes:

[0021] Receive the plurality of first spectral image data uploaded by the MEMS chip spectral camera through a preset transmission protocol.

[0022] In some embodiments, the preprocessing of all the first spectral image data to obtain the second spectral image data includes:

[0023] sorting the first spectral image data to obtain third spectral image data;

[0024] The third spectral image data are grouped and stored in different files to obtain the second spectral image data.

[0025] In some embodiments, the performing shooting time data analysis on the second spectral image data to obtain a shooting time report includes:

[0026] Analyze the total time consumed for shooting the second spectral image data corresponding to multiple real-time exposure wavelengths at different frame rates;

[0027] The shooting time consumption report is generated according to the total shooting time consumption corresponding to different frame rates.

[0028] To achieve the above-mentioned purpose, another aspect of the embodiment of the present application provides a data processing system based on a multi-MEMS chip spectral camera, the system comprising:

[0029] The first module is used to respond to a photographing trigger instruction and control the current working mode of the plurality of MEMS chip spectral cameras according to the photographing trigger instruction, so that the plurality of MEMS chip spectral cameras execute a photographing process in the current working mode and preliminarily process the first spectral image data in the photographing process;

[0030] The second module is used to receive the plurality of first spectral image data uploaded by the MEMS chip spectral camera;

[0031] A third module is used to preprocess all the first spectral image data to obtain second spectral image data;

[0032] The fourth module is used to analyze the shooting time data of the second spectral image data to obtain a shooting time report.

[0033] To achieve the above-mentioned purpose, another aspect of the embodiment of the present application proposes a data processing system based on a multi-MEMS chip spectral camera, comprising:

[0034] at least one processor;

[0035] at least one memory for storing at least one program;

[0036] When the at least one program is executed by the at least one processor, the at least one processor implements the above method.

[0037] To achieve the above objective, another aspect of an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and the computer program implements the above method when executed by a processor.

[0038] The embodiments of the present application include at least the following beneficial effects: the present application provides a method, system and medium for processing shooting data based on multiple MEMS chip spectral cameras. The scheme controls the current working mode of multiple MEMS chip spectral cameras according to the shooting trigger instruction after responding to the shooting trigger instruction, so that the multiple MEMS chip spectral cameras execute the shooting process in the current working mode and preliminarily process the first spectral image data in the shooting process, and then after receiving multiple first spectral image data uploaded by the MEMS chip spectral camera, all the first spectral image data are pre-processed to obtain the second spectral image data, so that different shooting requirements can be met by controlling the working modes of multiple MEMS chip spectral cameras, and spectral image data of multiple bands can be obtained without repeatedly performing switching operations, thereby effectively reducing the shooting workload and shooting time; at the same time, the present application can also perform shooting time data analysis based on the second spectral image data to obtain a shooting time report, so that the shooting time data of each band can be obtained in time. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] Figure 1 It is a flow chart of a method for processing data captured by a multi-MEMS chip spectral camera provided in an embodiment of the present application;

[0040] Figure 2 It is a processing flow chart of MEMS chip spectral camera shooting in the prior art;

[0041] Figure 3 is a top view of a MEMS chip spectral camera provided in an embodiment of the present application;

[0042] Figure 4 is a side view of a MEMS chip spectral camera provided in an embodiment of the present application;

[0043] Figure 5 This is a schematic diagram of a first operation interface of a multi-MEMS chip spectral camera driving voltage calibration system provided in an embodiment of the present application;

[0044] Figure 6 This is a schematic diagram of a second operation interface of a multi-MEMS chip spectral camera driving voltage calibration system provided in an embodiment of the present application;

[0045] Figure 7 is a flow chart of sorting hyperspectral image data provided by an embodiment of the present application;

[0046] Figure 8 It is a module schematic diagram of a data processing system based on a multi-MEMS chip spectral camera provided in an embodiment of the present application;

[0047] Fig. 9It is a schematic diagram of the hardware structure of a data processing system based on a multi-MEMS chip spectral camera provided in an embodiment of the present application. DETAILED DESCRIPTION

[0048] In order to make the purpose, technical solutions and advantages of the present application clearer, the present application is further described in detail below in conjunction with the accompanying drawings and examples. It should be understood that the specific embodiments described herein are only used to explain the present application and are not intended to limit the present application. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the embodiments of the present application, they are only examples of systems and methods consistent with some aspects of the embodiments of the present application.

[0049] It is understood that the terms "first", "second", etc. used in this application can be used to describe various concepts in this article, but unless otherwise specified, these concepts are not limited by these terms. These terms are only used to distinguish one concept from another concept. For example, without departing from the scope of the embodiment of the present application, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the words "if" and "if" as used herein can be interpreted as "at the time of" or "when" or "in response to determination".

[0050] The terms "at least one", "multiple", "each", "any", etc. used in this application, at least one includes one, two or more, multiple includes two or more, each refers to each of the corresponding multiple, and any refers to any one of the multiple.

[0051] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein are only for the purpose of describing the embodiments of this application and are not intended to limit this application.

[0052] Before describing the embodiments of the present application in detail, some nouns and terms involved in the embodiments of the present application are first described. The nouns and terms involved in the embodiments of the present application are subject to the following interpretations:

[0053] UVC: The full name is USB video class or USB video device class, which is a protocol standard defined for USB video capture devices. Webcams are the first and most common UVC devices. Benefits of using UVC: After USB video becomes a standard, hardware can run more smoothly between programs, and the driver installation process is omitted.

[0054] ENVI (The Environment for Visualizing Images) is a powerful remote sensing image processing platform. ENVI provides a comprehensive image processing solution, including image data input / output, calibration, enhancement, correction, orthorectification, mosaicking, data fusion, transformation, information extraction, image classification, integration with GIS, DEM and terrain information extraction, radar data processing, and 3D stereo display analysis. HDR (High Dynamic Range) is an image file format used to store image data with a high dynamic range. HDR images can capture a wider range of brightness and color information than traditional image formats (such as JPEG or PNG), providing more realistic visual effects. HDR files are usually synthesized from multiple LDR (Low-Dynamic Range) images with different exposure levels to reflect the lighting and reflection effects in the real environment.

[0055] RAW is an image file format used to store unprocessed or uncompressed image data. RAW files contain the original image data captured by the camera sensor, including information such as color, brightness, and details, without any compression or processing. In addition to image data, RAW files also record the camera settings at the time of shooting, such as ISO, shutter speed, aperture value, and white balance.

[0056] In the related art, near infrared spectrum curve inspection is a non-invasive detection technology for the composition and characteristics of detergents. This detection technology uses the light absorption and scattering characteristics of the near infrared spectrum region to obtain information about the spectral characteristics in the sample. Figure 2 As shown, when shooting multiple infrared bands through MEMS (microcontroller), it is necessary to repeat the process of switching MEMS → exposure → shooting. When there are many bands to be acquired, the shooting workload is large and time-consuming, and it is impossible to obtain the shooting time data of each band.

[0057] In view of this, a method, system and medium for processing shooting data based on multiple MEMS chip spectral cameras are provided in the embodiments of the present application. After responding to a shooting trigger instruction, the present application controls the current working mode of multiple MEMS chip spectral cameras according to the shooting trigger instruction, so that the multiple MEMS chip spectral cameras execute the shooting process in the current working mode and preliminarily process the first spectral image data in the shooting process, and then after receiving multiple first spectral image data uploaded by the MEMS chip spectral camera, all the first spectral image data are pre-processed to obtain second spectral image data, so that different shooting requirements can be met by controlling the working modes of multiple MEMS chip spectral cameras, and spectral image data of multiple bands can be obtained without repeatedly performing switching operations, thereby effectively reducing the shooting workload and shooting time. At the same time, the present application can also perform shooting time data analysis based on the second spectral image data to obtain a shooting time report, so that the shooting time data of each band can be obtained in time.

[0058] The data processing method based on multi-MEMS chip spectral camera provided in the embodiment of the present application relates to the field of spectral data processing technology. The data processing method based on multi-MEMS chip spectral camera provided in the embodiment of the present application can be applied to a terminal, can also be applied to a server, and can also be software running in a terminal or a server. In some embodiments, the terminal can be a smart phone, a tablet computer, a laptop computer, a desktop computer, a smart speaker, a smart watch, and a car terminal, etc., but is not limited to this; the server side can be configured as an independent physical server, or it can be configured as a server cluster or distributed system composed of multiple physical servers, and can also be configured as a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms. The server can also be a node server in a blockchain network; the software can be an application that implements the data processing method based on multi-MEMS chip spectral camera shooting, etc., but is not limited to the above forms.

[0059] The present application can be used in many general or special computer system environments or configurations. For example: personal computers, server computers, handheld or portable devices, tablet devices, multiprocessor systems, microprocessor-based systems, set-top boxes, programmable consumer electronics, network PCs, minicomputers, mainframe computers, distributed computing environments including any of the above systems or devices, etc. The present application can be described in the general context of computer-executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform specific tasks or implement specific abstract data types. The present application can also be practiced in distributed computing environments, in which tasks are performed by remote processing devices connected through a communication network. In a distributed computing environment, program modules can be located in local and remote computer storage media including storage devices.

[0060] Figure 1 is an optional flow chart of a method for processing data captured by a multi-MEMS chip spectral camera provided in an embodiment of the present application. Figure 1 The method may include but is not limited to steps S110 to S140:

[0061] Step S110, in response to a photographing trigger instruction, controlling the current working mode of the plurality of MEMS chip spectral cameras according to the photographing trigger instruction, so that the plurality of MEMS chip spectral cameras execute a photographing process in the current working mode and preliminarily process the first spectral image data in the photographing process;

[0062] Step S120, receiving a plurality of first spectral image data uploaded by the MEMS chip spectral camera;

[0063] Step S130, preprocessing all first spectral image data to obtain second spectral image data;

[0064] Step S140: Analyze the shooting time data of the second spectral image data to obtain a shooting time consumption report.

[0065] It is understandable that if Figure 3 and Figure 4As shown, the MEMS chip spectral camera of the embodiment of the present application includes a camera module 430, an I / O board 410 and a CPU board 420, and the camera module 430 includes two hyperspectral cameras and an RGB camera 433. Among them, the hyperspectral camera includes a near-infrared spectrum (NIR) camera 431 and a visible spectrum (VIS) camera 432. Specifically, the hyperspectral camera supports tunable spectral imaging output in the 500nm-920nm band, and the RGB camera supports the output of 1920*1080RGB images. The two hyperspectral cameras can be used to collect hyperspectral image data in the bands of 500nn-700nn and 700nn-920nn, respectively.

[0066] In an embodiment of the present application, after the MEMS chip spectral camera is connected to the control device and the multi-MEMS chip spectral camera driving voltage calibration system on the control device is started, the working state of the MEMS chip spectral camera can be controlled by the system and the hyperspectral image data collected by the camera can be processed.

[0067] It is understandable that if Figure 5 As shown, the operation interface of the multi-MEMS chip spectral camera drive voltage calibration system includes a menu bar 501, a general configuration bar 502, a whole machine status bar 503, a task bar 504, a calibration history bar 505, a task control bar 506 and a status bar 507. Among them, the menu bar includes controls such as file, setting and help. The file control is used to import new configurations and exit the software, the setting control is used to set the mode and chip parameter settings, etc., and the help control is used to display the help document. The general configuration bar is used to read and set the camera number, chip number and operator. The whole machine status bar is used to read the multi-spectral camera connection status, temperature and host CPU, content usage, firmware version and SDK version number, etc. The task bar is used to display the currently executed task and task status, and the adjustment line task can be modified and added by importing, deleting, up, down, etc. The calibration history bar is used to display the log and photo history during the calibration process. The task control bar is used to import new tasks, delete selected tasks, increase the priority of the current task upward, and reduce the priority of the current task downward. The status bar is used to display the current mode, configuration items and generation mode.

[0068] In the embodiment of the present application, when Figure 5 After the operation configuration is completed in the operation interface shown, the multi-MEMS chip spectral camera driving voltage calibration system can trigger a photo trigger instruction, and then control the current working mode of multiple MEMS chip spectral cameras according to the photo trigger instruction, so that multiple MEMS chip spectral cameras execute the photo process in the current working mode and perform preliminary processing on the first spectral image data in the photo process.

[0069] It can be understood that the process of controlling the current working mode of multiple MEMS chip spectral cameras according to the photo trigger instruction includes but is not limited to steps S210 to S230:

[0070] Step S210, determining a target operating mode of a plurality of MEMS chip spectral cameras from the selectable operating modes according to a photographing trigger instruction;

[0071] Step S220, obtaining the exposure band of each MEMS chip spectral camera in the target working mode;

[0072] Step S230: Using the target working mode and exposure band as the target working mode of the MEMS chip spectral camera.

[0073] Specifically, the working modes to be selected include parallel working mode and serial working mode. Multiple MEMS chip spectral cameras in parallel working mode can execute the shooting process synchronously; multiple MEMS chip spectral cameras in serial working mode execute the shooting process sequentially. It can be understood that multiple MEMS chip spectral cameras in this embodiment can respectively execute spectral image data acquisition of different exposure bands. The target working mode and exposure band are used as the target working mode of the MEMS chip spectral camera, so that the shooting process with different requirements can be realized.

[0074] In the embodiments of the present application, Figure 6 As shown, when the operator clicks the serial photography control 610 in the operation interface, the photography trigger instruction triggered by the serial photography control 601 can determine that the target working mode is the serial working mode, and then control each MEMS chip spectral camera to sequentially execute the photography process of the corresponding exposure band; when the operator clicks the parallel photography control 602 in the operation interface, the photography trigger instruction triggered by the parallel photography control 602 can determine that the target working mode is the parallel working mode, and then control all MEMS chip spectral cameras to synchronously execute the photography process of the corresponding exposure band. Through the operation process of this embodiment, all MEMS chip spectral cameras can be controlled to perform different shooting functions, so that the captured hyperspectral image data meets the actual scene requirements of the user.

[0075] It is understandable that when the MEMS chip spectral camera is shooting hyperspectral image data, this embodiment needs to perform preliminary processing on the first spectral image data in the shooting process. Specifically, this embodiment can obtain the first spectral image data in the shooting process and the identification information and real-time exposure wavelength corresponding to the first spectral image data, and then write the identification information and the real-time exposure wavelength into the image header of the first spectral image data. Specifically, the information table of the spectral image header is shown in Table 1:

[0076] Table 1

[0077]

[0078]

[0079] It can be understood that after the MEMS chip spectral camera of this embodiment completes writing the header information of each hyperspectral image data, the corresponding data can be uploaded to the control end corresponding to the multi-MEMS chip spectral camera driving voltage calibration system through a preset transmission protocol, wherein the preset transmission protocol includes but is not limited to the UVC protocol.

[0080] It is understandable that, after obtaining the first spectral image data after inserting the header data, the present embodiment preprocesses all the first spectral image data. Specifically, the present embodiment can obtain the third spectral image data by sorting the first spectral image data, and then group the third spectral image data and store them in different files to obtain the second spectral image data. For example, Figure 7 As shown, after receiving the image sent by the MEMS chip spectral camera, this embodiment sorts the images based on the real-time exposure wavelength during shooting. For example, the sorting result for images with an exposure band between 510nn-530nn is 510nn, blank frame, 530nn. Since 520nn is not imaged, it can be replaced by a blank frame. For another example, the sorting result for images with an exposure band between 710nn-730nn is 710nn, blank frame, 730nn. After completing the sorting, this embodiment can group the hyperspectral image data based on the exposure band. At the same time, this embodiment can also write the obtained hyperspectral image data into ENVI HDR and RAW files based on the grouping results to facilitate the subsequent processing of the hyperspectral image data.

[0081] It can be understood that, after obtaining the hyperspectral image data (second spectral image data) processed in groups, this embodiment can generate a shooting time report according to the total shooting time corresponding to different frame rates by analyzing the total shooting time of multiple real-time exposure wavelengths corresponding to the second spectral image data at different frame rates. Exemplarily, taking the shooting frame rate range between 10-120 as an example, the time consumption of the relevant processes of serial shooting and parallel shooting is analyzed, and then the shooting time reports corresponding to serial shooting and parallel shooting are generated respectively. Specifically, the shooting time report includes but is not limited to the shooting frame rate, total time consumption, number of bands (real-time exposure wavelength), total time report preparation time, total time of the shooting thread, single image shooting time report in the firmware (camera), MEMS voltage sending time, ACDT waiting time (waiting for stabilization time after sending MEMS voltage), image acquisition time from CMOS, image acquisition time, image header information filling time and resource release time. Among them, the shooting time report for serial shooting is shown in Table 2, and the shooting time report for parallel shooting is shown in Table 3:

[0082] Table 2

[0083]

[0084] Table 3

[0085]

[0086] It can be seen from Table 2 and Table 3 that, from the comparison of shooting at a frame rate of 120, the total shooting time is reduced from 812ms for serial shooting to 462ms for parallel shooting, which is nearly doubled. It can be seen that the present application can provide corresponding working modes for different working scenarios by setting the shooting mode selection.

[0087] Reference Figure 8 The embodiment of the present application provides a data processing system based on a multi-MEMS chip spectral camera, the system comprising:

[0088] The first module 810 is used to respond to a photographing trigger instruction and control the current working mode of the multiple MEMS chip spectral cameras according to the photographing trigger instruction, so that the multiple MEMS chip spectral cameras execute a photographing process in the current working mode and preliminarily process the first spectral image data in the photographing process;

[0089] The second module 820 is used to receive a plurality of first spectral image data uploaded by the MEMS chip spectral camera;

[0090] The third module 830 is used to pre-process all the first spectral image data to obtain second spectral image data;

[0091] The fourth module 840 is used to analyze the shooting time data of the second spectral image data to obtain a shooting time consumption report.

[0092] It can be understood that the contents of the above method embodiments are all applicable to the present system embodiments, the functions specifically implemented by the present system embodiments are the same as those of the above method embodiments, and the beneficial effects achieved are also the same as those achieved by the above method embodiments.

[0093] The embodiment of the present application also provides a data processing system based on multi-MEMS chip spectral camera shooting, the system includes a memory and a processor, the memory stores a computer program, and the processor implements the above method when executing the computer program. The data processing system based on multi-MEMS chip spectral camera shooting can be any intelligent terminal including a tablet computer, a car computer, etc.

[0094] It can be understood that the contents of the above method embodiments are all applicable to the present system embodiments, the functions specifically implemented by the present system embodiments are the same as those of the above method embodiments, and the beneficial effects achieved are also the same as those achieved by the above method embodiments.

[0095] See also Fig. 9 , Fig. 9 The hardware structure of another embodiment of a multi-MEMS chip spectral camera shooting data processing system is illustrated. The system includes:

[0096] The processor 910 may be implemented by a general-purpose CPU (Central Processing Unit), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of the present application;

[0097] The memory 920 can be implemented in the form of a read-only memory (ROM), a static storage device, a dynamic storage device, or a random access memory (RAM). The memory 920 can store an operating system and other application programs. When the technical solution provided in the embodiment of this specification is implemented by software or firmware, the relevant program code is stored in the memory 920, and the processor 910 calls and executes the data processing method based on the multi-MEMS chip spectral camera in the embodiment of this application;

[0098] Input / output interface 930, used to implement information input and output;

[0099] Communication interface 940, used to realize communication interaction between the device and other devices, which can be realized through wired mode (such as USB, network cable, etc.) or wireless mode (such as mobile network, WIFI, Bluetooth, etc.);

[0100] bus 950 , which transmits information between the various components of the device (e.g., processor 910 , memory 920 , input / output interface 930 , and communication interface 940 );

[0101] The processor 910 , the memory 920 , the input / output interface 930 , and the communication interface 940 are connected to each other in communication within the device via a bus 950 .

[0102] An embodiment of the present application also provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the above-mentioned method for processing data captured by a multi-MEMS chip spectral camera is implemented.

[0103] It can be understood that the contents of the above method embodiments are all applicable to the present storage medium embodiments, the functions specifically implemented by the present storage medium embodiments are the same as those of the above method embodiments, and the beneficial effects achieved are also the same as those achieved by the above method embodiments.

[0104] The memory, as a non-transient computer-readable storage medium, can be used to store non-transient software programs and non-transient computer executable programs. In addition, the memory may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some embodiments, the memory may optionally include a memory remotely disposed relative to the processor, and these remote memories may be connected to the processor via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0105] The embodiments described in the embodiments of the present application are intended to more clearly illustrate the technical solutions of the embodiments of the present application and do not constitute a limitation on the technical solutions provided in the embodiments of the present application. Those skilled in the art will appreciate that with the evolution of technology and the emergence of new application scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

[0106] Those skilled in the art will appreciate that the technical solutions shown in the figures do not constitute a limitation on the embodiments of the present application, and may include more or fewer steps than shown in the figures, or a combination of certain steps, or different steps.

[0107] The system embodiments described above are merely illustrative, and the units described as separate components may or may not be physically separated, that is, they may be located in one place or distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the present embodiment.

[0108] Those skilled in the art will appreciate that all or some of the steps in the methods disclosed above, and the functional modules / units in the systems and devices may be implemented as software, firmware, hardware, or a suitable combination thereof.

[0109] The terms "first", "second", "third", "fourth", etc. (if any) in the specification of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0110] It should be understood that in the present application, "at least one (item)" means one or more, and "plurality" means two or more. "And / or" is used to describe the association relationship of associated objects, indicating that three relationships may exist. For example, "A and / or B" can mean: only A exists, only B exists, and A and B exist at the same time, where A and B can be singular or plural. The character " / " generally indicates that the objects associated before and after are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, c can be single or multiple.

[0111] In the several embodiments provided in the present application, it should be understood that the disclosed systems and methods can be implemented in other ways. For example, the system embodiments described above are only schematic. For example, the division of the above units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of systems or units, which can be electrical, mechanical or other forms.

[0112] The units described above as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0113] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0114] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including multiple instructions to enable a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, referred to as ROM), random access memory (Random Access Memory, referred to as RAM), disk or optical disk and other media that can store programs.

[0115] The preferred embodiments of the present invention are described above with reference to the accompanying drawings, but the scope of the rights of the present invention is not limited thereto. Any modification, equivalent substitution and improvement made by a person skilled in the art without departing from the scope and essence of the present invention should be within the scope of the rights of the present invention.

Claims

1. A method for processing data captured by a multi-MEMS chip spectral camera, characterized in that: The method comprises the following steps: In response to a photographing trigger instruction, controlling the current working mode of the plurality of MEMS chip spectral cameras according to the photographing trigger instruction, so that the plurality of MEMS chip spectral cameras execute a photographing process in the current working mode and preliminarily process the first spectral image data in the photographing process; Receiving a plurality of first spectral image data uploaded by the MEMS chip spectral camera; Preprocessing all the first spectral image data to obtain second spectral image data; The shooting time data of the second spectral image data is analyzed to obtain a shooting time consumption report.

2. The method according to claim 1, characterized in that: The controlling the current working mode of the plurality of MEMS chip spectral cameras according to the photographing trigger instruction comprises: Determining target operating modes of the plurality of MEMS chip spectral cameras from the selectable operating modes according to the photographing trigger instruction; Acquire the exposure band of each MEMS chip spectral camera in the target working mode; The target operating mode and the exposure band are used as the target operating mode of the MEMS chip spectral camera.

3. The method according to claim 2, characterized in that The method of causing the plurality of MEMS chip spectral cameras to perform a photographing process in the current working mode includes: When the target working mode is a serial working mode, each of the MEMS chip spectral cameras is controlled to sequentially execute the photographing process corresponding to the exposure band; When the target working mode is a parallel working mode, all the MEMS chip spectral cameras are controlled to synchronously execute the photographing process corresponding to the exposure band.

4. The method according to claim 1, characterized in that: The preliminary processing of the first spectral image data in the photographing process includes: Acquire first spectral image data in a photographing process and identification information and a real-time exposure wavelength corresponding to the first spectral image data; The identification information and the real-time exposure wavelength are written into an image header of the first spectral image data.

5. The method according to claim 1, characterized in that The receiving the plurality of first spectral image data uploaded by the MEMS chip spectral camera includes: Receive the plurality of first spectral image data uploaded by the MEMS chip spectral camera through a preset transmission protocol.

6. The method according to claim 1, characterized in that The preprocessing of all the first spectral image data to obtain second spectral image data includes: sorting the first spectral image data to obtain third spectral image data; The third spectral image data are grouped and stored in different files to obtain the second spectral image data.

7. The method according to claim 1, characterized in that The performing shooting time data analysis on the second spectral image data to obtain a shooting time consumption report includes: Analyze the total time consumed for shooting the second spectral image data corresponding to multiple real-time exposure wavelengths at different frame rates; The shooting time consumption report is generated according to the total shooting time consumption corresponding to different frame rates.

8. A data processing system based on multi-MEMS chip spectral camera, characterized in that: The system comprises: The first module is used to respond to a photographing trigger instruction and control the current working mode of the plurality of MEMS chip spectral cameras according to the photographing trigger instruction, so that the plurality of MEMS chip spectral cameras execute a photographing process in the current working mode and preliminarily process the first spectral image data in the photographing process; The second module is used to receive the plurality of first spectral image data uploaded by the MEMS chip spectral camera; A third module is used to preprocess all the first spectral image data to obtain second spectral image data; The fourth module is used to analyze the shooting time data of the second spectral image data to obtain a shooting time report.

9. A data processing system based on multi-MEMS chip spectral camera, characterized in that: include: at least one processor; at least one memory for storing at least one program; When the at least one program is executed by the at least one processor, the at least one processor implements the method according to any one of claims 1 to 7.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.

Images