A target matching analysis system and method based on multimodal perception technology

Abstract

The present invention discloses a target matching analysis system and method based on multimodal sensing technology, which belongs to the technical field of data sensing analysis. The present invention includes: S10: determining the use time period of the target according to the real-time network data of the target when it is working; S20: analyzing the consumables consumption of the target according to the real-time working current value of each piezoelectric element in the target; S30: determining the consumables consumption of the target according to the real-time data transmission of the target when it is working; S40: matching the cause of the target's failure. The present invention determines the cause of the target's failure according to the matching degree between the cause of the target's failure and the selected cause of the failure. This process does not require manual analysis of the cause of the target's failure, which greatly shortens the maintenance time of the maintenance personnel on the target and further improves the matching analysis accuracy of the system.

Description

Technical Field

[0001] The present invention relates to the technical field of target data perception and analysis, and specifically to a target matching analysis system and method based on multimodal perception technology. Background Art

[0002] Multimodal sensing technology combines different sensor technologies, such as cameras, infrared sensors, radars, etc., to obtain diverse information about the target. By fusing and analyzing this information, more comprehensive and accurate perception results can be obtained. The key to multimodal sensing technology is the method of fusing data from different modalities.

[0003] Nowadays, when analyzing the fault conditions of targets in stores, store staff usually can only discover the target fault after the target has completely failed. When the target fails, store staff usually contact maintenance personnel to repair the target. This process wastes a lot of time, resulting in the store being unable to operate normally. When maintenance personnel perform fault analysis on the target, they usually need to disassemble the target to determine whether there is a fault inside the target. This process is relatively cumbersome. Summary of the invention

[0004] The purpose of the present invention is to provide a target matching analysis system and method based on multimodal perception technology to solve the problems raised in the above background technology.

[0005] In order to solve the above technical problems, the present invention provides the following technical solutions: a target matching analysis method based on multimodal perception technology, the method comprising:

[0006] S10: Determine the output time period of the target according to the real-time network data of the target when it is working;

[0007] S20: Analyze the consumables consumption of the target according to the real-time working current value of each piezoelectric element in the target;

[0008] S30: determining the consumption of consumables of the target according to the real-time data transmission of the target during operation;

[0009] S40: Match the target failure cause.

[0010] Furthermore, the specific method of determining the output time period of the target in S10 is:

[0011] The time point when the target receives the output file is collected, and the target output start time point is determined in combination with the target's reading and transmission time of the output file. The target's real-time network speed value is collected starting from the output start time point. If the collected real-time network speed value is ≥ the target minimum working network speed, the target can work at this time. If the collected real-time network speed value is < the target minimum working network speed, the target cannot work at this time. According to the comparison result, the target's output time period is determined.

[0012] Furthermore, the specific method of analyzing the consumption of the target consumables in S20 is:

[0013] During the output time period, the Hall sensor is used to collect the current value of the piezoelectric element corresponding to each component, with the single working time of the component as the interval time. The single consumable consumption of each component is calculated, where t=1,2,…,m, represents the number corresponding to the current collection time point, and m represents the total number of current value collections. It represents the current value collected by the Hall sensor at the collection time point numbered t. hour, , hour, , W represents the standard working current value of the piezoelectric element, A represents the consumables consumption of the component corresponding to the piezoelectric element when the current value flowing through the piezoelectric element is the standard working current value, and S represents the single consumables consumption of the component corresponding to the piezoelectric element;

[0014] according to Calculate the single consumable consumption of the target, where i=1,2,…,n, represents the number corresponding to each component, and n represents the total number of components in the target. Indicates the single consumable consumption of component numbered i at the collection time point numbered t. Indicates the single consumption of consumables in the previous interval corresponding to the collection time point numbered t.

[0015] Furthermore, the specific method of determining the target consumables consumption in S30 is:

[0016] According to the output speed set by the target, the amount of data to be output by the target in each interval time is determined. The amount of data to be output = output speed * interval time. Combined with the result of the target reading the output file, the output content of the target in each interval time is determined. Based on the determination result, the consumables consumption of the target is determined. The specific determination method is:

[0017] According to the target reading result, the font size of each output content in the output file is determined. Based on the output content of the target in each interval time, the output length value of each component in each output content is determined. Combined with the number of components set in the target and the interval distance value of the set components, when the target outputs each content, the working number of the target components is determined. The specific determination formula is:

[0018] ;

[0019] Wherein, j=1,2,…,m, represents the number corresponding to each output content, m represents the total number of components of each output content, p=1,2,…,q, represents the number corresponding to each output content in the output file, m represents the total number of output contents in the output file, It indicates the output length value corresponding to the component numbered j in the output content numbered p, and k indicates the interval distance value of the components in the target. Indicates the number of intersections in the output content numbered p. It indicates the number of components working when the target outputs the output content numbered p;

[0020] Based on the output content of the target in the previous interval corresponding to the acquisition time point numbered t, Accumulate the theoretical value of the single output of the target in the previous interval corresponding to the acquisition time point numbered t Perform calculations;

[0021] Combined with the output scanning results of the target, the actual value of the single output quantity of the target in the previous interval corresponding to the acquisition time point numbered t is Calculate and determine, , where c represents the color depth value of the output content in the output scan result, C represents the standard color depth value of the output content, a=1 or -1, when c / C≥1, a=1, when c / C<1, a=-1;

[0022] according to and The relationship between the output failure time of the target is determined. , it means that the target outputs a fault at the acquisition time point numbered t, and the target issues a warning message at this time.

[0023] Furthermore, the specific method of matching the fault cause of the target in S40 is:

[0024] During the output time period, when the target is abnormal, and The relationship between the real-time network speed value and the target minimum working network speed is used to match the target fault cause. The specific matching method is as follows:

[0025] when and , it means that the target component is faulty and needs to be replaced;

[0026] when and When , it indicates that the piezoelectric element corresponding to the component in the target is faulty;

[0027] when , it indicates a component failure in the target;

[0028] When the collected real-time network speed value is less than the target minimum working network speed value, it indicates that the target network connection is faulty;

[0029] right , , and the specific values ​​of the collected real-time network speed are obtained, a fault cause is randomly selected, the judgment condition and the number of judgment conditions J of the selected fault cause are determined, the type of the obtained specific value is determined according to the judgment condition, and it is determined whether each specific value obtained is within the corresponding value range. According to the judgment result, the matching degree between the target fault cause and the selected fault cause is determined, J, based on the determination result, determines the fault cause of the target, where u=1,2,…,v, represents the number corresponding to each judgment condition in each fault cause, and v represents the total number of judgment conditions in each fault cause. ,when When , it means that the specific value obtained is not within the corresponding value range. When , it means that the specific value obtained is within the corresponding value range. When the matching degree = 1, it means that the fault cause of the target is the selected fault cause. When the matching value ≠ 1, it means that the fault cause of the target is not the selected fault cause.

[0030] A target matching analysis system based on multimodal sensing technology, the system comprising an output time period determination module, a consumables consumption situation analysis module, a consumables consumption situation determination module and a fault matching module;

[0031] The output time period determination module determines the output time period of the target according to the real-time network data of the target when it is working;

[0032] The consumables consumption analysis module is used to analyze the consumables consumption of the target according to the real-time working current value of each piezoelectric element in the target;

[0033] The consumables consumption determination module is used to determine the consumables consumption of the target according to the real-time data transmission of the target when it is working;

[0034] The fault matching module is used to match the fault cause of the target.

[0035] Furthermore, the output time period determination module collects the time point when the target receives the output file, and determines the output start time point of the target in combination with the target's reading and transmission time of the output file, and starts collecting the real-time network speed value of the target at the output start time point, and compares the collected real-time network speed value with the target minimum working network speed. According to the comparison result, the output time period of the target is determined, and the determined output time period is transmitted to the consumables consumption analysis module, and the collected real-time network speed value and the target minimum working network speed are transmitted to the fault matching module.

[0036] Furthermore, the consumables consumption analysis module includes a single consumables consumption calculation unit and a single output calculation unit;

[0037] The single consumable consumption calculation unit receives the output time period transmitted by the output time period determination module, and within the output time period, uses the Hall sensor to collect the current value flowing through the piezoelectric element corresponding to each component with the single working time of the component as the interval time, calculates the single consumable consumption of each component according to the collected information, and transmits the calculation result to the single output calculation unit;

[0038] The single output quantity calculation unit receives the calculation result transmitted by the single consumable consumption quantity calculation unit, calculates the single output quantity of the target based on the received information, and transmits the calculation result to the fault matching module.

[0039] Further, the consumables consumption determination module includes an output content determination unit, a component work quantity determination unit, a single output quantity theoretical value determination unit and a single output quantity actual value calculation unit;

[0040] The output content determination unit determines the amount of data to be output by the target in each time interval according to the output speed set by the target, determines the output content of the target in each time interval in combination with the result of the target reading the output file, and transmits the determination result to the component quantity determination unit and the single output quantity theoretical value determination unit;

[0041] The component quantity determination unit receives the determination result transmitted by the output content determination unit, determines the font size of each output content in the output file according to the target reading result, determines the output length value of each stroke in each output content based on the received information, and determines the component working quantity of the target when the target outputs each content in combination with the number of black components set in the target and the interval distance value of the set black components, and transmits the determination result to the single output quantity theoretical value determination unit;

[0042] The single output theoretical value determination unit receives the determination result transmitted by the component quantity determination unit and the determination result transmitted by the output content determination unit, determines the single output theoretical value of the target in each interval time based on the received information, and transmits the determination result to the single output actual value calculation unit;

[0043] The single output actual value calculation unit receives the determination result transmitted by the single output theoretical value determination unit, calculates the single output actual value of the target in each interval time in combination with the output scanning result of the target, and transmits the calculation result to the fault matching module.

[0044] Furthermore, the fault matching module receives the calculation results transmitted respectively by the single output quantity calculation unit and the single output quantity actual value calculation unit, as well as the collected real-time network speed value and the target working network speed minimum value transmitted by the output time period determination module, randomly selects a fault cause, and determines the matching degree between the target fault cause and the selected fault cause in combination with the received information, and matches the target fault cause based on the determination result.

[0045] Compared with the prior art, the beneficial effects achieved by the present invention are:

[0046] 1. When the target is working, the present invention determines the fault time of the target according to the real-time working current value and real-time data transmission situation of the target when working. Store staff can obtain the output fault state of the target according to the early warning information issued by the target at the fault time, which is beneficial to reducing the maintenance time of the maintenance personnel on the target and can effectively avoid the increase of damage caused by excessive use of the target when it fails.

[0047] 2. The present invention determines the actual value of the single output of the target in each interval time according to the real-time data transmission of the target when it is working. This process eliminates the influence of relevant factors on the determination result based on the position information of specific components set inside the target, the output speed of the target, and the output content of the output file and the specification information of the output content, further improves the calculation accuracy of the result, and improves the analysis effect of the system.

[0048] 3. The present invention determines the type of specific value obtained according to the fault conditions and fault condition data of each fault cause, and determines the matching degree between the target fault cause and the selected fault cause in combination with the judgment result of whether each specific value obtained is within the corresponding value range. The target fault cause is determined according to the determined matching degree. This process does not require manual analysis of the target fault cause, which greatly shortens the maintenance time of the maintenance personnel for the target. In addition, this process eliminates the influence of the network on the collected real-time working current value and real-time data transmission, and further improves the matching analysis accuracy of the system. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings:

[0050] Figure 1 It is a schematic diagram of the workflow of a target matching analysis system and method based on multimodal sensing technology of the present invention. DETAILED DESCRIPTION

[0051] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0052] See also Figure 1 The present invention provides a technical solution: a target matching analysis method based on multimodal perception technology, the method comprising:

[0053] S10: Determine the output time period of the target according to the real-time network data of the target when it is working;

[0054] The specific method for S10 to determine the output time period of the target is:

[0055] The time point when the target receives the output file is collected, and combined with the target's reading and transmission time of the output file, the reading and transmission time of the output file = the memory capacity of the output file * the time value consumed by the target to read and transmit the content of the unit memory capacity, the unit memory capacity = 1Mb, and the output start time point of the target is determined, the output start time point of the target = the time point when the target receives the output file + the reading and transmission time of the target to the output file, and the real-time network speed value of the target is collected at the output start time point. If the collected real-time network speed value ≥ the minimum working network speed of the target, the target can print at this time. If the collected real-time network speed value < the minimum working network speed of the target, the target cannot work at this time. According to the comparison result, the output time period of the target is determined;

[0056] The real-time working current value and real-time data transmission of the target collected during the working time period are used to analyze the cause of the target failure. This process eliminates the influence of the network on the collected content, which is conducive to ensuring the matching analysis accuracy of the target failure cause;

[0057] S20: Analyze the consumables consumption of the target according to the real-time working current value of each piezoelectric element in the target;

[0058] The specific method for S20 to analyze the consumption of target consumables is as follows:

[0059] During the output time period, the single working time of the component is taken as the interval time. The single working time of the component refers to the sum of the time when the piezoelectric element corresponding to the component is deformed and the time when the deformation is reset. The Hall sensor is used to collect the current value flowing through the piezoelectric element corresponding to each component. The single consumable consumption of each component is calculated, where t=1,2,…,m, represents the number corresponding to the current collection time point, and m represents the total number of current value collections. It represents the current value collected by the Hall sensor at the collection time point numbered t. hour, , hour, , W represents the standard working current value of the piezoelectric element, A represents the consumables consumption of the component corresponding to the piezoelectric element when the current value flowing through the piezoelectric element is the standard working current value, S represents the single consumables consumption of the component corresponding to the piezoelectric element, and the single consumables consumption refers to the amount of ink ejected by the printer nozzle under the action of the piezoelectric element, and the standard working current value refers to the current value flowing through the piezoelectric element when the deformation degree of the piezoelectric element is the maximum value;

[0060] according to Calculate the single output of the target, where i=1,2,…,n, represents the number of each component, and n represents the total number of components in the target. Indicates the single consumable consumption of component numbered i at the collection time point numbered t. It indicates the single output volume of the target in the previous interval corresponding to the acquisition time point numbered t. The single output volume of the target refers to the amount of ink consumed by the target in the interval;

[0061] S30: determining the consumption of consumables of the target according to the real-time data transmission of the target during operation;

[0062] The specific method for S30 to determine the consumption of the target consumables is:

[0063] According to the output speed set by the target, the amount of data to be output by the target in each interval time is determined. The amount of data to be output = output speed * interval time. Combined with the result of the target reading the output file, the output content of the target in each interval time is determined. Based on the determination result, the consumables consumption of the target is determined. The specific determination method is:

[0064] According to the target reading result, the font size of each output content in the output file is determined. Based on the output content of the target in each interval time, the output length value of each stroke in each output content is determined. Combined with the number of components set in the target and the interval distance value of the set components, when the target outputs each content, the working number of the target components is determined. The specific determination formula is:

[0065] ;

[0066] Wherein, j=1,2,…,m, represents the number corresponding to each stroke of each output content, m represents the total number of strokes of each output content, p=1,2,…,q, represents the number corresponding to each output content in the output file, m represents the total number of output contents in the output file, represents the output length value corresponding to the stroke numbered j in the output content numbered p, and k represents the interval distance value of the black parts in the target. Indicates the number of stroke intersections in the output content numbered p. It indicates the number of components working when the target outputs the output content with the number p;

[0067] Based on the output content of the target in the previous interval corresponding to the acquisition time point numbered t, Accumulate the theoretical value of the single output of the target in the previous interval corresponding to the acquisition time point numbered t Perform calculations;

[0068] Combined with the output scanning results of the target, the actual value of the single output quantity of the target in the previous interval corresponding to the acquisition time point numbered t is Calculate and determine, , where c represents the color depth value of the output content in the output scanning result, C represents the standard color depth value of the output content, a=1 or -1, when c / C≥1, a=1, when c / C<1, a=-1, the standard color depth value of the output content refers to the color depth value of the ink ejected by the nozzle corresponding to the piezoelectric element on the printing paper when the current value flowing through the piezoelectric element is the standard working current value, and the calculation method of the color depth value of the output content is: the image information of the output content in the output scanning result is obtained, and based on the obtained image information, the color depth value of the output content is determined by using Gray=R*0.299+G*0.587+B*0.114;

[0069] according to and The relationship between the output failure time of the target is determined. When , it means that the target outputs a fault at the collection time point numbered t. At this time, the target issues a warning message. Store staff can determine the output fault state of the target based on the warning message, which is helpful to reduce the maintenance time of the maintenance personnel on the target.

[0070] S40: matching the fault cause of the target;

[0071] The specific method of S40 matching the fault cause of the target is:

[0072] During the output time period, when the target is abnormal, according to and The relationship between the real-time network speed value and the target minimum working network speed is used to match the target fault cause. The specific matching method is as follows:

[0073] when and , it means that the target component is faulty and needs to be replaced;

[0074] when and When , it indicates that the piezoelectric element corresponding to the component in the target is faulty;

[0075] when , it indicates a component failure in the target;

[0076] When the collected real-time network speed value is less than the target minimum working network speed value, it indicates that the target network connection is faulty;

[0077] right , , and the specific values ​​of the collected real-time network speed are obtained, a fault cause is randomly selected, the judgment condition and the number of judgment conditions J of the selected fault cause are determined, the type of the obtained specific value is determined according to the judgment condition, and it is determined whether each specific value obtained is within the corresponding value range. According to the judgment result, the matching degree between the target fault cause and the selected fault cause is determined, J, based on the determination result, determines the fault cause of the target, where u=1,2,…,v, represents the number corresponding to each judgment condition in each fault cause, and v represents the total number of judgment conditions in each fault cause. ,when When , it means that the specific value obtained is not within the corresponding value range. When , it means that the specific value obtained is within the corresponding value range. When the matching degree = 1, it means that the fault cause of the target is the selected fault cause. When the matching value ≠ 1, it means that the fault cause of the target is not the selected fault cause.

[0078] A target matching analysis system based on multimodal sensing technology, the system includes an output time period determination module, a consumables consumption analysis module, a consumables consumption determination module and a fault matching module;

[0079] The output time period determination module determines the output time period of the target according to the real-time network data of the target when it is working;

[0080] The output time period determination module collects the time point when the target receives the output file, and determines the output start time point of the target in combination with the target's reading and transmission time of the output file, and starts collecting the target's real-time network speed value at the output start time point, and compares the collected real-time network speed value with the target minimum working network speed. According to the comparison result, the output time period of the target is determined, and the determined output time period is transmitted to the consumables consumption analysis module, and the collected real-time network speed value and the target minimum working network speed are transmitted to the fault matching module;

[0081] The consumables consumption analysis module is used to analyze the consumables consumption of the target according to the real-time working current value of each piezoelectric element in the target;

[0082] The consumables consumption analysis module includes a single consumables consumption calculation unit and a single output calculation unit;

[0083] The single consumable consumption calculation unit receives the output time period transmitted by the output time period determination module, and within the output time period, uses the Hall sensor to collect the current value flowing through the piezoelectric element corresponding to each component with the single working time of the component as the interval time, calculates the single consumable consumption of each component according to the collected information, and transmits the calculation result to the single output quantity calculation unit;

[0084] The single output quantity calculation unit receives the calculation result transmitted by the single consumable consumption quantity calculation unit, calculates the single output quantity of the target based on the received information, and transmits the calculation result to the fault matching module;

[0085] The consumables consumption determination module is used to determine the consumables consumption of the target according to the real-time data transmission of the target during operation;

[0086] The consumables consumption determination module includes an output content determination unit, a component work quantity determination unit, a single output quantity theoretical value determination unit, and a single output quantity actual value calculation unit;

[0087] The output content determination unit determines the amount of data to be printed by the target in each interval according to the output speed set by the target, determines the output content of the target in each interval in combination with the result of the target reading the output file, and transmits the determination result to the component quantity determination unit and the single output quantity theoretical value determination unit;

[0088] The component quantity determination unit receives the determination result transmitted by the output content determination unit, determines the font size of each output content in the output file according to the target reading result, determines the output length value of each stroke in each output content based on the received information, and determines the component working quantity of the target when the target outputs each content in combination with the number of special components set in the target and the interval distance value of the set special components, and transmits the determination result to the single output quantity theoretical value determination unit;

[0089] The single output quantity theoretical value determination unit receives the determination result transmitted by the component quantity determination unit and the determination result transmitted by the output content determination unit, determines the single output quantity theoretical value of the target in each interval time based on the received information, and transmits the determination result to the single output quantity actual value calculation unit;

[0090] The single output actual value calculation unit receives the determination result transmitted by the single output theoretical value determination unit, calculates the single output actual value of the target in each interval time in combination with the output scanning result of the target, and transmits the calculation result to the fault matching module;

[0091] The fault matching module is used to match the fault cause of the target;

[0092] The fault matching module receives the calculation results transmitted by the single output volume calculation unit and the single ink consumption actual value calculation unit respectively, as well as the collected real-time network speed value and the target working network speed minimum value transmitted by the output time period determination module, randomly selects a fault cause, and determines the matching degree between the target fault cause and the selected fault cause in combination with the received information, and matches the target fault cause based on the determination result.

[0093] Example 1: The printer has 3 printed contents in the previous interval corresponding to the collection time point numbered t. , , , ampere, ampere, ml, then the theoretical value of the single ink consumption of the printer in the previous interval corresponding to the collection time point numbered t is:

[0094] ;

[0095] Therefore, the theoretical value of the single ink consumption of the printer in the previous interval corresponding to the collection time point numbered t is 4.8 ml.

[0096] Embodiment 2: Assuming that the selected fault cause of the printer is a fault of the ink cartridge in the printer, the judgment condition of the selected fault cause is: and , the number of judgment conditions for the selected fault cause J=1, according to the judgment conditions for the selected fault cause, the specific value type obtained is and ,set up

[0097] , , then the matching degree between the printer failure cause and the selected failure cause is:

[0098] because and , so the specific value obtained , are all within the corresponding value range, so we can know that ;

[0099] Matching degree = 1 / 1 = 1;

[0100] Then the printer failure is caused by a failure of the ink cartridge in the printer.

[0101] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device.

[0102] Finally, it should be noted that the above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art can still modify the technical solutions described in the aforementioned embodiments or replace some of the technical features therein by equivalents. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A target matching analysis method based on multimodal perception technology, characterized in that: The method comprises: S10: Determine the target's usage time period based on the target's real-time network data when it is working. The specific method is as follows: The time point when the target receives data information is collected, and the target's use start time point is determined in combination with the target's reading and transmission time of the data information. The target's real-time network speed value is collected at the use start time point. If the collected real-time network speed value is ≥ the target's minimum working network speed, the target can work at this time. If the collected real-time network speed value is < the target's minimum working network speed, the target is temporarily not working at this time. According to the comparison result, the target's use time period is determined; S20: Analyze the consumables consumption of the target according to the real-time working current value of each piezoelectric element in the target. The specific method is as follows: During the use period, the current value of the piezoelectric element corresponding to each component is collected by using the Hall sensor, with the single working time of the component as the interval time. The single consumable consumption of each component is calculated, where t=1,2,…,p, represents the number corresponding to the current collection time point, and p represents the total number of current value collections. It represents the current value collected by the Hall sensor at the collection time point numbered t. hour, , hour, , W represents the standard working current value of the piezoelectric element, A represents the consumables consumption of the component corresponding to the piezoelectric element when the current value flowing through the piezoelectric element is the standard working current value, and S represents the single consumables consumption of the component corresponding to the piezoelectric element; according to Calculate the single consumable consumption of the target, where i=1,2,…,n, represents the number corresponding to each component, and n represents the total number of components in the target. Indicates the single consumable consumption of component numbered i at the collection time point numbered t. Indicates the single consumption of consumables in the previous interval corresponding to the collection time point numbered t; S30: Determine the consumption of the target's consumables according to the real-time data transmission of the target during operation. The specific method is as follows: According to the output speed set by the target, the amount of data to be output by the target in each interval time is determined. The amount of data to be output = output speed * interval time. Combined with the result of the target reading the output file, the output content of the target in each interval time is determined. Based on the determination result, the consumables consumption of the target is determined. The specific determination method is: According to the target reading result, the font size of the file content is determined. Based on the target's file content at each interval, the length value of each stroke in each file content is determined. Combined with the number of black components set in the target and the interval distance value of the set black components, when the target outputs each content, the number of component workings of the target is determined. The specific determination formula is: ； Wherein, j=1,2,…,m, represents the number corresponding to each stroke of each output content, m represents the total number of strokes of each output content, p=1,2,…,q, represents the number corresponding to each output content in the file, q represents the total number of contents in the output file, It indicates the length value of the stroke numbered j in the content numbered p, and k indicates the interval value of the black parts in the target. Indicates the number of stroke intersections in the content numbered p. It indicates the number of components working when the target outputs the content numbered p; Based on the output content of the target in the previous interval corresponding to the acquisition time point numbered t, Accumulate the theoretical value of the single consumable consumption of the target in the previous interval corresponding to the collection time point numbered t Perform calculations; Combined with the target's scanning results, the actual value of the single consumable consumption of the target in the previous interval corresponding to the acquisition time point numbered t Calculate and determine, , where c represents the color depth value of the output content in the scan result, C represents the standard color depth value of the output content, a=1 or -1, when c / C≥1, a=1, when c / C<1, a=-1; according to and The relationship between the target failure time is determined. When , it means that the target fails at the acquisition time point numbered t, and the target issues a warning message; S40: Match the target failure cause.

2. The target matching analysis method based on multimodal perception technology according to claim 1 is characterized in that: The specific method of matching the fault cause of the target in S40 is: During the target working time period, when the target usage is abnormal, according to and The relationship between the real-time network speed value and the target minimum working network speed is used to match the target fault cause. The specific matching method is as follows: when and , it means that the target component is faulty and needs to be replaced; when and When , it indicates that the piezoelectric element corresponding to the component in the target is faulty; when , it indicates a component failure in the target; When the collected real-time network speed value is less than the target minimum working network speed value, it indicates that the target network connection is faulty; right , , and the specific values ​​of the collected real-time network speed are obtained, a fault cause is randomly selected, the judgment condition and the number of judgment conditions J of the selected fault cause are determined, the type of the obtained specific value is determined according to the judgment condition, and it is determined whether each specific value obtained is within the corresponding value range. According to the judgment result, the matching degree between the target fault cause and the selected fault cause is determined, J, based on the determination result, determines the fault cause of the target, where u=1,2,…,v, represents the number corresponding to each judgment condition in each fault cause, and v represents the total number of judgment conditions in each fault cause. ,when When , it means that the specific value obtained is not within the corresponding value range. When , it means that the specific value obtained is within the corresponding value range. When the matching degree = 1, it means that the fault cause of the target is the selected fault cause. When the matching value ≠ 1, it means that the fault cause of the target is not the selected fault cause.

3. A target matching analysis system based on multimodal sensing technology applied to the target matching analysis method based on multimodal sensing technology according to any one of claims 1 to 2, characterized in that: The system includes an output time period determination module, a consumables consumption situation analysis module, a consumables consumption situation determination module and a fault matching module; The output time period determination module determines the output time period of the target according to the real-time network data of the target when it is working; The output time period determination module collects the time point when the target receives the output file, determines the output start time point of the target in combination with the reading and transmission time of the output file by the target, starts collecting the real-time network speed value of the target at the output start time point, compares the collected real-time network speed value with the minimum value of the target working network speed, determines the output time period of the target according to the comparison result, and transmits the determined output time period to the consumables consumption analysis module, and transmits the collected real-time network speed value and the minimum value of the target working network speed to the fault matching module; The consumables consumption analysis module is used to analyze the consumables consumption of the target according to the real-time working current value of each piezoelectric element in the target; The consumables consumption analysis module includes a single consumables consumption calculation unit and a single output calculation unit; The single consumable consumption calculation unit receives the output time period transmitted by the output time period determination module, and within the output time period, uses the Hall sensor to collect the current value flowing through the piezoelectric element corresponding to each component with the single working time of the component as the interval time, calculates the single consumable consumption of each component according to the collected information, and transmits the calculation result to the single output calculation unit; The single output quantity calculation unit receives the calculation result transmitted by the single consumable material consumption calculation unit, calculates the single output quantity of the target based on the received information, and transmits the calculation result to the fault matching module; The consumables consumption determination module is used to determine the consumables consumption of the target according to the real-time data transmission of the target when it is working; The consumables consumption determination module includes an output content determination unit, a component work quantity determination unit, a single output quantity theoretical value determination unit and a single output quantity actual value calculation unit; The output content determination unit determines the amount of data to be output by the target in each time interval according to the output speed set by the target, determines the output content of the target in each time interval in combination with the result of the target reading the output file, and transmits the determination result to the component quantity determination unit and the single output quantity theoretical value determination unit; The component quantity determination unit receives the determination result transmitted by the output content determination unit, determines the font size of each output content in the output file according to the target reading result, determines the output length value of each stroke in each output content based on the received information, and determines the component working quantity of the target when the target outputs each content in combination with the number of black components set in the target and the interval distance value of the set black components, and transmits the determination result to the single output quantity theoretical value determination unit; The single output theoretical value determination unit receives the determination result transmitted by the component quantity determination unit and the determination result transmitted by the output content determination unit, determines the single output theoretical value of the target in each interval time based on the received information, and transmits the determination result to the single output actual value calculation unit; The single output actual value calculation unit receives the determination result transmitted by the single output theoretical value determination unit, calculates the single output actual value of the target in each interval time in combination with the output scanning result of the target, and transmits the calculation result to the fault matching module; The fault matching module is used to match the fault cause of the target.

4. The target matching analysis system based on multimodal perception technology according to claim 3 is characterized by: The fault matching module receives the calculation results transmitted respectively by the single output quantity calculation unit and the single output quantity actual value calculation unit, as well as the collected real-time network speed value and the target working network speed minimum value transmitted by the output time period determination module, randomly selects a fault cause, and determines the matching degree between the target fault cause and the selected fault cause in combination with the received information, and matches the target fault cause based on the determination result.

Images