The invention relates to the technical field of sports competition real-time penalty, and discloses a sports competition real-time penalty
system and method based on multi-
modal sensing and AI algorithms, and the
system comprises a monitoring identification module, an instrument tracking module, a rule parameter construction module, a fusion penalty module, an output and snapshot module, and a
wireless linkage and
energy management module. The method comprises the following steps: acquiring image and
instrument data, and constructing a multi-
modal sensing structure; calling a rule base to generate a penalty vector and loading a structure constraint; fusing the image and the instrument features to generate a feature
tensor; inputting an AI model to judge the legality of the action and outputting a penalty result; driving the snapshot logic to generate an image
record and
synchronizing the image
record to the terminal; and adjusting the
energy consumption strategy according to the task load and the
equipment state. According to the invention, a multi-
modal perception input structure fusing instrument motion data and a visual
image flow is introduced, so that the
system can synchronously acquire displacement, acceleration and attitude images in the
action recognition process, and a penalty basis is checked in a cross manner from multiple dimensions.