The disclosure presents systems and methods for hierarchical classification of input data across a plurality of categories. A
machine learning model processes various data formats, starting with
dimensional reduction using tokenization techniques, such as Bert-tiny tokenization, to create model-readable representations. The
system predicts super-categories, sub-categories, and granular categories through selective activation of sub-
layers tied to identified super-categories, optimizing computational efficiency.
Label smoothing during training mitigates overconfidence in predictions, while softmax normalization refines
inference outputs.
Synthetic data generation using Large Language Models (LLMs) supplements training datasets, and an
automated data labeling pipeline efficiently generates hierarchical labels. Modifications to the model, such as stop word removal and
file size limitations, further reduce latency.
Inference analyzes logits to predict hierarchical paths, providing detailed classifications with clear outputs. The method is adaptable for multimodal formats, ensuring scalable and accurate predictions across diverse data types while minimizing computational costs and improving reliability.