The invention provides a self-adaptive book checking
system and method based on RFID and vision bimodal fusion, and aims to solve the problems that in an existing checking
system, a single technology is poor in robustness and low in recognition rate in a complex
library environment, and accurate wrong shelf / missing scanning judgment cannot be achieved. According to the method, real-time detection and active probing of book missing scanning are achieved through bimodal sequence
cross validation,
metal interference is dynamically diagnosed through mobile scanning RFID
signal profile analysis, the contribution degree of RFID and
visual recognition is adaptively adjusted through a real-time quality evaluation and dynamic weight
fusion mechanism, and an autonomous learning mechanism is introduced to continuously optimize
system performance. According to the system, the technologies are integrated on a mobile checking
robot platform, a four-wheel omnidirectional mobile
chassis and a controllable lifting device are utilized, path planning is performed in combination with
laser navigation, high-precision, high-robustness, self-adaptive and evolvable automatic book checking in a complex indoor environment is finally realized, and the checking efficiency and the
data integrity are remarkably improved.