Unlock instant, AI-driven research and patent intelligence for your innovation.

Book positioning method based on computer vision

A technology of computer vision and positioning method, applied in computer components, computing, energy-saving computing, etc., can solve problems such as interference, increasing book identification obstacles, and inability to assist book grasping, so as to achieve high-accuracy book positioning and improve utilization Efficiency and time-saving effect of looking up data

Pending Publication Date: 2022-08-05
NANJING UNIV +1
View PDF2 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Among the many books on the bookshelf, how to enable the robot to accurately identify the target book and obtain its exact location is the top priority. Therefore, most libraries have put RFID tags on the books, but there is a Two problems: one is that due to the multipath effect and interference between tags, the positioning accuracy of RFID cannot meet the requirements of grasping; the other is that RFID-based book positioning can only locate the tags, not the book itself, and cannot assist the book crawl
[0006] However, in practical application, the above technology faces many challenges: in order to meet the needs of the robotic arm, the positioning accuracy of the book must be high enough; and the books in the library are densely arranged, and the textures are also highly similar. There are many books in the photo, which increases the book recognition. barriers, making positioning technology difficult to achieve

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Book positioning method based on computer vision
  • Book positioning method based on computer vision
  • Book positioning method based on computer vision

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0064] This embodiment mainly introduces a computer vision-based book positioning method. For the specific method, please refer to figure 1 .

[0065] A computer vision-based book positioning method, the method comprising:

[0066] Step S1, taking pictures by a camera, collecting the target area of ​​the book, and storing it as a picture;

[0067] Step S2, build and train a text detection model, mark all texts in the picture with a text area frame;

[0068] Step S3, based on the text area frame, carry out book instance segmentation to the picture, thereby obtaining the book instance and the position information of the book instance in the picture;

[0069] Step S4, constructing and training a text recognition model, identifying the text area frame, and merging the text recognition results in the same book instance to obtain the title recognition result of each book instance;

[0070] Step S5 , matching the title recognition result with the title of the book entered by the r...

Embodiment 2

[0108] Based on the foregoing Embodiment 1, this embodiment mainly introduces another method for locating books based on computer vision.

[0109] A computer vision-based book positioning method, the method comprising:

[0110] Step S0, build and train a text detection model and build and train a text recognition model;

[0111] Step S1, taking pictures with a camera, collecting the target area, and storing it as a picture;

[0112] Step S2, mark all texts in the picture with a text area frame;

[0113] Step S3, based on the text area frame, carry out book instance segmentation to the picture, thereby obtaining the book instance and the position information of the book instance in the picture;

[0114] Step S4, identifying the text area frame, and merging the text recognition results in the same book instance to obtain the title recognition result of each book instance;

[0115] Step S5 , matching the title recognition result with the title of the book entered by the reader...

Embodiment 3

[0162] Based on Embodiment 1, this embodiment further discusses the problems encountered when the application is improved and the improvement method:

[0163] For the ready-made datasets for instance segmentation of dense books in the scenario without bookshelves, the instance segmentation model trained with instance segmentation datasets in other scenarios is not effective. The solution of the present application is to creatively propose a traditional algorithm for book instance segmentation, so as to avoid the problem of low segmentation accuracy due to lack of corresponding data sets. The book instance segmentation algorithm only needs to be based on a neural network for text detection, and the data set for text detection is rich and the detection algorithm is relatively mature, making the overall algorithm easy to implement.

[0164]The placement of adjacent books on the bookshelf is often very close, the textures of these books are similar, and there are various placement...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a book positioning method based on computer vision, and the method comprises the steps: S1, carrying out the photographing of a camera, collecting a target region of a book, and storing the target region as a picture; s2, constructing and training a text detection model, and marking all texts in the picture by using a text region frame; s3, based on the text region frame, performing book instance segmentation on the picture, thereby obtaining a book instance and position information of the book instance in the picture; s4, constructing and training a text recognition model, recognizing the text region frame, and merging text recognition results in the same book instance to obtain a book name recognition result of each book instance; and S5, matching the book name identification result with a book name which is input by a reader and needs to be inquired on a bookshelf, and outputting a positioning result of a target book in the picture. According to the method, high-efficiency and high-accuracy book positioning is realized, and the book borrowing efficiency is improved.

Description

technical field [0001] The invention belongs to the field of computer vision design, in particular to a book positioning method based on computer vision. Background technique [0002] Compared with online resources that can be consulted online anytime, anywhere, it is not easy to search for specific book resources in the library; for readers, they need to search for books of interest through the library management system, and then search on the corresponding bookshelves until Find this book. In a real scenario, this process not only consumes a lot of manpower and time, but sometimes it is difficult for readers to find the target book on the corresponding bookshelf due to frequent book retrieval and listing in the library, resulting in a waste of resources and time. [0003] In order to solve this problem, technicians put forward the idea of ​​an automated library. Based on the rapid development of robotics, the books on the bookshelf are automatically grabbed by the robotic...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06V30/416G06V30/418G06F40/284G06T5/00G06T7/80G06V30/14G06V30/148G06V30/16G06V30/19
CPCG06V30/416G06V30/418G06V30/1444G06V30/15G06V30/153G06V30/19007G06V30/19093G06T7/80G06V30/16G06F40/284G06T5/80Y02D10/00
Inventor 陈力军刘佳徐毅晖顾桥磊陈星宇鄢伟
Owner NANJING UNIV