Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Vision-based pedestrian taxi calling behavior identification method

A pedestrian and behavior technology, which is applied in the field of automatic driving taxis to identify pedestrian behavior intentions, can solve the problem that behavior recognition algorithms cannot be applied to reasoning of car-hailing intentions with instantaneous characteristics, and achieves the process of improving environmental adaptability, simplifying networks, and reducing Effect

Pending Publication Date: 2022-01-28
DALIAN UNIV OF TECH
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Based on the above two characteristics, traditional behavior recognition algorithms based on 3DCNN (3D Convolutional Neural Network) and LSTM (Long Short Term Memory Network) cannot be applied to reasoning of car-hailing intentions with instantaneous characteristics.
Pedestrian gestures are the key information to express pedestrian intentions, and most current gesture recognition algorithms are mainly used in indoor scenes, and vision-based gesture recognition algorithms require high resolution of hand contours in images, but smart cars equipped with Vehicle-mounted cameras cannot produce such high-quality images in complex traffic scenes

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Vision-based pedestrian taxi calling behavior identification method
  • Vision-based pedestrian taxi calling behavior identification method
  • Vision-based pedestrian taxi calling behavior identification method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] Below in conjunction with accompanying drawing, the present invention is further described, as figure 1 As shown, a vision-based pedestrian calling behavior recognition method includes the following steps:

[0032] A. Image preprocessing

[0033]Using Yolov5 as the target detection method and the human body key point extraction algorithm OpenPose to realize the preprocessing of the image, and obtain the pedestrian detection frame D and the key point parameters K of the corresponding pedestrians in each detection frame, where the key point parameters are as follows: figure 2 As shown, the corresponding relationship between the sequence of key points and the parts of the human body is:

[0034]

[0035] The detection frame provided by object detection can improve the accuracy of human key point extraction. In the process of car-calling intention reasoning, the facial attention of the human body is the key clue to judge whether it has the car-calling intention. In th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a pedestrian taxi calling behavior recognition method based on vision. The pedestrian taxi calling behavior recognition method comprises the following steps of image preprocessing and intention reasoning. According to the method, a computer vision method is adopted to accurately and efficiently identify pedestrians with taxi calling behaviors from the images, passengers can be more efficiently found in the automatic driving taxi, the use efficiency of the automatic driving taxi is improved, and the travel efficiency of the passengers is also improved. According to the method, reasoning of the passenger taxi calling behaviors is achieved through the spatial reasoning network, dependence on time dimension information is reduced, compared with a traditional behavior recognition algorithm, the time feature extraction process is reduced, the network can be simplified, and the real-time performance of behavior reasoning can be improved. According to the method, a set of logically explainable fusion rules is adopted, fusion of the random forest and the graph convolutional network is realized, the logically explainable characteristics can improve the environmental adaptability of the algorithm and the accuracy of behavior recognition, and more stable and accurate reasoning of the fusion algorithm on the passenger taxi calling intention is realized.

Description

technical field [0001] The invention belongs to the field of vehicle intelligence, and in particular relates to a method for identifying pedestrian behavior intentions by a self-driving taxi. Background technique [0002] The behavior of vehicles recognizing pedestrians in traffic scenes belongs to the category of vehicle intelligence. Accurate and effective identification of pedestrians' intention to call a car can help self-driving taxis quickly find pedestrians with the intention of calling a car on the road, which is important for improving the travel efficiency of pedestrians and the use efficiency of self-driving taxis, and avoiding traffic congestion significance. [0003] Pedestrian calling behavior recognition refers to the use of computer vision methods to analyze pedestrians in traffic scenes and find pedestrians with the intention to call a car. Traffic scenes are highly complex, and the number and types of traffic participants (including pedestrians, vehicles,...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06V10/25G06V40/16G06V40/20G06V10/764G06V10/82G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06N3/045G06F18/24323
Inventor 连静王政皓李琳辉
Owner DALIAN UNIV OF TECH
Features
  • Generate Ideas
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More