The invention discloses a
social perception robot navigation method, device and equipment, a medium and a product. The method comprises the following steps: acquiring grid map data,
robot position data and target object
voice data; converting the grid map data into an image information vector by using a first preprocessing network, converting the
robot position data into a relative position information vector, and converting the target object
voice data into a
condition code vector by using a second preprocessing network; connecting to obtain an aggregation state; and inputting the aggregation state into a pre-trained HSAC-LLM model to obtain a
target action, and generating voice prompt information according to the
target action, so that the target object receives the voice prompt information. According to the embodiment of the invention, bidirectional
natural language interaction is realized in the navigation process between the robot and the
pedestrian, real-time communication is promoted,
navigation safety is enhanced in a dynamic environment, intelligent
obstacle avoidance is realized, and interaction experience is provided at the same time.