The invention discloses a landscape object identification and explanation method and
system, a medium and a product, and relates to the technical field of
augmented reality. The method comprises the following steps: when the head motion state of a user is stable, triggering a camera to collect and recognize a single-frame image, matching a recognition result with a regional
knowledge base, and generating a candidate object
list and coarse-grained poses which are sorted according to spatial probability and historical popularity; performing
feature point matching on a current frame and an ideal frame in the video
stream, and calculating a fine-grained
pose of a target landscape in the candidate object
list relative to a camera coordinate
system according to a matched target feature point; according to the fine-grained
pose and the real-time
eye movement data, determining a drop point part of the
sight line of the user on the target landscape, forming a multi-dimensional query vector according to the drop point part, the intention of the user and the environment context parameters, and generating
multimedia explanation content; and carrying out fusion rendering on the
multimedia explanation content and the real-time video
stream, and outputting and displaying. By implementing the technical scheme, the personalized
multimedia explanation content can be generated.