Intelligent exhibition hall control method and device based on guide robot and computer equipment

Abstract

According to the intelligent exhibition hall control method and device based on the guide robot and the computer equipment provided by the invention, accurate identity verification is completed through multi-modal biological recognition, and when the target visitor passes multi-modal detection, the user information of the target visitor can be accurately obtained so as to construct the user portrait of the target visitor. Meanwhile, the visitor intensity of each area of the exhibition hall can be detected in real time, the guide route is determined in combination with the user portraits, the sightseeing efficiency is improved while passenger flow balanced distribution is achieved, and user preferences can be considered when the guide route is generated. When it is detected that the target visitor is interested in any exhibit, personalized playing content and personalized explanation content are generated according to the user portrait to be pushed. In this way, behavior changes of visitors can be responded in real time, playing content and explanation content can be generated in a targeted mode, and the viewing experience and the intelligent level of an exhibition hall are improved. And the route is determined based on the same user portrait, and the explanation content and the playing content can realize deep linkage of data.

Description

Technical Field

[0001] This application relates to the field of artificial intelligence technology, and in particular, to an intelligent exhibition hall control method, device, and computer device based on a guiding robot. Background Art

[0002] As a new type of information interaction carrier integrating artificial intelligence and Internet of Things technology, the current mainstream implementation solutions for intelligent exhibition halls still mainly use basic identification technologies such as RFID and two-dimensional codes for visitor management, supplemented by fixed sensors to collect limited behavioral data such as residence time. Although this mode realizes basic digitization, due to the single dimension of data collection, the analysis of user behavior is not comprehensive enough, and coupled with the ineffective integration of data between systems, cross-modal behavior analysis is difficult to truly play a role.

[0003] The key bottleneck of the existing technology lies in the disconnection between the static system architecture and the dynamic scenario requirements. The data collection method based on preset rules and the one-way content push mechanism make the exhibition hall system lack the dynamic response ability to the real-time behavior changes of visitors. This not only leads to the fact that personalized services stay at the shallow content matching stage and it is difficult to achieve a deeper value experience, but also fundamentally restricts the substantial improvement of the intelligence level of the exhibition hall. Summary of the Invention

[0004] The purpose of this application aims to at least solve one of the above technical defects, especially the technical defect that the data collection method based on preset rules and the one-way content push mechanism in the existing technology make the exhibition hall system lack the dynamic response ability to the real-time behavior changes of visitors. This not only leads to the fact that personalized services stay at the shallow content matching stage and it is difficult to achieve a deeper value experience, but also fundamentally restricts the substantial improvement of the intelligence level of the exhibition hall.

[0005] In a first aspect, this application provides an intelligent exhibition hall control method based on a guiding robot. The method includes:

[0006] Performing multi-modal detection on a target visitor entering the exhibition hall. When the target visitor passes the multi-modal detection, obtaining the user information of the target visitor, and constructing a user portrait of the target visitor according to the user information;

[0007] Determining the visitor density of each area in the exhibition hall, and after determining a guiding route in a pre-constructed three-dimensional map of the exhibition hall according to the visitor density of each area in the exhibition hall and the user portrait, guiding the target visitor to view according to the guiding route;

[0008] During the visit of the target visitor, when it is detected that the target visitor is interested in any exhibit, personalized playback content and personalized explanation content are generated according to the user profile. The personalized playback content is uploaded to the playback control system to adjust the playback content in the relevant area of the exhibit, and the personalized explanation content is uploaded to the explanation device of the target visitor for exhibit explanation.

[0009] In one embodiment, the multi-modal detection of the target visitor entering the exhibition hall includes:

[0010] Collect the facial information and palmprint information of the target visitor entering the exhibition hall;

[0011] Match the facial information and the palmprint information in a preset reservation database. If there is reservation person information corresponding to both the facial information and the palmprint information in the reservation database, it is considered that the target visitor passes the multi-modal detection; otherwise, it is considered that the target visitor fails the multi-modal detection.

[0012] In one embodiment, the obtaining of the user information of the target visitor and the construction of the user profile of the target visitor according to the user information include:

[0013] Obtain the user information of the target visitor in a preset reservation database to determine the personnel category corresponding to the target visitor;

[0014] If the target visitor has a historical purchase record in the current exhibition hall, obtain the historical purchase record of the target visitor, determine the preference characteristics of the target visitor according to the historical purchase record, and then construct the user profile of the target visitor according to the personnel category and the preference characteristics;

[0015] If the target visitor has no historical purchase record in the current exhibition hall, construct the user profile of the target visitor according to the personnel category.

[0016] In one embodiment, the determination of the visitor density in each area of the exhibition hall and the determination of the navigation route in the pre-constructed three-dimensional map of the exhibition hall according to the visitor density in each area of the exhibition hall and the user profile include:

[0017] Obtain the number of detected people in each area of the exhibition hall, and calculate the visitor density of each area of the exhibition hall according to the number of detected people in each area of the exhibition hall;

[0018] Determine the permission information of the target visitor according to the user profile, and determine the accessible area in the pre-constructed three-dimensional map of the exhibition hall based on the permission information;

[0019] Mark target exhibits in the accessible area according to the user profile, and generate multiple target routes based on each marked target exhibit;

[0020] Evaluate the comprehensive density of each target route based on the visitor density in each area of the exhibition hall, and select the target route with the lowest comprehensive density among each target route as the guided tour route.

[0021] In one embodiment, guiding the target visitor to view according to the guided tour route includes:

[0022] When using a guided tour robot as the exhibition hall guiding device, synchronize the guided tour route to the guided tour robot closest to the target visitor, so that the guided tour robot guides the target visitor to view based on the guided tour route; the guided tour robot conducts guiding work based on 3D lidar and a preset path planning algorithm;

[0023] When using a wearable guiding device as the exhibition hall guiding device, synchronize the guided tour route to the wearable guiding device corresponding to the target visitor, so that the wearable guiding device displays the guided tour route and conducts text guiding based on the guided tour route.

[0024] In one embodiment, when it is detected that the target visitor is interested in any exhibit, generating personalized playback content and personalized explanation content according to the user profile includes:

[0025] Real-time detect the staying position of the target visitor. When the staying time at the staying position exceeds a preset threshold, detect the line-of-sight direction of the target visitor, and determine the exhibit to be explained by combining the staying position and the line-of-sight direction;

[0026] Determine the explanation style and explanation depth according to the user profile, and generate personalized explanation content for the exhibit to be explained according to the explanation style and the explanation depth;

[0027] Determine personalized playback content according to the type of the exhibit to be explained and the user profile.

[0028] In one embodiment, uploading the personalized playback content to the playback control system to adjust the playback content in the relevant area of the exhibit includes:

[0029] When the playback control system receives different personalized playback contents in the relevant area of the same exhibit, perform style integration based on the received multiple personalized playback contents to obtain the target playback content;

[0030] When the playback control system receives a personalized playback content in the relevant area of the exhibit, determine the personalized playback content as the target playback content;

[0031] Send the target playback content to the playback devices in the relevant areas of the exhibit for content playback.

[0032] In a second aspect, the present application provides an intelligent exhibition hall control device based on a guiding robot, the device comprising:

[0033] A visitor detection module, configured to perform multi-modal detection on a target visitor entering the exhibition hall. When the target visitor passes the multi-modal detection, obtain the user information of the target visitor, and construct a user portrait of the target visitor according to the user information;

[0034] A route generation module, configured to determine the visitor density of each area in the exhibition hall, and determine a guiding route in a pre-constructed three-dimensional map of the exhibition hall according to the visitor density of each area in the exhibition hall and the user portrait, and then guide the target visitor to view according to the guiding route;

[0035] A content generation module, configured to, during the viewing process of the target visitor, when it is detected that the target visitor is interested in any exhibit, generate personalized playback content and personalized explanation content according to the user portrait, upload the personalized playback content to a playback control system to adjust the playback content in the relevant area of the exhibit, and upload the personalized explanation content to the explanation device of the target visitor for exhibit explanation.

[0036] In a third aspect, the present application provides a storage medium, in which computer-readable instructions are stored. When the computer-readable instructions are executed by one or more processors, the one or more processors are caused to execute the steps of the intelligent exhibition hall control method based on a guiding robot as described in any one of the above embodiments.

[0037] In a fourth aspect, the present application provides a computer device, comprising: one or more processors, and a memory;

[0038] The memory stores computer-readable instructions. When the one or more processors execute the computer-readable instructions, the steps of the intelligent exhibition hall control method based on a guiding robot as described in any one of the above embodiments are executed.

[0039] As can be seen from the above technical solutions, the embodiments of the present application have the following advantages:

[0040] The intelligent exhibition hall control method, device, and computer equipment based on a tour guide robot provided in this application perform multimodal detection on target visitors entering the exhibition hall, accurately verifying their identity through multimodal biometric recognition. When a target visitor passes the multimodal detection, the user information of the target visitor is accurately obtained, and a user profile of the target visitor is then constructed based on the user information. Simultaneously, the visitor density in each area of the exhibition hall can be detected in real time. Based on the visitor density and user profile, a guided route is determined within a pre-built three-dimensional map of the exhibition hall, achieving balanced distribution of visitor flow while improving viewing efficiency. User preferences are also considered when generating guided routes. During the target visitor's tour, if the target visitor is detected to be interested in any exhibit, personalized playback content and explanation content are generated based on the user profile and pushed to the corresponding device. This not only responds to changes in visitor behavior in real time, but also enables targeted generation of personalized playback and explanation content, enhancing the viewing experience and the intelligent level of the exhibition hall. Furthermore, determining routes, explanation content, and playback content based on the same user profile enables deep data linkage, thereby achieving optimal allocation of exhibition hall resources and a synergistic improvement in visitor experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0042] Figure 1 A flowchart of a method for controlling an intelligent exhibition hall based on a tour guide robot provided in an embodiment of the present application;

[0043] Figure 2 A schematic diagram of a process for obtaining user information of a target visitor and constructing a user profile of the target visitor based on the user information provided in an embodiment of the present application;

[0044] Figure 3 A schematic diagram of a process for determining a guided route in a pre-built three-dimensional map of an exhibition hall provided in an embodiment of the present application;

[0045] Figure 4 A flowchart of generating personalized playback content and personalized explanation content based on the user profile when detecting that the target visitor is interested in any exhibit provided by the embodiment of the present application;

[0046] Figure 5 A schematic structural diagram of an intelligent exhibition hall control device based on a tour guide robot provided in an embodiment of the present application;

[0047] Figure 6 Internal structure diagram of a computer device provided by an embodiment of the present application. Detailed implementation manners

[0048] The following will clearly and completely describe the technical solutions in the embodiments of the present application with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present application without creative efforts shall fall within the protection scope of the present application.

[0049] In one embodiment, the present application provides an intelligent exhibition hall control method based on a guiding robot. The following embodiments will illustrate the application of this method to an intelligent exhibition hall control system, which is abbreviated as the system in the following embodiments. It can be understood that the computer device on which the intelligent exhibition hall control method based on the guiding robot is executed may be a computer device deployed with the intelligent exhibition hall control system. Specifically, multiple display screens, explanation devices, guiding robots, multi-modal detection devices, etc. are provided in the intelligent exhibition hall. The intelligent exhibition hall control system can communicate with these devices to execute the intelligent exhibition hall control method provided by the present application.

[0050] As Figure 1 shown, the present application provides an intelligent exhibition hall control method based on a guiding robot, and the method includes:

[0051] S101: Perform multi-modal detection on a target visitor entering the exhibition hall. When the target visitor passes the multi-modal detection, obtain the user information of the target visitor, and construct a user portrait of the target visitor according to the user information.

[0052] Among them, the target visitor refers to a visitor entering the exhibition hall. The user information includes the reservation information and permission information of the target visitor. The user portrait is a multi-dimensional and dynamic visitor feature description model constructed based on the user information.

[0053] In this step, when it is detected that a target visitor enters the exhibition hall, the system performs multi-modal biometric identification on the target visitor through a multi-modal detection device to complete identity verification. When the target visitor passes the multi-modal detection, at this time, an explanation device can be dispatched to the target visitor, and at the same time, the user information can be obtained from a preset reservation database, and then a user portrait of the target visitor is constructed based on the obtained user information.

[0054] Specifically, the multimodal detection device includes, but is not limited to, cameras, sensors, biometric devices, etc. Based on the multimodal detection device, biometric information of the user can be collected from multiple dimensions, and then this biometric information is compared with the information in the reservation database to complete the identity verification of the target visitor. In addition, during the construction of the user portrait, static information of the visitor (such as age, gender, occupation) can be combined with dynamic behaviors (such as interest preferences, purchase records) through data mining and analysis techniques to form a comprehensive and three-dimensional description of the visitor's characteristics, so as to obtain the user portrait.

[0055] S102: Determine the visitor density in each area of the exhibition hall, and after determining the guided tour route in the pre-constructed three-dimensional map of the exhibition hall based on the visitor density in each area of the exhibition hall and the user portrait, guide the target visitor to visit according to the guided tour route.

[0056] Among them, the visitor density refers to the number of visitors per unit area in each area of the exhibition hall, which reflects the degree of congestion in each area of the exhibition hall. The three-dimensional map of the exhibition hall is a digital three-dimensional model of the exhibition hall space, containing information such as the layout of the exhibition hall, the location of exhibits, and the distribution of passageways. The guided tour route is the optimal path generated in the three-dimensional map of the exhibition hall according to the visitor density and the user portrait. The purpose of the guided tour route is to guide visitors to visit exhibits efficiently, avoid congestion at the same time, and improve the viewing experience.

[0057] In this step, the system monitors the distribution of visitors in real time through sensors installed in each area of the exhibition hall, and calculates the visitor density in each area of the exhibition hall. These sensors can be infrared sensors, pressure sensors or cameras, etc. At the same time, the system uses the pre-constructed three-dimensional map of the exhibition hall, combines the visitor density and the preference information in the user portrait, and dynamically generates the guided tour route. For example, if the user portrait shows that the visitor has a high interest in a certain type of exhibit, and the visitor density in that area is low, the system will give priority to guiding the visitor to that area. On the contrary, if a certain area is too crowded with visitors, the system will guide the visitors to other areas to balance the passenger flow distribution.

[0058] Specifically, the guided tour route can be displayed to the visitors through wearable guided tour devices (such as handheld terminals, smart glasses, smart watches, etc.) or mobile robots in the exhibition hall. For example, visitors can see their current location and the recommended guided tour route through the map on the handheld terminal.

[0059] Furthermore, when constructing the three-dimensional map of the exhibition hall, 3D lidar can be used to scan the exhibition hall environment in all directions, and then the three-dimensional map of the exhibition hall is constructed based on the SLAM (Simultaneous Localization and Mapping) technology.

[0060] Determine the guided tour route by balancing crowding and interest preferences. In this way, on the one hand, based on precise spatial measurement and real-time data analysis, it can intelligently avoid high-density areas, effectively balance the overall passenger flow distribution in the exhibition hall, and prevent the decline in the exhibition experience caused by local congestion. On the other hand, it can customize the route sequence according to the user's interest preferences to ensure that visitors can first come into contact with highly matched exhibits and improve the value conversion rate of the viewing content. In addition, the specific balance weight setting can be dynamically set according to actual needs. This application does not make specific restrictions on this.

[0061] In one example, the system can also combine real-time data and historical data to predict the change trend of visitor flow, adjust the guided tour route and exhibit layout in advance, and further optimize the operation efficiency of the exhibition hall and the visitor experience.

[0062] S103: During the viewing process of the target visitor, when it is detected that the target visitor is interested in any exhibit, generate personalized playback content and personalized explanation content according to the user profile, upload the personalized playback content to the playback control system to adjust the playback content in the relevant area of the exhibit, and upload the personalized explanation content to the explanation device of the target visitor for exhibit explanation.

[0063] Among them, the playback control system refers to the system used to manage and control the multimedia playback devices in the exhibition hall. The explanation device refers to an intelligent device with a speaker, such as intelligent headphones, handheld explainers, intelligent robots, and so on.

[0064] In this step, when it is detected that the target visitor is interested in any exhibit during the viewing process, generate the personalized playback content and personalized explanation content of the exhibit according to the user profile, and then upload the personalized playback content to the playback control system to adjust the playback content in the relevant area of the exhibit, and upload the personalized explanation content to the explanation device of the target visitor to achieve the purpose of personalized exhibit explanation.

[0065] Specifically, it can be determined whether the target visitor is interested in a certain exhibit by the target visitor's staying time and line of sight direction. Furthermore, in the case of determining that the target visitor is interested in the exhibit, generate the personalized playback content and personalized explanation content for the exhibit, so as to provide the personalized playback content and explanation content for the target visitor.

[0066] In the above embodiment, multimodal detection is performed on target visitors entering the exhibition hall, and accurate identity verification is achieved through multimodal biometric recognition. When a target visitor passes the multimodal detection, the target visitor's user information is accurately obtained, and a user profile of the target visitor is then constructed based on the user information. Simultaneously, the visitor density of each area of the exhibition hall can be detected in real time. Based on this visitor density and user profile, a guided route is determined within a pre-built three-dimensional map of the exhibition hall, achieving balanced distribution of visitor flow while improving viewing efficiency. User preferences are also considered when generating guided routes. Then, during the target visitor's tour, if the target visitor is detected to be interested in any exhibit, personalized playback content and explanation content are generated based on the user profile and pushed to the corresponding device. This not only enables real-time response to changes in visitor behavior, but also enables targeted generation of personalized playback and explanation content, enhancing the viewing experience and the intelligent level of the exhibition hall. Furthermore, determining routes, explanation content, and playback content based on the same user profile enables deep data linkage, thereby achieving an overall optimal allocation of exhibition hall resources and a synergistic improvement in visitor experience.

[0067] In one embodiment, multimodal detection of target visitors entering an exhibition hall includes:

[0068] S1: Collect facial information and palm print information of target visitors entering the exhibition hall.

[0069] S2: Match the facial information and palm print information in a preset reservation database. If the reservation database contains reservation information corresponding to both the facial information and the palm print information, the target visitor is considered to have passed the multimodal detection. Otherwise, the target visitor is considered to have failed the multimodal detection.

[0070] Facial information refers to visitor facial features collected through facial recognition technology, and palm print information refers to visitor palm print feature data collected through palm print recognition technology. The reservation database is a database that stores the reservation information of target visitors, including the visitor's facial information, palm print information, occupation information, age, gender, etc.

[0071] In this embodiment, when a target visitor enters the exhibition hall, the system first collects the visitor's face information and palm vein information through a 3D structured light camera and a palm vein recognition sensor installed at the entrance of the exhibition hall respectively. Then, the collected face information and palm vein information are matched with the data in the preset reservation database. The reservation database stores the face and palm vein information of all reserved visitors. At this time, the collected information can be compared with the records in the database one by one to determine whether there is a completely matching reservation person information. If there is reservation person information in the reservation database that corresponds to both the collected face information and palm vein information, it is considered that the target visitor has passed the multi-modal detection and is allowed to enter the exhibition hall for viewing. On the contrary, if no matching information is found in the database, it is considered that the target visitor has not passed the multi-modal detection, and the system will prompt the target visitor to perform further identity verification or contact the exhibition hall staff.

[0072] Specifically, through the dual verification of face information and palm vein information, identity fraud and unauthorized access can be effectively prevented, ensuring that only visitors who have successfully reserved can enter the exhibition hall. This dual verification mechanism not only improves the accuracy and reliability of identity recognition, but also enhances the management efficiency and security of the exhibition hall.

[0073] As Figure 2 shown, in one of the embodiments, the user information of the target visitor is obtained, and a user portrait of the target visitor is constructed based on the user information, including:

[0074] S201: Obtain the user information of the target visitor in the preset reservation database to determine the personnel category corresponding to the target visitor.

[0075] S202: Determine whether the target visitor has a historical purchase record in the current exhibition hall.

[0076] S203: If the target visitor has a historical purchase record in the current exhibition hall, obtain the historical purchase record of the target visitor, determine the preference characteristics of the target visitor based on the historical purchase record, and then construct the user portrait of the target visitor according to the personnel category and preference characteristics.

[0077] S204: If the target visitor does not have a historical purchase record in the current exhibition hall, construct the user portrait of the target visitor according to the personnel category.

[0078] Among them, the historical purchase record refers to the past purchase behavior record of the target visitor in the current exhibition hall.

[0079] In this embodiment, when the target visitor enters the exhibition hall through multimodal detection, the system will obtain their user information from the preset reservation database to determine the corresponding personnel category of the visitor (such as experts and scholars, students, etc.). Next, the system will further check whether the target visitor has a historical purchase record in the current exhibition hall. If the target visitor has no historical purchase record in the current exhibition hall, a user profile will be constructed based on their personnel category. If the target visitor has a historical purchase record in the current exhibition hall, the system will obtain these historical purchase records and extract the visitor's preference features through data analysis techniques. For example, if a visitor often purchases a certain category of exhibits (such as technology products or artworks), the system will mark this category as the visitor's preference feature. Based on the visitor's personnel category and preference features, a user profile of the target visitor can be constructed. It can be understood that the user profile obtained in this case not only includes the basic information of the visitor (such as age, gender, membership level, etc.), but also covers their preference features (such as the category of products of interest, purchase frequency, etc.).

[0080] By obtaining the user information of the target visitor in the preset reservation database to determine the personnel category and constructing the user profile based on their historical purchase records to determine the preference features, in this way, the basic attributes and consumption preferences of the target visitor can be comprehensively understood, so as to provide the visitor with exhibit recommendations, guided tour routes and explanatory content that better meet their needs. For example, for target visitors with historical purchase records, relevant new exhibits or promotional activities can be recommended according to their preference features; for target visitors without historical purchase records, general but targeted services can be provided based on their personnel category. Thus, the optimal allocation of resources and the coordinated improvement of the visitor experience can be achieved.

[0081] As Figure 3 shown, in one of the embodiments, the visitor density of each area of the exhibition hall is determined, and the guided tour route is determined in the pre-constructed three-dimensional map of the exhibition hall according to the visitor density of each area of the exhibition hall and the user profile, including:

[0082] S301: Obtain the number of detected people in each area of the exhibition hall, and calculate the visitor density of each area of the exhibition hall according to the number of detected people in each area of the exhibition hall.

[0083] S302: Determine the permission information of the target visitor according to the user profile, and determine the accessible areas in the pre-constructed three-dimensional map of the exhibition hall based on the permission information.

[0084] S303: Mark the target exhibits in the accessible areas according to the user profile, and generate multiple target routes according to the marked target exhibits.

[0085] S304: Evaluate the comprehensive density of each target route based on the visitor density of each area of the exhibition hall, and select the target route with the lowest comprehensive density among each target route as the guided tour route.

[0086] Among them, the permission information refers to the viewing permission of the target visitor in the exhibition hall. The comprehensive density is used to measure the current congestion degree of the target route.

[0087] In this embodiment, the number of people in each area is detected by cameras in the exhibition hall, and then the visitor density of each area in the exhibition hall is calculated according to the number of people detected in each area of the exhibition hall. Specifically, the detected number of people can be converted into visitor density according to a preset rule or formula. When the visitor density is larger, it means the corresponding area is more crowded. Then, the visitor membership type is determined according to the user profile, and the permission information is determined based on the visitor membership type. For example, only VIP visitors can view some areas in the exhibition hall. Then, the accessible areas can be determined in the 3D map of the exhibition hall according to the permission information, and then the exhibits that the user may be more interested in can be selected according to the user profile in the accessible areas, that is, the target exhibits. Then, multiple target routes can be determined by adjusting the viewing order of each target exhibit and the route between two exhibits. Finally, the comprehensive density of each target route is evaluated, and the target route with the lowest comprehensive density is determined as the guided tour route.

[0088] Furthermore, when evaluating the comprehensive density of each target route, the average value of the visitor density of the exhibition hall areas passed by each target route can be calculated to obtain the comprehensive density of each target route. Higher weights can also be given to some key areas, and finally the weighted average is performed to obtain the comprehensive density of each route. This application does not make specific restrictions on this.

[0089] It can be understood that during the viewing process of the target visitor, the guided tour route can be updated regularly in the above manner to dynamically respond to the possible changing visitor density in each area of the exhibition hall.

[0090] In this embodiment, by obtaining the detected number of people in each area of the exhibition hall and calculating the visitor density, the distribution of the flow of people is grasped. Then, the accessible areas are determined according to the user profile, and the target exhibits are marked in the accessible areas to generate multiple target routes. Finally, the comprehensive density of each target route is evaluated and the route with the lowest comprehensive density is selected as the guided tour route. In this way, on the one hand, the viewing experience can be optimized and congestion can be avoided, achieving an even distribution of the passenger flow. On the other hand, the efficient operation of the exhibition hall can be ensured, and the intelligent level of the exhibition hall can be further improved.

[0091] In one of the embodiments, guiding the target visitor to view according to the guided tour route includes:

[0092] S1: When using a guided tour robot as the guided tour device in the exhibition hall, synchronize the guided tour route to the guided tour robot closest to the target visitor, so that the guided tour robot guides the target visitor to view based on the guided tour route.

[0093] Among them, the guiding robot conducts guiding work based on a 3D lidar and a preset path planning algorithm. Moreover, an inertial measurement unit and a wheel encoder are provided in the guiding robot, so that the acceleration and angular velocity of the robot and the rotation of the wheels can be sensed in real time, thereby further improving the positioning accuracy.

[0094] In this step, when the guiding robot is used as the exhibition hall guiding device in the exhibition hall, the guiding route can be synchronized to the guiding robot closest to the target visitor at this time, so that the guiding robot can guide the target visitor to view according to the received guiding route.

[0095] In one embodiment, the guiding robot is equipped with a far-field microphone array, a speaker, a camera, and a display screen. When the guiding robot receives a gesture signal or a voice signal, it can parse the gesture signal or the voice signal to execute corresponding measures. And when the battery of the guiding robot is insufficient, the system can timely dispatch a standby robot to take over the work of this guiding robot.

[0096] S2: When a wearable guiding device is used as the exhibition hall guiding device, synchronize the guiding route to the wearable guiding device corresponding to the target visitor, so that the wearable guiding device displays the guiding route and conducts text guiding according to the guiding route.

[0097] In this step, when the wearable guiding device is used as the exhibition hall guiding device in the exhibition hall, then after the target visitor enters the exhibition hall through multi-modal detection, a wearable guiding device will be distributed to the target visitor, such as a smart watch, smart glasses, etc. Then the guiding route can be sent to the wearable guiding device of the target visitor, so that the wearable guiding device can guide the target visitor to view according to the received guiding route.

[0098] In this embodiment, different guiding schemes are set according to different conditions in the exhibition hall, making full use of the facility resources in the exhibition hall and further improving the intelligent level of the exhibition hall. And when the resources are insufficient, a flexible guiding method of coexisting the two schemes can also be adopted. For example, fixed quotas can be set for the two schemes of robot guiding and wearable device guiding, and the target visitor can freely choose the guiding method when making a reservation to view the exhibition.

[0099] As Figure 4 shown, in one embodiment, when it is detected that the target visitor is interested in any exhibit, personalized playback content and personalized explanation content are generated according to the user profile, including:

[0100] S401: Real-time detect the staying position of the target visitor. When the staying time at the staying position exceeds a preset threshold, detect the line-of-sight direction of the target visitor, and determine the exhibit to be explained by combining the staying position and the line-of-sight direction.

[0101] S402: Determine the explanation style and depth according to the user profile, and generate personalized explanation content for the exhibits to be explained based on the explanation style and depth.

[0102] S403: Determine personalized playback content according to the type of the exhibits to be explained and the user profile.

[0103] Among them, the preset threshold is an empirical value and can be adjusted according to the actual situation. The exhibits to be explained refer to the exhibits that the current detected target visitor is interested in. The explanation style refers to the language style and expression way of the explanation content, including formal or informal, humorous or serious, academic or popular, etc. The explanation depth refers to the detail and professionalism of the explanation content, including basic information, in-depth analysis, background knowledge, etc. It is adjusted according to the knowledge level and interest depth of the visitor to ensure that the explanation content is both attractive and has popular science significance.

[0104] In this embodiment, during the visit of the target visitor, the exhibits to be explained that the target visitor is currently interested in can be determined by combining the staying position and line-of-sight direction of the target visitor. After determining the exhibits to be explained, the system will determine the explanation style and depth according to the information in the user profile. For example, if the user profile shows that the target visitor is a college student with a strong interest in art, the system may choose a relatively academic but interesting explanation style and provide an appropriate explanation depth, including both the basic information of the art work and some background knowledge of art history. Next, the system can generate personalized explanation content for the exhibits to be explained according to the explanation style and depth. Specifically, the personalized explanation content can be realized through natural language processing technology. At this time, prompt words can be generated according to the explanation style, depth and the exhibits to be explained, and then input into the corresponding model to obtain the personalized explanation content of the exhibits to be explained.

[0105] At the same time, the system can also determine personalized playback content according to the type of the exhibits to be explained and the user profile. Exemplarily, if the exhibit is a famous painting, the system may generate a video content including art style analysis and painter's life introduction according to the interest preference of the visitor. If the exhibit is a technology product, the system may generate a video showing the product functions and operation demonstrations.

[0106] By accurately matching the explanation style with the user's cognitive level, the information understanding threshold is greatly reduced, and the knowledge absorption efficiency is improved. In this process, the content depth customization based on interest preference and exhibit characteristics can not only avoid information overload but also meet the in-depth exploration needs. At the same time, the collaborative generation of the explanation content and the playback content forms a unified immersive viewing experience, improving the viewing experience and the intelligent level of the exhibition hall.

[0107] In one embodiment, uploading personalized playback content to the playback control system to adjust the playback content in the relevant area of the exhibit includes:

[0108] S1: When the playback control system receives different personalized playback contents for the same relevant area of the exhibit, perform style integration based on the received multiple personalized playback contents to obtain the target playback content.

[0109] S2: When the playback control system receives a personalized playback content for the relevant area of the exhibit, determine the personalized playback content as the target playback content.

[0110] S3: Send the target playback content to the playback devices in the relevant area of the exhibit for content playback.

[0111] In this embodiment, when there are multiple personalized playback contents for the same relevant area of the exhibit at the same time, it is necessary to integrate the playback styles of each personalized playback content to obtain the target playback content. On the contrary, when there are no multiple personalized playback contents for the same relevant area of the exhibit at the same time, directly determine the personalized playback content as the target playback content. After determining the target playback content, send the target playback content to the playback devices in the relevant area of the exhibit for content playback. Specifically, each relevant area of the exhibit can be pre-divided according to the position and size of the exhibit and in combination with the three-dimensional map of the exhibition hall.

[0112] It can be understood that by dynamically controlling the playback content in each relevant area of the exhibit, the playback content can be made to fit the user profile of the visitor, thereby improving the user viewing experience and the intelligent level of the exhibition hall at the same time.

[0113] In one embodiment, the visitor reservation process may include: the target visitor uploads biometric features and personal information through a mini-program or APP for reservation viewing.

[0114] It should be understood that although each step in the flowcharts involved in the above-described embodiments is displayed in sequence according to the arrow indication, these steps are not necessarily executed in the order indicated by the arrow. Unless there is a clear description in this article, the execution of these steps has no strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-described embodiments may include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same moment, but can be executed at different moments, and the execution order of these steps or stages is not necessarily sequential, but can be executed alternately or alternately with at least a part of other steps or steps or stages in other steps.

[0115] The following describes the intelligent exhibition hall control device based on the tour guide robot provided in an embodiment of the present application. The intelligent exhibition hall control device based on the tour guide robot described below and the intelligent exhibition hall control method based on the tour guide robot described above can be referenced to each other.

[0116] like Figure 5 As shown, the present application provides an intelligent exhibition hall control device 500 based on a tour guide robot, the device comprising:

[0117] Visitor detection module 501 is used to perform multimodal detection on target visitors entering the exhibition hall. When the target visitor passes the multimodal detection, user information of the target visitor is obtained and a user profile of the target visitor is constructed based on the user information.

[0118] Route generation module 502 is used to determine the visitor density of each area of the exhibition hall, and determine the guided route in the pre-built three-dimensional map of the exhibition hall based on the visitor density of each area of the exhibition hall and the user profile, and guide the target visitor to visit according to the guided route;

[0119] The content generation module 503 is used to generate personalized playback content and personalized explanation content based on the user portrait when it is detected that the target visitor is interested in any exhibit during the target visitor's browsing process, and upload the personalized playback content to the playback control system to adjust the playback content of the exhibit-related area, and upload the personalized explanation content to the target visitor's explanation device to explain the exhibit.

[0120] In the above embodiment, multimodal detection is performed on target visitors entering the exhibition hall, and accurate identity verification is achieved through multimodal biometric recognition. When a target visitor passes the multimodal detection, the target visitor's user information is accurately obtained, and a user profile of the target visitor is then constructed based on the user information. Simultaneously, the visitor density of each area of the exhibition hall can be detected in real time. Based on this visitor density and user profile, a guided route is determined within a pre-built three-dimensional map of the exhibition hall, achieving balanced distribution of visitor flow while improving viewing efficiency. User preferences are also considered when generating guided routes. Then, during the target visitor's tour, if the target visitor is detected to be interested in any exhibit, personalized playback content and explanation content are generated based on the user profile and pushed to the corresponding device. This not only enables real-time response to changes in visitor behavior, but also enables targeted generation of personalized playback and explanation content, enhancing the viewing experience and the intelligent level of the exhibition hall. Furthermore, determining routes, explanation content, and playback content based on the same user profile enables deep data linkage, thereby achieving an overall optimal allocation of exhibition hall resources and a synergistic improvement in visitor experience.

[0121] In one embodiment, the visitor detection module includes:

[0122] An information collection sub-module, configured to collect the facial information and palmprint information of target visitors entering the exhibition hall;

[0123] An information matching sub-module, configured to match the facial information and palmprint information in a preset reservation database. If there is reservation person information corresponding to both the facial information and the palmprint information in the reservation database, it is considered that the target visitor passes the multi-modal detection; otherwise, it is considered that the target visitor fails the multi-modal detection.

[0124] In one embodiment, the visitor detection module includes:

[0125] An information acquisition sub-module, configured to acquire the user information of the target visitor in a preset reservation database to determine the personnel category corresponding to the target visitor;

[0126] A first construction sub-module, configured to, if the target visitor has a historical purchase record in the current exhibition hall, acquire the historical purchase record of the target visitor, determine the preference characteristics of the target visitor according to the historical purchase record, and then construct a user portrait of the target visitor according to the personnel category and the preference characteristics;

[0127] A second construction sub-module, configured to, if the target visitor does not have a historical purchase record in the current exhibition hall, construct a user portrait of the target visitor according to the personnel category.

[0128] In one embodiment, the route generation module includes:

[0129] A calculation sub-module, configured to acquire the detected number of people in each area of the exhibition hall and calculate the visitor density of each area in the exhibition hall according to the detected number of people in each area of the exhibition hall;

[0130] An area determination sub-module, configured to determine the permission information of the target visitor according to the user portrait and determine the accessible area in a pre-constructed three-dimensional map of the exhibition hall based on the permission information;

[0131] A route generation sub-module, configured to mark target exhibits in the accessible area according to the user portrait and generate multiple target routes according to the marked target exhibits;

[0132] A route determination sub-module, configured to evaluate the comprehensive density of each target route based on the visitor density of each area in the exhibition hall and select the target route with the lowest comprehensive density among each target route as the guided tour route.

[0133] In one embodiment, the route generation module includes:

[0134] The first guiding sub-module is used to synchronize the guiding route to the guiding robot closest to the target visitor when using a guiding robot as the exhibition hall guiding device, so that the guiding robot guides the target visitor to view based on the guiding route; the guiding robot conducts guiding work based on a 3D lidar and a preset path planning algorithm;

[0135] The second guiding sub-module is used to synchronize the guiding route to the wearable guiding device corresponding to the target visitor when using a wearable guiding device as the exhibition hall guiding device, so that the wearable guiding device displays the guiding route and conducts text guiding according to the guiding route.

[0136] In one embodiment, the content generation module includes:

[0137] The exhibit determination sub-module is used to detect the staying position of the target visitor in real time. When the staying time at the staying position exceeds a preset threshold, it detects the line-of-sight direction of the target visitor, and determines the exhibit to be explained by combining the staying position and the line-of-sight direction;

[0138] The first determination sub-module is used to determine the explanation style and depth according to the user profile, and generate personalized explanation content for the exhibit to be explained according to the explanation style and depth;

[0139] The second determination sub-module is used to determine personalized playback content according to the type of the exhibit to be explained and the user profile.

[0140] In one embodiment, the content generation module includes:

[0141] The first determination sub-module is used to integrate the styles based on the received multiple personalized playback contents to obtain the target playback content when the playback control system receives different personalized playback contents for the relevant area of the same exhibit;

[0142] The second determination sub-module is used to determine the personalized playback content as the target playback content when the playback control system receives a personalized playback content for the relevant area of the exhibit;

[0143] The playback sub-module is used to send the target playback content to the playback device in the relevant area of the exhibit for content playback.

[0144] The division of each module in the above intelligent exhibition hall control device based on a guiding robot is only for illustrative purposes. In other embodiments, the intelligent exhibition hall control device based on a guiding robot can be divided into different modules as needed to complete all or part of the functions of the above intelligent exhibition hall control device based on a guiding robot. Each module in the above intelligent exhibition hall control device based on a guiding robot can be implemented in whole or in part by software, hardware, and their combination. Each of the above modules can be embedded in the processor of the computer device in hardware form or independent of it, or stored in the memory of the computer device in software form, so that the processor can call and execute the operations corresponding to each of the above modules.

[0145] In one embodiment, the present application also provides a storage medium storing computer-readable instructions, which, when executed by one or more processors, cause the one or more processors to execute the steps of the intelligent exhibition hall control method based on a guiding robot as described in any one of the above embodiments.

[0146] In one embodiment, the present application also provides a computer device storing computer-readable instructions, which, when executed by one or more processors, cause the one or more processors to execute the steps of the intelligent exhibition hall control method based on a guiding robot as described in any one of the above embodiments.

[0147] Schematically, as Figure 6 shown, Figure 6 is an internal structural schematic diagram of a computer device provided by an embodiment of the present application. The computer device 600 can be provided as a server. Referring to Figure 6 , the computer device 600 includes a processing component 602, which further includes one or more processors, and memory resources represented by a memory 601 for storing instructions executable by the processing component 602, such as application programs. The application programs stored in the memory 601 can include one or more modules each corresponding to a set of instructions. In addition, the processing component 602 is configured to execute instructions to perform the intelligent exhibition hall control method based on a guiding robot of any of the above embodiments.

[0148] The computer device 600 may further include a power supply component 603 configured to perform power management of the computer device 600, a wired or wireless network interface 604 configured to connect the computer device 600 to a network, and an input / output (I / O) interface 605. The computer device 600 can operate based on an operating system stored in the memory 601, such as WindowsServer TM, Mac OS XTM, Unix TM, Linux TM, Free BSDTM, or the like.

[0149] Those skilled in the art can understand that Figure 6 The structure shown in Figure 6 is only a block diagram of some structures related to the solution of this application, and does not constitute a limitation on the computer device to which the solution of this application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine some components, or have a different component layout.

[0150] Finally, it should also be noted that in this text, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variant thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements not only includes those elements, but also includes other elements not expressly listed, or also includes elements inherent to such process, method, article or device. Without further limitation, an element defined by the statement "including a..." does not exclude the existence of additional identical elements in the process, method, article or device including the said element. In this text, the singular forms "a", "an" and "the" may also include the plural form unless the context clearly indicates otherwise. It should also be understood that the terms "include / comprise" or "have" etc. specify the existence of the stated features, wholes, steps, operations, components, parts or combinations thereof, but do not exclude the possibility of the existence or addition of one or more other features, wholes, steps, operations, components, parts or combinations thereof. At the same time, the term "and / or" used in this specification includes any and all combinations of the related listed items.

[0151] The various embodiments in this specification are described in a progressive manner. Each embodiment focuses on the differences from other embodiments. The various embodiments can be combined as needed, and the same or similar parts can be referred to each other.

[0152] The above description of the disclosed embodiments enables those skilled in the art to implement or use this application. Various modifications to these embodiments will be obvious to those skilled in the art. The general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of this application. Therefore, this application will not be limited to these embodiments shown herein, but rather to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. An intelligent exhibition hall control method based on a guiding robot, characterized in that, The method includes: Performing multi-modal detection on a target visitor entering the exhibition hall. When the target visitor passes the multi-modal detection, obtaining the user information of the target visitor, and constructing a user profile of the target visitor according to the user information; Determining the visitor density of each area in the exhibition hall, and after determining a guided tour route in a pre-constructed three-dimensional map of the exhibition hall according to the visitor density of each area in the exhibition hall and the user profile, guiding the target visitor to view according to the guided tour route; During the viewing process of the target visitor, when it is detected that the target visitor is interested in any exhibit, generating personalized playback content and personalized explanation content according to the user profile, uploading the personalized playback content to the playback control system to adjust the playback content of the relevant area of the exhibit, and uploading the personalized explanation content to the explanation device of the target visitor for exhibit explanation.

2. The intelligent exhibition hall control method based on a navigation robot according to claim 1, wherein The performing multi-modal detection on a target visitor entering the exhibition hall includes: Collecting the face information and palmprint information of the target visitor entering the exhibition hall; Performing information matching on the face information and the palmprint information in a preset reservation database. If there is reservation person information corresponding to both the face information and the palmprint information in the reservation database, it is considered that the target visitor passes the multi-modal detection, otherwise, it is considered that the target visitor fails the multi-modal detection.

3. The intelligent exhibition hall control method based on a guiding robot according to claim 1, wherein, The obtaining the user information of the target visitor and constructing a user profile of the target visitor according to the user information includes: Obtaining the user information of the target visitor in a preset reservation database to determine the personnel category corresponding to the target visitor; If the target visitor has a historical purchase record in the current exhibition hall, obtaining the historical purchase record of the target visitor, determining the preference characteristics of the target visitor according to the historical purchase record, and then constructing the user profile of the target visitor according to the personnel category and the preference characteristics; If the target visitor does not have a historical purchase record in the current exhibition hall, constructing the user profile of the target visitor according to the personnel category.

4. The intelligent exhibition hall control method based on a guiding robot according to claim 1, wherein The determining the visitor density of each area in the exhibition hall and determining a guided tour route in a pre-constructed three-dimensional map of the exhibition hall according to the visitor density of each area in the exhibition hall and the user profile includes: Obtaining the number of detected people in each area of the exhibition hall, and calculating the visitor density of each area in the exhibition hall according to the number of detected people in each area of the exhibition hall; Determining the permission information of the target visitor according to the user profile, and determining the accessible area in a pre-constructed three-dimensional map of the exhibition hall based on the permission information; Marking target exhibits in the accessible area according to the user profile, and generating multiple target routes according to the marked target exhibits; Evaluating the comprehensive density of each target route based on the visitor density of each area in the exhibition hall, and selecting the target route with the lowest comprehensive density among the target routes as the guided tour route.

5. The intelligent exhibition hall control method based on a navigation robot according to claim 1, characterized in that The guiding the target visitor to view according to the guided tour route includes: When using a guiding robot as the guiding device in the exhibition hall, synchronize the guiding route to the guiding robot closest to the target visitor, so that the guiding robot guides the target visitor to view based on the guiding route; the guiding robot conducts guiding work based on a 3D lidar and a preset path planning algorithm; When using a wearable guiding device as the guiding device in the exhibition hall, synchronize the guiding route to the wearable guiding device corresponding to the target visitor, so that the wearable guiding device displays the guiding route and conducts text guiding according to the guiding route.

6. The intelligent exhibition hall control method based on a navigation robot according to claim 1, wherein, When it is detected that the target visitor is interested in any exhibit, generate personalized playback content and personalized explanation content according to the user profile, including: Real-time detect the staying position of the target visitor. When the staying time at the staying position exceeds a preset threshold, detect the line-of-sight direction of the target visitor, and determine the exhibit to be explained by combining the staying position and the line-of-sight direction; Determine the explanation style and explanation depth according to the user profile, and generate personalized explanation content for the exhibit to be explained according to the explanation style and the explanation depth; Determine personalized playback content according to the type of the exhibit to be explained and the user profile.

7. The intelligent exhibition hall control method based on a navigation robot according to claim 1, characterized in that, The uploading the personalized playback content to the playback control system to adjust the playback content in the relevant area of the exhibit includes: When the playback control system receives different personalized playback contents in the relevant area of the same exhibit, perform style integration based on the received multiple personalized playback contents to obtain the target playback content; When the playback control system receives a personalized playback content in the relevant area of the exhibit, determine the personalized playback content as the target playback content; Send the target playback content to the playback device in the relevant area of the exhibit for content playback.

8. An intelligent exhibition hall control device based on a guiding robot, characterized in that, The device includes: A visitor detection module, configured to perform multi-modal detection on the target visitor entering the exhibition hall. When the target visitor passes the multi-modal detection, obtain the user information of the target visitor, and construct the user profile of the target visitor according to the user information; A route generation module, configured to determine the visitor density of each area in the exhibition hall, and determine a guiding route in the pre-constructed three-dimensional map of the exhibition hall according to the visitor density of each area in the exhibition hall and the user profile, and then guide the target visitor to view according to the guiding route; A content generation module, configured to, during the viewing process of the target visitor, when it is detected that the target visitor is interested in any exhibit, generate personalized playback content and personalized explanation content according to the user profile, upload the personalized playback content to the playback control system to adjust the playback content in the relevant area of the exhibit, and upload the personalized explanation content to the explanation device of the target visitor for exhibit explanation.

9. A storage medium, characterized in that: The computer-readable instructions are stored in the storage medium. When the computer-readable instructions are executed by one or more processors, the one or more processors are caused to execute the steps of the intelligent exhibition hall control method based on a guiding robot according to any one of claims 1 to 7.

10. A computer device, characterized in that, Including: One or more processors, and a memory; Computer-readable instructions are stored in the memory, and when the computer-readable instructions are executed by the one or more processors, the steps of the intelligent exhibition hall control method based on a navigation robot according to any one of claims 1 to 7 are executed.

Images