Interactive multifunctional park guide device

Abstract

The invention relates to the technical field of smart park equipment, and discloses an interactive multifunctional park guide device which comprises an intelligent interactive screen, augmented reality glasses, an intelligent voice assistant, a mobile positioning and navigation module and an intelligent help system. The intelligent interaction screen comprises a touch screen, 3D projection and gesture recognition. The touch screen supports a user to inquire scenic spot information, the 3D projection is used for stereoscopically displaying images, and the gesture recognition module executes operation through gesture instructions. The augmented reality glasses have AR display and head tracking functions, render virtual images in real time and track head actions of a user. The intelligent voice assistant receives a user instruction through voice recognition and voice synthesis and gives reply or operation guidance. And the mobile positioning and navigation module positions the user position and displays the current position and surrounding scenic spot information. The interactive multifunctional park guide device provided by the invention not only improves the guide experience of the user, but also enables the management and service of the park to be more efficient and humanized through an intelligent means.

Description

Technical Field

[0001] The present invention relates to the technical field of smart park equipment, and in particular to an interactive multifunctional park guide device. Background Art

[0002] As an important part of the smart park, the park guide device not only provides users with basic park navigation services, but also carries multiple functions such as park cultural display and information interaction. However, most of the existing park guide devices have a single function and can only provide simple navigation services, which cannot meet users' needs for diversified information, nor can they achieve in-depth interaction with users.

[0003] Therefore, there is an urgent need for a new interactive multifunctional park guide device to solve the problems existing in the prior art and realize the comprehensive display of park information and the deep interaction between users and the device. Summary of the invention

[0004] In view of this, the present invention proposes an interactive multifunctional park guide device, which aims to achieve all-round display of park information and intelligent interaction between users and the device.

[0005] The present invention proposes an interactive multifunctional park guide device, comprising:

[0006] Smart interactive screens, augmented reality glasses, smart voice assistants, mobile positioning and navigation modules, and smart help systems;

[0007] The intelligent interactive screen includes a touch screen, a 3D projection and a gesture recognition module; the touch screen is configured to allow users to click and slide to query scenic spot information; the 3D projection is used for stereoscopic image display; the gesture recognition module is used to capture the user's gestures and perform corresponding operations through preset gesture instructions;

[0008] The augmented reality glasses include an AR display module and a head tracking module, wherein the AR display module is used to render and overlay virtual images in real time; the head tracking module is used to track the user's head movements in real time so that the virtual image is synchronized with the user's line of sight;

[0009] The intelligent voice assistant is used to receive the user's voice instructions through voice recognition and voice synthesis, and give replies or operation instructions;

[0010] The mobile positioning and navigation module is used to locate the real-time position of the user in the park and display the user's current position and surrounding scenic spots information through a map.

[0011] Preferably, the gesture recognition module is used to capture the user's gesture and perform corresponding operations through preset gesture instructions, specifically including:

[0012] The gesture recognition module has a built-in deep learning algorithm, and the deep learning algorithm is used to recognize the user's gesture;

[0013] The gesture recognition module is configured so that when the user waves his palm toward the screen, the smart interactive screen will automatically switch to the introduction of the next attraction; when the user draws a circle gesture in the air, the AR guide mode of the augmented reality glasses is started.

[0014] Preferably, when the gesture recognition module recognizes a circle gesture, it includes:

[0015] When the user draws a complete circle in the air in a clockwise or counterclockwise direction, the gesture recognition module captures and recognizes it as an instruction to start the AR guide mode;

[0016] When the user draws an approximate circle in the air in a clockwise or counterclockwise direction, the following judgment method is used to determine whether the approximate circle can be regarded as a complete circle:

[0017] The similarity between the approximate circle and the preset complete circle is calculated based on the Euclidean distance and the cosine similarity. When the similarity between the approximate circle and the preset complete circle reaches or exceeds a preset threshold, it is determined to be a complete circle, thereby starting the AR guide mode of the augmented reality glasses.

[0018] Preferably, the similarity between the approximate circle and the preset complete circle is calculated based on the Euclidean distance and the cosine similarity, and when the similarity between the approximate circle and the preset complete circle reaches or exceeds a preset threshold, it is determined to be a complete circle, including:

[0019] Acquire a set of feature points of an approximate circle and a preset complete circle, wherein the feature points include edge points of the circle and trajectory points when the user draws the circle in the air; calculate the Euclidean distance and cosine similarity using the set of feature points; wherein the edge points of the circle are identified by image processing technology, and the trajectory points when the user draws the circle in the air are identified by image processing technology;

[0020] The similarity Sim between the approximate circle and the preset complete circle is calculated based on the Euclidean distance and cosine similarity. The calculation formula is:

[0021] Sim=a·Euc+(1-a)·Cos;

[0022] Among them, Euc represents the similarity calculated based on Euclidean distance; Cos represents the similarity calculated based on cosine similarity; α represents the weight factor.

[0023] Preferably, the gesture recognition module is configured so that when the user uses the gesture recognition function, if the gesture recognition module still cannot accurately recognize the user's gesture after n consecutive attempts, the intelligent voice assistant automatically intervenes; at this time, the intelligent voice assistant is used to prompt the correct gesture, or suggest the user to use voice commands or touch screen operations.

[0024] Preferably, the smart interactive screen and augmented reality glasses are configured to support a voice guide mode, through which the user can query scenic spot information or navigation by voice commands;

[0025] The smart interactive screen is also configured to provide text guidance and vibration feedback for hearing-impaired users to perceive scenic spot introductions and navigation information.

[0026] Preferably, the interactive multifunctional park guide device further includes:

[0027] The intelligent environmental perception system is used to monitor the real-time environmental data in the park in real time and provide personalized services to users based on the real-time environmental data; the real-time environmental data includes weather, temperature, humidity and air quality.

[0028] Preferably, the interactive multifunctional park guide device further includes an emergency monitoring module and an intelligent help-seeking system;

[0029] The emergency situation monitoring module is used to identify and respond to emergencies within the park; when the emergency situation monitoring module identifies the existence of an emergency within the park, the emergency situation monitoring module sends instructions to the intelligent help system, and the intelligent help system will provide users with immediate help and guidance based on the type and location of the emergency.

[0030] Preferably, the intelligent help-seeking system is configured as follows:

[0031] When the emergency monitoring module detects an emergency, the intelligent help system activates the alarm system and sends an emergency notification to the user through the intelligent interactive screen, augmented reality glasses and intelligent voice assistant;

[0032] At the same time, the intelligent assistance system plans the best evacuation route according to the type and location of the emergency, and provides real-time guidance through the map display function of augmented reality glasses or smart interactive screens.

[0033] Preferably, the interactive multifunctional park guide device also includes an intelligent help system;

[0034] The intelligent help system is configured so that when a user triggers a help signal through a touch screen, gesture or voice command, the intelligent help system immediately communicates with the security monitoring center in the park in real time;

[0035] At the same time, the intelligent help system is configured with an intelligent voice communication module, which is used for real-time voice communication between the user and the security monitoring center.

[0036] Compared with the prior art, the present invention has the following beneficial effects:

[0037] The interactive multifunctional park guide device of the present invention provides users with a comprehensive and personalized guide experience through components such as intelligent interactive screen, augmented reality glasses, intelligent voice assistant, mobile positioning and navigation module, intelligent help system and intelligent environment perception system. In addition, the device also has emergency monitoring and intelligent help functions to ensure the safety of users in the park.

[0038] In specific applications, users can easily query scenic spot information, navigate, and ask for help through touch screens, gestures, or voice commands. The intelligent interactive screen not only supports touch query, but also provides users with three-dimensional display through 3D projection. The gesture recognition module captures the user's gestures through deep learning algorithms and performs corresponding operations, such as switching scenic spot introductions and starting AR guide mode.

[0039] The AR display module of the augmented reality glasses provides users with a perfect combination of virtual images and the real world, while the head tracking module ensures that the virtual image is always synchronized with the user's line of sight. The intelligent voice assistant achieves smooth communication with users through voice recognition and speech synthesis technology, providing users with operation guidance and scenic spot information.

[0040] In addition, the intelligent environmental perception system monitors the weather, temperature, humidity, air quality and other environmental data in the park in real time to provide users with personalized services. For example, in hot weather, the system can recommend sunshade facilities or cool tour routes for users.

[0041] In an emergency, the emergency monitoring module can quickly identify and respond, and the intelligent help system immediately activates the alarm system, sends emergency notifications to users, and plans the best evacuation route. Users can also trigger help signals through touch screens, gestures, or voice commands, and communicate with the security monitoring center in the park in real time to ensure that users receive timely help in an emergency.

[0042] In short, the interactive multifunctional park guide device of the present invention not only improves the user's tour experience, but also ensures the user's safety. Through technologies such as intelligent interaction, augmented reality, intelligent voice, mobile positioning and navigation, and intelligent help, it brings unprecedented convenience and comfort to users. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] Various other advantages and benefits will become apparent to those of ordinary skill in the art by reading the detailed description of the preferred embodiments below. The accompanying drawings are only for the purpose of illustrating the preferred embodiments and are not to be considered as limiting the present invention. Moreover, the same reference symbols are used throughout the accompanying drawings to represent the same components. In the accompanying drawings:

[0044] Figure 1 It is a functional block diagram of the interactive multifunctional park guide device of the present invention. DETAILED DESCRIPTION

[0045] Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments described herein. On the contrary, these embodiments are provided in order to enable a more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art. It should be noted that, in the absence of conflict, the embodiments of the present invention and the features described in the embodiments can be combined with each other. The present invention will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0046] See also Figure 1 This embodiment provides an interactive multifunctional park guide device, including:

[0047] Smart interactive screens, augmented reality glasses, smart voice assistants, mobile positioning and navigation modules, and smart help systems;

[0048] The intelligent interactive screen includes a touch screen, a 3D projection and a gesture recognition module; the touch screen is configured to allow users to click and slide to query scenic spot information; the 3D projection is used for stereoscopic image display; the gesture recognition module is used to capture the user's gestures and perform corresponding operations through preset gesture instructions;

[0049] The augmented reality glasses include an AR display module and a head tracking module, wherein the AR display module is used to render and overlay virtual images in real time; the head tracking module is used to track the user's head movements in real time so that the virtual image is synchronized with the user's line of sight;

[0050] The intelligent voice assistant is used to receive the user's voice instructions through voice recognition and voice synthesis, and give replies or operation instructions;

[0051] The mobile positioning and navigation module is used to locate the real-time position of the user in the park and display the user's current position and surrounding scenic spots information through a map.

[0052] It can be understood that the present embodiment aims to provide an innovative interactive multifunctional campus tour device, which integrates multiple high-end technologies, including a smart interactive screen, augmented reality glasses, an intelligent voice assistant, a mobile positioning and navigation module, and an intelligent help system, so as to provide a comprehensive, efficient, and convenient campus tour experience.

[0053] The intelligent interactive screen is composed of a touch screen, a 3D projection and a gesture recognition module. The touch screen is designed to allow users to query scenic spot information by clicking and sliding, providing users with an intuitive and convenient operation experience. 3D projection technology is used to display images in three dimensions, bringing users a more vivid and three-dimensional visual experience. The gesture recognition module can capture the user's gestures and perform corresponding operations through preset gesture instructions, making the entire guided tour process more intelligent and humane.

[0054] The augmented reality glasses include an AR display module and a head tracking module. The AR display module is responsible for real-time rendering and superimposing virtual images to provide users with a rich, three-dimensional augmented reality experience. The head tracking module is used to track the user's head movements in real time, so that the virtual image can be synchronized with the user's line of sight, further enhancing the user's immersion and interactive experience.

[0055] The intelligent voice assistant is another highlight of this device. It can receive the user's voice commands through voice recognition and speech synthesis technology, and give replies or operation instructions, making the navigation process more convenient and intelligent.

[0056] The mobile positioning and navigation module is responsible for locating the user's real-time position within the park, and displaying the user's current position and surrounding attractions information through a map, providing users with accurate and real-time navigation services.

[0057] In general, the interactive multifunctional park guide device provided in this embodiment aims to provide users with a comprehensive, efficient and convenient park guide experience by integrating multiple high-end technologies. Whether it is the operation of the touch screen, the three-dimensional display of augmented reality glasses, the voice interaction of the intelligent voice assistant, and the real-time navigation of the mobile positioning and navigation module, it provides great convenience for users and makes the park guide more intelligent and humane.

[0058] In some embodiments of the present application, the gesture recognition module is used to capture the user's gesture, and when performing a corresponding operation through a preset gesture instruction, specifically includes:

[0059] The gesture recognition module has a built-in deep learning algorithm, and the deep learning algorithm is used to recognize the user's gesture;

[0060] The gesture recognition module is configured so that when the user waves his palm toward the screen, the smart interactive screen will automatically switch to the introduction of the next attraction; when the user draws a circle gesture in the air, the AR guide mode of the augmented reality glasses is started.

[0061] It is understandable that this embodiment designs a gesture recognition module, whose main function is to capture the user's hand movements and execute corresponding functions when the user operates according to the pre-set gesture instructions. This module integrates advanced deep learning algorithms, which can accurately recognize and interpret the user's gestures.

[0062] Specifically, this gesture recognition module is designed so that when the user waves his palm in the direction of the smart interactive screen, the screen will automatically respond and switch to the introduction of the next attraction. This design can make the user experience smoother and obtain new information without unnecessary operations. In addition, when the user draws a circular gesture in the air, the system will start the AR guide mode of the augmented reality glasses. This mode can provide users with richer information, allowing them to understand the detailed information of the attractions more intuitively.

[0063] These embodiments demonstrate the application of the gesture recognition module in different scenarios, which not only improves the user's interactive experience, but also makes the operation easier, reflecting the humanized design of the intelligent system.

[0064] In some embodiments of the present application, when the gesture recognition module recognizes a circle gesture, it includes:

[0065] When the user draws a complete circle in the air in a clockwise or counterclockwise direction, the gesture recognition module captures and recognizes it as an instruction to start the AR guide mode;

[0066] When the user draws an approximate circle in the air in a clockwise or counterclockwise direction, the following judgment method is used to determine whether the approximate circle can be regarded as a complete circle:

[0067] The similarity between the approximate circle and the preset complete circle is calculated based on the Euclidean distance and the cosine similarity. When the similarity between the approximate circle and the preset complete circle reaches or exceeds a preset threshold, it is determined to be a complete circle, thereby starting the AR guide mode of the augmented reality glasses.

[0068] It is understandable that the gesture recognition module described in this embodiment is mainly responsible for recognizing and responding to the instructions issued by the user through specific gestures. Specifically, when the user, that is, the user, draws a complete circular trajectory smoothly in the clockwise or counterclockwise direction in the air through a finger or a corresponding input device, the gesture recognition module will instantly capture this action and recognize it as a request to activate the augmented reality (AR) navigation mode. This gesture design is intended to provide users with an intuitive and easy-to-understand way so that they can quickly and conveniently start the AR navigation function.

[0069] Furthermore, when a user tries to draw a circle, the shape drawn may not be a perfect circle due to various reasons, such as inaccuracy of the action or interference in the operating environment. To adapt to this situation, the gesture recognition module adopts a judgment mechanism to evaluate whether the irregular circle drawn can be regarded as a complete circle. The core of this judgment mechanism is based on two mathematical concepts, Euclidean distance and cosine similarity, which are used to calculate and compare the degree of similarity between the irregular circle and a preset, ideal complete circle.

[0070] Specifically, the gesture recognition module calculates the Euclidean distance between the irregular circle drawn by the user and the standard circle, that is, the actual distance difference between the two in space. At the same time, the module also calculates the cosine similarity between the two, which is an indicator to measure the angular difference between the two, ranging from -1 to 1, where 1 means that the two are exactly the same and -1 means they are completely opposite. In actual applications, when these two calculation results jointly indicate that the irregular circle drawn by the user is similar enough to the preset complete circle, that is, when the similarity reaches a pre-defined threshold, the gesture recognition module will determine that the gesture is a valid circle, and accordingly start the AR navigation mode of the augmented reality glasses, allowing users to enter a new interactive navigation experience.

[0071] In some embodiments of the present application, the similarity between the approximate circle and the preset complete circle is calculated based on the Euclidean distance and the cosine similarity. When the similarity between the approximate circle and the preset complete circle reaches or exceeds a preset threshold, it is determined to be a complete circle, including:

[0072] Acquire a set of feature points of an approximate circle and a preset complete circle, wherein the feature points include edge points of the circle and trajectory points when the user draws the circle in the air; calculate the Euclidean distance and cosine similarity using the set of feature points; wherein the edge points of the circle are identified by image processing technology, and the trajectory points when the user draws the circle in the air are identified by image processing technology;

[0073] The similarity Sim between the approximate circle and the preset complete circle is calculated based on the Euclidean distance and cosine similarity. The calculation formula is:

[0074] Sim=a·Euc+(1-a)·Cos;

[0075] Among them, Euc represents the similarity calculated based on Euclidean distance; Cos represents the similarity calculated based on cosine similarity; α represents the weight factor.

[0076] It can be understood that this embodiment uses the Euclidean distance and cosine similarity algorithm to evaluate the similarity between an approximate circle and a preset complete circle. Specifically, when the similarity between the two shapes reaches or exceeds a predefined specific threshold, we can determine that the approximate circle is complete. This process includes the following steps:

[0077] First, we need to collect a set of feature points of approximate circles and preset complete circles. These feature points include not only the traditional edge points of the circle, but also the trajectory points when the user draws a circle in the air. These trajectory points are accurately identified and extracted through advanced image processing technology.

[0078] Next, we use these feature point sets to calculate the Euclidean distance and cosine similarity. The Euclidean distance is used to measure the straight-line distance between two points, while the cosine similarity is used to measure the cosine value of the angle between two vectors. The combination of the two can comprehensively evaluate the similarity between two circles.

[0079] In the calculation formula for calculating the similarity between the approximate circle and the preset complete circle, Euc represents the similarity value calculated based on the Euclidean distance, Cos represents the similarity value calculated based on the cosine similarity, and α is a weight factor used to adjust the influence of the two calculated values ​​in the final similarity evaluation. Through this weighted method, we can get a more accurate and comprehensive similarity evaluation result.

[0080] In some embodiments of the present application, the gesture recognition module is configured to automatically intervene when the user uses the gesture recognition function, if the gesture recognition module still cannot accurately recognize the user's gesture after n consecutive attempts; at this time, the intelligent voice assistant is used to prompt the correct gesture, or suggest the user to use voice commands or touch screen operations.

[0081] It is understandable that the main function of the gesture recognition module designed in this embodiment is that when the user tries to use the gesture recognition function, if the module still cannot accurately recognize the gesture made by the user after n consecutive attempts, then our intelligent voice assistant will automatically intervene in this process. In this case, the main role of the intelligent voice assistant is to either prompt the user what the correct gesture should be, or to suggest that the user use voice commands to operate, or to operate through the touch screen. Such a design can not only ensure that the user can get timely guidance and help when using the gesture recognition function, but also improve the user's experience, making the entire operation process smoother and more convenient.

[0082] In some of the embodiments of the present application, the smart interactive screen and the augmented reality glasses are configured to support a voice guide mode, and the user queries the scenic spot information or navigation through the voice instructions in the voice guide mode;

[0083] The smart interactive screen is also configured to provide text guidance and vibration feedback for hearing-impaired users to perceive scenic spot introductions and navigation information.

[0084] It is understandable that the smart interactive screen and augmented reality glasses device provided in this embodiment are specially designed to support an advanced voice guide mode. By enabling this mode, users can easily query detailed information of various attractions or obtain accurate navigation guidance by simply issuing voice commands. This voice interaction method greatly improves the user's visiting experience and makes information acquisition faster and more intuitive.

[0085] In addition, the smart interactive screen in this embodiment has additional functions, namely, providing text guide services and vibration feedback mechanisms. This innovative design takes into account the needs of hearing-impaired users to ensure that they can also fully perceive the introduction and navigation information of the scenic spots. The text guide service can display the historical background, cultural connotations and other relevant information of the scenic spot in a visual form, while the vibration feedback is a tactile auxiliary means that enhances the user's sensory experience by transmitting vibration signals. This multi-sensory information transmission method not only makes up for the inconvenience of hearing-impaired users in traditional voice guides, but also provides all users with a richer and more three-dimensional visiting experience. In general, this embodiment reflects our innovation in the design of smart guide equipment and our in-depth consideration of user experience.

[0086] In some embodiments of the present application, the interactive multifunctional park guide device further includes:

[0087] The intelligent environmental perception system is used to monitor the real-time environmental data in the park in real time and provide personalized services to users based on the real-time environmental data; the real-time environmental data includes weather, temperature, humidity and air quality.

[0088] It is understandable that the interactive multifunctional park guide device described in this embodiment may further include an intelligent environment perception system. The main function of the system is to monitor and obtain the current environmental status data in the park in real time. By collecting these real-time environmental data, the system can accurately grasp the weather conditions, temperature changes, humidity levels, air quality and other information in the park. Furthermore, the system will provide users with personalized services that are more in line with personal needs based on the collected real-time environmental data. For example, when the weather changes suddenly, remind users to keep warm or sunscreen, provide users with comfort suggestions based on temperature and humidity changes, or give improvement suggestions when the air quality is poor. In this way, the intelligent environment perception system can greatly improve the quality of user experience in the park, allowing them to enjoy a more comfortable and humane tour environment.

[0089] In some of the embodiments of the present application, the interactive multifunctional park navigation device further includes an emergency monitoring module and an intelligent help-seeking system;

[0090] The emergency situation monitoring module is used to identify and respond to emergencies within the park; when the emergency situation monitoring module identifies the existence of an emergency within the park, the emergency situation monitoring module sends instructions to the intelligent help system, and the intelligent help system will provide users with immediate help and guidance based on the type and location of the emergency.

[0091] It is understandable that this embodiment introduces an interactive multifunctional park navigation device, which, in addition to the conventional navigation function, also includes some additional modules and systems to enhance its ability to respond to emergencies. Among them, the emergency monitoring module is an important component. The main function of this module is to monitor various situations in the park in real time. Once an emergency is identified, such as fire, earthquake, toxic gas leakage or other emergencies, the module will immediately activate the response mechanism.

[0092] When the emergency monitoring module detects an emergency situation in the park, it will immediately send an alarm command to the intelligent help system. This intelligent help system is a highly intelligent system that can quickly make judgments and formulate corresponding response strategies based on the type and location of the emergency. For example, if the emergency is a fire, the intelligent help system will immediately activate the fire emergency plan to provide users with instant help and guidance to ensure their personal safety.

[0093] In an emergency, the intelligent help system will promptly convey emergency information and response measures to users through various means, such as broadcasting, text messages, and APP push. At the same time, the intelligent help system will adjust the response strategy in real time according to the progress and changes of the emergency to ensure the safety of users. In addition, the intelligent help system can also be linked with other systems in the park, such as security systems and medical systems, to jointly respond to emergencies and enhance the overall response capabilities of the park.

[0094] In general, by adding emergency monitoring modules and intelligent help systems to the interactive multifunctional park guide device, the park's response capabilities in emergency situations can be greatly enhanced, the personal safety of users can be guaranteed, and the park's management efficiency and service quality can be improved.

[0095] In some embodiments of the present application, the intelligent help system is configured as follows:

[0096] When the emergency monitoring module detects an emergency, the intelligent help system activates the alarm system and sends an emergency notification to the user through the intelligent interactive screen, augmented reality glasses and intelligent voice assistant;

[0097] At the same time, the intelligent assistance system plans the best evacuation route according to the type and location of the emergency, and provides real-time guidance through the map display function of augmented reality glasses or smart interactive screens.

[0098] It is understandable that the intelligent help system described in this embodiment has advanced emergency response capabilities. Specifically, once the emergency monitoring module detects an emergency, the intelligent help system will immediately activate the alarm system and quickly send emergency notifications to users through multiple channels such as smart interactive screens, augmented reality glasses, and smart voice assistants, ensuring that every user can receive emergency information in the first place.

[0099] In addition, when an emergency occurs, the intelligent help system not only activates the alarm system, but also immediately calculates the optimal evacuation route based on the type and location of the emergency. This process is fully automated and does not require human intervention. After the calculation is completed, the intelligent help system will display the optimal evacuation route to users in real time through the map display function of augmented reality glasses or smart interactive screens, guiding them to evacuate quickly and safely.

[0100] This intelligent emergency response system greatly improves the user's chance of survival in emergency situations, reduces the pressure of manual emergency response, and improves the efficiency and accuracy of emergency response.

[0101] In some of the embodiments of the present application, the interactive multifunctional park guide device further includes an intelligent help system;

[0102] The intelligent help system is configured so that when a user triggers a help signal through a touch screen, gesture or voice command, the intelligent help system immediately communicates with the security monitoring center in the park in real time;

[0103] At the same time, the intelligent help system is configured with an intelligent voice communication module, which is used for real-time voice communication between the user and the security monitoring center.

[0104] It is understandable that this embodiment further describes such an interactive multifunctional park guide device: it not only has the conventional guide function, but also includes an intelligent help system. The design purpose of this intelligent help system is to enable users to get timely support from the security monitoring center in the park when they encounter any unknown situation or need help.

[0105] When users encounter some problems or need help while using the device, they can operate it through the touch screen equipped on the device, or trigger it through some simple gestures, or directly use voice commands to send out a help signal. Once the help signal is triggered, the intelligent help system will be activated immediately, and it will establish a real-time communication connection with the security monitoring center in the park to ensure that the help information can be received and processed in time.

[0106] In addition, in order to improve the efficiency and quality of communication, the intelligent help system is also specially equipped with an intelligent voice communication module. The main function of this module is to realize real-time voice communication between users and the security monitoring center. Through this module, users can describe their situations and needs to the monitoring center more clearly and directly, and the staff of the monitoring center can also understand the user's problems more accurately and quickly, and give corresponding guidance and help. In this way, not only the efficiency of handling problems is improved, but also the user's tour experience is enhanced.

[0107] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.

[0108] The present application is described with reference to flowcharts and / or block diagrams of methods, devices (systems) and computer program products according to embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0109] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0110] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0111] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the above embodiments, ordinary technicians in the relevant field should understand that the specific implementation methods of the present invention can still be modified or replaced by equivalents. Any modification or equivalent replacement that does not depart from the spirit and scope of the present invention should be covered within the scope of protection of the claims of the present invention.

Claims

1. An interactive multifunctional park guide device, characterized in that: include: Smart interactive screens, augmented reality glasses, smart voice assistants, mobile positioning and navigation modules, and smart help systems; The intelligent interactive screen includes a touch screen, a 3D projection and a gesture recognition module; the touch screen is configured to allow clicking and sliding to query scenic spot information; the 3D projection is used for stereoscopic image display; the gesture recognition module is used to capture the user's gestures and perform corresponding operations through preset gesture instructions; The augmented reality glasses include an AR display module and a head tracking module, wherein the AR display module is used to render and overlay virtual images in real time; the head tracking module is used to track the user's head movements in real time so that the virtual image is synchronized with the user's line of sight; The intelligent voice assistant is used to receive the user's voice instructions through voice recognition and voice synthesis, and give replies or operation instructions; The mobile positioning and navigation module is used to locate the real-time position of the user in the park and display the user's current position and surrounding scenic spots information through a map.

2. The interactive multifunctional park guide device according to claim 1, characterized in that: The gesture recognition module is used to capture the user's gestures and perform corresponding operations through preset gesture instructions, specifically including: The gesture recognition module has a built-in deep learning algorithm, and the deep learning algorithm is used to recognize the user's gesture; The gesture recognition module is configured so that when the user waves his palm toward the screen, the smart interactive screen will automatically switch to the introduction of the next attraction; when the user draws a circle gesture in the air, the AR guide mode of the augmented reality glasses is started.

3. The interactive multifunctional park guide device according to claim 2, characterized in that: When the gesture recognition module recognizes a circle gesture, it includes: When the user draws a complete circle in the air in a clockwise or counterclockwise direction, the gesture recognition module captures and recognizes it as an instruction to start the AR guide mode; When the user draws an approximate circle in the air in a clockwise or counterclockwise direction, the following judgment method is used to determine whether the approximate circle can be regarded as a complete circle: The similarity between the approximate circle and the preset complete circle is calculated based on the Euclidean distance and the cosine similarity. When the similarity between the approximate circle and the preset complete circle reaches or exceeds a preset threshold, it is determined to be a complete circle, thereby starting the AR guide mode of the augmented reality glasses.

4. The interactive multifunctional park guide device according to claim 1, characterized in that: The similarity between the approximate circle and the preset complete circle is calculated based on the Euclidean distance and the cosine similarity. When the similarity between the approximate circle and the preset complete circle reaches or exceeds a preset threshold, it is determined to be a complete circle, including: Acquire a set of feature points of an approximate circle and a preset complete circle, wherein the feature points include edge points of the circle and trajectory points when the user draws the circle in the air; calculate the Euclidean distance and cosine similarity using the set of feature points; wherein the edge points of the circle are identified by image processing technology, and the trajectory points when the user draws the circle in the air are identified by image processing technology; The similarity Sim between the approximate circle and the preset complete circle is calculated based on the Euclidean distance and cosine similarity. The calculation formula is: Sim=a·Euc+(1-a)·Cos; Among them, Euc represents the similarity calculated based on Euclidean distance; Cos represents the similarity calculated based on cosine similarity; α represents the weight factor.

5. The interactive multifunctional park guide device according to claim 1, characterized in that: The gesture recognition module is configured to automatically intervene when the user uses the gesture recognition function, if the gesture recognition module still cannot accurately recognize the user's gesture after n consecutive attempts; At this time, the intelligent voice assistant is used to prompt the correct gesture, or suggest the user to use voice commands or touch screen operations.

6. The interactive multifunctional park guide device according to claim 1, characterized in that: The smart interactive screen and augmented reality glasses are configured to support a voice guide mode, through which a user can query scenic spot information or navigation by voice commands; The smart interactive screen is also configured to provide text guidance and vibration feedback for hearing-impaired users to perceive scenic spot introductions and navigation information.

7. The interactive multifunctional park guide device according to claim 1, characterized in that: The interactive multifunctional park guide device also includes: The intelligent environmental perception system is used to monitor the real-time environmental data in the park in real time and provide personalized services to users based on the real-time environmental data; the real-time environmental data includes weather, temperature, humidity and air quality.

8. The interactive multifunctional park guide device according to claim 1, characterized in that: The interactive multifunctional park guide device also includes an emergency monitoring module and an intelligent help-seeking system; The emergency situation monitoring module is used to identify and respond to emergencies within the park; when the emergency situation monitoring module identifies the existence of an emergency within the park, the emergency situation monitoring module sends instructions to the intelligent help system, and the intelligent help system will provide users with immediate help and guidance based on the type and location of the emergency.

9. The interactive multifunctional park guide device according to claim 8, characterized in that: The intelligent help system is configured as follows: When the emergency monitoring module detects an emergency, the intelligent help system activates the alarm system and sends an emergency notification to the user through the intelligent interactive screen, augmented reality glasses and intelligent voice assistant; At the same time, the intelligent assistance system plans the best evacuation route according to the type and location of the emergency, and provides real-time guidance through the map display function of augmented reality glasses or smart interactive screens.

10. The interactive multifunctional park guide device according to claim 9, characterized in that: The interactive multifunctional park guide device also includes an intelligent help system; The intelligent help system is configured so that when a user triggers a help signal through a touch screen, gesture or voice command, the intelligent help system immediately communicates with the security monitoring center in the park in real time; At the same time, the intelligent help system is configured with an intelligent voice communication module, which is used for real-time voice communication between the user and the security monitoring center.

Images