Intelligent guide explainer based on ESP32

Abstract

The utility model provides an intelligent guide explainer based on ESP32, which relates to the technical field of guide explainers and comprises an intelligent guide explainer body. The main components of the intelligent guide explaining device body are composed of an ESP32-S3 and a row blank board K10, and the intelligent guide explaining device body comprises a main control unit, a visual module, a GNSS Beidou positioning module, a voice module and an interaction module. A WIFI + GNSS Beidou positioning module of an ESP32-S3 chip is adopted, the situation that a traditional navigation system purely depends on a single GPS is changed, in a complex environment, the GNSS Beidou positioning technology can effectively improve the positioning precision, and the problem that the traditional positioning error is larger than or equal to 10 meters is solved. The problems that an existing positioning technology depends on a single GPS, precision is insufficient in a complex environment, and the error is larger than or equal to 10 meters; the interaction mode is limited to pre-recording audio or simple touch control, and the dynamic response capability is lacked.

Description

Technical Field

[0001] This utility model belongs to the field of tour guide technology, and more specifically, it relates to an intelligent tour guide based on ESP32. Background Technology

[0002] In recent years, the rapid development of artificial intelligence technology has profoundly impacted all sectors of society, especially in smart cultural tourism and educational informatization, where it has shown great potential. It has been clearly proposed to promote the deep integration of AI, IoT and other technologies with culture and education, accelerate digital transformation, promote the inheritance of traditional culture through innovative means, and enhance the practicality and fun of science and technology education.

[0003] However, the limitations of traditional tour guide systems have become a bottleneck for the industry's development. Their core pain points are: positioning technology relies on a single GPS device, resulting in insufficient accuracy (≥10 meters) in complex environments; interaction methods are limited to pre-recorded audio or simple touch controls, lacking dynamic response capabilities; and the closed system architecture makes hardware expansion difficult, leading to high update and maintenance costs. These problems severely restrict the improvement of the quality of smart cultural tourism services. Utility Model Content

[0004] To address the aforementioned technical problems, this utility model provides an intelligent tour guide based on ESP32, which solves the problems of existing positioning technologies relying on a single GPS, having insufficient accuracy (≥10 meters) in complex environments, and having interaction methods limited to pre-recorded audio or simple touch control, lacking dynamic response capabilities.

[0005] The technical solution adopted in this utility model is as follows:

[0006] The intelligent tour guide based on ESP32 includes a main body. The main body is composed of an ESP32-S3 chip and a horizontal board K10. It includes a main control unit, a vision module, a GNSS / BeiDou positioning module, a voice module, and an interaction module. The main control unit uses the ESP32-S3 chip, the vision module uses a GC2145 camera, the GNSS / BeiDou positioning module is an ESP32-S3 chip with built-in WIFI + GNSS / BeiDou positioning, the voice module uses an ES7243E, and the interaction module uses an ILI9341 color LCD capacitive touchscreen with a 2.8-inch 240x320 resolution. The rear end of the main body is attached to the front end of the reset protective frame.

[0007] According to one embodiment of the present invention, a magnetic connector is provided at the middle of the rear end of the reset protection frame, and a sliding plate is slidably connected to both the upper and lower sides of the inner middle of the reset protection frame.

[0008] According to one embodiment of the present invention, two spring members are connected to the outer side of the two sliding plates, and the other ends of the four spring members are all connected to the inner wall of the reset protection frame.

[0009] According to one embodiment of the present invention, a hook is rotatably connected to each of the left and right sides of the sliding plate, and the four hooks are attached to the four corners of the main body of the intelligent tour guide.

[0010] Compared with the prior art, the present invention has the following beneficial effects:

[0011] Employing the WIFI+GNSS BeiDou positioning module integrated into the ESP32-S3 chip, this system changes the traditional reliance on GPS alone. In complex environments, GNSS BeiDou positioning technology effectively improves positioning accuracy, overcoming the problem of traditional positioning errors ≥10 meters. It achieves precise point identification and trajectory recording, providing users with more accurate location information. Whether in indoor venues or scenic areas with significant signal obstruction, it can accurately determine the user's location, thereby improving the quality of the tour guide service.

[0012] The interactive module uses a 2.8-inch 240x320 color LCD capacitive touchscreen (ILI9341) that supports gesture operation, allowing users to operate intuitively and conveniently. The voice module uses an ES7243E that integrates Baidu's UNIT platform's NLP technology, featuring speech recognition and synthesis as well as AI dialogue capabilities. It supports offline speech recognition and dynamic dialogue. This diverse interactive approach breaks through the limitations of traditional guided tours that are confined to pre-recorded audio or simple touch controls, achieving dynamic response interaction. Users can communicate naturally and fluently with the guide via voice to obtain the information they need, enhancing the user experience's fun and interactivity.

[0013] The vision module uses a GC2145 camera and is based on the YOLOv5s model to achieve offline rapid recognition of QR codes and scenes with a response time of ≤2 seconds. This allows users to quickly obtain real-time explanation services by scanning a specified QR code or by automatic detection and positioning. The operation is simple and fast, which greatly improves the efficiency of information acquisition and meets the needs of users to quickly obtain explanation content in different scenarios.

[0014] Equipped with a reset protection frame, the internal sliding plate, spring components, and hooks work together to firmly lock the main body of the smart tour guide in place at the four corners, effectively preventing the guide from being accidentally dropped and damaged. The magnetic connector at the rear of the reset protection frame can magnetically connect and reset with the magnetic position when the guide is put back in place, making it convenient for storage and further protecting the equipment and extending its service life.

[0015] The hardware architecture consisting of ESP32-S3 and K10 board offers better scalability compared to traditional closed tour guide system architectures. The ESP32-S3 main control unit chip has the effect of a Wi-Fi + low-power Bluetooth MCU module, which provides convenient conditions for subsequent function expansion and hardware upgrades, reduces update and maintenance costs, and is better able to adapt to the ever-evolving technological needs of the smart cultural tourism industry, thus promoting the continuous innovation and optimization of smart cultural tourism services. Attached Figure Description

[0016] Figure 1 This is a side view diagram of the overall structure of the ESP32 intelligent tour guide system of this utility model.

[0017] Figure 2 This is a side view of the disassembled reset protection structure of this utility model.

[0018] Figure 3 This is a schematic diagram of the main structure of the intelligent tour guide device of this utility model.

[0019] Figure 4 This is a schematic diagram illustrating the usage process of the ESP32 intelligent tour guide system of this utility model.

[0020] In the diagram, the correspondence between component names and drawing numbers is as follows:

[0021] 1. Main body of the intelligent tour guide; 101. Main control unit; 102. Visual module; 103. GNSS Beidou positioning module; 104. Voice module; 105. Interactive module; 2. Reset protection frame; 201. Magnetic connector; 202. Sliding plate; 203. Spring component; 204. Hook clamp. Detailed Implementation

[0022] To make the objectives, technical solutions, and advantages of the embodiments of this utility model clearer, the technical solutions of the embodiments of this utility model will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this utility model. All other embodiments obtained by those skilled in the art based on the described embodiments of this utility model without creative effort are within the scope of protection of this utility model.

[0023] Unless otherwise defined, the technical or scientific terms used herein shall have the ordinary meaning understood by one of ordinary skill in the art to which this utility model pertains. The use of terms such as "a," "an," or "the" in this utility model patent application specification and claims does not indicate a quantity limitation, but rather indicates the presence of at least one. Terms such as "comprising" or "including" mean that the element or object preceding the word encompasses the element or object listed following the word and its equivalents. Terms such as "connected" or "linked" are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. Terms such as "upper," "lower," "left," and "right" are used only to indicate relative positional relationships; these relative positional relationships may change accordingly when the absolute position of the described object changes.

[0024] The embodiments of this utility model will be described in further detail below with reference to the accompanying drawings and examples.

[0025] Example:

[0026] As attached Figure 1 To be continued Figure 4 As shown:

[0027] This utility model provides an intelligent tour guide based on ESP32, including an intelligent tour guide body 1. The main components of the intelligent tour guide body 1 are composed of ESP32-S3 and a horizontal plate K10, including a main control unit 101, a vision module 102, a GNSS Beidou positioning module 103, a voice module 104, and an interaction module 105. The rear end of the intelligent tour guide body 1 is attached to the front end of a reset protection frame 2. A magnetic connector 201 is provided at the middle of the rear end of the reset protection frame 2. A sliding plate 202 is slidably connected to the upper and lower sides of the inner middle of the reset protection frame 2. Two springs 203 are connected to the outer sides of the two sliding plates 202. The other ends of the four springs 203 are connected to the inner wall of the reset protection frame 2. A hook 204 is rotatably connected to the left and right sides of the sliding plate 202. The four hooks 204 are hooked at the four corners of the intelligent tour guide body 1.

[0028] Among them, the main control unit 101 adopts the ESP32-S3 chip, which has the effect of Wi-Fi + low power Bluetooth MCU module;

[0029] The vision module 102 uses a GC2145 camera to achieve image acquisition and recognition functions;

[0030] The GNSS Beidou positioning module 103 uses the ESP32-S3 chip and comes with WIFI+GNSS Beidou positioning, and has the functions of point recognition and trajectory recording.

[0031] The voice module 104 uses the ES7243E, which has speech recognition and synthesis capabilities, AI dialogue function, and integrates the NLP technology of Baidu UNIT platform for voice interaction, supporting offline speech recognition and dynamic dialogue.

[0032] The interaction module 105 uses an ILI9341 color LCD capacitive touchscreen, 2.8 inches, 240x320 resolution, which supports gesture operation and information display.

[0033] When using:

[0034] When using the main body 1 of the intelligent tour guide, the user needs to input commands. Commands can be transmitted to the main body 1 of the intelligent tour guide via touch screen input and voice input. The commands are then analyzed by the interaction module 105 and cooperated with the GNSS Beidou positioning module 103 to accurately determine the current location.

[0035] The GC2145 camera designed through vision module 102 enables image acquisition and recognition functions, scanning designated QR codes or automatically detecting and locating to obtain real-time explanation services. The voice module 104 connects to an artificial intelligence big data model to conduct voice dialogue, obtain location information, and perform voice broadcasting, realizing the function of intelligent explanation of each location. The vision module 102 is based on the YOLOv5s model to realize offline fast recognition of QR codes and scenes, with a response time of ≤2 seconds.

[0036] The main body 1 of the intelligent tour guide is placed at the front end of the reset protective frame 2. Next, four hooks 204 are attached to the four corners of the main body 1. Through the cooperation of the sliding plate 202 and the spring 203, the four hooks 204 are firmly locked at the corners of the main body 1. The reset protective frame 2 provides a drop protection for the main body 1. The magnetic connector 201 at the rear end of the reset protective frame 2 magnetically connects and resets the main body 1 to the magnetic position when it is put back in place.

[0037] Although this application has been described with reference to the foregoing embodiments, those skilled in the art will understand that various changes can be made without departing from the spirit and scope of this application as defined by the appended claims. While this specification contains details of many specific implementations, these should not be construed as limiting the scope of the claims, but rather as descriptions of features specific to particular embodiments. The scope of this application is defined by the appended claims and their equivalents, and is not limited to the embodiments described above.

Claims

1. An intelligent guide interpreter based on ESP32, characterized in that: Intelligent guide and explanation device, including intelligent guide and explanation device body (1), the main components of the intelligent guide and explanation device body (1) are composed of ESP32-S3 and line empty board K10, including main control unit (101), vision module (102), GNSS Beidou positioning module (103), voice module (104) and interactive module (105), the main control unit (101) adopts ESP32-S3 chip, the vision module (102) adopts GC2145 camera, the GNSS Beidou positioning module (103) is the WIFI+GNSS Beidou positioning of ESP32-S3 chip, the voice module (104) adopts ES7243E, the interactive module (105) adopts ILI9341 color LCD capacitive touch screen 2.8 inch 240x320, the rear end position of the intelligent guide and explanation device body (1) is attached to the front end position of the reset protection frame (2).

2. The ESP32-based smart guide interpreter of claim 1, wherein: The rear end middle position of the reset protection frame (2) is provided with a magnetic connecting piece (201), and the inside middle upper and lower sides of the reset protection frame (2) are slidably connected with a sliding plate (202).

3. The ESP32-based smart guide interpreter of claim 2, wherein: The outer side positions of the two sliding plates (202) are connected with two spring pieces (203), and the other end positions of the four spring pieces (203) are connected with the inner wall positions of the reset protection frame (2).

4. The ESP32-based smart guide interpreter of claim 3, wherein: The left and right side positions of the sliding plate (202) are respectively rotationally connected with a hook clamp (204), and the four hook clamps (204) are hung on the four corner positions of the intelligent guide and explanation device body (1).

Images