Shared intelligent terminal system and management method based on cloud AI collaboration

Abstract

The invention relates to the technical field of shared economy, in particular to a shared intelligent terminal system and management method based on cloud AI collaboration, the system comprises a shared cabinet, a cloud background service module and a plurality of terminal devices, and the shared cabinet charges the terminal devices; when the terminal equipment is used, WiFi hotspot service can be provided, other equipment can be charged, and the cloud background service module is requested to call an AI engine to provide translation or scenic spot broadcasting service; and when the shared cabinet receives the renting instruction from the cloud background service module, the terminal equipment of the corresponding slot is unlocked, so that the user rents the terminal equipment. It can be understood that according to the technical scheme provided by the invention, the charging function, the WiFi hotspot function, the translation function and the scenic spot broadcasting function are integrated only through one terminal device, and the mobile terminal is convenient to carry by a user. And meanwhile, the cloud end utilizes AI to cooperate with the terminal equipment to provide translation or scenic spot broadcasting service, so that the service quality can be improved, and the user satisfaction is high.

Description

Technical Field

[0001] The present invention relates to the field of shared economy technology, and in particular to a shared intelligent terminal system and management method based on cloud AI collaboration. Background Art

[0002] In today's travel scenarios, people often need to carry multiple electronic devices, including mobile phones, power banks, mobile Wi-Fi (MIFI) devices, and translators. This not only significantly increases the travel burden, but also creates numerous inconveniences in management and use due to the independent functions of each device. While shared power banks solve the charging problem, their functionality is relatively limited; existing MIFI devices typically only provide network connectivity; and independent AI translators or tour guides, while powerful, need to be purchased and carried separately and often rely on mobile hotspots or public Wi-Fi, resulting in unstable network connections.

[0003] At the same time, smart guide services for tourists mostly exist in the form of mobile phone apps. This method relies on the performance and battery life of the user's mobile phone, and the update and maintenance of scenic spot information may not be timely enough. Summary of the Invention

[0004] In view of this, the purpose of the present invention is to provide a shared intelligent terminal system and management method based on cloud AI collaboration, so as to solve to a certain extent the inconvenience of people having to carry multiple electronic devices when traveling.

[0005] According to a first aspect of an embodiment of the present invention, a shared intelligent terminal system based on cloud AI collaboration is provided, including:

[0006] Terminal equipment, shared cabinets and cloud-based backend service modules;

[0007] The shared cabinet is provided with a plurality of slots for accommodating terminal devices. When the terminal devices are in the slots, the shared cabinet charges the terminal devices. The terminal devices and the shared cabinet are both connected to the cloud backend service module network.

[0008] When in use, the terminal device is used to provide WiFi hotspot services and charge other devices connected to the terminal device; it is also used to obtain AI service requests, user-input voice data and positioning data, and the AI ​​service requests include translation requests or scenic spot broadcast requests; it is also used to output audio data received from the cloud backend service module;

[0009] When the shared cabinet receives a rental instruction from the cloud backend service module, it unlocks the terminal device in the corresponding slot according to the rental instruction;

[0010] The cloud-based backend service module is used to obtain and process the user's rental request and generate a rental instruction; it is also used to call the API of the corresponding AI engine according to the AI ​​service request, and if the AI ​​service request is a translation request, generate translation audio data; if the AI ​​service request is a scenic spot broadcast request, generate scenic spot broadcast audio data.

[0011] Preferably, the terminal device includes: a main control unit, a MIFI module, a power management unit, a positioning module, an audio input / output unit, a user interaction module and a cabinet physical interface;

[0012] The MIFI module is used to connect to the 4G / 5G network, establish a WiFi hotspot service, and establish a network connection between the main control unit and the cloud background service module;

[0013] The power management unit is used to manage the charging and discharging of the built-in battery of the terminal device and control the built-in battery to serve as a mobile power source to charge other devices;

[0014] The positioning module is used to obtain the positioning data of the terminal device in real time;

[0015] The audio input / output unit is used to obtain voice data input by the user and also to output translated audio data or scenic spot broadcast audio data received from the cloud backend service module;

[0016] The main control unit is used to encapsulate the voice data and positioning data and send them to the cloud backend service module; it is also used to send the status data of the terminal device to the cloud backend service module; the status data includes: power, network signal strength, positioning data, data usage and device ID;

[0017] The user interaction module is used to obtain AI service requests, including translation requests or scenic spot broadcast requests;

[0018] The cabinet physical interface is used to connect to the shared cabinet when the terminal device is in a slot of the shared cabinet.

[0019] Preferably, the shared cabinet comprises: a cabinet body, and a plurality of slots corresponding to the terminal devices, a cabinet main controller, a network communication module and a user interaction interface arranged on the cabinet body;

[0020] The slot is also used to interact with the terminal device for data; each slot has a device ID recognition module and an electronically controlled locking / unlocking device;

[0021] The user interaction interface is used to display the QR code and preset information;

[0022] The network communication module is used to establish a network connection between the cabinet main controller and the cloud background service module;

[0023] The cabinet main controller is used to monitor the information of each slot and upload the slot information to the cloud background service module; it is also used to obtain a lease instruction from the cloud background service module and unlock the terminal device of the corresponding slot according to the lease instruction.

[0024] Preferably, the cloud-based backend service module includes: a user management and authentication module, a device management module, a rental and order management module, an AI service scheduling module, and a scenic spot information and content management module;

[0025] The user management and authentication module is used to manage user account information, including registration, login, identity authentication, and payment binding;

[0026] The device management module is used to obtain data of all terminal devices and shared cabinets;

[0027] The rental and order management module is used to obtain and process user rental requests, generate rental instructions, generate orders based on rental requests, manage the rental lifecycle, and record rental and return events;

[0028] An AI service scheduling module is used to call the API of the corresponding AI engine according to the AI ​​service request. If the AI ​​service request is a translation request, the module generates translation audio data. If the AI ​​service request is a scenic spot broadcast request, the module calls the pre-stored scenic spot data to generate scenic spot broadcast audio data.

[0029] The attraction information and content management module is used to store and manage attraction data; it is also used to update attraction data; the attraction data includes: attraction geo-fence data, multilingual attraction introduction text and audio materials.

[0030] Preferably, the shared intelligent terminal system based on cloud AI collaboration further includes:

[0031] The billing and payment module is used to obtain multi-dimensional usage data of the terminal device in real time. The multi-dimensional usage data includes: status data of the terminal device, AI translation service call data, and AI scenic spot broadcast trigger data; dynamically calculate the rental fee based on the multi-dimensional usage data and pre-designed fee rules; and connect with a third-party payment platform to complete fee settlement.

[0032] Preferably, the user interaction module of the terminal device further includes:

[0033] Status indicator lights, physical button group and display screen.

[0034] According to a second aspect of an embodiment of the present invention, a method for managing a shared intelligent terminal based on cloud AI collaboration is provided, comprising:

[0035] When the terminal device is in the slot of the shared cabinet, the shared cabinet charges the terminal device, and the cloud-based backend service module performs remote maintenance on the terminal device;

[0036] Obtain and verify the user's login account information, and instruct the target shared cabinet to unlock the corresponding slot according to the user's instructions;

[0037] When the terminal device is turned on, it automatically connects to the network and registers with the cloud-based backend service module, which authorizes the terminal device to provide WiFi hotspot services, charging services, translation services, and scenic spot broadcast services;

[0038] When the terminal device sends an AI service request to the cloud-based backend service module, the cloud-based backend service module calls the corresponding AI engine API to generate translation audio data or scenic spot broadcast audio data, so that the terminal device plays the corresponding audio data;

[0039] The terminal device sends power level, network signal strength, positioning data, traffic consumption and device ID to the cloud backend service module at preset intervals;

[0040] When any shared cabinet detects that the terminal device is in the slot again, the shared cabinet identifies the terminal device and locks the slot, and sends the return information to the cloud backend service module;

[0041] The cloud-based backend service module calculates the rental fee based on the multi-dimensional usage data, settles the fee through the payment method bound to the account information, and generates a bill.

[0042] Preferably, when the terminal device provides translation services, it includes:

[0043] Collect the user's voice data through the audio input / output unit of the terminal device and send the voice data to the cloud backend service module;

[0044] The cloud backend service module calls the API of the AI ​​translation engine to process the voice data, generate translated audio data, and send the translated audio data back to the terminal device;

[0045] The cloud-based backend service module records the number of times the AI ​​translation engine is called.

[0046] Preferably, when the terminal device provides the scenic spot broadcast service, it includes:

[0047] The terminal device obtains the positioning data in real time and sends the positioning data to the cloud backend service module;

[0048] The cloud backend service module matches the scenic spot database according to the positioning data to detect whether the terminal device is in the preset scenic spot area;

[0049] If the terminal device is in the preset scenic spot area and the scenic spot broadcast audio has not been sent to the terminal device, the pre-stored scenic spot broadcast content is selected according to the language set by the user;

[0050] The cloud backend service module calls the API of the AI ​​scenic spot broadcast engine, generates scenic spot broadcast audio data according to the scenic spot broadcast content, and sends the scenic spot broadcast audio data back to the terminal device;

[0051] The cloud-based backend service module records the number of times the AI ​​scenic spot broadcast engine is called.

[0052] Preferably, the cloud backend service module performs remote maintenance on the terminal device, including:

[0053] The terminal device sends the status data to the cloud-based backend service module, and the cloud-based backend service module determines whether the terminal device needs maintenance based on the status data;

[0054] If the terminal device needs maintenance, when the terminal device is in the slot of the shared cabinet, the cloud backend service module sends a maintenance instruction to the shared cabinet;

[0055] When the shared cabinet receives a maintenance instruction, it locks the slot where the terminal device is located and establishes a data connection with the terminal device;

[0056] The cloud-based backend service module performs remote maintenance on terminal devices through a shared cabinet;

[0057] After maintenance is completed, the shared cabinet verifies the status of the terminal device and updates the maintenance record of the terminal device.

[0058] The technical solutions provided by the embodiments of the present invention may have the following beneficial effects:

[0059] It is understandable that the present invention relates to a shared intelligent terminal system and management method based on cloud AI collaboration, the system includes a shared cabinet, a cloud background service module and a plurality of terminal devices, the shared cabinet charges the terminal device; when the terminal device is in use, it can provide WiFi hotspot services, charge other devices, and request the cloud background service module to call the AI ​​engine to provide translation or scenic spot broadcast services; when the shared cabinet receives a rental instruction from the cloud background service module, it unlocks the terminal device in the corresponding slot to allow the user to rent the terminal device. It is understandable that the technical solution provided by the present invention integrates the charging function, WiFi hotspot function, translation function and scenic spot broadcast function through only one terminal device, which is convenient for users to carry. At the same time, the cloud uses AI to collaborate with terminal devices to provide translation or scenic spot broadcast services, which can improve service quality and increase user satisfaction.

[0060] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0061] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.

[0062] Figure 1 This is a schematic block diagram of a shared intelligent terminal system based on cloud AI collaboration according to an exemplary embodiment;

[0063] Figure 2 is a schematic diagram of the overall system architecture according to an exemplary embodiment;

[0064] Figure 3 is a hardware block diagram of a terminal device according to an exemplary embodiment;

[0065] Figure 4 is a diagram showing an architecture of a terminal device according to an exemplary embodiment;

[0066] Figure 5 is a hardware structure block diagram of a shared cabinet according to an exemplary embodiment;

[0067] Figure 6 The figure is a flowchart of an AI service scheduling according to an exemplary embodiment. DETAILED DESCRIPTION

[0068] Exemplary embodiments will be described in detail herein, examples of which are illustrated in the accompanying drawings. In the following description, when referring to the drawings, like numbers in different figures represent like or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments are not intended to represent all possible embodiments consistent with the present invention. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present invention, as detailed in the appended claims.

[0069] In one embodiment, Figure 1 is a schematic block diagram of a shared intelligent terminal system based on cloud AI collaboration according to an exemplary embodiment. Figure 2 This is a schematic diagram of the overall system architecture according to an exemplary embodiment. Figure 1 and Figure 2 , providing a shared intelligent terminal system based on cloud AI collaboration, including:

[0070] Terminal equipment, shared cabinets and cloud-based backend service modules.

[0071] The shared cabinet is provided with a plurality of slots for accommodating terminal devices. When the terminal devices are in the slots, the shared cabinet charges the terminal devices. Both the terminal devices and the shared cabinet are connected to the cloud-based backend service module network.

[0072] When in use, the terminal device is used to provide WiFi hotspot services and charge other devices connected to the terminal device; it is also used to obtain AI service requests, user-input voice data and positioning data, and the AI ​​service requests include translation requests or scenic spot broadcast requests; it is also used to output audio data received from the cloud background service module.

[0073] When the shared cabinet receives a rental instruction from the cloud backend service module, it unlocks the terminal device of the corresponding slot according to the rental instruction.

[0074] The cloud-based backend service module is used to obtain and process the user's rental request and generate a rental instruction; it is also used to call the API of the corresponding AI engine according to the AI ​​service request, and if the AI ​​service request is a translation request, generate translation audio data; if the AI ​​service request is a scenic spot broadcast request, generate scenic spot broadcast audio data.

[0075] like Figure 2 As shown in Figure 1, the shared smart terminal system consists of three main layers: the user layer, the edge layer, and the cloud layer. The user layer includes users and their mobile apps / applets; the edge layer includes shared smart terminal devices and smart shared cabinets; and the cloud layer includes cloud backend service modules, AI service clusters, and data storage and analysis systems. Each layer communicates with each other via secure network connections, forming a complete service ecosystem.

[0076] It should be noted that, see Figure 3 The terminal device includes: a main control unit, a MIFI module, a power management unit, a positioning module, an audio input / output unit, a user interaction module and a cabinet physical interface.

[0077] The MIFI module is used to connect to the 4G / 5G network, establish a WiFi hotspot service, and establish a network connection between the main control unit and the cloud backend service module. It can automatically search for and connect to the optimal mobile network and support intelligent network switching.

[0078] The MIFI module utilizes the Qualcomm MDM9207 chip as its core hardware architecture. This chip is fully compatible with 4G / 5G networks and integrates dual-mode SIM and eSIM technology, enabling adaptive access to multiple carriers' network frequency bands worldwide. The module not only provides a high-speed network link for the terminal itself but also creates on-demand Wi-Fi hotspot services for connected devices such as mobile phones and tablets, while also establishing a secure network connection between the terminal and the cloud-based backend service module.

[0079] The power management unit is used to manage the charging and discharging of the built-in battery of the terminal device and control the built-in battery to serve as a mobile power source to charge other devices.

[0080] The hardware architecture design utilizes the BQ25898 power management chip, compatible with a 10,000mAh high-capacity lithium-ion battery and supporting 18W bidirectional fast charging. This chip precisely controls the internal battery's charge and discharge, while also providing a power bank function, enabling emergency charging for external electronic devices.

[0081] The positioning module is used to obtain the positioning data of the terminal device in real time.

[0082] The positioning module uses the u-blox NEO-M8N GPS / Beidou dual-mode chip with an accuracy of 2.5m, which is used to obtain the real-time geographic location information of the terminal device.

[0083] The audio input / output unit is used to obtain voice data input by the user and is also used to output translated audio data or scenic spot broadcast audio data received from the cloud backend service module.

[0084] The audio processing unit is equipped with the TI TLV320AIC3254 audio codec, integrating dual-microphone array noise reduction technology and a high-fidelity speaker driver solution. The microphone array is responsible for collecting user voice signals for AI translation or providing voice commands, while the high-fidelity speaker is used to play the AI ​​translation audio or AI attraction announcement audio, achieving a clear and smooth human-computer voice interaction experience.

[0085] The main control unit is configured to encapsulate the voice data and positioning data (in JSON format) and send them to the cloud-based backend service module. It is also configured to send the terminal device's status data to the cloud-based backend service module. The status data includes battery level, network signal strength, positioning data, data usage, and device ID. Preferably, the terminal device maintains a heartbeat connection with the cloud-based backend service module, reporting the device's status data to the cloud-based backend service system every 10 seconds.

[0086] In terms of hardware implementation, the main control unit is an MCU or low-power SoC, using an ARM Cortex-M4 processor with a main frequency of 72MHz, built-in 256KB Flash and 64KB RAM, and power consumption of <100mW. It is responsible for the overall logic control of the device, data acquisition and coordination, communication with the MIFI module, communication with the cloud background service module, and control of user interaction.

[0087] The user interaction module is used to obtain AI service requests, including translation requests or scenic spot broadcast requests. The user interaction module of the terminal device includes: a status indicator light, a physical button group and a display screen.

[0088] Users can use physical buttons to turn the device on and off, adjust translation mode and attraction announcement mode, and adjust the volume of the audio played by the device. A status indicator shows the current status of the device. The display, a 1.44-inch IPS color screen with a 128×128 resolution, displays battery life, network status, and simple prompts.

[0089] The cabinet physical interface is used to connect to the shared cabinet when the terminal device is in a slot of the shared cabinet. The shared cabinet charges the terminal device and exchanges data between the shared cabinet and the terminal device.

[0090] Regarding cloud service requests and result presentation on the terminal device, based on user interaction instructions (translation instructions, attraction announcement instructions) or system-preset trigger conditions (such as location awareness based on GPS geofencing), the terminal device automatically initiates task requests to the cloud. The terminal device receives and parses the processing results returned by the cloud (such as text translation text / audio, attraction announcement audio), and plays the audio through the speaker or displays the translated text on the display.

[0091] Preferably, the terminal device also has basic offline functions when it is offline: when the network is interrupted or not connected to the cloud, it can provide basic device status display, power indication, etc.

[0092] See also Figure 3The shared intelligence terminal device in this embodiment adopts a modular design. The main control unit (MCU) uses an ARM Cortex-M4 processor with an operating frequency of 72MHz, built-in 256KB flash memory and 64KB RAM, and runs the FreeRTOS real-time operating system. The device is equipped with a Qualcomm MDM9207 MIFI chip, supports 4G / 5G networks, and provides 802.11ac WiFi hotspot functionality. The power management unit uses TI's BQ25898 chip to manage a 10,000mAh lithium battery and supports 18W input and output fast charging. The positioning module uses the u-blox NEO-M8N chip, supports GPS and Beidou dual-mode positioning, and has an accuracy of better than 2.5 meters. The audio unit includes a dual-microphone array with integrated noise reduction function and a 1W speaker, controlled by the TI TLV320AIC3254 audio codec. The user interface includes four status LEDs, three physical buttons, and a 1.44-inch IPS display. The device casing is made of PC+ABS material, has an IP54 dust and water resistance rating, and the total weight of the device does not exceed 180 grams.

[0093] See also Figure 4 The software of the terminal device adopts a layered architecture, with the FreeRTOS real-time operating system as the bottom layer, providing basic functions such as task scheduling, memory management, and interrupt handling. The driver layer includes MIFI driver, audio driver, power management driver, GPS driver, and display driver, which are responsible for direct control of the hardware. The middleware layer includes the network protocol stack (supporting TCP / IP, HTTP, MQTT and other protocols), security module (implementing TLS1.3 encrypted communication), codec module (supporting Opus audio codec), and storage management module. The application layer implements core functions such as device status management, cloud communication, user interaction control, MIFI hotspot service, voice collection and processing, location monitoring, and power management.

[0094] It should be noted that, see Figure 5 The shared cabinet includes: a cabinet body, and a plurality of slots corresponding to terminal devices, a cabinet main controller, a network communication module and a user interaction interface arranged on the cabinet body.

[0095] The slots are also used to exchange data with the terminal devices. Each slot has a device ID recognition module (such as an RFID reader or contact recognition) and an electronically controlled locking / unlocking mechanism. The device ID recognition module can monitor the presence of a device, the device ID, and the device's charging status in real time in each slot. The shared cabinet synchronizes this detected information with the cloud-based backend service module. The electronically controlled locking / unlocking mechanism can unlock the slot upon receiving an unlock command, or lock the terminal device after it is returned. Each slot can accommodate one terminal device.

[0096] In terms of hardware implementation, each card slot is equipped with an RK3399 processor, 2GB of RAM, and 16GB of eMMC storage. The slot also has a built-in 36W fast charging port for connecting to the physical interface of the terminal cabinet, which can charge the terminal device and is used for data exchange with the terminal device, such as USB or dedicated contacts.

[0097] The shared cabinet interacts with the terminal device for data exchange. When the terminal device is in the cabinet, it can be used as a data transmission channel to perform batch firmware updates, scenic spot data cache synchronization, or remote diagnosis on the terminal device according to the instructions of the cloud background.

[0098] The cabinet uses a state machine to manage each slot. Slot states include: Idle - Ready, Idle - Under Maintenance, Occupied - Charging, Occupied - Charging Completed, Occupied - Under Maintenance, Occupied - Ready, etc. The cabinet monitors the status of each slot in real time and reports status information in a preset format to the cloud backend.

[0099] The user interaction interface is used to display a QR code and preset information. For example, a 10.1-inch touch screen with a resolution of 1280×800 is provided to support QR code scanning. When the user's smart device scans the QR code, the user can complete the rental and return operations through the smart device by themselves.

[0100] The network communication module is used to establish a network connection between the cabinet main controller and the cloud background service module. The network communication module has a wired Ethernet interface (1000Mbps) or a wireless communication module (such as WiFi, 4G / 5G) for data exchange between the cabinet and the cloud background service module.

[0101] The cabinet main controller is used to monitor the information of each slot and upload the slot information to the cloud background service module; it is also used to obtain a lease instruction from the cloud background service module and unlock the terminal device of the corresponding slot according to the lease instruction.

[0102] The cabinet master controller is responsible for managing the status of all card slots in the cabinet, controlling charging, executing lock / unlock commands, driving the user interface, and communicating with the cloud backend service system.

[0103] The power supply system of the shared cabinet is AC 220V input, with a built-in UPS backup power supply, which can operate for 2 hours in the event of a power outage.

[0104] It should be noted that the cloud-based backend service module includes: user management and authentication module, equipment management module, rental and order management module, AI service scheduling module, and scenic spot information and content management module.

[0105] The user management and authentication module is used to manage user account information, including registration, login, identity authentication, and payment binding.

[0106] The device management module is used to obtain data on all terminal devices and shared cabinets. It maintains a database of all terminal devices and cabinets, and tracks their status (location, power consumption, network, whether they are in the cabinet, whether they are rented, etc.), usage history, and maintenance records in real time.

[0107] The rental and order management module is used to obtain and process user rental requests, generate rental instructions, generate orders based on rental requests, manage the rental life cycle, and record rental and return events.

[0108] The AI ​​service scheduling module is used to call the API of the corresponding AI engine (such as machine translation API, speech synthesis TTS API, speech recognition ASR API, geographic location and scenic spot information matching service) according to the AI ​​service request (including original data such as voice and GPS coordinates). If the AI ​​service request is a translation request, translation audio data is generated. If the AI ​​service request is a scenic spot broadcast request, the pre-stored scenic spot data is called to generate scenic spot broadcast audio data.

[0109] See also Figure 6 The AI ​​service scheduling module intelligently selects the most appropriate AI service provider based on factors such as request type, audio quality, language combination, and network conditions, ensuring a balance between service quality and cost-effectiveness. The system supports the integration and flexible switching of multiple third-party AI services, avoiding reliance on a single one.

[0110] At the same time, the AI ​​service scheduling module can also manage the interfaces, keys and call quotas with third-party AI services, format and encapsulate the AI ​​processing results, and return them to the requesting terminal device.

[0111] The attraction information and content management module is used to store and manage attraction data; it is also used to update attraction data; the attraction data includes: attraction geo-fence data, multilingual attraction introduction text and audio materials.

[0112] The cloud-based backend service system utilizes a microservices architecture and is deployed on an elastic cloud computing platform. The system entry layer includes a load balancer and API gateway to ensure high availability and security. The microservices layer includes user services, device management services, cabinet management services, order services, an AI service gateway, content management services, billing services, payment services, and data analysis services. The data storage layer utilizes a combination of a relational database (MySQL) and a NoSQL database (MongoDB), with Redis used as a cache to enhance performance.

[0113] It should be noted that the shared intelligent terminal system based on cloud AI collaboration also includes:

[0114] The billing and payment module is used to obtain multi-dimensional usage data of the terminal device in real time. The multi-dimensional usage data includes: status data of the terminal device, AI translation service call data, and AI scenic spot broadcast trigger data; dynamically calculate the rental fee based on the multi-dimensional usage data and pre-designed fee rules; and connect with a third-party payment platform to complete fee settlement.

[0115] For example, data such as charging time, MIFI traffic consumption, number / duration of AI translation service calls, and number of AI scenic spot broadcast triggering are collected as multi-dimensional usage data. The rental fee is dynamically calculated based on the package type selected by the user (such as basic package, traffic package, full-function package) and the actual multi-dimensional usage data generated, combined with the preset billing rules (such as unit price, tiered price, and capped price).

[0116] Preferably, the cloud backend service module also includes an API interface module: it can provide a secure API interface for terminal devices, smart cabinets, user apps / applets, etc. to call. Data analysis and operation monitoring module: it analyzes device usage data, user behavior data, and system operation status to support operational decisions and monitor system health.

[0117] In another embodiment, a method for managing a shared intelligent terminal based on cloud AI collaboration is provided, which is used to manage the above-mentioned shared intelligent terminal system based on cloud AI collaboration, including:

[0118] Step S11: When the terminal device is in the slot of the shared cabinet, the shared cabinet charges the terminal device, and the cloud background service module performs remote maintenance (firmware update, scenic spot data synchronization, etc.) on the terminal device.

[0119] Step S12: Obtain and verify the user's login account information, and instruct the target shared cabinet to unlock the corresponding slot according to the user's instruction.

[0120] In practice, users register an account and log in to the system through a client on their mobile phone (such as a mobile app or mini-program). Users use the client to view information about available terminal devices in nearby shared cabinets and choose to rent them. At this point, the user's mobile phone connects data with the cloud-based backend service module. The user initiates a rental request on the client, and the cloud-based backend service module verifies the user's identity and account status. After the verification is passed, the cloud-based backend service module sends an unlock command to the target cabinet, the cabinet unlocks the slot of the corresponding device, and the user takes out the terminal device; the cloud-based backend records the rental start time and device information.

[0121] Step S13: When the terminal device is turned on, the terminal device automatically connects to the network and registers with the cloud-based backend service module. The cloud-based backend service module authorizes the terminal device to provide WiFi hotspot services, charging services, translation services, and scenic spot broadcast services.

[0122] After the user obtains the terminal device and turns it on, the terminal device automatically connects to the network (via the MIFI module), registers / checks in with the cloud-based backend service module, and reports its device ID and initial status. The cloud-based backend service module confirms the device activation and authorizes the device to access MIFI Internet services and various cloud-based AI services.

[0123] Users can use the WiFi hotspot provided by the terminal device, and the terminal device regularly reports MIFI traffic consumption data to the cloud background service module.

[0124] Step S14: When the terminal device sends an AI service request to the cloud-based backend service module, the cloud-based backend service module calls the API of the corresponding AI engine to generate translated audio data or scenic spot broadcast audio data, so that the terminal device plays the corresponding audio data.

[0125] When using AI translation, users input voice through the microphone of their terminal device, which then uploads the voice data to the cloud-based backend service module. The cloud-based backend service module then processes the AI ​​translation engine and sends the translated audio data to the terminal device for playback. The cloud-based backend records the translation service calls.

[0126] When a user uses the AI ​​attraction announcement service, the terminal device obtains its GPS location in real time and reports it to the cloud backend. The cloud backend then matches the GPS location to the attraction database. If the user enters a preset attraction area, the corresponding attraction introduction is triggered, and the AI ​​speech synthesis engine is invoked to generate voice data, which is then sent to the terminal device for playback. The cloud backend also records the calls to the attraction announcement service.

[0127] At the same time, users can use terminal devices to charge other devices.

[0128] Step S15: The terminal device sends power level, network signal strength, positioning data, traffic consumption and device ID to the cloud backend service module at preset intervals.

[0129] During the rental period, the terminal device continuously reports power consumption, network signal strength, positioning data, traffic consumption and device ID to the cloud background, and the cloud background monitors the status of the device in real time.

[0130] Step S16: When any shared cabinet detects that the terminal device is in the slot again, the shared cabinet identifies the terminal device and locks the slot, and sends the return information to the cloud backend service module.

[0131] When a user wants to return a device, they simply insert the terminal device into any available slot in the cooperative shared cabinet. The shared cabinet will recognize the inserted device ID, lock the device, and report the return information (device ID, card slot number, return time) to the cloud backend.

[0132] Step S17: The cloud-based backend service module calculates the rental fee based on the multi-dimensional usage data, settles the fee through the payment method bound to the account information, and generates a bill.

[0133] It should be noted that when the terminal device provides translation services, it includes:

[0134] Step S21: Collect the user's voice data through the audio input / output unit of the terminal device, and send the voice data to the cloud backend service module.

[0135] When a user wants to use AI translation, the user inputs voice through the audio input / output unit (microphone) of the terminal device, and the terminal device collects the voice data.

[0136] Step S22: The cloud-based backend service module calls the API of the AI ​​translation engine to process the voice data, generate translated audio data, and send the translated audio data back to the terminal device.

[0137] Step S23: The cloud-based backend service module records the number of times the AI ​​translation engine is called.

[0138] In practice, when using the translation service, users can press the translation button on their terminal device, which activates the microphone and collects the user's voice. The audio data is packaged and uploaded in real time using Opus encoding (16KHz sampling rate, mono, 24kbps bit rate). The cloud receives the audio stream, selects the appropriate ASR engine for recognition based on the language characteristics, and transmits the recognition results to the translation engine for conversion into the target language. The translation results can be returned directly in text form or synthesized into voice data using a TTS engine. The translated text or voice data is sent to the terminal device for display or playback. The average latency of the entire process is controlled within 1.5 seconds, ensuring the immediacy of the translation.

[0139] It should be noted that when the terminal device provides scenic spot broadcasting services, it includes:

[0140] Step S31: The terminal device obtains positioning data in real time and sends the positioning data to the cloud backend service module.

[0141] Step S32: The cloud backend service module matches the scenic spot database according to the positioning data to detect whether the terminal device is within the preset scenic spot area.

[0142] Step S33: If the terminal device is in a preset scenic spot area and no scenic spot broadcast audio has been sent to the terminal device, the pre-stored scenic spot broadcast content is selected according to the language set by the user.

[0143] Step S34: The cloud-based backend service module calls the API of the AI ​​scenic spot broadcast engine, generates scenic spot broadcast audio data according to the scenic spot broadcast content, and sends the scenic spot broadcast audio data back to the terminal device.

[0144] Step S35: The cloud-based backend service module records the number of times the AI ​​scenic spot broadcast engine is called.

[0145] In actual practice, when a user uses the scenic spot broadcast service, for example, the terminal device collects and uploads the GPS location every 5 seconds. The cloud matches the location with the predefined scenic spot geo-fence. When it detects that the user has entered a scenic spot area, the system checks whether the same content has been pushed to the user. If it has not been pushed, the appropriate scenic spot introduction is selected from the content library according to the language set by the user. Preferably, depending on the network conditions, the system can choose to generate content in real time (such as using TTS real-time synthesis) or use pre-compiled content (such as pre-recorded MP3 files). The content is sent to the terminal device, the user is notified and the content is played. The system records the broadcast usage for billing and analysis.

[0146] It should be noted that the cloud-based backend service module performs remote maintenance on terminal devices, including:

[0147] Step S41: The terminal device sends status data to a cloud-based backend service module, and the cloud-based backend service module determines whether the terminal device needs maintenance based on the status data.

[0148] Step S42: If the terminal device needs maintenance, when the terminal device is in a slot of the shared cabinet, the cloud-based backend service module sends a maintenance instruction to the shared cabinet.

[0149] Step S43: When the shared cabinet receives the maintenance instruction, it locks the slot where the terminal device is located and establishes a data connection with the terminal device.

[0150] Step S44: The cloud-based backend service module performs remote maintenance on the terminal device through the shared cabinet.

[0151] Step S45: After the maintenance is completed, the shared cabinet verifies the status of the terminal device and updates the maintenance record of the terminal device.

[0152] In practice, the cloud continuously monitors the status of all terminal devices. When it detects a device requiring maintenance (e.g., a firmware version that's too low, a content library that needs updating, or an abnormal status), the system marks the device and waits for it to be returned to the cabinet. Once the device is in the shared cabinet, the cloud sends a maintenance command to the cabinet, which then locks the corresponding slot and establishes a high-speed data connection with the device.

[0153] Perform different operations based on the maintenance type: Firmware update: Download the latest firmware, verify, install, and restart the device; Content synchronization: Analyze the device's recent activity area, prepare relevant attraction content data, and synchronize it to the device; Health check: Perform battery health test, network connection test, and sensor calibration, etc.

[0154] After maintenance is complete, the equipment status is verified and the equipment record is updated, making the equipment available for rent again. The cabinet reports the maintenance completion status to the cloud.

[0155] The shared intelligent terminal system based on cloud AI collaboration places high emphasis on security and privacy protection during its design and implementation. Data transmission security: All communications between terminal devices and the cloud utilize the TLS 1.3 encryption protocol to ensure secure data transmission. API access utilizes the OAuth 2.0 authorization framework and JWT token authentication.

[0156] Device Security: The terminal device utilizes a secure boot mechanism to ensure that only digitally signed, legitimate firmware can run. Device firmware supports secure over-the-air (OTA) updates, with update packages verified using RSA-2048 signatures. The device also features a built-in tamper protection mechanism. If unauthorized opening of the device's casing is detected, a security alert is triggered and reported to the cloud.

[0157] Data privacy protection: User voice data is immediately deleted from the cloud after use and is not stored long-term. Location information is desensitized before analysis, and users can choose to disable precise location sharing. Complying with privacy regulations such as GDPR and CCPA, user data export and deletion functions are provided.

[0158] Access control: The cloud backend adopts a role-based access control (RBAC) model, and different roles (such as operation and maintenance personnel, customer service, and administrators) have strictly limited system access rights.

[0159] Anomaly Monitoring: The system is equipped with a security monitoring module that can detect abnormal access patterns, DDoS attacks, and malicious API calls in real time and automatically take corresponding protective measures.

[0160] In another embodiment, the shared intelligent terminal system based on cloud AI collaboration supports multi-language and multi-regional deployment.

[0161] Multi-language Support: The terminal UI and voice prompts support 15 major languages, including Chinese (Simplified / Traditional), English, Japanese, Korean, French, German, Spanish, Russian, and more. The translation service supports translation between over 50 languages, with specially optimized translation models for common language combinations (such as Chinese-English, Chinese-Japanese, and English-French). The attraction content library supports multiple languages ​​and automatically selects appropriate content based on the user's language setting.

[0162] Regional Adaptability: The network connection module supports the network standards and frequency bands of major global operators and has built-in region-specific network selection policies. The payment system integrates mainstream payment methods in various regions, such as Alipay / WeChat Pay, international credit cards, and PayPal. Content push complies with local regulatory requirements, with content filtering and compliance checking mechanisms implemented for different regions.

[0163] Distributed deployment architecture: The cloud backend utilizes a multi-region deployment, with independent data centers in key regions to ensure low latency and high availability. Edge computing nodes are deployed in major tourist cities to accelerate content distribution and reduce the load on central servers. Disaster recovery mechanisms ensure that failures in a single region do not affect global service availability.

[0164] Device customization: Providing appropriate hardware variants based on user habits and usage environments in different regions, such as enhanced low-temperature adaptability in Northern Europe and enhanced waterproof and moisture-proof capabilities in tropical regions.

[0165] In actual application scenarios, the shared intelligent terminal system based on cloud AI collaboration can be directly deployed in crowded areas such as tourist attractions, airports, and railway stations to provide rental services to individual users.

[0166] Preferably, the terminal devices of the shared intelligent terminal system based on cloud AI collaboration have reserved expansion interfaces, which can be used to add functions such as cameras and environmental sensors through external modules. At the same time, the modular design of the cabinet can increase the display size, add self-service shopping functions, and integrate advertising display systems as needed.

[0167] AI capabilities can also be expanded. The cloud AI service adopts a plug-in architecture, which allows for the easy integration of new AI models and algorithms. For example, image recognition (taking photos to identify objects / text), AR navigation, and real-time video translation can be added.

[0168] Compared with the prior art, the present invention has the following significant advantages and beneficial effects:

[0169] Function integration: Integrating multiple functions such as MIFI Internet access, AI translation, scenic spot broadcasting and mobile charging into a single portable device, greatly reducing the user's travel burden and improving convenience.

[0170] Cloud-based intelligent collaboration: By placing computing-intensive tasks (such as speech recognition, machine translation, and content generation) in the cloud for processing, terminal devices remain lightweight and low-power while providing high-quality AI services.

[0171] Infrastructure benefits: Adopting a sharing economy model improves equipment utilization, reduces resource consumption, and achieves sustainable development. One device can serve multiple users, making it more economical and environmentally friendly than purchasing dedicated equipment for each user.

[0172] Efficient management: Through the collaboration of smart cabinets and cloud systems, equipment can be managed, maintained, and deployed automatically, significantly reducing operating costs and improving system reliability.

[0173] Flexible billing: The multi-dimensional billing model can charge reasonable fees based on actual user usage, which not only protects the profitability of service providers but also ensures that users receive fair and reasonable service pricing.

[0174] Improve travel experience: AI-enabled translation and tourist attraction interpretation services help travelers overcome language barriers, gain a deeper understanding of the destination culture, and significantly enhance the quality of their travel experience.

[0175] Scalable architecture: Modular design and open API architecture ensure that the system has strong scalability and can continuously evolve and upgrade with technological development and market demand, extending the solution lifecycle.

[0176] It can be understood that the same or similar parts of the above embodiments can be referenced to each other, and the contents not described in detail in some embodiments can refer to the same or similar contents in other embodiments.

[0177] It should be noted that, in the description of the present invention, the terms "first", "second", etc. are used for descriptive purposes only and should not be understood as indicating or implying relative importance. In addition, in the description of the present invention, unless otherwise specified, the meaning of "plurality" is at least two.

[0178] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, segment or portion of code comprising one or more executable instructions for implementing the steps of a specific logical function or process, and the scope of the preferred embodiments of the present invention includes alternative implementations in which functions may be performed out of the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order depending on the functions involved, which should be understood by those skilled in the art to which the embodiments of the present invention pertain.

[0179] It should be understood that various parts of the present invention can be implemented using hardware, software, firmware, or a combination thereof. In the above-described embodiments, multiple steps or methods can be implemented using software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented using hardware, as in another embodiment, any one of the following technologies known in the art or a combination thereof can be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application-specific integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0180] Those skilled in the art will understand that all or part of the steps in the method of the above embodiment can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium. When the program is executed, it includes one or a combination of the steps of the method embodiment.

[0181] In addition, the functional units in the various embodiments of the present invention may be integrated into a single processing module, or each unit may exist physically separately, or two or more units may be integrated into a single module. The aforementioned integrated modules may be implemented in the form of hardware or in the form of software functional modules. If the integrated modules are implemented in the form of software functional modules and sold or used as independent products, they may also be stored in a computer-readable storage medium.

[0182] The storage medium mentioned above can be a read-only memory, a magnetic disk or an optical disk, etc.

[0183] Throughout this specification, reference to terms such as "one embodiment," "some embodiments," "examples," "specific examples," or "some examples" means that a specific feature, structure, material, or characteristic described in conjunction with that embodiment or example is included in at least one embodiment or example of the present invention. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.

[0184] Although the embodiments of the present invention have been shown and described above, it will be understood that the above embodiments are illustrative and are not to be construed as limitations on the present invention. A person skilled in the art may change, modify, replace and modify the above embodiments within the scope of the present invention.

Claims

1. A shared intelligent terminal system based on cloud AI collaboration, characterized in that: include: Terminal equipment, shared cabinets and cloud-based backend service modules; The shared cabinet is provided with a plurality of slots for accommodating terminal devices. When the terminal devices are in the slots, the shared cabinet charges the terminal devices. The terminal devices and the shared cabinet are both connected to the cloud backend service module network. When in use, the terminal device is used to provide WiFi hotspot services and charge other devices connected to the terminal device; it is also used to obtain AI service requests, user-input voice data and positioning data, and the AI ​​service requests include translation requests or scenic spot broadcast requests; it is also used to output audio data received from the cloud backend service module; When the shared cabinet receives a rental instruction from the cloud backend service module, it unlocks the terminal device in the corresponding slot according to the rental instruction; The cloud-based backend service module is used to obtain and process the user's rental request and generate a rental instruction; it is also used to call the API of the corresponding AI engine according to the AI ​​service request, and if the AI ​​service request is a translation request, generate translation audio data; if the AI ​​service request is a scenic spot broadcast request, generate scenic spot broadcast audio data.

2. The shared intelligent terminal system based on cloud AI collaboration according to claim 1 is characterized in that: The terminal device includes: a main control unit, a MIFI module, a power management unit, a positioning module, an audio input / output unit, a user interaction module and a cabinet physical interface; The MIFI module is used to connect to the 4G / 5G network, establish a WiFi hotspot service, and establish a network connection between the main control unit and the cloud background service module; The power management unit is used to manage the charging and discharging of the built-in battery of the terminal device and control the built-in battery to serve as a mobile power source to charge other devices; The positioning module is used to obtain the positioning data of the terminal device in real time; The audio input / output unit is used to obtain voice data input by the user and also to output translated audio data or scenic spot broadcast audio data received from the cloud backend service module; The main control unit is used to encapsulate the voice data and positioning data and send them to the cloud backend service module; it is also used to send the status data of the terminal device to the cloud backend service module; the status data includes: power, network signal strength, positioning data, data usage and device ID; The user interaction module is used to obtain AI service requests, including translation requests or scenic spot broadcast requests; The cabinet physical interface is used to connect to the shared cabinet when the terminal device is in a slot of the shared cabinet.

3. The shared intelligent terminal system based on cloud AI collaboration according to claim 2 is characterized in that: The shared cabinet comprises: a cabinet body, and a plurality of slots corresponding to terminal devices, a cabinet main controller, a network communication module and a user interaction interface arranged on the cabinet body; The slot is also used to interact with the terminal device for data; each slot has a device ID recognition module and an electronically controlled locking / unlocking device; The user interaction interface is used to display the QR code and preset information; The network communication module is used to establish a network connection between the cabinet main controller and the cloud background service module; The cabinet main controller is used to monitor the information of each slot and upload the slot information to the cloud background service module; it is also used to obtain a lease instruction from the cloud background service module and unlock the terminal device of the corresponding slot according to the lease instruction.

4. The shared intelligent terminal system based on cloud AI collaboration according to claim 3 is characterized in that: The cloud-based backend service module includes: user management and authentication module, equipment management module, rental and order management module, AI service scheduling module, and scenic spot information and content management module; The user management and authentication module is used to manage user account information, including registration, login, identity authentication, and payment binding; The device management module is used to obtain data of all terminal devices and shared cabinets; The rental and order management module is used to obtain and process user rental requests, generate rental instructions, generate orders based on rental requests, manage the rental lifecycle, and record rental and return events; An AI service scheduling module is used to call the API of the corresponding AI engine according to the AI ​​service request. If the AI ​​service request is a translation request, the module generates translation audio data. If the AI ​​service request is a scenic spot broadcast request, the module calls the pre-stored scenic spot data to generate scenic spot broadcast audio data. The attraction information and content management module is used to store and manage attraction data; it is also used to update attraction data; the attraction data includes: attraction geo-fence data, multilingual attraction introduction text and audio materials.

5. The shared intelligent terminal system based on cloud AI collaboration according to claim 4 is characterized in that: Also includes: A billing and payment module is used to obtain multi-dimensional usage data of the terminal device in real time, wherein the multi-dimensional usage data includes: status data of the terminal device, AI translation service call data, and AI scenic spot broadcast trigger data; The rental fee is dynamically calculated based on the multi-dimensional usage data and pre-designed fee rules; and the fee settlement is completed by connecting with a third-party payment platform.

6. The shared intelligent terminal system based on cloud AI collaboration according to claim 2 is characterized in that: The user interaction module of the terminal device further includes: Status indicator lights, physical button group and display screen.

7. A management method for shared intelligent terminals based on cloud AI collaboration, characterized in that: include: When the terminal device is in the slot of the shared cabinet, the shared cabinet charges the terminal device, and the cloud-based backend service module performs remote maintenance on the terminal device; Obtain and verify the user's login account information, and instruct the target shared cabinet to unlock the corresponding slot according to the user's instructions; When the terminal device is turned on, it automatically connects to the network and registers with the cloud-based backend service module, which authorizes the terminal device to provide WiFi hotspot services, charging services, translation services, and scenic spot broadcast services; When the terminal device sends an AI service request to the cloud-based backend service module, the cloud-based backend service module calls the corresponding AI engine API to generate translation audio data or scenic spot broadcast audio data, so that the terminal device plays the corresponding audio data; The terminal device sends power level, network signal strength, positioning data, traffic consumption and device ID to the cloud backend service module at preset intervals; When any shared cabinet detects that the terminal device is in the slot again, the shared cabinet identifies the terminal device and locks the slot, and sends the return information to the cloud backend service module; The cloud-based backend service module calculates the rental fee based on the multi-dimensional usage data, settles the fee through the payment method bound to the account information, and generates a bill.

8. The method according to claim 7, characterized in that When the terminal device provides translation services, it includes: Collect the user's voice data through the audio input / output unit of the terminal device and send the voice data to the cloud backend service module; The cloud backend service module calls the API of the AI ​​translation engine to process the voice data, generate translated audio data, and send the translated audio data back to the terminal device; The cloud-based backend service module records the number of times the AI ​​translation engine is called.

9. The method according to claim 7, characterized in that When the terminal device provides scenic spot broadcasting service, it includes: The terminal device obtains the positioning data in real time and sends the positioning data to the cloud backend service module; The cloud backend service module matches the scenic spot database according to the positioning data to detect whether the terminal device is in the preset scenic spot area; If the terminal device is in the preset scenic spot area and the scenic spot broadcast audio has not been sent to the terminal device, the pre-stored scenic spot broadcast content is selected according to the language set by the user; The cloud backend service module calls the API of the AI ​​scenic spot broadcast engine, generates scenic spot broadcast audio data according to the scenic spot broadcast content, and sends the scenic spot broadcast audio data back to the terminal device; The cloud-based backend service module records the number of times the AI ​​scenic spot broadcast engine is called.

10. The method according to claim 7, characterized in that The cloud-based backend service module performs remote maintenance on terminal devices, including: The terminal device sends the status data to the cloud-based backend service module, and the cloud-based backend service module determines whether the terminal device needs maintenance based on the status data; If the terminal device needs maintenance, when the terminal device is in the slot of the shared cabinet, the cloud backend service module sends a maintenance instruction to the shared cabinet; When the shared cabinet receives a maintenance instruction, it locks the slot where the terminal device is located and establishes a data connection with the terminal device; The cloud-based backend service module performs remote maintenance on terminal devices through a shared cabinet; After maintenance is completed, the shared cabinet verifies the status of the terminal device and updates the maintenance record of the terminal device.

Images