AIoT-based cultural and creative post operation method and operation device

Abstract

The invention relates to an AIoT-based file and creative post operation method and an operation device, and belongs to the field of intelligent equipment and systems. The operation method is operated based on the self-service selling management subsystem, the intelligent guiding and leasing subsystem and the AI interaction operation subsystem. The intelligent guiding and leasing subsystem uploads guiding content information and plays propaganda materials through a screen of an equipment end according to streaming user attributes; a user obtains a commodity picture, a price and a commodity channel number through the self-service selling management subsystem to select a transaction product; the intelligent guide leasing subsystem obtains user identity information, applies for a collection code through a third-party payment platform, prompts payment, and completes leasing or returns to the guide terminal; and the AI interaction operation subsystem carries out posture interaction and voice broadcast with a user. According to the AIoT-based file and creative post operation method and operation device, a closed-loop operation mode of renting, using, returning, purchasing and playing of guide terminals, file and creative commodities and interactive services can be realized, and a one-stop closed-loop operation service is realized.

Description

Technical Field

[0001] The present invention relates to an AIoT-based cultural and creative station operation method and operation device, and belongs to the field of intelligent devices and systems. Background Art

[0002] With the recovery of consumption in the cultural and tourism industry in the post-epidemic period, the construction of operation and service infrastructure of various cultural and tourism venues has gradually increased. The demand for comprehensive self-service operation equipment has also gradually increased. Traditional cultural and tourism self-service equipment has a single function, lacks a closed-loop operation model, lacks interactive operation equipment with integrated rental, use, return, purchase, and play, lacks innovative application of new technologies, and lacks the ability to achieve precise promotion for different user groups. Summary of the invention

[0003] The present invention uses an AIoT-based cultural and creative station operation method to realize a closed-loop operation mode of renting, using, returning, purchasing, and playing guide terminals, cultural and creative products, and interactive services, thereby realizing a one-stop closed-loop operation service.

[0004] The present invention adopts the following technical solution:

[0005] The AIoT-based cultural and creative station operation method of the present invention operates a cultural and creative station built by a self-service sales management subsystem, an intelligent guide rental subsystem, and an AI interactive operation subsystem; multiple Ibeacon base stations are arranged within the operation range covered by the cultural and creative station; and multiple Ibeacon base stations are distributed in each service area;

[0006] The smart tour guide rental subsystem uploads the tour guide content information and plays the promotional materials through the device screen according to the stream user attributes;

[0007] Users obtain product images, prices, and channel numbers through the self-service sales management subsystem to select transaction products;

[0008] The smart tour guide rental subsystem obtains the user's identity information and applies for a payment code through a third-party payment platform and prompts payment to complete the rental or return the tour guide terminal;

[0009] The user interacts with the Ibeacon base station through the navigation terminal;

[0010] The AI ​​interactive operation subsystem interacts with users through gestures and voice broadcasts.

[0011] In the AIoT-based cultural and creative station operation method of the present invention, the tour content information in the smart tour guide rental subsystem includes audio and video materials of each tour guide explanation point and corresponding location number information; the smart tour guide rental subsystem regularly sends the content information to the main control unit of the device end, and then the main control unit transmits it to each tour guide terminal through the communication interface;

[0012] The self-service vending management subsystem uploads the product pictures, prices, and channel number sales information, and sends the sales information to the main control unit of the device end in real time.

[0013] The AIoT-based cultural and creative station operation method of the present invention includes the following interactive steps of the smart tour guide rental subsystem:

[0014] (1) Using the touch screen on the device to enable users to rent a tour terminal or purchase cultural and creative products;

[0015] (2) When the rental guide terminal on the touch screen of the device is clicked, the corresponding interactive interface is entered, and the main control unit obtains the user's ID card information through the ID card reader, obtains the user's mobile phone number and other information through the touch screen, and then applies for a payment code from the third-party payment platform through the intelligent guide rental subsystem and prompts payment;

[0016] (3) After payment is completed, the main control unit controls one of the lock mechanisms through the lock control panel to pop up the navigation terminal for the user to collect;

[0017] (4) The guide terminal obtains location information through the positioning module and outputs the corresponding audio and video information when arriving at each explanation point.

[0018] The AIoT-based cultural and creative station operation method of the present invention is that when a user enters the self-service vending management subsystem, the user can rent a guide terminal or purchase cultural and creative products through the touch screen of the device. The interaction steps are as follows:

[0019] (1) The user enters the corresponding interactive interface through the rental guide terminal on the touch screen.

[0020] (2) The main control unit obtains the user's ID card information through the ID card reader, obtains the user's mobile phone number and other information through the touch screen, and then applies for a payment code from the third-party payment platform through the smart guide rental subsystem and prompts payment;

[0021] (3) When the user completes the payment, the locking mechanism in the Cultural and Creative Station will pop up the guide terminal for the user to collect.

[0022] The AIoT-based cultural and creative station operation method of the present invention is that when a user enters the self-service vending management subsystem, the user can rent a guide terminal or purchase cultural and creative products through the touch screen of the device. The interaction steps are as follows:

[0023] (1) The user enters the corresponding interactive interface through the rental guide terminal on the touch screen.

[0024] (2) The main control unit obtains the user's ID card information through the ID card reader, obtains the user's mobile phone number and other information through the touch screen, and then applies for a payment code from the third-party payment platform through the smart guide rental subsystem and prompts payment;

[0025] (3) When the user completes the payment, the locking mechanism in the Cultural and Creative Station will pop up the guide terminal for the user to collect.

[0026] (4) The user writes to the navigation terminal to scan all the surrounding iBeacon base stations through the Bluetooth module, collect the RSSI value of each base station, and extract the MAC addresses and corresponding RSSI values ​​of the three iBeacon base stations with the strongest RSSI signal values;

[0027] (5) The navigation terminal uses the RSSI value and the preset transmission power TXPower to calculate the distance d between the positioning terminal and each iBeacon base station i , the expression is as follows:

[0028]

[0029] Where TXPower is the transmit power (unit: dBm), the theoretical RSSI value at a distance of 1 meter; RSSI i is the received signal strength indication of the i-th Ibeacon base station (unit: dBm); n is the environmental attenuation factor, which reflects the impact of the signal propagation environment on the signal strength.

[0030] (6) Use the trilateral measurement method to calculate the initial position (x0, y0) of the user's navigation terminal; assuming that there are three iBeacon base stations A (x1, y1), B (x2, y2), and C (x3, y3), and the corresponding distances are d1, d2, and d3 respectively, then the initial position (x0, y0) can be obtained by solving the following set of equations:

[0031]

[0032] (7) When the user's navigation terminal reaches the specified area, the precise coordinates of the calibration point (x c ,y c ), use the following formula to calibrate the precise coordinates to correct the initial position (x0, y0):

[0033] (x f ,y f )=(x0+Δx,y0+Δy)

[0034] Δx=x c -x0

[0035] Δy=y c -y0

[0036] Among them, (x f ,y f ) is the final position after correction;

[0037] After precision calibration using the infrared code transmitter of the Ibeacon base station, the infrared signal is received and decoded, and the explanation content corresponding to the infrared code is played at the same time;

[0038] (8) When the positioning terminal leaves the calibration point, it continues to use the Ibeacon base station for positioning and uses the correction value (Δx, Δy) of the last calibration point for dynamic adjustment to maintain positioning accuracy.

[0039] The AIoT-based cultural and creative station operation method of the present invention is that the AI ​​digital communication system collects image data through a camera through an AI edge processor and performs posture detection on the person in the image, and generates an AI digital human video stream corresponding to the action posture through an AI large model; the specific steps are as follows:

[0040] (1) Obtain the video stream in the camera channel and extract frames, decode, and convert the format to obtain continuous frame images in RGB format and pre-process the images;

[0041] (2) Use a combined target detection algorithm to detect the human body through Yolo or Faster-RCNN based on deep learning;

[0042] (3) For each detected human body, a model is used for training and the training model is output;

[0043] (4) using the training model of step (3) to detect and identify the key points of the human body in the target image, obtain the coordinate information of the key points of a single / multiple human body contained in the target image, and calculate the connection relationship between each key point and the human body joint by using the key point affinity field prediction algorithm;

[0044] (5) Perform non-real-time posture sketch reconstruction, draw lines to connect the human skeleton posture through the connection relationship between the key points calculated in step (4) and the corresponding human joints, and generate a 2D skeleton tangent posture sketch;

[0045] (6) Import the 2D skeleton tangent pose sketch data in step (5) into the 3D pose estimation model Sketch2Pose and fit it into the pose of the person in the camera captured image in step (1) consistent with the 3D digital virtual human;

[0046] (7) Import text promotional materials into the PortaSpeech 2 large model voice fitting platform to realize the voice broadcast of 3D digital virtual people.

[0047] An operating device for a cultural and creative station operation method based on AIoT includes a device body; a main control unit, a voice guide terminal, at least one integrated touch display screen, a camera, a shipping port, and a cargo channel mechanism;

[0048] A cargo channel mechanism is provided in the main body of the device for selling goods; a voice guide terminal for rental, at least one integrated touch display screen and a camera are arranged on the main body of the device;

[0049] The delivery port is located below the cargo channel mechanism;

[0050] The main control unit is used to collect image data captured by the camera for analyzing the attributes of streaming users; and accurately set the content and playback time period of the promotional materials based on the analysis and statistical results, and play them through the device screen.

[0051] The operating device of the AIoT-based cultural and creative station operating method of the present invention, the voice guide terminal includes an embedded mainboard, a Bluetooth module, an infrared receiver, a GPS module, and an audio module;

[0052] The Bluetooth module and GPS module are connected to the embedded mainboard through the UART port;

[0053] The infrared receiver is connected to the embedded mainboard through the IIC port;

[0054] The audio module is used to play voice messages.

[0055] Beneficial Effects

[0056] The AIoT-based cultural and creative station operation method and operation device adopted by the present invention can realize a closed-loop operation mode of renting, using, returning, purchasing, and playing guide terminals, cultural and creative products, and interactive services, and realize a one-stop closed-loop operation service.

[0057] The present invention adopts an AIoT-based cultural and creative station operation method and operation device. The present invention uses AI technology to realize intelligent analysis of user attributes, thereby achieving accurate promotion of commodity sales and advertising.

[0058] The AIoT-based cultural and creative station operation method and operation device adopted by the present invention realize the precise indoor positioning of the intelligent guide terminal through two positioning methods: positioning base station and infrared transmitter. Combined with Beidou and GPS modules, seamless indoor and outdoor positioning switching is achieved, thereby completing the intelligent guide broadcast of precise location, greatly improving the user's exhibition experience.

[0059] The present invention adopts the AIoT-based cultural and creative station operation method and operation device. The cargo lane structure of the present invention can adapt to the sale of a variety of commodities of different shapes, and can sell cultural and creative products, beverages, blind boxes, tickets and other products at the same time. The cargo lane adopts a unique magnetic non-contact induction spring support plate structure, which can effectively avoid under-shipping or over-shipping, and greatly improves the stability of the equipment.

[0060] The AIoT-based cultural and creative station operation method and operation device adopted by the present invention adopts a unique magnetic non-contact induction spring support plate structure for the cargo aisle, which effectively improves the service life of the cargo aisle compared to the traditional cargo aisle through mechanical switch feedback.

[0061] The AIoT-based cultural and creative station operation method and operation device adopted by the present invention use artificial intelligence technology to output the posture of the person in the image captured by the camera in a 3D digital human synchronized posture, and realizes interactive promotion of cultural and creative industries through voice fitting technology, thereby further improving the operation effect of the cultural and creative station.

[0062] The AIoT-based cultural and creative station operation method and operation device adopted by the present invention combine the indoor positioning technology of Ibeacon and infrared coding to significantly improve the positioning accuracy, thereby improving the ability of tourists to accurately locate and play relevant content in areas where precise switching of explanation content is required, thereby greatly improving the tourists' visiting experience.

[0063] The AIoT-based cultural and creative station operation method and operation device adopted by the present invention install infrared coding transmitters at important explanation points, which can not only ensure the accurate positioning and explanation of important explanation points, but also serve as calibration points and continuously calibrate the Ibeacon positioning system, killing two birds with one stone and reducing costs and increasing efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0064] Figure 1 This is a schematic diagram of the principle of the AIoT-based cultural and creative station operation method of the present invention;

[0065] Figure 2 This is a schematic diagram of the structure of the AIoT-based cultural and creative station operation device of the present invention;

[0066] Figure 3 This is a composition diagram of the lock control mechanism in the AIoT-based cultural and creative station operation device of the present invention;

[0067] Figure 4 This is a composition diagram of the ticket card sending mechanism in the AIoT-based cultural and creative station operation device of the present invention;

[0068] Figure 5 This is a control principle diagram of the locking mechanism in the AIoT-based cultural and creative station operation device of the present invention;

[0069] Figure 6 This is a structural diagram of the crawler cargo lane in the AIoT-based cultural and creative station operation device of the present invention;

[0070] Figure 7 This is a schematic diagram of the control principle of the cargo channel mechanism in the AIoT-based cultural and creative station operation device of the present invention.

[0071] In the figure, 1-equipment body, 2-aisle mechanism, 3-rental and return port, 4-touch screen, 5-camera, 6-shipping port, 11-aisle body, 21-track, 31-limit baffle, 41-brushless motor, 51-reducer, 61-magnetic sensor, 71-spring support plate with built-in magnet. DETAILED DESCRIPTION

[0072] In order to make the purpose and technical solution of the embodiment of the present invention clearer, the technical solution of the embodiment of the present invention will be clearly and completely described below in conjunction with the drawings of the embodiment of the present invention. Obviously, the described embodiment is a part of the embodiment of the present invention, not all of the embodiments. Based on the described embodiment of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0073] The AIoT-based cultural and creative station operation device of the present invention is composed of a commodity self-service sales subsystem, an intelligent tour guide rental subsystem, and an AI interactive operation subsystem;

[0074] The equipment hardware includes the equipment body, the main control unit, the voice guide terminal, the lock control panel, multiple lock and spring mechanisms, the cargo aisle control panel, the cargo aisle mechanism, the ticket and card issuance module, the ID card reader, the camera, the AI ​​edge processor, at least one integrated touch display screen, and the positioning module.

[0075] The main control unit is one or more combinations of Android boards and industrial control boards, and is used to implement device-side program control.

[0076] The locking control mechanism consists of a locking control plate and a locking spring mechanism. Figure 3 This is a diagram of the locking mechanism.

[0077] The lock control board is connected to the main control board for communication information exchange. The lock control board can be powered by the main control board, or powered separately. The lock control board is connected to the indicator light and the solenoid valve of the lock spring mechanism. Multiple lock control boards can be powered in series.

[0078] The locking mechanism is composed of a multi-contact ejector pin, a micro switch, a solenoid valve, a spring and a card slot.

[0079] The ticket card sending mechanism includes crawler cargo lane, cargo lane control board, motor, electromagnetic lock, sensor and other modules. Figure 4 This is a diagram of the ticket sending organization.

[0080] The cargo lane control board is connected to n crawler cargo lanes. The cargo lane control board is powered by 24V and connected to the magnetic sensor, temperature sensor, and cargo lane motor.

[0081] The crawler cargo lane includes the cargo lane, crawler, rear-end drive (motor, reducer), spring support plate with built-in magnet at the front, sensor, and limit baffle. The crawler is mounted on the cargo lane. The side of the cargo lane body is equipped with a brushless motor and reducer. The motor drives the movement of the crawler, and the reducer and motor follow. A limit baffle is installed above the cargo lane. The front end of the shipment is equipped with a spring support plate with built-in magnet, and a magnetic sensor is set at the bottom of the front end.

[0082] The positioning module is an infrared transmitter arranged at each guide explanation point.

[0083] As a solution optimization, the positioning base station also includes an Ibeacon positioning base station group or a UWB positioning base station group. Multiple Ibeacon base stations are distributed to cover the entire positioning area, and the coordinate position of each Ibeacon base station is recorded. Infrared coding transmitters are installed at important explanation points, and the coordinate position of each infrared coding transmitter is recorded.

[0084] The camera is connected to the AI ​​edge processor via the USB port, and the AI ​​edge processor is connected to the main control unit for bidirectional communication;

[0085] Preferably, a 4G module is also included to realize wireless data interaction between the main control unit and the cloud management background.

[0086] The voice guide terminal includes an embedded mainboard, a Bluetooth module, an infrared receiver, a GPS module, and an audio module; the Bluetooth module and the GPS module are connected to the embedded mainboard through the UART port; the infrared receiver is connected to the embedded mainboard through the IIC port. Preferably, the voice guide terminal also includes an operation interaction unit such as a touch screen or a button.

[0087] A plurality of rental and return ports for voice guide terminals are arranged on the device body, and each rental and return port is provided with a wireless charging plate or a contact charging port for powering each voice guide terminal; preferably, each rental and return port is also provided with an IoT communication interface for connecting the main control unit and the voice guide terminal to realize data transmission, so as to realize batch data import and update of the broadcast materials of the voice guide terminal;

[0088] The operation equipment of the Cultural and Creative Station also includes a system background for data interaction with hardware equipment and implementation of operation management business logic. The system background includes a self-service product sales management subsystem, an intelligent tour guide rental subsystem, and an AI interactive operation subsystem. The self-service product sales management subsystem is used to implement functions such as product information management, channel management, sales transactions and order management; the intelligent tour guide rental management subsystem is used to implement functions such as tour guide content management, tour guide terminal rental management, rental transactions and order management; the AI ​​operation analysis management subsystem includes AI algorithm model management, AI function management, AI interactive order management, AI promotion service management, etc.

[0089] The cultural and creative station operation method of the present invention comprises the following steps:

[0090] Step 1: Upload the tour content information through the intelligent tour guide rental subsystem, including the audio and video materials of each tour guide explanation point and the corresponding location number information; the intelligent tour guide rental subsystem regularly sends the content information to the main control unit of the device end, and then the main control unit transmits it to each tour guide terminal through the communication interface;

[0091] Step 2: Upload product pictures, prices, channel numbers and other sales information through the self-service sales management subsystem, and the self-service sales management subsystem sends the sales information to the main control unit of the device in real time;

[0092] Step 3: Upload AI algorithm models, function settings and other content through the AI ​​operation analysis management subsystem, and the AI ​​operation analysis management subsystem will periodically send relevant information to the main control unit of the device end;

[0093] Step 4: The AI ​​edge processor collects image data through the camera, analyzes the attributes of passenger flow users according to the algorithm model, and uploads the analysis results to the AI ​​operation analysis management subsystem through the main control unit;

[0094] Step 5: The AI ​​operation analysis management subsystem analyzes and counts the attributes of customer traffic in different time periods uploaded by the device, and accurately sets the content and playback time period of the promotional materials based on the analysis and statistical results, and plays them through the device screen.

[0095] Step 6: Use the touch screen on the device to enable the user to rent a guide terminal or purchase cultural and creative products;

[0096] Step 7: When the rental guide terminal on the touch screen of the device is clicked, the corresponding interactive interface is entered, and the main control unit obtains the user's ID card information through the ID card reader, obtains the user's mobile phone number and other information through the touch screen, and then applies for a payment code from the third-party payment platform through the smart guide rental subsystem and prompts payment;

[0097] Step 8: After payment is completed, the main control unit controls one of the lock mechanisms through the lock control panel to pop up the navigation terminal for the user to collect;

[0098] Step 9: The guide terminal obtains the location information through the positioning module, and outputs the corresponding audio and video information when arriving at each explanation point; the location information acquisition includes the following steps:

[0099] (1) The navigation terminal scans all the surrounding iBeacon base stations through the Bluetooth module, collects the RSSI value of each base station, and extracts the MAC addresses and corresponding RSSI values ​​of the three iBeacon base stations with the strongest RSSI signal values.

[0100] (2) Use the RSSI value and the preset transmission power TXPower to calculate the distance d between the positioning terminal and each iBeacon base station i .

[0101] The formula is as follows:

[0102]

[0103] Where TXPower is the transmit power (unit: dBm), the theoretical RSSI value at a distance of 1 meter; RSSI i is the received signal strength indication of the i-th Ibeacon base station (unit: dBm); n is the environmental attenuation factor, which reflects the impact of the signal propagation environment on the signal strength.

[0104] (3) Use the trilateral measurement method to calculate the initial position (x0, y0) of the navigation terminal. Assuming there are three iBeacon base stations A (x1, y1), B (x2, y2), and C (x3, y3), and the corresponding distances are d1, d2, and d3 respectively, the initial position (x0, y0) can be obtained by solving the following set of equations:

[0105]

[0106] (4) When the guide terminal is located below a calibration point, it receives the infrared code from the calibration point, decodes the infrared signal, obtains the precise coordinates of the calibration point, and plays the explanation content corresponding to the position of the infrared code.

[0107] (5) Use infrared coding transmitter to perform precision calibration. When the positioning terminal is located below the calibration point, it receives and decodes the infrared signal to obtain the precise coordinates of the calibration point (x c ,y c ), use the precise coordinates of the calibration points to correct the initial position (x0, y0). The correction formula is as follows:

[0108] (x f,y f )=(x0+Δx,y0+Δy)

[0109] Δx=x c -x0

[0110] Δy=y c -y0

[0111] Among them, (xf, yf) is the final position after correction;

[0112] (6) When the positioning terminal leaves the calibration point, it continues to use the Ibeacon base station for positioning and uses the correction value (Δx, Δy) of the last calibration point for dynamic adjustment to maintain positioning accuracy.

[0113] Step 10: When returning the terminal, directly insert the navigation terminal into the rental and return port of the device body. The locking mechanism will automatically lock the terminal to complete the return operation.

[0114] Step 11: After the return is completed, the device will promote the sale of cultural and creative products through the touch screen. After directly clicking on the product on the touch screen, the main control unit will apply for a payment code from the third-party payment platform through the self-service sales management subsystem and prompt payment;

[0115] Step 12. After the payment is completed, the main control unit determines the category of the goods for which the payment has been completed; when the payment is completed for the ticket and card goods, the main control unit controls the ticket and card sending mechanism to send the ticket and card to the delivery port; when the payment is completed for other goods, the main control unit controls the cargo channel of the corresponding goods through the cargo channel control panel to execute the delivery action and deliver the goods to the delivery port for the user to pick up.

[0116] Step 13: When the user clicks the interactive button on the touch screen, the AI ​​edge processor collects image data through the camera and detects the posture of the person in the image, and generates an AI digital human video stream corresponding to the action posture through the AI ​​large model. Furthermore, the device broadcasts the cultural and creative promotion materials to tourists through voice fitting while the AI ​​digital human gestures interact, realizing a more vivid AI interactive promotion. The acquisition of location information includes the following steps:

[0117] (1) Obtain the video stream in the camera channel and extract frames, decode, and convert the format to finally obtain continuous frame images in RGB format.

[0118] (2) Perform image preprocessing, including image enhancement, denoising, resizing and grayscale conversion of continuous frame images to improve image quality.

[0119] (3) Use a combined target detection algorithm to detect the human body through Yolo or Faster-RCNN based on deep learning.

[0120] (4) For each detected human body, a dual-branch deep convolutional neural network VGG-19 is used with a convolution kernel size of 4×4, Sigmoid as the activation function, and Boosting mechanism as the training mechanism. The initial weights are used for training, and the weights are updated according to the Pose iterative algorithm to improve the accuracy. After completion, the training model is output.

[0121] (5) Use the training model in step 4 to detect and identify the key points of the human body in the target image, obtain the coordinate information of the key points of a single / multiple human body contained in the target image, and calculate the connection relationship between each key point and the human body joint through the key point affinity field prediction algorithm.

[0122] (6) Perform non-real-time posture sketch reconstruction, draw lines to connect the human skeleton posture through the connection relationship between the key points calculated in step 5 and the corresponding human joints, and generate a 2D skeleton tangent posture sketch.

[0123] (7) Import the 2D skeletal tangent pose sketch data in step 6 into the 3D pose estimation model Sketch2Pose, and input the 3D style model parameters to fit the pose of the person in the image captured by the camera in step 1 to the 3D digital virtual human.

[0124] (8) Import text promotional materials into the PortaSpeech 2 large model voice fitting platform to realize 3D digital human voice broadcasting, thereby promoting cultural and creative materials interactively.

[0125] The working principle of the lock control mechanism of the cultural and creative station operation device based on AIoT of the present invention:

[0126] When a user needs to rent a tour guide device, the user first uses the touch screen on the device to interact with the user's rental tour guide terminal. The main control board is equipped with a 4G module. When the user scans the code, the 4G module transmits a signal to the main control board. The main control board detects which device is fully charged and binds the device to the order. The lock control board controls the lock mechanism to pop up the tour guide terminal for the user to pick up. Each lock control board is connected to multiple lock mechanisms. The lock mechanism controls Figure 5 As shown. The lock control board is powered by the main control board or powered separately. When receiving a signal from the main control board, the lock control board sends a signal to energize the solenoid valve, and the guide pops out through the solenoid valve. The lock pop-up mechanism consists of a multi-contact ejector, a micro switch, a solenoid valve, and a spring. The guide terminal is inserted into the mechanism, the spring is compressed, the micro switch senses that the device is in place, and the multi-contact ejector connects the guide device to start charging. When the lock control board receives a signal from the main control board, the solenoid valve is energized to pop out the device.

[0127] The guiding working principle of the cultural and creative station operation device based on AIoT of the present invention:

[0128] The guide terminal searches for the surrounding Ibeacon base stations and RSSI signal strength through the Bluetooth module, takes out the three points with the strongest RSSI signal values, and obtains the distance data d1, d2, and d3 from the terminal to the three base station plane coordinate points based on the signal strength and distance conversion relationship (eliminating the height difference); establishes an equation and solves the plane coordinate point (x, y) of the terminal to achieve preliminary position determination. The transmitter located at each explanation point will continue to transmit infrared coded signals to the explanation area. When the guide terminal arrives at the explanation area, it receives the coded signal through the infrared receiver, parses the explanation point number, and automatically broadcasts the audio and video materials of the corresponding explanation point. The guide terminal obtains location information through the positioning module, and outputs the corresponding audio and video information when it arrives at each explanation point.

[0129] The working principle of the cargo channel mechanism of the cultural and creative station operation device based on AIoT of the present invention: the structure diagram of the crawler cargo channel is as follows: Figure 6 shown.

[0130] The crawler type cargo lane structure includes a cargo lane body 11, a crawler 21, a limit baffle 31, a brushless motor 41, a reducer 51, a magnetic sensor 61, and a spring support plate 71 with a built-in magnet.

[0131] The crawler 21 is mounted on the crawler frame, and a brushless motor 41 and a reducer 51 are arranged on the side of the cargo channel body 11. The brushless motor 41 drives the movement of the crawler 21. A magnetic sensor 61 and a spring support plate 71 with a built-in magnet are arranged at the front end exit of the cargo channel.

[0132] In the present invention, the movement of the motor drives the meshing between the driving gear and the driven gear, thereby driving the crawler belt to transmit, and the crawler belt can be stably and automatically tightened by the expansion and contraction of the spring. The limit baffle prompts the empty sale of goods.

[0133] A magnetic sensor is provided at the front end of the crawler frame. When the goods are shipped through the crawler, when the goods pass through the spring support plate 71 with built-in magnets, the spring drag plate is temporarily pressed down and presents a downhill tilt angle (about 30-45 degrees), and the goods slide down for shipment. At this time, the built-in magnet in the spring support plate 71 with built-in magnets will approach the magnetic sensor 61, and the magnetic sensor 61 will generate an induction signal and send it to the cargo channel control board. The cargo channel control board controls the motor to stop rotating to prevent the following goods from continuing to fall out. When the goods slide down and are shipped successfully, the spring support plate 71 with built-in magnets returns to a horizontal state under the action of the spring elastic force. At this time, the built-in magnet in the spring support plate 71 with built-in magnets will move away from the magnetic sensor 61 and return to the state before shipment.

[0134] When users need to buy cultural and creative products, they can use the self-developed self-selling system to purchase directly through the touch screen of the device. The main control unit will apply for the payment code from the third-party payment platform through the self-service sales management subsystem and prompt payment. The main control board is equipped with a 4G module. When the user scans the code to pay, the 4G module transmits a signal to the main control board, which detects the corresponding product and binds the device to the order. The cargo channel control board controls the cargo channel movement and transmits the product.

[0135] Each cargo lane control panel can control n crawler cargo lanes. Figure 7 As shown. The cargo lane control board is powered by 24V. When receiving the signal from the main control board, the cargo lane control board sends a signal to power on the motor, driving the crawler cargo lane to transport. After the magnetic sensor detects that the item has fallen, it sends a signal to the motor to stop working and the crawler cargo lane stops. Before the items are purchased, the crawler cargo lane is closely arranged with limited baffles on both sides. After the user purchases the item, the motor pushes the item on the crawler cargo lane, and then the item enters the spring support plate with a built-in magnet and presses it down to a downhill tilt state, and then falls out of the shipping lane by its own gravity.

[0136] The working principle of AI interactive promotion in the AIoT-based cultural and creative station operation method of the present invention:

[0137] When the user clicks the interactive button on the touch screen, the AI ​​edge processor collects image data through the camera and detects the posture of the characters in the image, and generates an AI digital human video stream with the corresponding action posture through the AI ​​big model. At the same time, the device uses voice fitting to broadcast the cultural and creative promotion materials to tourists while the AI ​​digital human is interacting, thus achieving more vivid AI interactive promotion.

[0138] The above is only a preferred specific embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any changes or substitutions that can be easily thought of by a person skilled in the art within the technical scope disclosed by the present invention should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.

Claims

1. A method for operating a cultural and creative station based on AIoT, characterized by: The operation method is to operate the cultural and creative station built based on the self-service sales management subsystem, the intelligent guide rental subsystem, and the AI ​​interactive operation subsystem; multiple Ibeacon base stations are deployed within the operation range covered by the cultural and creative station; Multiple Ibeacon base stations are distributed in each service area; The smart tour guide rental subsystem uploads the tour guide content information and plays the promotional materials through the device screen according to the stream user attributes; Users obtain product images, prices, and channel numbers through the self-service sales management subsystem to select transaction products; The smart tour guide rental subsystem obtains the user's identity information and applies for a payment code through a third-party payment platform and prompts payment to complete the rental or return the tour guide terminal; The user interacts with the Ibeacon base station through the navigation terminal; The AI ​​interactive operation subsystem interacts with users through gestures and voice broadcasts.

2. The AIoT-based cultural and creative station operation method according to claim 1, characterized in that: The tour content information in the intelligent tour guide rental subsystem includes the audio and video materials of each tour guide point and the corresponding location number information; the intelligent tour guide rental subsystem regularly sends the content information to the main control unit at the device end, and then the main control unit transmits it to each tour guide terminal through the communication interface; The self-service vending management subsystem uploads the product pictures, prices, and channel number sales information, and sends the sales information to the main control unit of the device end in real time.

3. The AIoT-based cultural and creative station operation method according to claim 1, characterized in that: The interactive steps of the smart tour guide rental subsystem are as follows: (1) Using the touch screen on the device to enable users to rent a tour terminal or purchase cultural and creative products; (2) When the rental guide terminal on the touch screen of the device is clicked, the corresponding interactive interface is entered, and the main control unit obtains the user's ID card information through the ID card reader, obtains the user's mobile phone number and other information through the touch screen, and then applies for a payment code from the third-party payment platform through the intelligent guide rental subsystem and prompts payment; (3) After payment is completed, the main control unit controls one of the lock mechanisms through the lock control panel to pop up the navigation terminal for the user to collect; (4) The guide terminal obtains location information through the positioning module and outputs the corresponding audio and video information when arriving at each explanation point.

4. The AIoT-based cultural and creative station operation method according to claim 1, characterized in that: When the user enters the self-service vending management subsystem, the user can rent a guide terminal or purchase cultural and creative products through the touch screen of the device. The interaction steps are as follows: (1) The user enters the corresponding interactive interface through the rental guide terminal on the touch screen. (2) The main control unit obtains the user's ID card information through the ID card reader, obtains the user's mobile phone number and other information through the touch screen, and then applies for a payment code from the third-party payment platform through the smart guide rental subsystem and prompts payment; (3) When the user completes the payment, the locking mechanism in the Cultural and Creative Station will pop up the navigation terminal for the user to collect. (4) The user writes to the navigation terminal to scan all the surrounding iBeacon base stations through the Bluetooth module, collect the RSSI value of each base station, and extract the MAC addresses and corresponding RSSI values ​​of the three iBeacon base stations with the strongest RSSI signal values; (5) The navigation terminal uses the RSSI value and the preset transmission power TXPower to calculate the distance d between the positioning terminal and each iBeacon base station i , the expression is as follows: Where TXPower is the transmit power (unit: dBm), the theoretical RSSI value at a distance of 1 meter; RSSI i is the received signal strength indication of the i-th Ibeacon base station (unit: dBm); n is the environmental attenuation factor, which reflects the impact of the signal propagation environment on the signal strength. (6) Use the trilateral measurement method to calculate the initial position (x0, y0) of the user's navigation terminal; obtain the distance data d1, d2, and d3 from the terminal to the three base station plane coordinate points through the following equation; establish the following coordinate equation: (7) When the user's navigation terminal reaches the specified area, the precise coordinates of the calibration point (x c ,y c ), use the following formula to calibrate the precise coordinates to correct the initial position (x0, y0): Δx=x c -x0 Δy=y c -y0 Among them, (x f ,y f ) is the final position after correction; After precision calibration using the infrared code transmitter of the Ibeacon base station, the infrared signal is received and decoded, and the explanation content corresponding to the infrared code is played at the same time; (8) When the positioning terminal leaves the calibration point, it continues to use the Ibeacon base station for positioning and uses the correction value (Δx, Δy) of the last calibration point for dynamic adjustment to maintain positioning accuracy.

5. The AIoT-based cultural and creative station operation method according to claim 1, characterized in that: The AI ​​digital communication system uses the AI ​​edge processor to collect image data through the camera and detect the posture of the person in the image, and generates an AI digital human video stream with the corresponding action posture through the AI ​​big model; the specific steps are as follows: (1) Obtain the video stream in the camera channel and extract frames, decode, and convert the format to obtain continuous frame images in RGB format and pre-process the images; (2) Use a combined target detection algorithm to detect the human body through Yolo or Faster-RCNN based on deep learning; (3) For each detected human body, a model is used for training and the training model is output; (4) using the training model of step (3) to detect and identify the key points of the human body in the target image, obtain the coordinate information of the key points of a single / multiple human body contained in the target image, and calculate the connection relationship between each key point and the human body joint by using the key point affinity field prediction algorithm; (5) Perform non-real-time posture sketch reconstruction, draw lines to connect the human skeleton posture through the connection relationship between the key points calculated in step (4) and the corresponding human joints, and generate a 2D skeleton tangent posture sketch; (6) Import the 2D skeleton tangent pose sketch data in step (5) into the 3D pose estimation model Sketch2Pose and fit it into the pose of the person in the image captured by the camera in step (1) consistent with the 3D digital virtual human; (7) Import text promotional materials into the PortaSpeech 2 large model voice fitting platform to realize the voice broadcast of 3D digital virtual people.

6. An operating device using the AIoT-based cultural and creative station operating method according to any one of claims 1 to 5, characterized in that: It includes a device body; a main control unit, a voice guide terminal, at least one integrated touch display screen, a camera, a shipping port, and a cargo channel mechanism; A cargo channel mechanism is provided in the main body of the device for selling goods; a voice guide terminal for rental, at least one integrated touch display screen and a camera are arranged on the main body of the device; The delivery port is located below the cargo channel mechanism; The main control unit is used to collect image data collected by the camera for analyzing the attributes of the streaming users; Based on the analysis and statistical results, the content and playback time period of the promotional materials can be accurately set and played through the device screen.

7. An operating device using the AIoT-based cultural and creative station operating method according to claim 6, characterized in that: The voice guide terminal includes an embedded mainboard, a Bluetooth module, an infrared receiver, a GPS module, and an audio module; The Bluetooth module and GPS module are connected to the embedded mainboard through the UART port; The infrared receiver is connected to the embedded mainboard through the IIC port; The audio module is used to play voice messages.

Images