Movement control method of smart screen, mobile smart screen, medium and product

Abstract

A smart screen movement control method, a mobile smart screen, a medium and a product relate to the technical field of mobile smart screen control, and the method comprises the steps of determining a target position for moving and a movement path for moving to the target position based on a target setting instruction of a user terminal; moving according to the moving path, and determining the residual electric quantity; when it is determined that the standby point position with the residual electric quantity lower than the preset safe electric quantity exists, the equipment position of the standby smart screen is obtained; determining a target point location for handover between the mobile smart screen and the standby smart screen, and sending a handover instruction to the standby smart screen; a task transfer instruction is sent to the standby smart screen, so that the standby smart screen displays screen display information of the mobile smart screen and goes to the target position based on the moving path; and moving to an equipment position for charging. By implementing the method, the endurance of the mobile smart screen can be optimized, work interruption is avoided, and the user experience is optimized.

Description

Technical Field

[0001] The present application relates to the field of mobile smart screen control technology, and in particular to a mobile control method of a smart screen, a mobile smart screen, a medium and a product. Background Art

[0002] With the development of Internet of Things technology and artificial intelligence, smart home systems play an increasingly important role in modern life. Smart home systems use various smart devices and sensors to achieve automated control and intelligent management of home environments. The main control terminal is generally a main control tablet or a mobile smart screen (a mobile robot), which allows users to view the status of the entire home at any time and perform management settings.

[0003] In related technologies, mobile smart screens mainly use sensors such as laser radar or cameras to perceive the surrounding environment in real time and perform positioning and navigation. In order to achieve long-term operation, mobile smart screens are usually powered by large-capacity lithium batteries and automatically return to the charging station for charging when the battery is low.

[0004] However, in the related art, after the mobile smart screen has been working for a long time, it may run out of power and need to be charged, which will cause the task to be temporarily interrupted and affect the user experience. Summary of the invention

[0005] The present application provides a mobile control method of a smart screen, a mobile smart screen, a medium and a product, which are used to optimize the battery life of the mobile smart screen, avoid work interruptions and optimize the user experience.

[0006] In the first aspect, the present application provides a mobile control method for a smart screen, which is applied to a mobile smart screen, and the method includes: determining the target position to be moved to and the moving path to the target position based on the target setting instruction of the user terminal; moving according to the moving path, and determining the remaining power at each point on the moving path according to the real-time power; when it is determined that there is a standby point at each point where the remaining power is lower than the preset safety power, obtaining the device position of the standby smart screen within a preset distance range of the standby point; determining the target point for handing over the mobile smart screen to the standby smart screen according to the real-time position, remaining power and device position of the standby smart screen, and sending a handover instruction including the target point to the standby smart screen; when moving to the target point and determining that the standby smart screen is at the target point, sending a task transfer instruction to the standby smart screen, so that the standby smart screen displays the screen display information of the mobile smart screen and moves to the target position based on the moving path; moving to the device position for charging.

[0007] In the above embodiment, when the mobile smart screen detects low power, it can promptly hand over tasks to the backup smart screen to avoid work interruptions, and at the same time go to the charging location for charging, thereby realizing intelligent power management, optimizing the battery life of the mobile smart screen, improving work efficiency, and effectively improving user experience.

[0008] In combination with some embodiments of the first aspect, in some embodiments, based on the target setting instruction of the user terminal, determining the target position to be moved to and the moving path to the target position, specifically includes: receiving the target setting instruction of the user terminal; when it is determined that the target setting instruction is to follow a character, determining the character position of the target character to be followed; taking the character position as the target position to be moved to, determining the moving path to the target position; when it is detected that the target character has moved, updating the target position and the moving path based on the position after the movement.

[0009] In the above embodiment, the mobile smart screen can detect the position changes of the target person in real time and dynamically update the moving path to ensure that it always follows the target person, thereby improving the practicality of the mobile smart screen in human-computer interaction scenarios, enabling it to better meet the user's mobile needs and provide more convenient services.

[0010] In combination with some embodiments of the first aspect, in some embodiments, before the step of determining the target position to be moved to and the moving path to the target position based on the target setting instruction of the user terminal, the method also includes: when it is detected that the handle position is held by the user, converting its own action state to a static state; when a thrust in the plane direction is detected after the static state, moving according to the direction and magnitude of the thrust.

[0011] In the above embodiment, the user can switch the action state of the mobile smart screen by holding the handle and control its movement by applying thrust, so that the user can control the mobile smart screen more conveniently, enhancing the convenience and user-friendliness of operation.

[0012] In combination with some embodiments of the first aspect, in some embodiments, after the steps of moving according to the moving path and determining the remaining power at each point on the moving path based on the real-time power, the method also includes: acquiring a path image on the moving path in real time; when it is determined that there is an obstacle on the moving path based on the path image, redetermining the moving path to avoid the obstacle.

[0013] In the above embodiment, the mobile smart screen can perceive the surrounding environment in real time and automatically adjust the moving path when encountering obstacles, thereby improving the safety and reliability of the mobile smart screen, enabling it to navigate more smoothly in complex environments, reducing the risk of collision, and ensuring the safety of the equipment and the environment.

[0014] In combination with some embodiments of the first aspect, in some embodiments, when it is determined that there is an obstacle on the moving path based on the path image, the moving path is redetermined to avoid the obstacle, specifically including: when it is determined that there is an obstacle on the moving path based on the path image, obtaining obstacle information including the type, size and position of the obstacle; calculating the minimum turning angle and shortest path required to bypass the obstacle based on the obstacle information and the space requirement parameters of the mobile smart screen; redetermining the moving path as the shortest path, and detecting obstacle information in real time while moving on the shortest path; if it is determined that the obstacle has moved based on the obstacle information, updating the moving path again.

[0015] In the above embodiment, the mobile smart screen can not only identify the type, size and location of obstacles, but also calculate the optimal detour path and continuously monitor the status of obstacles during movement. It can adapt to various environments more flexibly and improve work efficiency and safety in complex scenarios.

[0016] In combination with some embodiments of the first aspect, in some embodiments, after the step of moving to the device location for charging, the method also includes: monitoring the charging current and battery temperature during the charging process, and adjusting the charging power in real time according to the battery temperature; when the charging power reaches a preset power threshold, sending a charging completion reminder to the user terminal.

[0017] In the above embodiment, the mobile smart screen realizes intelligent charging management. It can monitor the current and temperature during the charging process, automatically adjust the charging power, and notify the user when charging is completed, thereby improving charging efficiency and safety and providing users with a more reliable and convenient user experience.

[0018] In combination with some embodiments of the first aspect, in some embodiments, after the step of sending a charging completion reminder to the user terminal when the charging power reaches a preset power threshold, the method also includes: obtaining subsequent instructions from the user; subsequent instructions include continuing standby, resuming the original task, or executing a new task; when the subsequent instructions are to resume the original task, obtaining the current position and task progress of the standby smart screen; determining the handover location and return path for taking over the task based on the current position and task progress, and moving to the handover location along the return path; after arriving at the handover location, synchronizing data with the standby smart screen to complete the task handover.

[0019] In the above embodiment, after charging is completed, the mobile smart screen can flexibly handle subsequent tasks according to user instructions. When resuming the original task, it can hand over the task with the backup smart screen to achieve seamless connection, improve work continuity, and reduce interruptions and delays caused by task switching, thereby optimizing the overall work efficiency and user experience.

[0020] In a second aspect, an embodiment of the present application provides a mobile smart screen, which includes: one or more processors and a memory; the memory is coupled to the one or more processors, and the memory is used to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to enable the mobile smart screen to execute the method described in the first aspect and any possible implementation method of the first aspect.

[0021] In a third aspect, an embodiment of the present application provides a computer program product comprising instructions. When the above-mentioned computer program product is run on a mobile smart screen, the above-mentioned mobile smart screen executes the method described in the first aspect and any possible implementation method of the first aspect.

[0022] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, comprising instructions. When the instructions are executed on a mobile smart screen, the mobile smart screen executes the method described in the first aspect and any possible implementation method of the first aspect.

[0023] It can be understood that the mobile smart screen provided in the second aspect, the computer program product provided in the third aspect, and the computer storage medium provided in the fourth aspect are all used to execute the method provided in the embodiment of the present application. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method, which will not be repeated here.

[0024] One or more technical solutions provided in the embodiments of the present application have at least the following technical effects or advantages: 1. Due to the method of determining the target location and moving path based on user terminal instructions, as well as the mechanism of real-time monitoring of power and handing over tasks with the backup smart screen when necessary, the mobile smart screen can intelligently plan the path and manage power, and realize autonomous charging while ensuring task continuity, effectively solving the problem of work interruption of the mobile smart screen due to insufficient power in related technologies, and thus realizing intelligent power management and task handover.

[0025] 2. Since the method of obtaining the path image on the mobile path in real time and re-planning the path when an obstacle is detected is adopted, the mobile smart screen can intelligently perceive the surrounding environment and make corresponding adjustments to effectively avoid obstacles. This effectively solves the problem in related technologies that mobile smart screens are prone to collision or obstruction in complex environments, thereby realizing intelligent obstacle avoidance functions and path optimization.

[0026] 3. Due to the method of monitoring the current and temperature during the charging process, adjusting the charging power in real time according to the battery temperature, and the mechanism of notifying the user when charging is completed, the mobile smart screen can realize intelligent and safe charging management, effectively solving the potential safety hazards and inefficiency problems in the charging process in related technologies, and thus realizing optimized charging control and user interaction. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Figure 1 It is a flow chart of the mobile control method of the smart screen in the embodiment of the present application; Figure 2 It is another flowchart of the mobile control method of the smart screen in the embodiment of the present application; Figure 3 This is a schematic diagram of the physical device structure of a mobile smart screen in an embodiment of the present application. DETAILED DESCRIPTION

[0028] The terms used in the following embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to be used as limitations to the present application. As used in the specification of the present application, the singular expressions "one", "a kind of", "above", "the" and "this" are intended to also include plural expressions, unless there is a clear indication to the contrary in the context. It should also be understood that the term "and / or" used in the present application refers to any or all possible combinations comprising one or more of the listed items.

[0029] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as suggesting or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features, and in the description of the embodiments of the present application, unless otherwise specified, "plurality" means two or more.

[0030] For ease of understanding, the application scenarios of the embodiments of the present application are introduced below.

[0031] In a smart office building of a large technology company, mobile smart screens are widely used for meeting appointments, indoor navigation, and information display. However, as the frequency of use increases, the company finds that these devices often interrupt service due to power failure in the middle of work. For example, during an important video conference, the mobile smart screen in the conference room suddenly shut down, causing the conference to be interrupted and resulting in business losses.

[0032] In the related art, the power management of mobile smart screens can be achieved by using fixed charging stations and manual intervention; however, this method often leads to service interruptions and low efficiency. The following introduces the scenario of using the mobile control method of the smart screen in the related art.

[0033] To solve the power problem, the company initially adopted a simple strategy: when the power of the mobile smart screen is less than 20%, the system will automatically send the mobile smart screen, and the mobile smart screen will automatically return to the charging station. However, this method has obvious flaws. At a product launch conference, the mobile smart screen at the main venue issued a low-battery warning at a critical moment and returned to charge autonomously, which not only interrupted the launch process, but also caused some data loss due to improper operation.

[0034] By adopting the mobile control method of the smart screen in the embodiment of the present application, the continuous operation of the mobile smart screen is achieved through real-time monitoring of power, autonomous search for backup equipment, and intelligent planning of handover paths, which not only avoids service interruptions but also reduces the need for manual intervention.

[0035] The following introduces the scenarios in which the mobile control method of the smart screen in this application is used.

[0036] After the introduction of the mobile control method of the smart screen of the present application, the company's equipment management has changed. At a product seminar that lasted a whole day, the mobile smart screen in the conference room was able to autonomously monitor the power status. When it detects that the power is about to run low, it automatically communicates with the nearby backup smart screen and coordinates an optimal handover point. At noon in the seminar, the main mobile smart screen moved smoothly to the door of the conference room and seamlessly handed over to the backup smart screen that was already waiting there. During the whole process, there was no interruption in the display content, and the participants did not even notice the change of equipment. The original device autonomously went to the charging station to charge in preparation for the afternoon meeting. This method of autonomous coordination and handover not only ensures the continuity of the meeting, but also reduces the need for manual intervention.

[0037] It can be seen that the mobile control method of the smart screen in the embodiment of the present application can not only realize the continuous operation of the mobile smart screen, but also effectively solve the problems of waste of human resources and unstable service quality, thereby realizing efficient management of smart devices.

[0038] For ease of understanding, the following describes the process of the method provided by this implementation in combination with the above scenario. Figure 1 , which is a flow chart of the mobile control method of the smart screen in an embodiment of the present application.

[0039] S101: Determine a target location to be moved to and a moving path to the target location based on a target setting instruction of a user terminal.

[0040] Among them, the user terminal refers to the device used by the user to send instructions and receive feedback, such as a smartphone, tablet or dedicated controller. The target setting instruction refers to the command sent by the user through the terminal to set the destination of the mobile smart screen. The target location refers to the final location that the mobile smart screen needs to reach, which can be a specific room, near furniture, or a specified coordinate point. The moving path is used to represent the travel trajectory from the current location to the target location, including a series of intermediate points and turn instructions.

[0041] After receiving the target setting instruction sent by the user through the terminal, the mobile smart screen will perform this step to plan the action of the mobile smart screen. Specifically, the mobile smart screen first parses the user's instructions and extracts the target location information. Then, the mobile smart screen will combine the current environment map, the location information of the mobile smart screen, and the possible distribution of obstacles, and use the path planning algorithm (such as the A* algorithm or the RRT algorithm) to calculate an optimal moving path. This path is not only based on the shortest distance, but also on factors such as energy consumption and safety to ensure that the mobile smart screen can reach the target location efficiently and safely.

[0042] In some embodiments, the determination of the target location and the moving path can be achieved in a variety of ways: Optionally, the mobile smart screen can first parse the user's voice instructions through voice recognition technology to extract the target location information; then build and update the real-time indoor map; finally, use the dynamic path planning algorithm to generate the optimal moving path based on possible dynamic obstacles. Optionally, the mobile smart screen can obtain the target location coordinates by analyzing the user's click operations on the mobile terminal APP; then, use the pre-stored static indoor map information; finally, use the improved Dijkstra algorithm to calculate the optimal path based on multiple constraints. It can be understood that other methods can also be used to determine the target location and moving path, such as combining computer vision technology to recognize user gesture commands, or using reinforcement learning methods to dynamically optimize path selection, etc., which are not limited here.

[0043] S102, moving according to the moving path, and determining the remaining power at each point of the moving path according to the real-time power.

[0044] Among them, the real-time power refers to the current remaining battery power of the mobile smart screen during operation. Each point represents a key node on the moving path, which may include turning points, intermediate stops, etc. The remaining power is used to indicate the estimated remaining battery power when the mobile smart screen arrives at each key point.

[0045] After completing the path planning, the mobile smart screen will perform this step to control the actual movement of the mobile smart screen and manage power. Specifically, the mobile smart screen first activates the drive system of the mobile smart screen, and controls it to move along the predetermined trajectory according to the planned path information. At the same time, the mobile smart screen will monitor the battery power in real time, and combine factors such as moving distance, speed, and power consumption to estimate and calculate the remaining power at each key point on the moving path. This real-time power monitoring and estimation mechanism enables the mobile smart screen to predict possible power shortages in advance, providing an important basis for subsequent task scheduling and charging management.

[0046] In some embodiments, mobile control and power estimation can be achieved in a variety of ways: Optionally, the mobile smart screen can first use a PID control algorithm to achieve path tracking of the mobile smart screen; then, the battery voltage and current data are collected in real time through the battery management system (BMS); finally, a machine learning model (such as an LSTM network) is used to predict the remaining power at each point. Optionally, the mobile smart screen can use an adaptive cruise control algorithm to adjust the moving speed to balance energy consumption and efficiency; then estimate the real-time remaining power; finally, combine historical data and current workloads to use the Kalman filter algorithm to optimize the remaining power prediction accuracy. It is understandable that other methods can also be used to achieve mobile control and power estimation, such as combining visual odometer technology to improve positioning accuracy, or using fuzzy logic control to optimize energy consumption management, etc., which are not limited here.

[0047] S103. When it is determined that there is a standby point among the points where the remaining power is lower than the preset safety power, the device position of the standby smart screen within the preset distance range of the standby point is obtained.

[0048] Among them, the preset safety power refers to the minimum power threshold pre-set by the mobile smart screen to ensure the safe operation of the mobile smart screen. The standby point indicates a specific location on the moving path where the remaining power may be lower than the preset safety power. The preset distance range refers to the maximum distance pre-defined by the mobile smart screen for task handover. The backup smart screen refers to other smart devices that can take over the work of the current mobile smart screen. The device position is used to indicate the specific spatial coordinates of the backup smart screen.

[0049] The mobile smart screen will perform this step to prepare for possible task handover during the movement and power estimation process. Specifically, the mobile smart screen first analyzes the remaining power of each point calculated in step S102 to determine whether there is a situation where the power is lower than the preset safety power. If so, the mobile smart screen will mark the point as a standby point. Then, the mobile smart screen will search for available backup smart screens within a preset distance range with the standby point as the center. This search process involves communication and positioning with other smart devices. Finally, the mobile smart screen will obtain and record the location information of qualified backup smart screens to prepare for subsequent task handover.

[0050] In some embodiments, the standby point determination and backup device search can be implemented in a variety of ways: Optionally, the mobile smart screen can first use a dynamic programming algorithm to calculate all possible standby points; then, use WiFi positioning technology to determine the devices within a preset range; finally, use the mesh network communication between devices to obtain the location and status information of the standby smart screen. Optionally, the mobile smart screen can use a Monte Carlo simulation method to evaluate the probability of each point becoming a standby point; then, use Bluetooth beacon technology to detect surrounding backup devices; finally, coordinate the location information collection of multiple standby smart screens through edge computing nodes. It is understandable that other methods can also be used to implement standby point determination and backup device search, such as using reinforcement learning to optimize the standby point selection strategy, or using UWB technology to achieve high-precision indoor positioning, etc., which are not limited here.

[0051] S104. Determine the target point for handover between the mobile smart screen and the backup smart screen based on the real-time position of the mobile smart screen, the remaining power, and the device position of the backup smart screen, and send a handover instruction including the target point to the backup smart screen.

[0052] The real-time position refers to the spatial coordinates of the mobile smart screen. The target point is used to indicate the best position for the mobile smart screen and the standby smart screen to hand over tasks. The handover instruction refers to the command information sent by the mobile smart screen to the standby smart screen to indicate that it is ready to take over the task.

[0053] After the mobile smart screen determines that a task handover is required, it will perform this step to coordinate the handover process between the mobile smart screen and the backup smart screen. Specifically, the mobile smart screen first comprehensively analyzes the real-time location of the mobile smart screen, the trend of changes in remaining power, and the location information of the backup smart screen. Then, the mobile smart screen will use an optimization algorithm to calculate an optimal handover point, which should be able to maximize the continuity of task execution while ensuring the safe operation of the mobile smart screen. After determining the target point, the mobile smart screen will generate instructions containing detailed handover information, such as handover time, location, task content, etc., and securely transmit these instructions to the backup smart screen through the network, instructing it to execute the takeover process.

[0054] In some embodiments, the target point determination and the handover instruction sending can be achieved in a variety of ways: Optionally, the mobile smart screen can first use a multi-objective optimization algorithm to comprehensively consider power consumption, moving distance and task urgency to calculate the optimal handover point; then, use the state machine model to generate detailed handover process instructions; finally, the instructions are securely transmitted to the backup smart screen through an encrypted P2P communication channel. Optionally, the mobile smart screen can use a fuzzy logic control method to determine the handover point based on the fuzzy scores of multiple factors; then, use a scenario-based instruction generator to create an adaptive handover instruction; finally, use distributed ledger technology to ensure the immutability and traceability of the handover instruction. It is understandable that other methods can also be used to achieve target point determination and handover instruction sending, such as using a swarm intelligence algorithm to optimize the multi-device collaborative handover strategy, or using 5G network slicing technology to ensure the real-time and reliability of the handover instruction, etc., which are not limited here.

[0055] S105. When moving to the target location and determining that the standby smart screen is at the target location, send a task transfer instruction to the standby smart screen, so that the standby smart screen displays the screen display information of the mobile smart screen and moves to the target location based on the moving path.

[0056] The task transfer instruction refers to the command information sent by the mobile smart screen to the standby smart screen to formally start the task handover. The screen display information refers to all the content currently displayed on the mobile smart screen, including but not limited to the task status, user interface, etc.

[0057] The mobile smart screen will perform this step to complete the actual handover of the task after the mobile smart screen arrives at the handover point. Specifically, the mobile smart screen first confirms that the mobile smart screen has reached the predetermined target point, and verifies that the backup smart screen is also in place. Then, the mobile smart screen will generate and send a detailed task transfer instruction, which contains all relevant information of the current task. After receiving the instruction, the backup smart screen will synchronize the display content of the mobile smart screen to ensure the continuity of the user experience. At the same time, the mobile smart screen will transmit the original movement path information to the backup smart screen, so that it can seamlessly continue the original task and continue to the final target location.

[0058] In some embodiments, task transfer and display synchronization can be achieved in a variety of ways: Optionally, the mobile smart screen can first use a blockchain-based smart contract to automatically trigger the task transfer process; then, transmit the compressed screen image data through a high-speed local area network; finally, use an incremental learning algorithm to adapt the standby smart screen to the new mobile path. Optionally, the mobile smart screen can use a distributed transaction processing mechanism to ensure the atomicity and consistency of task transfer; then, use remote desktop protocol technology to achieve real-time mirroring of screen content; finally, optimize the motion control of the standby smart screen on the new path through reinforcement learning methods. It is understandable that other methods can also be used to achieve task transfer and display synchronization, such as using federated learning technology to share task-related machine learning models while protecting privacy, or using edge computing to accelerate the screen rendering process, etc., which are not limited here.

[0059] S106, move to the device location for charging.

[0060] Among them, the device location refers to the spatial coordinates of the dedicated charging station or wireless charging area of ​​the mobile smart screen. After completing the task handover, the mobile smart screen will perform this step to ensure that the mobile smart screen is charged in time and ready for the next task. Specifically, the mobile smart screen will first plan an optimal path from the current location to the nearest charging station. During the movement, the mobile smart screen will continue to monitor the surrounding environment and avoid possible obstacles. After arriving at the charging position, the mobile smart screen will control the mobile smart screen to align with the charging port or wireless charging area. Then, the mobile smart screen will start the charging program and monitor various parameters during the charging process, such as charging current, battery temperature, etc., to ensure the safety and efficiency of charging. At the same time, the mobile smart screen will also estimate the time required for charging, and can adjust the charging strategy according to the urgency of the next task.

[0061] In some embodiments, intelligent management of the charging process can be achieved in a variety of ways: Optionally, the mobile smart screen can first use the A* algorithm combined with real-time map information to plan the shortest charging path; then, locate the charging port through computer vision technology; finally, use an adaptive charging algorithm to dynamically adjust the charging power according to the battery status. Optionally, the mobile smart screen can use a multi-agent path planning method to coordinate the charging sequence of multiple devices; then, use wireless charging positioning technology to achieve automatic alignment; finally, use a predictive maintenance algorithm to evaluate the battery health status and optimize the charging strategy. It is understandable that other methods can also be used to achieve intelligent management of the charging process, such as using reinforcement learning to optimize long-term charging strategies to extend battery life, or using energy harvesting technology to assist charging during mobility, etc., which are not limited here.

[0062] The following is a more detailed description of the process of the method provided by this implementation. Figure 2 , which is another flow chart of the mobile control method of the smart screen in an embodiment of the present application.

[0063] S201: Receive a target setting instruction from a user terminal.

[0064] Among them, the target setting instruction refers to the command information sent by the user through the terminal to specify the action target of the mobile smart screen.

[0065] When the mobile smart screen is in standby mode or performing other tasks, it will continue to listen for instructions from the user terminal. Specifically, the mobile smart screen first starts its wireless communication module to establish a connection with the user terminal. Then, it will continue to listen to the designated communication channel or interface, waiting for the target setting instructions sent by the user. When the terminal command signal is detected, the mobile smart screen will capture the signal and decode it into a recognizable command format. Subsequently, it will perform a preliminary analysis of the command, confirm its type and validity, and prepare for subsequent specific actions.

[0066] In some embodiments, the reception of user terminal target setting instructions can be achieved in a variety of ways: Optionally, the mobile smart screen can first establish a short-range connection with the user terminal through Bluetooth low energy (BLE) technology; then, use a dedicated instruction protocol to parse the received data packet; finally, use a security verification algorithm to ensure the authenticity and integrity of the instruction. Optionally, the mobile smart screen can monitor HTTP requests from the user terminal APP through a WiFi network; then, use the JSON format to parse the instruction content in the request body; finally, store the parsed instructions in a local queue for execution. It is understandable that other methods can also be used to receive user terminal target setting instructions, such as using a 5G network to achieve remote instruction reception, or directly receiving the user's voice instructions through a voice recognition module, etc., which are not limited here.

[0067] In some embodiments, the mobile smart screen will change its action state to a static state when it detects that the handle is held by the user; when it detects a thrust in the plane direction after the static state, it will move according to the direction and magnitude of the thrust.

[0068] The handle position refers to the grip area on the mobile smart screen that is specially designed for manual operation. The static state refers to the working mode in which the mobile smart screen stops all active movements. The thrust in the plane direction refers to the force applied by the user to the mobile smart screen in the horizontal plane.

[0069] When the mobile smart screen is in automatic operation mode, the system will continuously monitor the status of the handle position so as to switch to manual control mode in time. Specifically, the system first detects in real time whether the handle position is held through a pressure sensor or a touch sensor. When it is detected that the user is holding the handle, the system switches the action state of the mobile smart screen to a static state and stops all autonomous movements. Then, the system monitors the force sensor and continuously monitors the external force acting on the mobile smart screen. If a thrust is detected in the planar direction, the system will analyze the direction and magnitude of the thrust, and calculate the corresponding movement speed and direction accordingly. Finally, the system controls the mobile smart screen to move according to the calculation results to achieve manual control.

[0070] In some embodiments, the manual control mode of the mobile smart screen can be implemented in a variety of ways: Optionally, the system can first use a capacitive touch sensor to detect the state of the handle being held; then, a six-axis torque sensor is used to measure the thrust applied by the user; finally, a fuzzy control algorithm is used to convert the thrust into a smooth motion command. Optionally, the system can use an infrared proximity sensor to identify the movement of the user's hand approaching the handle; then, a strain gauge array is used to measure the thrust components in multiple directions; finally, an adaptive damping control algorithm is applied to dynamically adjust the response sensitivity of the mobile smart screen according to the thrust size. It is understandable that other methods can also be used to implement the manual control mode of the mobile smart screen, such as using machine vision technology to identify user gesture commands, or combining an inertial measurement unit (IMU) to improve the accuracy of motion control, etc., which are not limited here.

[0071] S202: When it is determined that the target setting instruction is to follow a person, determine the position of the target person to be followed.

[0072] Among them, character following refers to the working mode in which the mobile smart screen needs to continuously follow the movement of a specific person. The target person refers to the specific individual who is designated to be followed. The character position is used to indicate the specific coordinates and orientation information of the target person in space.

[0073] After receiving the target setting instruction and parsing it into the character following mode, the mobile smart screen will perform this step to locate the target person. Specifically, the mobile smart screen first activates its visual sensing system, including the camera and depth sensor. Then, it scans the surrounding environment and uses the human body detection algorithm to identify all people in the field of view. Next, the mobile smart screen will filter out the target person from the detected people based on preset features (such as facial features, clothing color, height, etc.). Finally, through triangulation or other positioning algorithms, the position and orientation of the target person relative to itself are calculated.

[0074] In some embodiments, the position of the target person can be determined in a variety of ways: Optionally, the mobile smart screen can first use a depth camera to capture 3D point cloud data; then, apply a deep learning-based human posture estimation algorithm to identify the target person; finally, combine the IMU data and use an extended Kalman filter to calculate the spatial position of the person. Optionally, the mobile smart screen can construct a 360-degree panoramic image through multiple wide-angle cameras; then, use target detection and face recognition algorithms to lock the target person; finally, use visual SLAM technology to update the position of the target person in the environmental map in real time. It is understandable that other methods can also be used to determine the position of the target person, such as using UWB technology for high-precision indoor positioning, or combining thermal imaging technology to improve the accuracy of person detection under complex lighting conditions, etc., which are not limited here.

[0075] S203: Taking the position of the person as the target position to be moved to, determining a moving path to the target position.

[0076] The target location indicates the destination that the mobile smart screen needs to reach. The moving path is used to indicate the trajectory from the current location of the mobile smart screen to the target location, including a series of intermediate path points and turn instructions.

[0077] After obtaining the location of the target person, the mobile smart screen will perform this step to plan a path to that location. Specifically, the mobile smart screen first sets the location of the target person as its own target location. Then, it accesses the internally stored environmental map data, combines its current position and target position, and constructs a path planning problem. Next, the mobile smart screen will run a path planning algorithm (such as A or RRT algorithm), analyze multiple factors such as distance, energy consumption, and safety, and calculate an optimal movement path. Finally, it will decompose this path into a series of specific motion instructions and prepare to execute the movement.

[0078] In some embodiments, the determination of the moving path can be achieved in a variety of ways: Optionally, the mobile smart screen can first use a grid map to represent the environment, mark obstacles and passable areas; then, apply the improved Dijkstra algorithm to calculate the shortest path with multiple constraints; finally, use the Bezier curve to smooth the path and generate a continuous and smooth motion trajectory. It is understandable that other methods can also be used to determine the moving path, such as using the artificial potential field method to avoid dynamic obstacles, or combining the reinforcement learning method to dynamically adjust the path planning strategy, etc., which are not limited here.

[0079] S204: When the movement of the target person is detected, the target position and the moving path are updated based on the position after the movement.

[0080] The mobile smart screen will continue to perform this step throughout the entire process of performing the character following task to adapt to the dynamic changes of the target person. Specifically, the mobile smart screen first monitors the position changes of the target person in real time through its visual system and positioning system. When a significant position change is detected, it captures the new position coordinates of the target person. The mobile smart screen then sets this new position as the updated target position. Next, it reruns the path planning algorithm to generate a new optimal movement path based on the current position, the updated target position, and environmental factors. Finally, the mobile smart screen will smoothly transition to the new movement path to ensure the continuity and smoothness of the following process.

[0081] In some embodiments, the dynamic update of the target position and the moving path can be achieved in a variety of ways: Optionally, the mobile smart screen can first use the optical flow algorithm to track the movement of the target person in real time; then, apply the Kalman filter to predict the movement trend of the person in the short term; finally, use the incremental path planning method to adjust the existing path to reduce computational overhead. Optionally, the mobile smart screen can locate the target person through multi-sensor fusion technology (such as the combination of vision, LiDAR, and IMU); then, use the dynamic path planning algorithm (such as the D* algorithm) to efficiently update the path; finally, apply the model predictive control (MPC) method to smoothly perform path adjustments and improve the stability of following. It is understandable that other methods can also be used to achieve dynamic updates of target positions and moving paths, such as using deep reinforcement learning methods to adaptively optimize following strategies, or planning paths in advance in combination with behavior prediction models, etc., which are not limited here.

[0082] S205: Move according to the moving path, and determine the remaining power at each point of the moving path according to the real-time power.

[0083] Referring to step S102, the mobile smart screen will move and determine the remaining power.

[0084] S206: Acquire a path image on the moving path in real time.

[0085] Among them, the path image is used to represent the visual scene information along the moving path, including the environment layout, object location, etc.

[0086] The mobile smart screen will continue to perform this step throughout the entire process of performing mobile tasks to obtain the latest environmental information. Specifically, the mobile smart screen first activates its forward camera system and sets appropriate image acquisition parameters such as resolution, frame rate, etc. Then, it will continue to capture the image sequence in front along the planned moving path. These images will undergo preliminary processing, such as denoising, contrast enhancement, etc., to improve the quality of subsequent analysis. At the same time, the mobile smart screen will associate these images with its current location information to form an image data stream with spatial markers. These real-time acquired path images provide important visual basis for subsequent obstacle detection and path adjustment.

[0087] In some embodiments, real-time acquisition of path images on a moving path can be achieved in a variety of ways: Optionally, the mobile smart screen can first use a wide-angle camera to capture high-resolution panoramic images; then, apply an image stitching algorithm to construct a continuous path panorama; finally, use image segmentation technology to pre-process the image to highlight key environmental features. Optionally, the mobile smart screen can simultaneously capture RGB images and depth information through a depth camera; then, use SLAM technology to build a three-dimensional environmental map in real time; finally, combine the inertial measurement unit (IMU) data to locate the acquisition position of each frame of the image. It is understandable that other methods can also be used to achieve real-time acquisition of path images on a moving path, such as using a multispectral camera to improve image quality under different lighting conditions, or combining an event camera to capture high-speed motion scenes, etc., which are not limited here.

[0088] S207: When it is determined according to the path image that there is an obstacle on the moving path, redetermine the moving path to avoid the obstacle.

[0089] Among them, obstacles refer to objects or areas that may hinder the normal movement of the mobile smart screen.

[0090] After acquiring the path image, the mobile smart screen will perform this step to ensure the safety of travel. Specifically, the mobile smart screen first analyzes the acquired path image and uses the target detection algorithm to identify objects and areas in the image. Then, it matches the detected objects with the pre-defined obstacle categories to determine whether there are obstacles that need to be avoided. If it is confirmed that there is an obstacle, the mobile smart screen will suspend the current movement plan and start the path replanning procedure. When replanning, it will use dynamic path planning algorithms such as dynamic path planning algorithms to generate a new path that can safely avoid obstacles based on the location, size and movement ability of the obstacle. Finally, the mobile smart screen will smoothly switch to the new path and continue to move to the target location.

[0091] In some embodiments, the path redetermination based on obstacle detection can be achieved in a variety of ways: Optionally, the mobile smart screen can first use a semantic segmentation algorithm based on deep learning to identify various objects in the path image; then, apply the probabilistic roadmap method to generate multiple candidate obstacle avoidance paths; finally, use the heuristic search algorithm to select the optimal solution from the candidate paths. Optionally, the mobile smart screen can construct a three-dimensional model of the obstacle through 3D point cloud processing technology; then, use the extended random tree (RRT) algorithm to plan the obstacle avoidance path in three-dimensional space; finally, apply the trajectory optimization method to smooth the path to ensure the continuity of the motion. It is understandable that other methods can also be used to achieve path redetermination based on obstacle detection, such as using reinforcement learning methods to dynamically adjust the obstacle avoidance strategy, or combining the artificial potential field method to achieve real-time local path adjustment, etc., which are not limited here.

[0092] In some embodiments, when the mobile smart screen determines that there is an obstacle on the moving path based on the path image, it will obtain obstacle information including the type, size and location of the obstacle; calculate the minimum turning angle and shortest path required to bypass the obstacle based on the obstacle information and the space requirement parameters of the mobile smart screen; re-determine the moving path as the shortest path, and detect the obstacle information in real time while moving on the shortest path; if it is determined that the obstacle has moved based on the obstacle information, the moving path is updated again.

[0093] Obstacle information refers to the detailed data about the obstructing object obtained by the system through sensors. The space requirement parameter indicates the minimum space size required for the mobile smart screen to pass safely. The minimum turning angle refers to the minimum rotation angle required to bypass an obstacle.

[0094] While the mobile smart screen is performing mobile tasks, the system will continue to analyze the path image to detect potential obstacles. Specifically, the system first uses a computer vision algorithm to analyze the path image and identify possible obstacles. Then, the system analyzes the characteristics of each obstacle in detail, including its type (such as a static object or a moving object), size (length, width, and height), and position. Next, the system combines the size and motion characteristics of the mobile smart screen to calculate the minimum turning angle required to safely bypass the obstacle. At the same time, the system uses a path planning algorithm to determine multiple possible detours and ultimately determine a new, shortest and safe path. During the movement process, the system will continue to monitor the status of the obstacle. If the position of the obstacle is found to have changed, it will trigger the path replanning process to ensure that the mobile smart screen can flexibly respond to dynamic environments.

[0095] S208. When it is determined that there is a standby point among the points where the remaining power is lower than the preset safety power, the device position of the standby smart screen within the preset distance range of the standby point is obtained.

[0096] Referring to step S103, the mobile smart screen will determine the device location of the backup smart screen when the battery is low.

[0097] S209. Determine the target point for handover between the mobile smart screen and the backup smart screen based on the real-time position of the mobile smart screen, the remaining power, and the device position of the backup smart screen, and send a handover instruction including the target point to the backup smart screen.

[0098] Referring to step S104, the mobile smart screen will determine the target point for handover and send a handover instruction.

[0099] S210. When moving to the target location and determining that the standby smart screen is at the target location, send a task transfer instruction to the standby smart screen, so that the standby smart screen displays the screen display information of the mobile smart screen and moves to the target location based on the moving path.

[0100] Referring to step S105, the mobile smart screen will move to the target point for handover.

[0101] S211. Move to the device location for charging.

[0102] Referring to step S106, the mobile smart screen will go to the device location for charging.

[0103] S212: Monitor the charging current and battery temperature during the charging process, and adjust the charging power in real time according to the battery temperature.

[0104] After entering the charging state, the mobile smart screen will continue to perform this step to ensure the safety and efficiency of charging. Specifically, the mobile smart screen first activates its battery management system (BMS) to continuously collect charging current and battery temperature data at multiple points. Then, it compares the collected data with the preset safety threshold to evaluate the safety of the current charging state. If an abnormal increase in battery temperature is detected, the mobile smart screen will reduce the charging power to prevent overheating. At the same time, it will dynamically adjust the charging power according to the changing trend of the battery temperature, using algorithms such as fuzzy control, to maximize charging efficiency while ensuring safety. In addition, the mobile smart screen will also record this data for subsequent battery health status analysis and charging strategy optimization.

[0105] In some embodiments, monitoring and adjustment during the charging process can be achieved in a variety of ways: Optionally, the mobile smart screen can first use a high-precision current sensor and a thermistor network to collect charging data in real time; then, apply the Kalman filter algorithm to process the sensor data to reduce the impact of noise; finally, use the adaptive PID control algorithm to dynamically adjust the charging current and optimize the charging curve. Optionally, the mobile smart screen can monitor the surface temperature distribution of the battery through infrared thermal imaging technology; then, use a neural network model to predict the temperature change trend inside the battery; finally, apply the model predictive control (MPC) method to optimize the charging power curve and balance the charging speed and battery life. It is understandable that other methods can also be used to achieve monitoring and adjustment during the charging process, such as using electrochemical impedance spectroscopy technology to evaluate the health status of the battery in real time, or combining machine learning methods to personalize and optimize the charging strategy of each battery, etc., which are not limited here.

[0106] S213: When the charging power reaches a preset power threshold, a charging completion reminder is sent to the user terminal.

[0107] The charging capacity refers to the current amount of power stored in the battery. The preset capacity threshold indicates the capacity standard at which the system determines that charging is complete. The charging completion reminder is a message that notifies the user that charging has ended.

[0108] The mobile smart screen will continuously monitor the battery power during the charging process and perform this step when the preset threshold is reached. Specifically, the mobile smart screen first continuously measures the real-time power of the battery through its battery management system (BMS). Then, it compares the measured power with the preset power threshold. When it detects that the power reaches or exceeds this threshold, the mobile smart screen will consider the charging process to be complete. Next, it will generate a notification message containing information such as the charging completion status, current power percentage, and charging time. Finally, the mobile smart screen will securely transmit this message to the user's terminal device through a preset communication channel (such as Wi-Fi or Bluetooth) to ensure that the user can understand the charging status in a timely manner.

[0109] In some embodiments, the sending of charging completion reminders can be achieved in a variety of ways: Optionally, the mobile smart screen can first use the coulomb counting method to calculate the remaining battery power; then, apply message queue technology to ensure the reliable delivery of notifications; finally, use push notification services (such as Firebase Cloud Messaging) to send messages to the user's mobile device in real time. Optionally, the mobile smart screen can broadcast charging status changes through smart home protocols (such as MQTT); then, use end-to-end encryption to ensure the security of the notification content; finally, apply scenario perception technology to select the most suitable notification method (such as sound, vibration or screen reminder) according to the user's current situation. It is understandable that other methods can also be used to send charging completion reminders, such as using distributed ledger technology to record charging history for user tracing, or combining artificial intelligence assistants to notify users of charging completion status through natural language, etc., which are not limited here.

[0110] In some embodiments, the mobile smart screen will obtain subsequent instructions from the user; the subsequent instructions include continuing standby, resuming the original task, or executing a new task; when the subsequent instruction is to resume the original task, obtain the current position and task progress of the standby smart screen; determine the handover location and return path for taking over the task based on the current position and task progress, and move to the handover location along the return path; after arriving at the handover location, synchronize data with the standby smart screen to complete the task handover.

[0111] Among them, the subsequent instruction refers to the next work arrangement issued by the user after the mobile smart screen completes charging. Task progress is used to indicate the degree and status of the current work completion. The handover location refers to the predetermined location for the mobile smart screen and the backup smart screen to hand over the task. Data synchronization refers to the process of exchanging and updating task-related information between the two devices.

[0112] After the mobile smart screen is fully charged, the system will execute this process to ensure the continuity and smooth transition of the task. Specifically, the system first sends a charging completion notification to the user terminal and waits for the user's subsequent instructions. After receiving the instruction, the system will parse the instruction content and determine the next action. If the instruction is to restore the original task, the system will establish communication with the backup smart screen to obtain its current location and detailed task execution progress. Then, the system will comprehensively analyze factors such as the location and task status of the mobile smart screen and the backup smart screen to calculate the optimal handover point and the return path of the mobile smart screen. Next, the system controls the mobile smart screen to go to the handover point along the planned path. Upon arrival, the system will start a high-speed data transmission protocol to perform comprehensive data synchronization with the backup smart screen, including task status, user preferences, environmental information, etc. After synchronization is completed, the system will smoothly take over the task to ensure seamless work.

[0113] In some embodiments, the task recovery and handover process of the mobile smart screen can be implemented in a variety of ways: Optionally, the system can first use natural language processing technology to understand and execute the user's voice commands; then, apply distributed database technology to synchronize the task status between multiple smart screens in real time; finally, use the collaborative positioning algorithm to calculate the best handover location. Optionally, the system can centrally manage the working status of multiple smart screens through the smart home control center; then, use the blockchain-based task handover protocol to ensure the security and integrity of data exchange; finally, apply a dynamic path planning algorithm to determine real-time traffic conditions and optimize the return path. It is understandable that other methods can also be used to implement the task recovery and handover process of the mobile smart screen, such as using a multi-agent system to coordinate the collaboration of multiple smart screens, or combining augmented reality technology to assist users in intuitively performing task handover operations, etc., which are not limited here.

[0114] In the embodiment of the present application, due to the adoption of an autonomous coordination mechanism between devices based on real-time power monitoring and a dynamic path planning algorithm, the mobile smart screen can autonomously find backup devices, plan the optimal handover path, and complete task handover in low-power conditions, effectively solving the problem of service interruption and intervention due to power exhaustion in traditional methods, thereby achieving continuous and stable operation of the mobile smart screen. This not only improves the efficiency and reliability of equipment use, but also reduces management costs. At the same time, through intelligent power management and task scheduling, it provides users with a smoother and more seamless service experience.

[0115] The following describes the mobile smart screen in the embodiment of the present invention from the perspective of hardware processing. Figure 3 , which is a schematic diagram of a physical device structure of a mobile smart screen in an embodiment of the present application.

[0116] It should be noted that Figure 3 The structure of the mobile smart screen shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0117] like Figure 3As shown, the mobile smart screen includes a central processing unit (CPU) 301, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 302 or the program loaded from the storage part 308 to the random access memory (RAM) 303, such as executing the method described in the above embodiment. In RAM 303, various programs and data required for system operation are also stored. CPU 301, ROM 302 and RAM 303 are connected to each other through bus 304. Input / output (I / O) interface 305 is also connected to bus 304.

[0118] The following components are connected to the I / O interface 305: an input section 306 including an audio input device, a button switch, etc.; an output section 307 including a liquid crystal display (LCD) and an audio output device, an indicator light, etc.; a storage section 308 including a hard disk, etc.; and a communication section 309 including a network interface card such as a LAN (Local Area Network) card, a modem, etc. The communication section 309 performs communication processing via a network such as the Internet. A drive 310 is also connected to the I / O interface 305 as needed. A removable medium 311, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 310 as needed so that a computer program read therefrom is installed into the storage section 308 as needed.

[0119] In particular, according to an embodiment of the present invention, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present invention includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a computer program for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through the communication part 309, and / or installed from a removable medium 311. When the computer program is executed by the central processing unit (CPU) 301, various functions defined in the present invention are performed.

[0120] It should be noted that specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present invention, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, apparatus, or device.

[0121] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present invention. Each box in the flowchart or block diagram may represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of a code contains one or more executable instructions for implementing the specified logical functions. It should also be noted that in some alternative implementations, the functions marked in the box may also occur in an order different from that marked in the accompanying drawings.

[0122] Specifically, the mobile smart screen of this embodiment includes a processor and a memory. A computer program is stored in the memory. When the computer program is executed by the processor, the mobile control method of the smart screen provided in the above embodiment is implemented.

[0123] As another aspect, the present invention further provides a computer-readable storage medium, which may be included in the mobile smart screen described in the above embodiment; or may exist independently without being assembled into the mobile smart screen. The above storage medium carries one or more computer programs, and when the above one or more computer programs are executed by a processor of the mobile smart screen, the mobile smart screen implements the mobile control method of the smart screen provided in the above embodiment.

[0124] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

[0125] As used in the above embodiments, the term "when..." may be interpreted to mean "if..." or "after..." or "in response to determining..." or "in response to detecting...", depending on the context. Similarly, the phrases "upon determining..." or "if (the stated condition or event) is detected" may be interpreted to mean "if determining..." or "in response to determining..." or "upon detecting (the stated condition or event)" or "in response to detecting (the stated condition or event)", depending on the context.

[0126] Those skilled in the art can understand that to implement all or part of the processes in the above-mentioned embodiments, the processes can be completed by computer programs to instruct related hardware, and the programs can be stored in computer-readable storage media. When the programs are executed, they can include the processes of the above-mentioned method embodiments. The aforementioned storage media include: ROM or random access memory RAM, magnetic disk or optical disk and other media that can store program codes.

Claims

1. A method for controlling the movement of a smart screen, characterized in that: Applied to a mobile smart screen, the method includes: Determining a target location to be moved to and a moving path to the target location based on a target setting instruction of a user terminal; Move according to the moving path, and determine the remaining power at each point of the moving path according to the real-time power; When it is determined that there is a standby point where the remaining power is lower than the preset safety power among the points, obtaining the device position of the standby smart screen within the preset distance range of the standby point; According to the real-time position of the mobile smart screen, the remaining power and the device position of the standby smart screen, determine the target point for handover between the mobile smart screen and the standby smart screen, and send a handover instruction including the target point to the standby smart screen; When the mobile smart screen moves to the target location and determines that the standby smart screen is at the target location, a task transfer instruction is sent to the standby smart screen, so that the standby smart screen displays the screen display information of the mobile smart screen and moves to the target location based on the moving path; Move to the device location to charge.

2. The method according to claim 1, characterized in that The determining of the target location to be moved to and the moving path to the target location based on the target setting instruction of the user terminal specifically includes: receiving a target setting instruction from a user terminal; When it is determined that the target setting instruction is character following, determining a character position of a target character to be followed; Taking the position of the person as the target position to be moved to, determining a moving path to the target position; When the target person is detected to move, the target position and the moving path are updated based on the position after the movement.

3. The method according to claim 1, characterized in that Before the step of determining the target location to be moved to and the moving path to the target location based on the target setting instruction of the user terminal, the method further includes: When the handle is detected to be held by the user, the action state is changed to the static state; When a thrust in the plane direction is detected after the stationary state, movement is performed according to the direction and magnitude of the thrust.

4. The method according to claim 1, characterized in that After the step of moving according to the moving path and determining the remaining power at each point of the moving path according to the real-time power, the method further includes: Acquire a path image on the moving path in real time; When it is determined according to the path image that there is an obstacle on the moving path, the moving path is re-determined to avoid the obstacle.

5. The method according to claim 4, characterized in that When it is determined according to the path image that there is an obstacle on the moving path, re-determining the moving path to avoid the obstacle specifically includes: When it is determined according to the path image that there is an obstacle on the moving path, obtaining obstacle information including the type, size and position of the obstacle; Calculate the minimum turning angle and shortest path required to bypass the obstacle based on the obstacle information and the space requirement parameters of the mobile smart screen; Re-determining the moving path as the shortest path, and detecting the obstacle information in real time when moving on the shortest path; If it is determined according to the obstacle information that the obstacle has moved, the moving path is updated again.

6. The method according to claim 1, characterized in that After the step of moving to the device location for charging, the method further includes: Monitor the charging current and battery temperature during the charging process, and adjust the charging power in real time according to the battery temperature; When the charging power reaches a preset power threshold, a charging completion reminder is sent to the user terminal.

7. The method according to claim 6, characterized in that After the step of sending a charging completion reminder to the user terminal when the charging power reaches a preset power threshold, the method further includes: Obtaining subsequent instructions from the user; the subsequent instructions include continuing to wait, resuming the original task, or executing a new task; When the subsequent instruction is to resume the original task, obtain the current position and task progress of the standby smart screen; Determine the handover location and return path for taking over the task according to the current position and the task progress, and move to the handover location along the return path; After arriving at the handover location, data is synchronized with the backup smart screen to complete the task handover.

8. A mobile smart screen, characterized in that: The mobile smart screen includes: one or more processors and a memory; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to enable the mobile smart screen to execute the method described in any one of claims 1-7.

9. A computer-readable storage medium comprising instructions, characterized in that: When the instruction is executed on the mobile smart screen, the mobile smart screen executes the method as described in any one of claims 1 to 7.

10. A computer program product, characterized in that When the computer program product runs on a mobile smart screen, the mobile smart screen executes the method as described in any one of claims 1 to 7.

Images