Interaction system and method for controlling intelligent support through mobile phone

Abstract

The invention provides an interaction system and method for controlling an intelligent support through a mobile phone, the interaction system is arranged on the mobile phone, the mobile phone is connected to the intelligent support, the interaction system comprises a user interface, a Bluetooth connection module, a camera connection module, a control module and a central processing unit, the central processing unit is connected to the Bluetooth connection module, the camera connection module and the control module and is used for receiving, calling, analyzing and processing various data information of the mobile phone and the intelligent support, the mobile phone is used as a main brain to control the intelligent support, and the intelligent support is controlled through a camera, a microphone, an acceleration sensor and a gyroscope of the mobile phone. Information and emotion interaction between the user and the intelligent support is achieved, operation is easy, and use is convenient.

Description

Technical Field

[0001] The present invention relates to the field of smart phone brackets, and in particular to an interactive system and method for controlling a smart phone bracket through a mobile phone. Background Art

[0002] In today's trend of information development, people's communication with virtual information and the non-material world is becoming closer and more frequent. This trend has caused the interface between people and the outside world to become narrower, and the largest carrier of human-computer interaction has become the screen. In the development of human-computer interaction, the theory of tangible interaction has become a very concerned and research direction. At the same time, in terms of mobile devices, the deformation interaction mechanism has been proven to be particularly suitable for mobile devices. For example, it can be used to improve usability and improve human-computer communication and interaction or achieve emotional interaction.

[0003] The use of smart phones is already very common, so how to control smart brackets through mobile phones and apply this tangible concept to the field of smart phones, providing mobile phones with other interactive ports besides screens, is very valuable, and then realizing intelligent interaction between mobile phones and smart brackets to meet more needs of people is worth studying. Summary of the invention

[0004] One advantage of the present invention is that it provides an interactive system and method for controlling a smart bracket through a mobile phone. The mobile phone is connected to the smart bracket through the interactive system, and the mobile phone acts as a master to control the smart bracket, thereby achieving emotional interaction with the user.

[0005] Another advantage of the present invention is that it provides an interactive system and method for controlling a smart bracket through a mobile phone, controlling the smart bracket in an intelligent manner, realizing visual interaction, voice interaction, touch screen interaction, and tangible interaction between the user and the smart bracket through the mobile phone, and controlling various movements of the robot through the mobile phone to meet the user's usage and entertainment needs.

[0006] Another advantage of the present invention is that it provides an interactive system and method for controlling a smart bracket through a mobile phone. The mobile phone and the smart bracket form a lightweight and interactive smart bracket, and the two are used as a whole. Compared with other ordinary brackets, it has more functions and wider applications. Compared with other robots, it has low cost and can use the user's mobile phone as the main brain to control, which can meet more people's needs.

[0007] Another advantage of the present invention is that it provides an interactive system and method for controlling a smart bracket through a mobile phone. By combining information from the mobile phone's camera, microphone, accelerometer, gyroscope and other sensor devices, the smart bracket can perform a series of overall actions under the control of the mobile phone and can provide feedback to the mobile phone. The operation is simple and easy to use.

[0008] Another advantage of the present invention is that it provides an interactive system and method for controlling a smart bracket through a mobile phone, and can also realize physical video chat interaction, tracking shooting and other functions through remote control, not only realizing human-computer interaction, but also realizing physical interaction between people and between people and brackets through remote control.

[0009] Another advantage of the present invention is that it provides an interactive system and method for controlling a smart bracket through a mobile phone. After the mobile phone is connected to the smart bracket, the smart bracket can be controlled by the mobile phone, thereby improving the interactive dimension of the mobile phone itself and providing the mobile phone with other interactive ports other than the screen. It will not affect the normal use of the mobile phone. The user can still perform conventional interactive operations with the mobile phone through touch screen, voice, vision, etc., and the functions and interactive methods of the mobile phone itself are still retained.

[0010] According to one aspect of the present invention, the present invention provides an interactive system, wherein the interactive system is arranged in a mobile phone, and the mobile phone is fixed to a smart bracket in a communicative manner, wherein the interactive system comprises:

[0011] A user interface suitable for touch screen interaction and operation;

[0012] A Bluetooth connection module, which establishes a connection between the mobile phone and the smart bracket by calling Bluetooth;

[0013] a camera connection module to enable the camera of the mobile phone to perform visual interaction;

[0014] a control module, which controls various components of the smart bracket to drive the mobile phone to move, thereby realizing tangible interaction between the user and the smart bracket; and

[0015] A central processor is connected to the Bluetooth connection module, the camera connection module and the control module, and receives, calls, analyzes and processes various data information of the mobile phone and the smart bracket, so that the user can realize intelligent interaction with the smart bracket through the camera and microphone of the mobile phone.

[0016] The interactive system further comprises a voice recognition module connected to the central processor, wherein the voice recognition module is connected to the voice service, and the user realizes voice interaction with the smart bracket through the microphone of the mobile phone.

[0017] The interactive system further includes a motion module, which establishes a connection between the motion sensors of the mobile phone and the smart bracket, senses the motion status of the smart bracket, and controls the smart bracket to drive the mobile phone to perform autonomous environmental exploration.

[0018] The interactive system further includes a light module that establishes a connection between the mobile phone and the light sensor of the smart bracket, which is suitable for sensing a dark environment and controlling the opening and closing of the lighting device of the smart bracket.

[0019] The environmental data of the smart bracket is obtained through the camera connection module to realize SLAM monocular mapping, face recognition and tracking, tracking, gesture recognition and interaction, and video physical interaction with another mobile phone installed with the interactive system.

[0020] The user interface includes a robot interface, a remote control interface, a programming interface, a floating window interface and a main interface. The user is suitable for calling up the robot interface, the remote control interface, the programming interface and the floating window interface through the main interface, and enabling the connection between the mobile phone and the smart bracket through each interface.

[0021] The smart bracket includes a device body, a connecting device, an information processing module and a functional component. The connecting device is movably arranged on the device body to clamp and connect the mobile phone. The device body drives the mobile phone to move. The information processing module is arranged inside the device body to achieve connection with the mobile phone through the interactive system. The functional component is arranged on the device body and connected to the information processing module so that the mobile phone can control the functional component to execute corresponding instructions.

[0022] According to another aspect of the present invention, the present invention also provides an interaction method, which is suitable for a user to control a smart bracket through a mobile phone and realize interaction with the smart bracket, comprising the following steps:

[0023] (S101) An interactive system is placed on a mobile phone, and a mobile phone capable of communication is fixed on a smart bracket;

[0024] (S102) the user controls the interactive system through a user interface placed on the mobile phone;

[0025] (S103) the interactive system obtains the authority to call, receive, analyze and process the information of the mobile phone and the smart bracket;

[0026] (S104) the mobile phone serves as a master to control the smart bracket; and

[0027] (S105) The smart bracket analyzes and processes various instructions of the mobile phone to achieve intelligent interaction with the user.

[0028] The step (S104) includes the following steps: (S1041) the smart bracket performs face recognition and tracking through the camera of the mobile phone; (S1042) the user performs visual interaction with the smart bracket through the camera of the mobile phone; (S1043) the user performs voice interaction with the smart bracket through the microphone of the mobile phone; (S1044) the mobile phone senses the motion state of the smart bracket through a motion sensor; (S1045) the mobile phone senses the dark environment through a light sensor and controls the opening and closing of the lighting device of the smart bracket; (S1046) the user uses voice, gestures and screen triggers through the mobile phone to realize video calls and physical interaction of two-way remote control with another mobile phone installed with the interactive system.

[0029] In the step (S101), the interactive system sends a pitch signal to the mobile phone, and the mobile phone controls the smart bracket to drive the mobile phone to perform a pitch movement. The acceleration sensor of the mobile phone confirms whether the connection status between the mobile phone and the smart bracket is good according to the change of acceleration during the pitch movement.

[0030] The step (S103) includes the following steps: (S1031) the interactive system establishes a connection with the camera, microphone, acceleration sensor, and gyroscope of the mobile phone; (S1032) the interactive system and the mobile phone establish a connection with the motor, servo, power supply, sensor, and lighting device of the smart bracket; (S1033) the interactive system is suitable for calling, receiving, analyzing, processing, and sending various sensor data and interactive signals of the mobile phone and the smart bracket.

[0031] The mobile phone plans the driving route of the smart bracket through the interactive system, controls the smart bracket to perform autonomous environmental exploration, and obtains environmental data through the camera of the mobile phone to realize SLAM monocular mapping.

[0032] The interactive system runs in the background of the mobile phone or floats on the interface of the mobile phone through a floating window, and the user performs remote control, programming and management operations through the user interface of the interactive system. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] Figure 1 It is a structural schematic diagram of a mobile phone communicating with a smart bracket according to a preferred embodiment of the present invention.

[0034] Figure 2 It is a schematic diagram of the three-dimensional structure of the mobile phone connected to the outside according to the above preferred embodiment of the present invention.

[0035] Figure 3It is a schematic structural diagram of the intelligent bracket according to the above preferred embodiment of the present invention.

[0036] Figure 4 It is a structural block diagram of the interactive system according to the above preferred embodiment of the present invention.

[0037] Figure 5 is a schematic diagram of a user interface of the interactive system according to the above preferred embodiment of the present invention.

[0038] Figure 6 is an application schematic diagram of the interactive system according to the above preferred embodiment of the present invention.

[0039] Figure 7 is an application schematic diagram of the interactive system according to the above preferred embodiment of the present invention. DETAILED DESCRIPTION

[0040] The following description is used to disclose the present invention so that those skilled in the art can implement the present invention. The preferred embodiments described below are only examples, and those skilled in the art can think of other obvious variations. The basic principles of the present invention defined in the following description can be applied to other embodiments, variations, improvements, equivalents, and other technical solutions that do not deviate from the spirit and scope of the present invention.

[0041] Those skilled in the art should understand that, in the disclosure of the present invention, the terms "longitudinal", "lateral", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside" and the like indicating the orientation or position relationship are based on the orientation or position relationship shown in the drawings, which are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operate in a specific orientation. Therefore, the above terms should not be understood as limiting the present invention.

[0042] It is to be understood that the term "one" should be understood as "at least one" or "one or more", that is, in one embodiment, the number of an element may be one, while in another embodiment, the number of the element may be multiple, and the term "one" should not be understood as a limitation on the quantity.

[0043] Reference Figure 1 To Attachment Figure 7As shown, an interactive system for controlling a smart bracket through a mobile phone according to a preferred embodiment of the present invention is illustrated. In this embodiment, the interactive system 10 is connected between the mobile phone 20 and the smart bracket 30, so that the mobile phone 20 controls the smart bracket 30 as the master, so that the user and the smart bracket can interact intelligently. At the same time, the mobile phone 20 is connected to the smart bracket 30 to form a whole, and as a lightweight intelligent robot, it realizes information exchange and various emotional interactions with the user. Through the combination of the mobile phone and the smart bracket, the cost is low, the use is convenient, and the various needs of the user can be met.

[0044] The interactive system 10 is set inside the mobile phone 20 as an APP, cooperates with various components and systems inside the mobile phone 20, calls and processes various sensor data inside the mobile phone 20, and establishes communication with the smart bracket 30 to achieve control of the hardware and various sensor data of the smart bracket 30, remotely control the smart bracket 30, and receive various information fed back by the smart bracket 30.

[0045] After the interactive system 10 is set on the mobile phone 20, the mobile phone 20 acts as the master to control the smart bracket 30. By connecting the mobile phone 20 and the smart bracket 30 to form a movable overall structure, it serves as a movable intelligent interactive device, and then performs intelligent interaction with the user 40 to meet the user's needs.

[0046] The smart bracket 30 includes a device body 31, a connecting device 32, an information processing module 33, and a functional component 34. The connecting device 32 is arranged on the device body 31 and detachably clamps the mobile phone 20, so that the mobile phone 20 can be movably installed on the device body 31 through the connecting device 32 and realize intelligent interaction with the device body 31. The bottom of the device body 31 is provided with moving wheels and tracks, which can walk on the surface of objects such as the desktop and the ground, drive the mobile phone to perform various motion changes, and can feed back the motion information to the mobile phone 20 through the information processing module, so that the walking speed and direction of the smart bracket 30 can be accurately fed back and controlled, and the user can also dynamically adjust the walking speed and movement direction according to their own needs.

[0047] Those skilled in the art will appreciate that, the connecting device 32 is implemented as a clamping device in the present embodiment, but under the conception of the present invention, it can also be implemented as other connecting methods, such as a magnetic method, a plug-in method, etc.

[0048] The information processing module 33 is arranged inside the device body 32 and has the necessary information processing capabilities. It can realize information transmission and analysis processing with the mobile phone 20, for example, receive various instructions sent by the mobile phone 20, and feedback various information of the smart bracket 20 to the mobile phone 20, establish a connection with the mobile phone 20, and then when the mobile phone 20 is fixed to the smart bracket 30, the user can realize various interactions with the smart bracket 30 through the mobile phone 20.

[0049] The functional components 34 are also arranged in various parts of the device body 31, and the mobile phone 20 is able to control the functional components 34 through the information processing module 33, and the information processing module 33 is connected to the mobile phone 20 through the interactive system 10, so that the smart bracket 30 has corresponding functions and is suitable for information exchange and intelligent interaction with the mobile phone 20.

[0050] The connecting device 32 includes a clamping mechanism 321 and a pitching mechanism 322, wherein the pitching mechanism 322 is arranged between the clamping mechanism 321 and the device body 31, the clamping mechanism 321 can detachably clamp the mobile phone 20, and perform a pitching motion along the device body 31 through the pitching mechanism 322, and the angle and speed of the pitching motion can be accurately and real-time fed back to the mobile phone 20 through the information processing module 33, and the acceleration sensor of the mobile phone 20 can confirm whether the clamping and connection status between the mobile phone 20 and the smart bracket 30 is good according to the acceleration change during the pitching motion of the mobile phone 20.

[0051] The information processing module 33 can also feed back the clamping posture of the mobile phone 20 to the mobile phone 20 and the interactive system 10, such as horizontal screen, vertical screen, etc. The information processing module 33 can also feed back the clamping angle of the mobile phone 20 to the mobile phone 20 and the interactive system 10. The user can send an angle adjustment instruction to the information processing module 33 through the mobile phone 20 to dynamically adjust the clamping angle between the mobile phone 20 and the smart bracket 30 to meet the user's demand for the mobile phone clamping angle, and also facilitate the realization of face tracking and follow-up shooting.

[0052] The information processing module 33 includes a motor drive module, a motor drive module, a power module, a wireless charging module, an information control module, etc., to monitor, feedback and control various motion information, environmental information, power information of the smart bracket 30 in real time, and receive, process, analyze and feedback various sensor information of the smart bracket 30 to the mobile phone 20. The interactive system 10 establishes a connection between the mobile phone 20 and the smart bracket 30, so that the user can realize touch screen interaction, voice interaction, visual interaction and other tangible interaction with the smart bracket through the mobile phone 20.

[0053] The functional components 34 include a servo, a motor, a power supply, an indicator light and various sensors, which are respectively installed in various parts of the device body 31, so that the smart bracket 30 has various functions such as walking, retreating, turning, pitch change, environmental perception, lighting, charging and discharging, etc.

[0054] The interactive system 10 includes a user interface 11 , a Bluetooth connection module 12 , a camera connection module 13 , a central processing unit 14 , a control module 15 , a voice recognition module 16 , a motion module 17 and a light module 18 .

[0055] The interactive system 10 is installed on the mobile phone 20 as an APP, and the user interface 11 is presented on the screen of the mobile phone 20, so that the user can perform corresponding operations through the user interface 11. The user can also realize touch screen interaction with the mobile phone 20 and the smart bracket 30 through the user interface 11, that is, send corresponding instructions through the user interface to establish the connection between the mobile phone 20 and the smart bracket 30, and control the smart bracket 30 to meet the needs of intelligent interaction.

[0056] In addition, the user interface 11 can also display and prompt information such as the connection status and power level between the mobile phone 20 and the smart bracket 30 .

[0057] The Bluetooth connection module 12 is used to call Bluetooth to establish a communication mode between the mobile phone 20 and the smart bracket 30, thereby realizing a communication connection between the interactive system 10, the mobile phone 20 and the smart bracket 30, facilitating intelligent interaction.

[0058] The camera connection module 13 is used to enable the camera of the mobile phone 20, so as to facilitate visual interaction between the user and the smart bracket 30 through the camera of the mobile phone 20, that is, to connect the interactive system 10 to the camera of the mobile phone 20 to control the interaction between the camera of the mobile phone 20 and the smart bracket 30.

[0059] Through the camera connection module 13, the user is able to establish interaction between the camera of the mobile phone 20 and the smart bracket 30. On the one hand, visual interaction, video chatting, face recognition and tracking, and follow-up shooting can be achieved; on the other hand, the smart bracket 30 can be controlled through the camera of the mobile phone 20, for example, gesture interaction and control, expression interaction, etc.; thirdly, the surrounding environment data of the smart bracket 30 can be obtained through the camera of the mobile phone 20 to achieve SLAM monocular mapping; fourthly, a two-way video call function can be established with another mobile phone installed with this interactive system 10 through the camera of the mobile phone 20, and the smart bracket connected to the mobile phone can be remotely controlled to achieve remote controlled logistics interaction, making video calls more user-friendly.

[0060] The mobile phone 20 and the smart bracket 30 form a whole that can perform face recognition through the front camera of the mobile phone 20, and control the smart bracket to perform corresponding movements according to the movement of the face to perform face tracking.

[0061] The front camera of the mobile phone 20 can recognize a face. The mobile phone is suitable for judging the moving direction and speed of the face within a preset speed and angle range through the interactive system 10. The mobile phone 20 sends a set of signals to the smart bracket 30 via Bluetooth, so that the smart bracket 30 performs corresponding pitch, rotation, or pitch and rotation at the same time according to the instructions sent by the mobile phone 20 to capture the face information, so that the smart bracket 30 can track the face by moving, which is convenient for follow-up shooting. Especially in today's society where the era of self-media has emerged, when users need to shoot short videos, etc., they can clamp their mobile phones on the smart bracket 30 to form a whole, and follow-up shooting through face recognition and tracking, which is simple to use and easy to operate.

[0062] The central processor 14 is connected to the Bluetooth connection module 12, the camera connection module 13, the control module 15, the voice recognition module 16, the motion module 17 and the light module 18 to summarize, analyze and process the information of each module, and then establish a connection with the mobile phone 20 and the smart bracket 30, and at the same time call, receive, analyze, process and feedback various sensor data of the mobile phone 20 and the smart bracket 30, analyze and process various information and instructions fed back by the mobile phone 20 and the smart bracket 30, and timely execute corresponding instructions through the user interface 11, the Bluetooth connection module 12, the camera connection module 13, the control module 15, the voice recognition module 16, the motion module 17 and the light module 18, so as to better realize the mobile phone 20 as the master to control the smart bracket 30, so that the user can establish intelligent interaction with the intelligent robot composed of the mobile phone 20 and the smart bracket 30.

[0063] The control module 15 is connected to the functional component 34 of the smart bracket 30 to establish a connection between the mobile phone 20 and the smart bracket 30 so as to control the hardware of the smart bracket 30 through the mobile phone 20 .

[0064] By analyzing the status and needs of the functional component 34, timely feedback is given to the processor 14, and the data detected by various sensors of the mobile phone 20 are fed back to the processor 14, and then the functional component 34 is further controlled by the control module 15, so that each functional component of the functional component 34 can perform corresponding work according to the instructions of the mobile phone 20 and the interactive system 10. In other words, the motor, steering gear, lighting device and other actuators of the smart bracket 30 can be controlled and perform corresponding operations through the control module 15.

[0065] For example, the connecting device 32 can be controlled to perform pitching motion by controlling the steering gear, and the acceleration sensor of the mobile phone can identify the connection status and clamping angle of the mobile phone according to the acceleration change during the pitching process. The movement direction, movement speed, feedback and control of obstacles in front, whether to follow the shooting, power prompt, indicator light brightness change, opening and closing of lighting devices, charging and discharging prompts, etc. of the smart bracket 30 can also be controlled.

[0066] The voice recognition module 16 can perform voice operations to realize the voice recognition function, recognize preset fixed phrases, and can enable a two-way voice transmission function with another mobile phone installed with the interactive system 10 through voice services. Combined with the camera connection module 13, the two-way audio and video call function between the mobile phone installed with the interactive system 10 can be enabled through voice awakening, gestures, screen triggering, etc. In other words, after both mobile phones are installed with the interactive system 10, a video call function between the two mobile phones can be established through the interactive system 10. Moreover, when two mobile phones installed with the interactive system 10 are installed on the smart bracket 30, one of the mobile phones can be used to control the smart bracket connected to the other mobile phone.

[0067] After the mobile phone 20 and the smart bracket 30 are connected, the physical interaction in the video chat between the two mobile phones can be achieved by remotely controlling the movement of the smart bracket 30.

[0068] Specifically, user A and user B use mobile phones equipped with the interactive system 10 at the same time, and connect the mobile phones to the smart bracket 30. User B sends a command signal to the interactive system 10 of user A through the network, for example, turn left or turn right, etc. The interactive system 10 of user A is received by the signal and sends a command signal to its own smart bracket 30. Then the smart bracket 30 of user A performs corresponding actions according to the instructions, driving the mobile phone of user A to turn left or right. At this time, user B obtains the field of view of turning left or right, realizing physical interaction in video chat, without the need for users to turn left or right manually. This saves time and effort for users, and intelligent interaction is more convenient and humane.

[0069] The motion module 17 establishes a connection with the motion sensors of the mobile phone 20 and the smart bracket 30, and is suitable for sensing the motion actions of the smart bracket 30 such as collision, flipping, being picked up, etc., so as to perform subsequent operations.

[0070] The light module 18 establishes a connection between the light sensors of the mobile phone 20 and the smart bracket 30, is suitable for sensing a dark environment, and controls the LED headlights of the smart bracket 30 to turn on to present a bright light environment, and can timely receive and process the ambient brightness information of the smart bracket 30 to facilitate regulation through the mobile phone 20.

[0071] Through the cooperation of the above-mentioned components, the interactive system 10 is suitable for planning a driving route for the smart bracket 30 and controlling the smart bracket 30 and the mobile phone 20 to perform autonomous environmental exploration.

[0072] The interactive system 10 can be run in the background, or attached to the mobile phone interface through a floating window, and the user can perform corresponding operations through the user interface 11 of the interactive system 10.

[0073] The user interface 11 includes a robot interface 111, a remote control interface 112, a programming interface 113, a floating window interface 114 and a main interface 115. Each of the interfaces is suitable for users to operate through the mobile phone screen, so as to establish a connection between the mobile phone and the smart bracket, receive, analyze and process the information of the mobile phone 20 and the smart bracket 30 and establish a connection between the two, thereby realizing intelligent interaction between the two.

[0074] The robot interface 111 provides the user with functions such as gaming, taking photos, recording videos, and memorizing, for the user to select according to needs.

[0075] The remote control interface 112 is used for the user to remotely control the smart bracket 30, wherein the interface of the remote control interface 112 displays the functions operated by the user such as the right joystick (servo pitch), the left joystick (travel direction), the headlight switch, the cliff detection switch, etc.

[0076] The programming interface 113 includes new programming, last programming and saved programming for the user to operate according to needs.

[0077] The floating window interface 114 includes operations such as normal connection, follow-up prompt and follow-up prompt.

[0078] The main interface 115 includes a main button 1151, an upper bar window 1152, a setting window 1153 and a help window 1154. The robot interface 111, the remote control interface 112 and the programming interface 113 can be called up through the main button 1151. The upper bar window 1152 can be used for Bluetooth connection and memory awakening, wherein memory awakening includes recognition of sight, recognition of people, and hearing, wherein the recognition operation is performed through character naming and character labels to identify the operator. The user can also adjust the volume, brightness, enhance interaction, system update, etc. through the function operation of the setting window 1153, wherein the volume adjustment includes the interface sound effect and the sound effect of the smart bracket 30 and the sound effect of the mobile phone 20, and the enhanced interaction includes floating window setting, face tracking, enhanced prompts, etc. The system update includes firmware update and version update, etc.

[0079] The user can also learn and understand the interactive system through the help window 1154 on the upper bar of the main interface.

[0080] Multiple interfaces bring greater convenience to user operations, allowing users to control mobile phones and smart stands in a variety of ways.

[0081] That is to say, in the present invention, the interactive mobile phone holder and the mobile phone form a system to realize intelligent interaction between the user, the mobile phone and the smart holder.

[0082] The obstacle avoidance sensor, touch sensor, ToF distance sensor, cliff sensor, motion sensor, etc. on the smart bracket 30 are connected to the mobile phone 20 through the interactive system 10, thereby enabling the user to achieve intelligent interaction with the mobile phone 20 and the smart bracket 30.

[0083] The camera, microphone, acceleration sensor, angular velocity sensor, electronic compass, etc. on the mobile phone 20 are connected to the smart bracket 30 through the interactive system 10, thereby realizing intelligent interaction with the user.

[0084] The camera sensor can identify common objects on the desktop (such as water cups, mice, potted plants), and distinguish different faces. The microphone sensor can recognize keywords spoken by the user, and convert the user's voice input into text input into the robot behavior system. The inputs of these sensors correspond to a variety of emotional expression modes. The corresponding relationship is stored in the database of the mobile phone. The software running in the mobile phone receives the input of these sensors in real time, and the signal changes of the sensors generate instructions. The behavior system in the mobile phone software selects the relevant emotional expression mode to execute according to the corresponding relationship stored in the database. For example, the cliff sensor in front of the smart bracket 30 triggers the emotional expression mode corresponding to "surprise-backward"; the touch sensor is triggered to correspond to the emotional expression mode of "happy". These expression modes are also related to the state of the robot itself. For example, after the mobile phone camera detects a face, if the robot has not seen the face for a period of time, it corresponds to the emotional expression mode of "greeting".

[0085] The present invention provides an interactive method for controlling a smart bracket through a mobile phone, comprising the following steps:

[0086] (S101) The interactive system 10 is placed on the mobile phone 20, and the mobile phone 20 is fixed to the smart bracket 30 for communication;

[0087] (S102) The user controls the interactive system 10 through the user interface 11 placed on the mobile phone 20;

[0088] (S103) The interactive system 10 obtains the authority to call, receive, analyze and process the information of the mobile phone 20 and the smart bracket 30;

[0089] (S104) the mobile phone 20 acts as a master to control the smart bracket 30; and

[0090] (S105) The smart bracket 30 analyzes and processes various instructions of the mobile phone 20 to achieve intelligent interaction with the user.

[0091] The step (S104) includes the following steps: (S1041) the smart bracket 30 performs face recognition and tracking through the camera of the mobile phone 20; (S1042) the user performs visual interaction with the smart bracket 30 through the camera of the mobile phone 20; (S1043) the user performs voice interaction with the smart bracket 30 through the microphone of the mobile phone 20; (S1044) the mobile phone 20 senses the movement state of the smart bracket 30 through a motion sensor; (S1045) the mobile phone 20 senses the dark environment through a light sensor and controls the opening and closing of the lighting device of the smart bracket 30; (S1046) the user uses voice, gestures and screen triggers through the mobile phone 20 to realize video calls and physical interactions of two-way remote control with another mobile phone installed with the interactive system 10.

[0092] The mobile phone 20 and the smart bracket 30 have the functions of face recognition and tracking, and can therefore be used for follow-up filming. The follow-up filming (S1041) includes the following steps: (A) recognizing a face through the camera of the mobile phone 20; (B) the mobile phone 20 determines the direction of the face and sends a command to the smart bracket 30; (C) the smart bracket 30 moves according to the command sent by the mobile phone 20 to track the face; and (D) the smart bracket 30 can track and follow the face within a preset angle range through the pitch movement of the connecting device 32 and / or the left and right movement of the device body 31.

[0093] In the above steps, the camera of the mobile phone 20 is aroused by the camera connection module 13 of the interactive system 10, so as to achieve interaction with the smart bracket 30.

[0094] The step (S1046) includes the following steps: (S10461) the mobile phones of user A and user B are fixed on their respective smart brackets; (S10462) user B inputs the command of "turn left" through his mobile phone; (S10463) user B's command of "turn left" is sent to user B's mobile phone through the network; (S10464) user B's mobile phone receives and analyzes the signal; (S10465) user B's mobile phone sends the processed signal to its smart bracket via Bluetooth; (S10466) user B's smart bracket receives and executes the command of "turn left", driving user B's mobile phone to turn left; and (S10467) the user obtains the field of view after user B turns left.

[0095] By connecting their respective mobile phones to the smart bracket 30, two users can achieve physical interaction with each other and perform two-way remote control.

[0096] In addition, users can use the front camera of the mobile phone to recognize simple gestures and customize commands to operate the robot's actions according to the gestures. For example, when recognizing an eight-shaped gesture, the robot can be customized to move forward; when recognizing a gesture with five fingers open, the robot can be customized to stop moving; when recognizing an upward scissors hand gesture, the front camera can be customized to take a photo; when recognizing a downward scissors hand gesture, the rear camera can be customized to take a photo. All gestures and customized operations can be customized through the transformation interface 113. Users only need to understand the relevant gestures and customization instructions through the help interface 1153.

[0097] The user can also use the mobile phone 20 to display different interfaces and interactive expressions to achieve information and emotional interaction with the robot, realize the anthropomorphism of the robot through expressions and coordinated actions, and achieve the best anthropomorphic effect and achieve the purpose of entertainment by designing corresponding actions to match the expressions.

[0098] It should be understood by those skilled in the art that the embodiments of the present invention described above and shown in the accompanying drawings are only examples and do not limit the present invention. The purpose of the present invention has been fully and effectively achieved. The functional and structural principles of the present invention have been demonstrated and explained in the embodiments, and the embodiments of the present invention may be deformed or modified in any way without departing from the principles.

Claims

1. An interactive system, the interactive system is set in a mobile phone, the mobile phone is fixed to a smart bracket for communication, characterized in that: The interactive system comprises: A user interface suitable for touch screen interaction and operation; A Bluetooth connection module, which establishes a connection between the mobile phone and the smart bracket by calling Bluetooth; a camera connection module to enable the camera of the mobile phone to perform visual interaction; a control module, which controls various components of the smart bracket, drives the mobile phone to move, and realizes tangible interaction between the user and the smart bracket; and A central processor is connected to the Bluetooth connection module, the camera connection module and the control module, and receives, calls, analyzes and processes various data information of the mobile phone and the smart bracket, so that the user can realize intelligent interaction with the smart bracket through the camera and microphone of the mobile phone.

2. The interactive system according to claim 1, wherein the interactive system further comprises a voice recognition module connected to the central processor, wherein the voice recognition module accesses the voice service, and the user realizes voice interaction with the smart bracket through the microphone of the mobile phone.

3. The interactive system according to claim 1, wherein the interactive system further comprises a motion module, which establishes a connection between the motion sensors of the mobile phone and the smart bracket, senses the motion status of the smart bracket, and controls the smart bracket to drive the mobile phone to conduct autonomous environmental exploration.

4. The interactive system according to claim 1, wherein the interactive system further comprises a light module that establishes a connection between the mobile phone and the light sensor of the smart bracket, suitable for sensing a dark environment and controlling the opening and closing of the lighting device of the smart bracket.

5. The interactive system according to any one of claims 1 to 4, wherein the environmental data of the smart bracket is obtained through the camera connection module to realize SLAM monocular mapping, face recognition and tracking, tracking, gesture recognition and interaction, and video physical interaction with another mobile phone installed with the interactive system.

6. An interactive system according to any one of claims 1 to 5, wherein the user interface comprises a robot interface, a remote control interface, a programming interface, a floating window interface and a main interface, and a user is suitable for calling up the robot interface, the remote control interface, the programming interface and the floating window interface through the main interface, and enabling the connection between the mobile phone and the smart bracket through each interface.

7. The interactive system according to claim 6, wherein the smart bracket comprises a device body, a connecting device, an information processing module and a functional component, the connecting device is movably arranged on the device body to connect and fix the mobile phone, and the device body drives the mobile phone to move, wherein the information processing module is arranged inside the device body to achieve connection with the mobile phone through the interactive system, and the functional component is arranged on the device body and connected to the information processing module to control the functional component to execute corresponding instructions through the mobile phone.

8. An interaction method, suitable for a user to control a smart bracket and interact with the smart bracket through a mobile phone, characterized in that: The following steps are involved: (S101) An interactive system is placed on a mobile phone, and the mobile phone is fixed to a smart bracket for communication; (S102) the user controls the interactive system through a user interface placed on the mobile phone; (S103) the interactive system obtains the authority to call, receive, analyze and process the information of the mobile phone and the smart bracket; (S104) the mobile phone serves as a master to control the smart bracket; as well as (S105) The smart bracket analyzes and processes various instructions of the mobile phone to achieve intelligent interaction with the user.

9. The interactive method according to claim 8, wherein the step (S104) comprises the following steps: (S1041) the smart bracket performs face recognition and tracking through the camera of the mobile phone; (S1042) The user conducts visual interaction with the smart bracket via the camera of the mobile phone; (S1043) The user conducts voice interaction with the smart bracket via the microphone of the mobile phone; (S1044) The mobile phone senses the motion state of the smart bracket via a motion sensor; (S1045) The mobile phone senses the dark environment via a light sensor and controls the opening and closing of the lighting device of the smart bracket; (S1046) The user uses voice, gestures and screen triggers via the mobile phone to realize video calls with another mobile phone installed with the interactive system and physical interaction of two-way remote control.

10. The interactive method according to claim 9, wherein in the step (S101), the interactive system sends a pitch signal to the mobile phone, the mobile phone controls the smart bracket to drive the mobile phone to perform a pitch movement, and the acceleration sensor of the mobile phone confirms whether the connection status between the mobile phone and the smart bracket is good according to the change in acceleration during the pitch movement.

11. The interactive method according to any one of claims 8 to 10, wherein the step (S103) comprises the following steps: (S1031) The interactive system establishes a connection with the camera, microphone, acceleration sensor, and gyroscope of the mobile phone; (S1032) The interactive system and the mobile phone establish a connection with the motor, servo, power supply, sensor, and lighting device of the smart bracket; (S1033) The interactive system is suitable for calling, receiving, analyzing, processing, and sending various sensor data and interactive signals of the mobile phone and the smart bracket.

12. The interactive method according to claim 11, wherein the mobile phone plans the driving route of the smart bracket through the interactive system, controls the smart bracket to perform autonomous environmental exploration, and obtains environmental data through the camera of the mobile phone to realize SLAM monocular mapping.

13. The interactive method according to claim 12, wherein the interactive system runs in the background of the mobile phone or floats on the interface of the mobile phone through a floating window, and the user performs remote control, programming and management operations through the user interface of the interactive system.

Images