Graphical user interface for human-machine interaction with a physical robot

Abstract

1. The name of the design product: graphical user interface for human-computer interaction of physical robot. 2. The use of the design product: robot state display and human-computer interaction; screen display interface for various intelligent terminals. 3. The design points of the design product: in the pattern. 4. The picture or photo that best indicates the design points: front view. 5. The use of the graphical user interface: for robot user DIY programming and execution, voice interactive task execution, voice interactive question and answer learning. 6. The human-computer interaction mode of the graphical user interface: 1, the start-up loading interface, when the loading waiting interface is displayed as interface change state figure 1 state. After starting, the interface is displayed as the main view state. In the main view state, the facial expression interface can have several expressions, simulating various emotional states of humans. The function bar above the main view interface is provided with the current default task name (the task name can be selected in the task list of the program setting interface), the state indicating light (green when waiting for task execution, blue when executing task, and red when stopping task execution), the 【run】 button, the 【stop】 button, the voice indicating light (green when voice input is allowed), the input content display box (displayed after voice recognition, and can also be typed), and the 【conversation】 button (used when non-voice input). 2, when the voice or text input "please broadcast the weather forecast", the input content display box displays the voice recognition content, and the information bar at the bottom of the interface displays the response content (click to display the response information). 3, in the main view interface, click the 【run】 button, the current default task name ("broadcast the weather forecast") starts execution, the state indicating light is blue, and the information bar at the bottom of the interface displays the task content being executed, see interface change state figure 2. 4, in the main view, click the product name (Yuzhixing brain...) in the upper left corner to enter the program setting interface. The user can select the default task name for the main view from the task list in the interface, and the user can also edit and execute DIY tasks for the robot in the interface, see state 3. 5, edit task state: in the program setting interface, click the product name (Yuzhixing brain...) in the upper left corner, then an input management password dialog box will pop up, see state 4. After entering the correct password, enter the program setting interface (for task editing), the leftmost side appears the operation button of the editable task, see interface change state figure 5. (1) new task name - click the 【new】 button, then a "please enter the file name" dialog box will pop up, see interface change state figure 6. After inputting the new file name, click the 【Yes】 button, a new task file is generated, see the interface state chart 7. (2) Edit task content - select the task name "test1.py", click the 【edit】 button to pop up the edit file dialog box, you can edit the task content, see the interface state chart 8. (3) Delete task name - select the task name "test1.py", click the 【delete】 button to pop up the "confirm delete this file" dialog box, you can delete the task name, see the interface state chart 9. 6, the execution state of the task: in the program setting interface, select a task name, click the 【run】 button, start executing the selected task, the task execution state indicator light is blue, the task completion state indicator light is green, and the interface below displays the running result, see the interface state chart 10. 7, man-machine interactive learning state: question and answer mode program can edit state (see interface state chart 5), click the 【learn】 button to enter the man-machine interactive learning interface, see the interface state chart 11. The interface is initially defaulted to the question and answer mode, and the round button below the figure is green (start learning). In the question and answer mode, the machine has the output display of the corresponding content after the voice input sentence content. For example, when the voice input is "hello", the answer area responds "hello". Learning mode in question and answer mode (interface state chart 11), user voice input "XX start learning" (XX is the nickname of the robot, which can be specified by the user), or click the 【start learning】 button, enter the voice interactive learning interface, the round button below turns blue, and the information bar content corresponding to the learning action-task is popped up, including robot action, task, picture and video learning content, see the interface state chart 12. The information content of the original state of this interface is empty, and when the user interacts with the system, the information bar displays, for example, when the user says "please say hello" ("please say" is a special prefix word), "hello" is displayed in the please say bar, and when the user says "answer you are also very good" ("answer" is a special prefix word), "you are also very good" is displayed in the answer bar. The voice learning mode of other actions, tasks and other contents is similar and will not be described here. In addition to voice input content, learning can also be done through manual typing input and sliding wheel selection. When all the learning information input interface content is completed, see the interface state chart 13. When the voice input is "this sentence learning is completed", or the 【this sentence learning is completed】 button is clicked, the relevant learning result is prompted. If uploading learning success interface, see interface change state diagram 14, if learning fails, see interface change state diagram 15. When the user voice input "XX exits learning", or clicks the 【stop learning】 button, exit the current learning mode, and return to the question and answer mode of interface change state diagram 11.

Images