Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Physical programming-based multi-modal interaction method and related equipment

A technology of physical programming and interactive methods, applied in the field of multi-modal interactive methods and related equipment based on physical programming, can solve the problems of uneconomical and inability to meet the multi-purpose of one machine, and achieve the effect of improving learning interest and enriching interaction

Pending Publication Date: 2022-04-29
HANGZHOU CHOHOO SMART TECH CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] At present, the physical programming equipment on the market cannot meet the multi-purpose of one machine, and each machine has its own special playing method.
If you want to have a new modeling programming machine, new gameplay requires new purchases, which is very uneconomical in terms of teaching costs or family costs

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Physical programming-based multi-modal interaction method and related equipment
  • Physical programming-based multi-modal interaction method and related equipment
  • Physical programming-based multi-modal interaction method and related equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0043] Such as figure 1 As shown, the present invention provides a kind of multimodal interaction method based on programming in kind, comprising:

[0044] S11, acquiring or identifying multimodal interaction instructions through the physical programming device interaction interface;

[0045] It should be noted that the multi-modal interaction described in the present invention is a form of human-computer interaction in which multiple senses are integrated. Through the processing and output of various data such as text, voice, vision, action, and environment by smart devices, it fully simulates the interaction between people. In the multi-modal interaction with the device, the output signals for people include but are not limited to visual, auditory, tactile and emotional aspects.

[0046]In this embodiment, the multi-modal interaction instructions include user-touch instructions, physical programming block execution instructions, or interactive mode instructions;

[0047] ...

Embodiment 2

[0054] Obtaining a multimodal interaction instruction through the physical programming device interaction interface, when the multimodal interaction instruction is a user touch instruction, and the current programming interaction entry is role confirmation entry 2;

[0055] The physical programming device analyzes the user's touch instruction to obtain an instruction for character confirmation, and outputs the character matching result as a feedback.

[0056] Such as Figure 2-3 As shown, the multi-modal interaction method of the embodiment of game programming with the programming interaction entry as the physical programming entry, the role confirmation entry, and the color selection entry as the embodiment is:

[0057] S21, the student displays all roles through the role confirmation portal;

[0058] In this game, the interactive interface of the physical programming device is an intelligent learning desktop display, and the character confirmation entrance displays several ...

Embodiment 3

[0073] Such as Figure 4-5 As shown, as an example, the multi-modal interaction method of animation programming based on the character confirmation entry as an example is:

[0074] S31, the student displays the animation character through the character confirmation entrance;

[0075] S32, the interactive interface of the physical programming device obtains the user's touch command to confirm the animated character;

[0076] Same as the game programming in Embodiment 2, the left side of the intelligent learning desktop is the physical code area, and the animation playback effects, playback speed, sound effects, and loop parameters can be set through the physical code blocks, so that each student’s animation is different ; The middle area is the animation creation and editing area and the animation display area. The two-in-one area makes better use of the space; the right area is also the animation character recognition area and the paint tray.

[0077] S33, the physical progr...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to the technical field of children programming education, and provides a multi-modal interaction method based on physical programming, which is provided with a plurality of programming interaction entrances such as a physical programming entrance, a role confirmation entrance, a color selection entrance, a film identification entrance and an intelligent hardware identification entrance. The physical programming device and intelligent hardware or programming blocks which are connected with or recognized by the physical programming device can be integrated, so that the programming machine has multiple playing methods and can recognize other intelligent hardware, the effect that one machine has multiple purposes is achieved, students can select one or more of different programming interaction entrances for programming, and the programming efficiency is improved. And the students can keep certain curiosity and enthusiasm.

Description

technical field [0001] The invention relates to the technical field of children's programming education, in particular to a multi-modal interaction method based on physical programming and related equipment. Background technique [0002] Object programming is based on a graphical programming language, which materializes the code blocks on the screen to express the program logic. [0003] At present, the physical programming equipment on the market cannot meet the multi-purpose of one machine, and each machine has its own dedicated gameplay. If you want to have a new modeling programming machine, new gameplay requires new purchases, which is very uneconomical in terms of teaching costs or family costs. [0004] Therefore, there is a need for a multi-modal interaction method based on physical programming, which can integrate physical programming equipment with intelligent hardware or programming blocks that are connected or recognized by physical programming equipment, so tha...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/0488G06F3/0484G06F3/04842G06F3/04845G06F8/34G09B19/00
CPCG06F3/0488G06F3/0484G06F3/04842G06F3/04845G06F8/34G09B19/0053
Inventor 应宏张炜张潇殷慧青
Owner HANGZHOU CHOHOO SMART TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com