Massage manipulator training method based on deep reinforcement learning

A technology that strengthens learning and training methods, applied in the field of manipulators, can solve problems such as scarcity, incomplete application, and difficulty in implementation, and achieve the effects of improving professionalism, reducing fatigue work, and reducing costs

Active Publication Date: 2019-02-01
SHANDONG NORMAL UNIV
View PDF10 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Due to the high-dimensional sample complexity and other physical limitations of the reinforcement learning algorithm, the combination of deep learning and reinforcement learning greatly reduces the dimension and complexity of the data, but it is currently only in the simulation state and cannot be fully applied to the actual

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Massage manipulator training method based on deep reinforcement learning
  • Massage manipulator training method based on deep reinforcement learning
  • Massage manipulator training method based on deep reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] It should be pointed out that the following detailed description is exemplary and intended to provide further explanation to the present application. Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs.

[0026] It should be noted that the terminology used here is only for describing specific implementations, and is not intended to limit the exemplary implementations according to the present application. As used herein, unless the context clearly dictates otherwise, the singular is intended to include the plural, and it should also be understood that when the terms "comprising" and / or "comprising" are used in this specification, they mean There are features, steps, operations, means, components and / or combinations thereof.

[0027] As introduced in the background technology, in the prior art, the massage manipulator is only in a simula...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a massage manipulator training method based on deep reinforcement learning. The problems that in the prior art, the action of a massage manipulator is only in a simulation state, and the massage action is not accurate enough are solved. The massage manipulator training method has the effects of enhancing the skill of the massage manipulator, providing professional and accurate massage, and reducing the fatigue of manual massage. The massage manipulator training method comprises the following steps that actions and pressure data are acquired, the data are processed, a reference action set and a reference pressure set are constructed, and a pressure value comfort range is set; the data, the reference action and the reference pressure are input into a neural network tobe predicted and decided, an action value and a pressure value corresponding to the output decision of the neural network are executed, and the action value and the pressure value are compared with the reference action and the pressure value comfort range; and the trained network is connected with a control system of the massage manipulator after the set condition is met.

Description

technical field [0001] The invention relates to the field of manipulators, in particular to a massage manipulator training method based on deep reinforcement learning. Background technique [0002] Nowadays, the mechanical equipment used for massage is not diversified. Most of them are single-function or multi-functional massagers, massage chairs, etc., with few movements and mechanization. It is difficult to grasp the use of force, and cannot provide users with more comfortable, More professional service. Manual massage movements are delicate and soft, especially professional massage, which is highly skilled and skillful. However, the number of professional masseuses is small, and they cannot provide services anytime and anywhere, and the cost is relatively high, so they cannot meet the needs of ordinary people. [0003] With the development of artificial intelligence and the continuous improvement of productivity requirements, industrial robotic arms have been used in mo...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): B25J9/16B25J11/00G16H40/40G16H40/63
CPCB25J9/163B25J11/00G16H40/40G16H40/63
Inventor 范一诺王翔宇丁萌任晓惠汪浩陆佃杰张桂娟
Owner SHANDONG NORMAL UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products