Image Warping Model for Autism Interaction Training

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for enhancing social skills in children with autism spectrum disorder lack effective techniques to create psychological stability and familiarity with others, which are crucial for improving interaction skills.

Innovation Solution

An interactive training system using an image warping model that converts images of unfamiliar individuals into familiar objects based on interaction frequency, with a head-mounted display and sensor system to monitor and adjust the similarity of converted images according to user stress levels.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Stability of the object's composition

If images of unfamiliar individuals are converted into familiar objects using image warping, then psychological stability and familiarity are improved, but the complexity of the system increases due to requiring image warping models and multiple processing devices

Engineering Contradiction:
Improvepsychological stabilityVSAvoidsystem complexity
Core Design Contradiction:
Stability of the object's compositionVSDevice complexity

Solution Approach 1:

The system divides the image processing task into distinct modules: a photographing device captures original images, an image warping device processes the images through trained models to generate converted images, and a display device presents the results. This segmentation allows each component to specialize in one function, improving overall system stability while managing complexity through modular design.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The image warping model is trained in advance using a dataset of images and their corresponding converted versions. This preliminary training phase stores learned transformation patterns in the model, enabling the system to perform real-time image conversion without complex runtime calculations, thereby enhancing psychological stability through consistent image transformation while reducing operational complexity.

Inventive Principle:
Principle #10Preliminary action

2Adaptability or versatility

If the similarity of converted images is adjusted according to interaction frequency, then interaction skills are enhanced, but the difficulty of detecting and measuring interaction frequency and stress levels increases

Engineering Contradiction:
Improveinteraction skill enhancementVSAvoidmeasurement difficulty
Core Design Contradiction:
Adaptability or versatilityVSDifficulty of detecting and measuring

Solution Approach 1:

The system incorporates sensors that detect the user's stress index in real-time and feed this information back to the image warping device. Based on the feedback, the system automatically adjusts the similarity parameter of converted images: when stress is high, images are made more similar to familiar objects to reduce anxiety; when stress is low, images maintain appropriate distinction. This closed-loop feedback mechanism enables adaptive interaction training while simplifying the measurement process through automated sensor-based detection.

Inventive Principle:
Principle #23Feedback

3Manufacturing precision

If multiple photographing angles are captured to create comprehensive image data, then the quality of image conversion is improved, but the loss of time for processing multiple images increases

Engineering Contradiction:
Improveimage conversion qualityVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system captures original images from multiple photographing angles in advance and stores them in the image warping device. During real-time operation, the pre-captured multi-angle images are readily available for rapid selection and conversion, eliminating the need for time-consuming on-the-spot multi-angle photography and processing, thus maintaining high conversion quality while reducing processing time.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS12033299B2Interaction training system for autistic patient using image warping, method for training image warping model, and computer readable storage medium including executions causing processor to perform same
Publication Date: 2024.07.09 SEOUL NAT UNIV HOSPITAL
  • US12033299B2 patent drawing
  • US12033299B2 patent drawing
  • US12033299B2 patent drawing

AI summary

There is provided a user interaction training system. The user interaction training system comprises: a photographing device configure to photograph an original image including a first object at a plurality of photographing angles; an image warping device configured to receive an image including a second object corresponding to a user and the original image including the first object photographed by the photographing device, and to generate a converted image converting the first object into a third object different from the first object based on characteristic information of the second object by using a pre-trained image warping model; and a display device configured to display the generated converted image.