Video Writing Extraction for Automatic Lecture Note Capture

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing e-learning technologies require learners to manually take notes of instructor's writing in videos, leading to inconvenience and potential missed content.

Innovation Solution

An electronic device and method that automatically identifies and records writing information in videos, modifying images based on detected changes such as corrections, additions, or area adjustments, and displays them in a separate area of the screen.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If learners manually take notes of writing information in video lectures, then they can record the content, but they must pause the video which causes them to miss lecture content

Engineering Contradiction:
Improvelecture contentVSAvoidnote-taking process
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The system automatically captures and copies writing information from the video frame by frame, converting it into a separate note document. This eliminates the need for manual note-taking and video pausing, as the writing information is automatically extracted and recorded while the video continues to play.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces the manual mechanical process of pausing video and writing notes with an automated computer vision system that detects writing areas in video frames, extracts the writing information, and records it automatically. This substitution eliminates the need for user intervention in the note-taking process.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If the system displays the entire video screen, then all content is visible, but writing information cannot be clearly distinguished from other video elements

Engineering Contradiction:
Improvewriting information detectionVSAvoiddisplay area
Core Design Contradiction:
Measurement precisionVSArea of stationary object

Solution Approach 1:

The system extracts the writing information from the entire video frame by identifying specific writing areas using computer vision algorithms. The extracted writing information is then displayed in a separate dedicated area, separating it from the main video content and other visual elements, thereby improving detection precision and readability.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent segments the video frame into different regions, identifying the writing area distinct from other video elements. The writing information is extracted from this segmented region and displayed separately, allowing for clear distinction and focused analysis of the writing content without interference from other video elements.

Inventive Principle:
Principle #1Segmentation

3Loss of information

If the system processes and displays all writing information in real-time, then complete information is provided, but system resources are heavily consumed

Engineering Contradiction:
Improvewriting information completenessVSAvoidsystem resource consumption
Core Design Contradiction:
Loss of informationVSUse of energy by moving object

Solution Approach 1:

The system performs partial processing by focusing only on identifying and extracting writing information from specific regions of the video frame, rather than processing the entire frame in detail. This selective approach maintains information completeness while reducing the computational load and resource consumption.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system performs preliminary identification of writing areas in each video frame before full processing. By pre-identifying regions containing writing information, the system can then focus computational resources only on those specific areas, reducing overall processing requirements while ensuring no writing information is missed.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS12632642B2Electronic device for displaying and modifying images, and control method
Publication Date: 2026.05.19 SAMSUNG ELECTRONICS CO LTD
  • US12632642B2 patent drawing
  • US12632642B2 patent drawing
  • US12632642B2 patent drawing

AI summary

A control method for an electronic device includes displaying a video in a first area of a display; identifying a writing area, including at least one piece of writing information, from the video displayed in the first area; acquiring a first image corresponding to the identified writing area, so as to display the first image in a second area of the display; based on a change being detected in the at least one writing information, identifying a type of the change; and acquiring a second image formed by correcting a first image based on the type of the identified change, so as to display the second image in the second area.