Lecture Video Editing via Importance Level Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for editing lecture-containing videos, such as those described in Patent Document 1, may incorrectly determine the importance of sections where a teacher is performing board writing, potentially losing important information about the order of board writing or sections written with a red pen, which are crucial for learning.

Innovation Solution

An information processing device and method that generate information for reproduction assistance by determining importance levels for sections of a lecture video and sound based on associated information, including board writing activities, to ensure that important sections are not deleted or compressed inadvertently.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If importance level determination is performed based on speech time, volume, gesture, and emotion of the teacher, then the editing efficiency is improved, but the importance level of board writing sections is incorrectly determined to be low, causing loss of important learning information

Engineering Contradiction:
Improveediting efficiencyVSAvoidboard writing order information
Core Design Contradiction:
ProductivityVSLoss of information

Solution Approach 1:

The video is divided into multiple sections based on speech time, and importance levels are determined for each section. This segmentation allows the system to evaluate different types of content (speech vs. board writing) separately and assign appropriate importance levels to each, preventing the loss of board writing information while maintaining editing efficiency.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different importance levels are assigned to different sections of the video based on their specific characteristics. Sections containing board writing are identified and assigned high importance levels, while sections with only speech are evaluated based on speech characteristics. This local differentiation ensures that board writing order information is preserved while still enabling efficient editing.

Inventive Principle:
Principle #3Local quality

2Productivity

If sections with low importance levels are deleted to reduce data volume, then the learning efficiency is improved, but important board writing sections may be incorrectly deleted

Engineering Contradiction:
Improvelearning efficiencyVSAvoidcritical learning content
Core Design Contradiction:
ProductivityVSLoss of information

Solution Approach 1:

The system performs preliminary analysis of the video to determine importance levels of different sections before deletion. By pre-identifying sections containing board writing and assigning them high importance levels, the system ensures that critical learning content is protected from deletion while still removing non-essential sections to reduce data volume and improve learning efficiency.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses feedback from the importance level determination to guide the deletion process. Sections with high importance levels (including board writing sections) are protected from deletion, while sections with low importance levels are candidates for removal. This feedback mechanism ensures that critical learning content is retained while achieving data volume reduction.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS20230141178A1Information processing device, generation method, and program
Publication Date: 2023.05.11 SONY GROUP CORP
  • US20230141178A1 patent drawing
  • US20230141178A1 patent drawing
  • US20230141178A1 patent drawing

AI summary

There is provided an information processing device, a generation method, and a program that are capable of editing or reproducing a lecture-containing video in an appropriate form. The information processing device includes a generation unit configured to generate information for reproduction assistance, depending on importance levels each determined for one of predetermined sections generated by dividing data including a video and a sound of a lecture. The importance levels are determined on the basis of information associated with the lecture. The present technology can be applied to, for example, a lecture capture system used for imaging a lecture.