Semantic Notation Embedding in Visual Content for Search

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Structured data loses its semantic structure when copied from websites and pasted into notebook applications, making it difficult to search, edit, and manage effectively.

Innovation Solution

Introducing semantic notation into visual content to preserve and enhance the structured data, allowing it to be searched and managed like structured data while maintaining the ability to edit the content without disrupting existing editing tools.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If semantic notation is introduced into visual content to preserve structured data, then searchability and data management capability are improved, but device complexity increases

Engineering Contradiction:
ImprovesearchabilityVSAvoidcontent store complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent embeds semantic notation within the existing HTML structure of visual content, nesting structured data representations inside the visual content elements. This allows search functionality to be added without replacing the entire content store architecture, thus improving searchability while controlling complexity increase.

Inventive Principle:
Principle #7Nested doll (Nesting)

Solution Approach 2:

The patent introduces an intermediary layer of semantic notation that sits between the visual content and the search/query processing layer. This intermediary enables structured data extraction and search capabilities without requiring fundamental changes to the existing content store or visual editing tools.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If semantic notation is added to visual content to enable structured data management, then data management capability is improved, but ease of operation deteriorates

Engineering Contradiction:
Improvedata management capabilityVSAvoiduser editing experience
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent extracts the structured data representation into separate semantic notation elements that are independent from the visual content display. This allows users to continue editing visual content normally while the semantic notation handles the structured data management aspects, preserving ease of operation.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The semantic notation acts as an intermediary that handles structured data management operations separately from user editing operations. Users interact with visual content through existing tools while the semantic notation layer manages structured data queries, joins, and searches without interfering with user editing experience.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Loss of information

If semantic notation is introduced to preserve structured data, then loss of information is reduced, but device complexity increases

Engineering Contradiction:
Improvesemantic structure lossVSAvoidcontent store structure
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent nests semantic notation within the existing HTML content structure, embedding structured data representations inside visual content elements. This approach preserves semantic information without requiring a completely new storage system, thus reducing information loss while limiting the increase in overall system complexity.

Inventive Principle:
Principle #7Nested doll (Nesting)

Solution Approach 2:

The patent makes the content store universal by enabling it to handle both visual content and structured data through the addition of semantic notation. Existing content store infrastructure is reused for both purposes, reducing the need for separate systems and thereby limiting complexity increase while preventing information loss.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10706124B2Storage and retrieval of structured content in unstructured user-editable content stores
Publication Date: 2020.07.07 MICROSOFT TECHNOLOGY LICENSING LLC
  • US10706124B2 patent drawing
  • US10706124B2 patent drawing
  • US10706124B2 patent drawing

AI summary

Systems and techniques are disclosed for enabling structured data to be associated with visual content in a manner that preserves the ability to edit the visual content using a content application such as a notebook application. Techniques and systems enable semantic notation to be introduced into selected regions of the visual content that indicate the visual content's structured data, allowing the content to be searched and accessed more easily by common search technologies and search engines. The semantic notation is assigned to the visual content so that the introduction of the semantic notation does not hinder the user's viewing or editing of the visual content with a content application. The inclusion of the semantic notation does not cause existing visual editing tools that do not understand the semantic notation to cease to function properly.