Hint-Based Media Tagging System for Social Networks

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Social networking systems face inefficiencies in image tagging, relying on manual processes that can be time-consuming and prone to errors, especially when dealing with large volumes of media content.

Innovation Solution

Implementing a system that uses hints from social networking data, such as comments and natural language processing, to suggest tags for users, including facial recognition and social graph analysis to provide relevant tag suggestions in real-time.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual tagging processes are used for image tagging in social networking systems, then users can provide contextual information and identify objects, but the process becomes time-consuming and error-prone when dealing with large volumes of media content

Engineering Contradiction:
Improvetagging accuracyVSAvoidtagging time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary actions by automatically generating tag suggestions using image recognition technology before the user completes the tagging process. The system analyzes the image content, identifies objects, people, and scenes, and pre-populates a list of relevant tags that the user can then review and select, thereby reducing the time required for manual tagging while maintaining accuracy.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system enables self-service tagging by allowing the automatic image recognition system to generate tag suggestions based on the image content itself. The technology autonomously analyzes visual elements, extracts meaningful information, and provides tagging recommendations without requiring extensive manual intervention, thus reducing both time consumption and potential errors in the tagging process.

Inventive Principle:
Principle #25Self-service

2Productivity

If automated image recognition is implemented to reduce manual tagging effort, then tagging speed increases, but the system complexity and computational requirements increase

Engineering Contradiction:
Improvetagging speedVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system segments the tagging process into distinct functional modules: image preprocessing, feature extraction, object recognition, tag generation, and user interface presentation. Each module handles a specific aspect of the tagging workflow, allowing the complex automated recognition task to be broken down into manageable components that can be processed independently and efficiently.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system introduces an intermediary layer between the image input and the final tags output. This intermediary consists of multiple processing stages including feature detection, object classification, and confidence scoring mechanisms that translate raw image data into structured tag suggestions. This intermediary architecture manages system complexity by providing clear interfaces between different processing components.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If comprehensive tag suggestions are provided to users, then tagging accuracy improves, but the information processing load and computational resources increase

Engineering Contradiction:
Improvetagging accuracyVSAvoidcomputational energy
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The system applies partial action by generating a prioritized list of tag suggestions rather than exhaustively analyzing every possible tag. The image recognition system focuses on identifying the most prominent and relevant objects, people, and scenes in the image, generating tag suggestions for the top detected elements. This approach provides sufficient tagging accuracy for the most important content while significantly reducing computational energy requirements compared to comprehensive analysis of all potential tags.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system dynamically adjusts processing parameters such as confidence thresholds, detection sensitivity, and tag generation depth based on image characteristics and user context. By changing these parameters, the system can optimize the balance between tagging accuracy and computational energy consumption, providing comprehensive suggestions when needed while reducing processing load for routine images.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS10528591B2Methods and systems for using hints in media content tagging
Publication Date: 2020.01.07 META PLATFORMS INC
  • US10528591B2 patent drawing
  • US10528591B2 patent drawing
  • US10528591B2 patent drawing

AI summary

Techniques to allow a social networking system to provide hints when a user tags an image. In one embodiment, a comment associated with an image to be tagged by a user of a social networking system is received. A hint based on the comment that is suggestive of at least one aspect relating to the image is identified. A set of candidate tags associated with the user is determined. At least one suggested tag from the set of candidate tags is selected based on the hint. The at least one suggested tag is provided for the user to potentially tag the image.