Image Search Method Using Device Motion Detection and Object Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image search methods are inefficient and inaccurate due to the need for user intervention to obtain and upload images, which can result in wasted time and reduced accuracy due to large image sizes and inclusion of irrelevant objects.

Innovation Solution

A method that monitors the moving state of a computing device to automatically obtain and process images, determining a target object's coordinates within the image to extract a relevant image portion, thereby reducing user interaction and improving search efficiency and accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a user manually presses a shooting button to obtain an image for search, then the image can be obtained, but user operations increase and time is wasted

Engineering Contradiction:
Improveuser operationVSAvoidtime
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The system uses the computing device's own movement detection capabilities to automatically trigger image capture without requiring user intervention. The camera automatically photographs the target object when the device is held steady, making the system self-service and eliminating the need for manual button pressing.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system performs preliminary detection of the computing device's movement state before capturing the image. By monitoring whether the device meets preset stability conditions, the system prepares to capture the image at the optimal moment automatically, rather than waiting for user input.

Inventive Principle:
Principle #10Preliminary action

2Productivity

If the entire to-be-searched image is used for search, then the search process is simple, but image search accuracy decreases due to large image size and inclusion of irrelevant objects

Engineering Contradiction:
Improvesearch efficiencyVSAvoidimage search accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The system segments the to-be-searched image into multiple regions based on object detection results. By identifying the specific region containing the target object and separating it from the rest of the image, the system creates a focused search image that improves accuracy while maintaining efficiency.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system extracts the target object or the region containing the target object from the original to-be-searched image. This extraction creates a cleaned-up search image that removes irrelevant objects and background noise, thereby improving search accuracy without significantly impacting search efficiency.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS12072926B2Image search method and computing device
Publication Date: 2024.08.27 SHANGHAI BILIBILI TECH CO LTD
  • US12072926B2 patent drawing
  • US12072926B2 patent drawing
  • US12072926B2 patent drawing

AI summary

This application provides techniques of searching images. The techniques comprise monitoring a moving state of a first computing device; controlling the first computing device to obtain an image comprising a target object to be searched in response to determining that the moving state of the first computing device meets a preset condition; determining a first coordinate group of the target object in the image; acquiring a target image of the target object from the image based on the first coordinate group; determining, based on the target image, a search result related to the target object and displaying the search result.