Autonomous Vehicle Lost Item Detection via Image Comparison

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In autonomous vehicles providing shared mobility services, there is a challenge in managing lost items while protecting passenger privacy, as existing systems lack effective methods to sense and handle lost items without violating privacy regulations.

Innovation Solution

A system and method that utilize a vision sensor to capture interior images of an autonomous vehicle before and after passenger boarding/alighting, comparing these images to detect lost items and transmit relevant information to user terminals, while ensuring privacy by blurring or deleting regions of other passengers and using sensors like weight, ultrasonic, and radar to determine passenger presence and service completion.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the vehicle captures and transmits interior images to detect lost items, then the ability to sense lost items is improved, but passenger privacy is violated

Engineering Contradiction:
Improvelost item detection accuracyVSAvoidprivacy violation
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The system extracts only the necessary information (lost item detection) from the interior images while removing or blurring personally identifiable information about passengers. This allows the vehicle to maintain lost item detection capability while protecting passenger privacy by separating the useful detection function from the harmful privacy exposure.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The server acts as an intermediary between the vehicle's vision sensor and the user terminal. It receives interior images, processes them to detect lost items while protecting privacy, and transmits only the relevant lost item information to the user terminal, thereby mediating between detection needs and privacy protection requirements.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If the vehicle operates unmanned for shared mobility service, then operational efficiency is improved, but management of lost items and hygiene becomes difficult

Engineering Contradiction:
Improveoperational efficiencyVSAvoidlost item management
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The system implements self-service functionality where the autonomous vehicle automatically detects, identifies, and communicates lost item information to passengers without requiring manual inspection by operators. The vehicle autonomously compares interior images, detects lost items, and notifies users, enabling unmanned operation while maintaining effective lost item management.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system establishes a feedback loop where the vision sensor continuously monitors the interior, the server processes images and detects lost items, and the user terminal receives notifications. This automated feedback mechanism enables the unmanned vehicle to maintain effective lost item management through continuous monitoring and communication with passengers.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11507960B2System and method for handling lost item in autonomous vehicle
Publication Date: 2022.11.22 HYUNDAI MOTOR CO LTD
  • US11507960B2 patent drawing
  • US11507960B2 patent drawing
  • US11507960B2 patent drawing

AI summary

A system for handling a lost item in an autonomous vehicle and a server. The vehicle includes a vision sensor configured to respectively capture a first vehicle interior image and a second vehicle interior image when a passenger boards and alights from the vehicle. The vehicle is configured to transmit the captured first vehicle interior image and second vehicle interior image to the server. The server is configured to compare the first vehicle interior image with the second vehicle interior image and transmit lost item information to the passenger when the lost item in the vehicle is sensed.