Smartphone Audio Interception for Transaction Verification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Visually impaired individuals face challenges in verifying financial transaction amounts during contactless payments, relying on cashiers for accuracy, which can lead to potential fraud and discomfort, and existing solutions interfere with timely authorization or require substantial changes to legacy systems.

Innovation Solution

A smartphone-based system that stores payment card details, captures and processes images of payment cards using optical character recognition, and audibly communicates transaction amounts and account balances, ensuring timely authorization without disrupting existing financial processes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If visually impaired consumers rely on cashiers to state transaction amounts, then the transaction process remains simple and fast, but the accuracy and reliability of transaction amount verification deteriorates due to potential fraud

Engineering Contradiction:
Improvetransaction amount verification reliabilityVSAvoidtransaction verification system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system provides real-time audible feedback to the visually impaired consumer by capturing the point-of-sale terminal's audio output, extracting the transaction amount, and playing it back through the smartphone's speaker. This closed-loop feedback mechanism allows the consumer to verify the charged amount immediately during the transaction, eliminating reliance on cashier honesty while maintaining system simplicity.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The smartphone acts as an intermediary device between the point-of-sale terminal and the visually impaired consumer. It captures the terminal's audio announcements, processes the transaction amount information, and delivers it to the consumer in an accessible format, bridging the information gap without requiring changes to the existing payment infrastructure.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If text messages or phone calls are sent to verify transactions, then fraud detection capability is improved, but the transaction authorization time increases

Engineering Contradiction:
Improvefraud detection capabilityVSAvoidtransaction authorization time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs transaction verification in advance by capturing and analyzing the point-of-sale terminal's audio announcement of the transaction amount before the consumer completes the payment. This preliminary verification allows the visually impaired consumer to confirm the correct amount is being charged while the authorization process is still pending, enabling informed decision-making without delaying transaction completion.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system maintains continuous monitoring of the point-of-sale terminal's audio output throughout the transaction process, allowing real-time verification of transaction amounts. This continuous action ensures that fraud detection occurs seamlessly during the natural flow of the transaction rather than requiring separate verification steps that would interrupt or delay authorization.

Inventive Principle:
Principle #20Continuity of useful action

3Productivity

If visually impaired consumers wait until later to verify payment history, then the transaction process remains uninterrupted, but the ability to detect fraud timely deteriorates

Engineering Contradiction:
Improvetransaction processing efficiencyVSAvoidfraud detection time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system provides immediate audible feedback of the transaction amount to the visually impaired consumer during the point-of-sale interaction, eliminating the need to wait for later payment history verification. This real-time feedback loop enables instant fraud detection while maintaining uninterrupted transaction processing, as the consumer can verify the amount is correct before completing payment.

Inventive Principle:
Principle #23Feedback

4Ease of operation

If smartphone audio capabilities are used to read transaction details, then accessibility for visually impaired users is improved, but the system requires integration with existing payment infrastructure

Engineering Contradiction:
Improveaccessibility for visually impaired usersVSAvoidsystem integration complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The smartphone application serves as an intermediary that leverages existing audio capture capabilities to intercept and process the point-of-sale terminal's spoken announcements. By using the smartphone's microphone to capture the terminal's audio output and its text-to-speech or speech-to-text capabilities to extract and communicate transaction amounts, the system improves accessibility without requiring modifications to the payment terminal or infrastructure.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system utilizes the smartphone's existing audio processing capabilities, including the microphone for capturing terminal announcements and the speaker for delivering verified transaction information to the user. This self-service approach leverages already-available hardware and software features to provide accessibility enhancements without requiring additional specialized equipment or complex external system integrations.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS10607213B2Method and system of providing financial transactions for the visually impaired
Publication Date: 2020.03.31 MASTERCARD INT INC
  • US10607213B2 patent drawing
  • US10607213B2 patent drawing
  • US10607213B2 patent drawing

AI summary

A method for audibly communicating transaction details includes: storing payment card details for a payment card, the card details including a payment card number; receiving transaction details for a financial transaction involving the payment card, the transaction details including a transaction amount; and audibly emitting the transaction amount for the financial transaction. A method for audibly communicating account information which includes: capturing an image of a payment card; processing the captured image of the payment card to identify payment card details, the card details including a payment card number; transmitting the identified card details; receiving account details for a financial account associated with the payment card, the account details including at least an account balance; and audibly emitting the account balance for the financial account.