Automatic Action Item Detection from Calls Without Manual Note-Taking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In call centers, representatives face challenges in efficiently taking notes during customer interactions to create action items, leading to inefficiencies and potential loss of details.

Innovation Solution

A system utilizing machine learning models, such as BERT, to transcribe audio streams, identify issues and action items, and generate real-time notifications for call center agents, allowing them to manage action items concurrently with customer interactions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If representatives manually take notes during customer interactions, then action items can be captured, but it occupies unnecessary time and prevents operators from engaging in the next customer interaction

Engineering Contradiction:
Improveaction item detailsVSAvoidoperator throughput
Core Design Contradiction:
Loss of informationVSProductivity

Solution Approach 1:

The system performs preliminary action by automatically generating action items during the customer interaction itself, rather than requiring post-interaction note-taking. The transcription service converts speech to text in real-time, and the machine learning model identifies and creates action items concurrently with the interaction, freeing the operator to focus on customer service.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system enables self-service by allowing the interaction data to automatically generate action items without human intervention. The machine learning model processes the transcribed text and autonomously creates structured action items with tasks, assignees, and due dates, eliminating the need for manual note-taking by representatives.

Inventive Principle:
Principle #25Self-service

2Loss of information

If representatives manually take notes during customer interactions, then action items can be captured, but it is difficult and time consuming to effectively take notes

Engineering Contradiction:
Improveaction item detailsVSAvoidnote-taking time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The system replaces the mechanical process of manual note-taking with an automated computational system. Speech is transcribed to text, and machine learning models automatically extract and structure action items, replacing the manual cognitive and physical effort of note-taking with automated processing.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The transcription service acts as an intermediary between the spoken interaction and the action item creation process. It converts speech to text, which then serves as input for the machine learning model that generates action items, creating a bridge that eliminates the need for manual note-taking while preserving all interaction details.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Productivity

If automated transcription and action item detection is implemented, then manual note-taking time is reduced, but system complexity increases

Engineering Contradiction:
Improveoperator throughputVSAvoidsystem architecture
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system achieves multi-functionality by combining speech-to-text transcription, natural language processing, action item detection, and task management into a single integrated platform. This universal system handles multiple functions that would otherwise require separate tools, justifying the increased complexity through consolidated functionality.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS12361347B1Automatic action item detection
Publication Date: 2025.07.15 AMAZON TECH INC
  • US12361347B1 patent drawing
  • US12361347B1 patent drawing
  • US12361347B1 patent drawing

AI summary

Systems and methods are described for automatic action item detection and generation. In some aspects, textual data, such as may be generated based on an interaction between at least two entities, may be received. At least one issue may be identified in the text using a first machine learning model. At least one action item, corresponding to the issue, may similarly be identified using a second machine learning model, with the action item including an action to be performed to resolve the at least one issue. The action item may be assigned to a queue of a plurality of queues based on attributes of the action item, with the queue corresponding to an action that is specified in the action item. In some aspects, a notification of the action item may also be provided, such as in real-time or near-real-time with the occurrence of the interaction between the two entities.