Message Deliverability Scoring Using Error-Code Subscores
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
There is a lack of a comprehensive system to measure the performance, health, and functioning of outgoing network traffic messages, such as SMS and MMS, which often fail to reach their intended destinations due to various errors, leading to unnecessary costs for senders.
Innovation Solution
A deliverability scoring system that provides a single score representing the health and performance of network traffic messages, incorporating subscores for sent rate, compliance, fraud, latency, and engagement, calculated based on error codes and performance metrics, with recommendations for improvement.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If network traffic messages are transmitted to multiple destinations, then the coverage and reach of messaging is improved, but the cost increases and delivery reliability decreases due to various errors
Solution Approach 1:
The system implements feedback by monitoring actual error codes returned from message transmission attempts and using this information to calculate deliverability scores. The system continuously receives feedback about message delivery outcomes (successes and failures) and adjusts the deliverability scoring accordingly, allowing senders to learn from past performance and improve future message routing decisions
Solution Approach 2:
The system performs preliminary action by calculating deliverability scores before messages are transmitted. By analyzing historical error codes and performance data in advance, the system provides predictive scoring that allows senders to make informed decisions about message routing and content before actual transmission occurs, potentially preventing wasted transmission attempts
2Measurement precision
If comprehensive error tracking is implemented for all network traffic messages, then the measurement precision of message performance is improved, but the device complexity increases
Solution Approach 1:
The system segments the complex task of performance measurement by dividing it into distinct components: error code collection, error code classification into categories (hard failures, soft failures, policy violations), and separate scoring calculations for different message types and destinations. This segmentation allows each component to be handled independently, reducing overall system complexity while maintaining comprehensive measurement precision
Solution Approach 2:
The system introduces an intermediary layer (the deliverability scoring system) that sits between the message transmission process and the performance analysis. This intermediary automatically collects, standardizes, and processes error codes from various sources, transforming raw data into meaningful scores without requiring complex integration with each individual message transmission system
3Loss of information
If detailed subscores are calculated for different message performance aspects, then the information quality for remedial actions is improved, but the device complexity increases
Solution Approach 1:
The system segments performance measurement into distinct subscores covering different aspects: hard delivery failures, soft delivery failures, policy violations, and overall deliverability. Each subscore focuses on a specific dimension of message performance, allowing senders to identify and address specific problems (e.g., formatting issues vs. routing issues) without being overwhelmed by a single complex metric
Data Source
AI summary
A computing device can assign possible error codes to subscore bins. The subscore bins can include a sent rate bin, a compliance rate bin, a fraud bin, a latency bin, and an engagement bin. The computing device can transmit network traffic messages and receive actual error codes associated with the network traffic messages. The actual error codes can overlap with and include some or all of the possible error codes. A subscore can be calculated for each subscore bin based on the actual error codes received. A deliverability score can be calculated based on the subscore for each subscore bin.