ML Survey Parameter Optimization via Feedback Loops

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional methods for determining survey parameters are not systematic and fail to tailor to individual circumstances, leading to suboptimal user response rates and resource inefficiencies in survey campaigns.

Innovation Solution

A machine learning-based system that monitors user activity, provides survey prompts based on optimized parameters, and retrains models using feedback to improve future notification acceptance rates, optimizing parameters such as prompt timing, content, and user selection.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If survey parameters are determined by intuition or expert recommendations, then the implementation process is simple, but the survey response rates and data collection efficiency are suboptimal

Engineering Contradiction:
Improvesurvey response rateVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system implements a feedback loop where survey responses and user interactions are continuously collected and used to retrain the machine learning model. This closed-loop feedback mechanism allows the system to automatically learn from past performance and improve survey parameter optimization over time, resolving the contradiction by transforming a static expert-based system into a dynamic self-improving system.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The machine learning model enables the system to automatically determine optimal survey parameters without requiring continuous human intervention or expert analysis. The system serves itself by autonomously learning from data, selecting timing, content, and user targeting parameters, thereby maintaining simplicity of use while achieving high response rates through automated intelligence.

Inventive Principle:
Principle #25Self-service

2Productivity

If survey parameters are optimized for individual users using machine learning, then survey acceptance rates improve, but computational resources and system complexity increase

Engineering Contradiction:
Improvedata collection efficiencyVSAvoidcomputational resource consumption
Core Design Contradiction:
ProductivityVSLoss of energy

Solution Approach 1:

The system performs preliminary actions by pre-processing user data and training the machine learning model in advance. Survey parameters are determined ahead of time based on historical data analysis, allowing the actual survey deployment to use pre-computed optimizations rather than performing heavy computations in real-time, thus reducing immediate computational resource consumption while maintaining high data collection efficiency.

Inventive Principle:
Principle #10Preliminary action

3Adaptability or versatility

If survey parameters are customized for individual circumstances, then user response quality improves, but the system becomes less systematic and more complex to manage

Engineering Contradiction:
Improveparameter customizationVSAvoidsystem management ease
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system replaces manual expert judgment and mechanical parameter adjustment with an automated machine learning system. The ML model systematically processes user data and determines optimal parameters without requiring human operators to manually customize settings for each scenario. This substitution maintains high adaptability and customization while improving ease of operation, as the automated system handles the complexity internally without increasing user burden.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS11854028B2Reinforcement learning applied to survey parameter optimization
Publication Date: 2023.12.26 MICROSOFT TECHNOLOGY LICENSING LLC
  • US11854028B2 patent drawing
  • US11854028B2 patent drawing
  • US11854028B2 patent drawing

AI summary

Systems and methods are directed to optimizing survey parameters using machine learning. A network system monitors user activity of a plurality of users with respect to an application and provides a notification to users of the plurality of users that satisfy a trigger condition for providing the notification. The network system obtains feedback corresponding to the notification, whereby the feedback indicates whether each of the users accepted, rejected, or ignored the notification. A machine learning model is then trained using input data obtained from the feedback to optimize on one or more parameters used by the network system in providing a future notification. Based on the machine learning model, the future notification is presented to a further set of users using the one or more optimized parameters.