Multimedia Interaction via Acoustic Input Substitution

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing technologies complicate user interaction with multimedia content by requiring manual text input using keyboards, which is cumbersome, especially on small screens, reducing user enthusiasm for interacting with multimedia information.

Innovation Solution

An interaction information processing method that allows users to collect and send multimedia information, such as audio or image comments, during video playback, pausing the video to record interactions and sending them to a service platform for insertion when the same content is played by another user, enhancing interaction convenience and enriching interaction forms.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If users manually enter bullet screen information using a physical or virtual keyboard, then text-based interaction is achieved, but user operations become complicated and interaction enthusiasm is dampened

Engineering Contradiction:
Improveease of entering interaction informationVSAvoidcomplexity of operation process
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent replaces the mechanical keyboard input system with an acoustic field-based input system. Users speak their interaction information, and the acoustic signal is captured and processed into bullet screen data, eliminating the need for physical or virtual keyboard operations during full-screen playback

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces an acoustic signal as an intermediary between the user and the bullet screen information system. The user's voice is captured, converted to text through speech recognition, and then displayed as bullet screen information, providing a more natural and convenient interaction pathway

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If users enter bullet screen information using a virtual keyboard on small screens, then interaction is possible, but operations become extremely difficult and user experience deteriorates

Engineering Contradiction:
Improveadaptability to different screen sizesVSAvoidease of entering information on mobile devices
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent replaces the mechanical typing process with acoustic input, allowing users to enter bullet screen information by speaking rather than manually typing on small mobile screens, making the interaction feasible and comfortable on portable devices with limited input interfaces

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Loss of information

If manual text input is required for bullet screen information, then text-based interaction is achieved, but user enthusiasm for interaction is reduced

Engineering Contradiction:
Improvecompleteness of interaction informationVSAvoidinteraction efficiency and user enthusiasm
Core Design Contradiction:
Loss of informationVSProductivity

Solution Approach 1:

The patent substitutes the time-consuming manual text input process with rapid acoustic input, allowing users to convey interaction information much faster through speech, thereby improving interaction efficiency and reigniting user enthusiasm for participating in bullet screen interactions

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS11412307B2Interaction information processing method, client, service platform, and storage medium
Publication Date: 2022.08.09 TENCENT TECHNOLOGY (SHENZHEN) CO LTD
  • US11412307B2 patent drawing
  • US11412307B2 patent drawing
  • US11412307B2 patent drawing

AI summary

Embodiments of the present disclosure disclose an interaction information processing method, a client, and a service platform. An interaction information processing method applied to a first account includes: receiving a first information collection operation when playing first multimedia information; responding to the first information collection operation, pausing playing the first multimedia information, and collecting second multimedia information, the second multimedia information being included in a first interaction information; and sending the first interaction information to the service platform, wherein the first interaction information is available being played when the second account plays the first multimedia information. The embodiments of the present disclosure further disclose a computer storage medium.