Multimodality Rich Media Comments via Sensor Data Analysis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current multimedia technologies are inadequate for convenient interactive opinion exchange between users, focusing primarily on man-machine interactions rather than user-to-user information exchange.
Innovation Solution
A system and method for multimodality-appended rich media comments, utilizing a server and electronic device with sensors and a processing unit to sense user behavior, analyze data, and combine interactive objects with source media, creating a rendered medium for enhanced user interaction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If current multimedia technology is used for information exchange, then man-machine interaction is achieved, but user-to-user interactive opinion exchange is not mature
Solution Approach 1:
The patent introduces a server as an intermediary component that mediates between multiple electronic devices. The server receives sensing data from users' electronic devices, processes this data to generate situation factors, and delivers the processed information back to users. This intermediary architecture enables mature user-to-user interactive opinion exchange without requiring direct complex peer-to-peer connections between all user devices.
2Loss of information
If sensors are added to electronic devices to sense user behavior, then user behavior data can be obtained, but device complexity increases
Solution Approach 1:
The patent extracts the complex data processing functionality from the electronic devices and relocates it to the server. The electronic devices are simplified to only perform sensing and data transmission functions, while the server handles the complex tasks of analyzing sensing data, generating situation factors, and creating rendered media. This extraction reduces device complexity while preserving the ability to capture comprehensive user behavior information.
3Loss of information
If sensing data is analyzed and interactive objects are modified to create rendered medium, then rich media comments are generated, but processing time and computational resources increase
Solution Approach 1:
The system performs preliminary actions by pre-defining multiple interactive objects and their associated situation factors before actual user interaction occurs. When sensing data is received, the server can quickly match the data against pre-established situation factors and select appropriate pre-prepared interactive objects, rather than generating new comments from scratch. This preliminary preparation significantly reduces processing time while maintaining rich comment information.
Data Source
AI summary
A system of multimodality-appended rich media comments is provided. The system includes a server and an electronic device. The electronic device includes a network access module, at least one sensor and a processing unit. The network access module communicates with the server. The at least one sensor senses a user's behavior in a recording mode to obtain a sensing data. The processing unit performs an application to provide a source medium, wherein a rich media comment function of the application can be activated to provide multiple interactive objects for selection and then trigger the recording mode. The application uploads the sensing data to the server after the recording mode finishes. The server analyzes the sensing data and accordingly modifies the selected interactive object, combines the source medium with the modified interactive object into a rendered medium, and then delivers the rendered medium to the application.