Coordinate Transformation for Cross-Resolution Touch Input
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies face challenges in enabling touch input operations on extended screens with different display resolutions, and require user intervention for image calibration between projectors and cameras.
Innovation Solution
An information processing method and electronic device that synchronizes input operations across screens by acquiring and transforming coordinates based on display parameters, and an image calibration method using a depth camera to automatically calibrate the relative position of a projection region without user input.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If gesture input operation or extension device is used to enable input operation on extended screen, then input operation on extended screen is realized, but host screen cannot process and respond to input operation on extended screen due to different display resolutions
Solution Approach 1:
The patent introduces a coordinate transformation mechanism as an intermediary between the extended screen and host screen. This mediator converts coordinates from the extended screen's coordinate system to the host screen's coordinate system, enabling the host screen to accurately process and respond to input operations performed on the extended screen despite different resolutions.
Solution Approach 2:
The patent changes the parameter representation of coordinates by establishing a transformation relationship between the coordinate systems of the host screen and extended screen. By transforming the coordinates according to the resolution ratio and position relationship between the two screens, the input operation coordinates are adapted to match the host screen's parameter system, enabling accurate response.
2Measurement precision
If user clicks alignment patterns to calibrate relative position of projection region in recognition region, then calibration is achieved, but user operation is required which reduces efficiency
Solution Approach 1:
The patent implements self-service calibration by enabling the system to automatically determine the relative position between the projection region and recognition region. The electronic device uses the depth camera to capture the projection plane and automatically calculates the coordinate transformation relationship, eliminating the need for manual user operation while maintaining calibration accuracy.
Solution Approach 2:
The patent performs preliminary calibration by pre-establishing the coordinate transformation relationship between the projector and camera coordinate systems. By capturing images and calculating transformation parameters in advance, the system prepares the calibration data before actual projection and recognition operations, thereby eliminating the need for repeated manual calibration during use.
3Measurement precision
If alignment patterns are projected onto four corners of recognition region for calibration, then relative position calibration is achieved, but the process is complex and requires user intervention
Solution Approach 1:
The patent extracts the essential calibration information by using the depth camera to directly capture the projection plane and identify key feature points. Instead of requiring users to manually place alignment patterns at four corners, the system extracts the necessary geometric relationships directly from the captured image, simplifying the calibration process while maintaining alignment precision.
Data Source
AI summary
An information processing method applied to an electronic device is provided. The electronic device can make first multimedia data displayed synchronously on a first display unit and a second display unit. The method includes: acquiring a first parameter of the first display unit and a second parameter of the second display unit; acquiring a first operation on the first multimedia data for the second display unit; analyzing the first operation to obtain first coordinates of the first operation; transforming, based on the first parameter and the second parameter, the first coordinates of the first operation into second coordinates of the first operation on the first multimedia data for the first display unit; and performing the first operation based on the second coordinates of the first operation.