Markerless 3D Golf Swing Reconstruction via Stereo Vision

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing vision-based golf launch monitoring systems require additional markers or stickers on the club face, leading to hardware setup challenges, user distraction, potential damage, and increased costs, while also struggling with accurate 3D posture measurement of club heads due to lack of consistent features.

Innovation Solution

A rear-placement vision-based golf launch monitoring system that uses 3D scanning and stereo vision techniques to measure club head movement and orientation without additional markers, allowing for full 3D reconstruction of the launching scene, enabling accurate measurement and replay from any angle with high fidelity, and simplifying hardware requirements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If additional markers or stickers are placed on the club face for vision-based measurement, then measurement robustness is improved, but device complexity and user burden increase

Engineering Contradiction:
Improvemeasurement robustnessVSAvoidhardware setup complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent extracts the measurement function from the club face by placing markers on the shaft instead. This removes the need for club face stickers while maintaining measurement capability, reducing user burden and preserving club appearance.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent introduces an intermediary marker on the shaft that mediates between the camera system and the club head. This indirect marking approach enables measurement without direct contact with the club face, avoiding wear and appearance issues.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If side-ways placement of hardware is used for measurement, then measurement capability is achieved, but player distraction and hardware damage risk increase

Engineering Contradiction:
Improveclub parameter measurementVSAvoidplayer distraction and hardware damage
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The patent inverts the conventional side-wards placement approach by positioning the marker on the shaft facing the player. This allows the camera to be placed behind the player, eliminating distraction and damage risks while maintaining measurement precision.

Inventive Principle:
Principle #13The other way round (Inversion)

Solution Approach 2:

The patent creates a visual copy of the club head using stereo cameras and image processing. This virtual representation enables precise measurement without requiring physical markers on the club face, avoiding all hardware-related issues.

Inventive Principle:
Principle #26Copying

3Manufacturing precision

If high speed cameras are used to capture club and ball movement, then performance analysis quality is improved, but hardware cost increases

Engineering Contradiction:
Improveperformance analysis qualityVSAvoidhardware cost
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent creates a 3D virtual copy of the launching scene using stereo cameras and computer graphics. This digital reconstruction enables high-quality performance analysis without requiring expensive high-speed cameras, as the 3D model can be rendered at any frame rate and resolution.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent transitions from 2D camera images to 3D spatial reconstruction. By capturing images from multiple angles and reconstructing the scene in 3D space, the system achieves comprehensive performance analysis using standard cameras rather than expensive high-speed equipment.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

4Device complexity

If fixed angle viewing of video is used, then hardware simplicity is maintained, but analysis flexibility is reduced

Engineering Contradiction:
Improvehardware simplicityVSAvoidviewing angle flexibility
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The patent adds the dimension of 3D spatial reconstruction to 2D camera images. This enables the system to provide multiple viewing angles and perspectives from a single hardware setup, greatly enhancing analysis flexibility without increasing hardware complexity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent transforms the static fixed-angle video into a dynamic 3D interactive model. Users can dynamically adjust viewing angles, zoom, and pan through the reconstructed scene, providing versatile analysis capabilities while maintaining simple hardware requirements.

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables accurate and cost-effective measurement of club parameters with reduced hardware complexity, allowing users to view and interact with the launching scene from any perspective, improving performance analysis without the need for additional markers or stickers, and compensating for club face variations.

Implementation Method 1

A rear-placement vision-based golf launch monitoring system is provided without any requirement of additional markers, providing a more desirable solution for golfers. This system can measure the club head movement and orientation from the back of the player without any requirement of additional markers/stickers.

Methodology Applied
Scientific EffectStereo vision: Parallax

Implementation Method 2

With a full 3D model of the club head, a simple model of the ball and accurate measurement of their respective movements, a 3D model of the launching scene can be fully reconstructed in high fidelity.

Methodology Applied
Scientific Effect3D scanning: Photogrammetry

Data Source

PatentUS11583746B2Measurement and reconstruction of the golf launching scene in 3D
Publication Date: 2023.02.21 RAPSODO
  • US11583746B2 patent drawing
  • US11583746B2 patent drawing
  • US11583746B2 patent drawing

AI summary

A method, including scanning a golf club to obtain scanning information; inputting the scanning information into a processing system; using at least one camera positioned behind and in-line to a golf swing direction and at least one lighting unit to obtain a series of images of a golf club during the golf swing; converting the series of images into parameterized motion representations; using at least one radar to obtain a radar signal; inputting the parameterized motion representations and the radar signal into the processing system; receiving golf club parameters and golf swing parameters as an output of the processing system; and generating a visual model of the golf club and the golf swing in a virtual space using the golf club parameters and the golf swing parameters.