Game System Multi-Viewpoint Synthesis for Real-Virtual Integration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional game systems fail to effectively integrate real-space images into virtual spaces, resulting in a lack of realism, as the virtual space does not appear to extend beyond the screen, leading to an unsatisfactory gaming experience.

Innovation Solution

A game system comprising a game apparatus and a terminal device that communicate to synthesize pickup images with virtual space images, using multiple virtual cameras to create the illusion of depth, allowing the virtual space to appear more real by displaying images from different viewpoints, and incorporating features like image recognition and sound processing to enhance interaction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If pickup images are displayed with objects synthesized thereon, then the game processing can use the pickup image as a game input, but the real space represented by the pickup image is not displayed in good association with the virtual space, making the virtual space appear insufficiently real

Engineering Contradiction:
Improvepickup image integrationVSAvoidvirtual space realism
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent introduces a new spatial dimension by generating a second image of the virtual space from a different virtual camera viewpoint than the first image. This multi-viewpoint approach creates depth perception and spatial association between the real pickup image and the virtual space, allowing players to perceive the virtual space as extending beyond the screen in three-dimensional space.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent uses the pickup image itself as an intermediary element that bridges the real and virtual spaces. By displaying the pickup image in the first image from one viewpoint and the corresponding virtual space from another viewpoint, the system creates a spatial relationship that makes the virtual space feel connected to the real world through the pickup image.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If multiple virtual cameras are used to generate images from different viewpoints, then the virtual space appears more real and immersive, but the device complexity increases

Engineering Contradiction:
Improvevirtual space realismVSAvoidimage generation system
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent makes the virtual camera system multi-functional by using the same virtual camera mechanism to generate both the first image (with pickup image synthesis) and the second image (from different viewpoint). This universal approach allows a single camera system to serve multiple purposes: creating immersive virtual space representations and establishing spatial relationships between real and virtual environments, thereby reducing overall system complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS9149715B2Game system, game apparatus, storage medium having game program stored therein, and image generation method
Publication Date: 2015.10.06 NINTENDO CO LTD
  • US9149715B2 patent drawing
  • US9149715B2 patent drawing
  • US9149715B2 patent drawing

AI summary

An example game system includes a game apparatus and a terminal device capable of communicating with the game apparatus. The terminal device transmits a pickup image obtained by an image pickup section to the game apparatus. The game apparatus receives the pickup image, and generates a first image by synthesizing the pickup image at least in part with an image of a predetermined virtual space as viewed from a first virtual camera. The first image is outputted and displayed on a predetermined display device. In addition, the game apparatus generates a second image of the virtual space as viewed from a second virtual camera different from the first virtual camera. The second image is outputted and displayed on the terminal device.