Selecting portions of vehicle-captured video to use for display

A technology for vehicle and video display, which is applied to select parts of the video captured by the vehicle for display, and can solve problems such as user motion sickness

Active Publication Date: 2018-10-23
MICROSOFT TECH LICENSING LLC
View PDF3 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

One such problem is that the playback of the video may cause symptoms of motion sickness in some users due to the latency of the view change in response to the user's control of the vehicle

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Selecting portions of vehicle-captured video to use for display
  • Selecting portions of vehicle-captured video to use for display
  • Selecting portions of vehicle-captured video to use for display

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0014] This article discusses selecting a portion of the video captured by the vehicle for display. The vehicle includes or is attached to a camera system that captures video and transmits the captured video to a remote user device, and thus the vehicle may also be referred to as a camera carrier. As used herein, a vehicle refers to a vehicle that is controlled by a remote control (eg, an unmanned vehicle). Vehicles may include unmanned aerial vehicles (UAVs) or drones, unmanned ground vehicles (eg, moving along rails or wheels), unmanned floating and / or submersible vehicles, and the like. The vehicle may also include a human being used as a remote-controlled camera system carrier, for example by translating control commands into sounds or vibrations to tell the human where the carrier is going. The camera system wirelessly transmits the captured video to a remote user device. The remote user equipment communicates with the vehicle via wireless communication to wirelessly re...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

A vehicle camera system captures and transmits video to a user device, which includes a viewing device for playback of the captured video, such as virtual reality or augmented reality glasses. A rendering map is generated that indicates which pixels of the video frame (as identified by particular coordinates of the video frame) correspond to which coordinates of a virtual sphere in which a portionof the video frame is rendered for display. When a video frame is received, the rendering map is used to determine the texture values (e.g., colors) for coordinates in the virtual sphere, which is used to generate the display for the user. This technique reduces the rendering time when a user turns his or her head (e.g., while in virtual reality) and so it reduces motion and / or virtual reality sickness induced by the rendering lag.

Description

Background technique [0001] Remotely controlled vehicles have become increasingly popular. This is especially the case with unmanned aerial vehicles (UAVs), which often include stabilization technology that allows the UAV to be more easily piloted, especially by novice users. Some of these remote-controlled vehicles also include a camera that allows video to be captured and transmitted back to the user for display on a screen at the user's location, thereby providing the user with a first-person view of what the vehicle "sees" View (FPV) (eg, what the user would see if he or she was at the vehicle's location). While first-person view video from these vehicles is beneficial, it's not without its problems. One such problem is that playback of the video may cause motion sickness symptoms for some users due to latency in response to the view change of the user's control of the vehicle. SUMMARY OF THE INVENTION [0002] This Summary is provided to introduce a selection of some...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04N5/232
CPCB60R11/04G06T3/005H04N7/183H04N21/41422H04N21/4223H04N13/243H04N13/344H04N13/111G02B2027/0134G02B2027/0138G02B2027/014G02B27/017G02B2027/0178G02B2027/0187H04N23/66H04N23/698G02B27/0179H04N19/00H04N13/00
Inventor N·斯莫尔扬斯基张正友S·E·安德森M·霍尔
Owner MICROSOFT TECH LICENSING LLC
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products