Programs, head-mounted displays and information processing devices

By using user gestures to determine the virtual space capture range in a head-mounted display, and combining distance and range detection, the problem of difficult image data acquisition in virtual space is solved, enabling flexible image capture and access control.

CN115803704BActive Publication Date: 2026-04-24DENTSU INC
View PDF 3 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
DENTSU INC
Filing Date
2021-06-22
Publication Date
2026-04-24

AI Technical Summary

Technical Problem

In existing technologies, head-mounted displays have difficulty specifying a capture area in virtual space for screen capture, resulting in difficulties in acquiring image data.

Method used

The capture range in virtual space is determined by using the user's gestures or hand gestures formed by objects in real and virtual space on a head-mounted display, and image data within the capture range is acquired by combining distance detection and range detection.

Benefits of technology

It enables convenient acquisition of image data in virtual space by specifying the capture range, can adjust the viewing angle according to the distance between the user's head and hand, and handles objects or avatars that cannot be photographed to prevent unauthorized shooting.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115803704B_ABST
    Figure CN115803704B_ABST
Patent Text Reader

Abstract

A program, executed in a head-mounted display or an information processing device connected to the head-mounted display for providing virtual reality, causes the head-mounted display or the information processing device to function as: a determining unit that uses a gesture formed by a user's hand in real space or a gesture formed by an object of the hand in virtual space to determine a capture range in virtual space; and a capturing unit that acquires content displayed in the virtual space within the capture range as image data.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to programs, head-mounted displays, and information processing devices. Background Technology

[0002] Previously, head-mounted displays providing virtual reality (also known as VR) were known, allowing users to photograph avatars or objects displayed in virtual space. For example, Patent Document 1 discloses the following: detecting the movement of any one of the user's limbs, and detecting an event of taking a picture based on the movement of that limb.

[0003] Prior art literature.

[0004] Patent documents

[0005] Patent Document 1: Japanese Patent Publication No. 2019-67456 Summary of the Invention

[0006] (The problem the invention aims to solve)

[0007] However, the technology in Patent Document 1 has the following problem: although it is possible to start shooting in the virtual space from the movement of the user's limbs, it is difficult to specify the capture range for screen capture in the virtual space covered by the head-mounted display.

[0008] The present invention was made in view of the above-mentioned problems, and its object is to provide a program, a head-mounted display and an information processing device that makes it easy to acquire image data by specifying a capture range in virtual space.

[0009] (Technical solution used to solve the problem)

[0010] The first aspect of the present invention is a program executed in a head-mounted display or an information processing device connected to the head-mounted display for providing virtual reality, the program causing the head-mounted display or the information processing device to function as: a determining unit that uses a gesture formed by a user's hand in real space or a gesture formed by an object of the hand in virtual space to determine a capture range in virtual space; and a capturing unit that acquires content displayed within the capture range in the virtual space as image data.

[0011] Based on this configuration, it is possible to capture the range indicated by the user's hand in real space or the range indicated by the hand's object in virtual space and obtain it as image data, thus making it easy to obtain image data by specifying the capture range in virtual space.

[0012] The second aspect of the present invention is based on the first aspect, and includes: a distance detection unit that detects the distance between the user's head and the user's hand in real space; and a range detection unit that detects the range indicated by the user's hand in real space or the range indicated by the hand's object in virtual space, wherein the determining unit determines the capture range in the virtual space based on the range and the distance.

[0013] Based on this configuration, the capture range in virtual space changes according to the distance between the user's head and hand, thus enabling the acquisition of captured image data with a viewpoint that changes according to the distance between the user's head and hand.

[0014] The procedure of the third aspect of the present invention is based on the procedure of the second aspect, wherein the distance detection unit detects the distance between the user's glove-type device or the controller held by the user and the head-mounted display as the distance between the user's head and the user's hand.

[0015] Based on this configuration, the distance between the user's head and hands can be detected.

[0016] The program of the fourth aspect of the present invention is based on the program of any one of the first to third aspects, and includes: a detection unit that detects an unphotographable object or an unphotographable avatar by referring to object information within the capture range; a determination unit that determines whether the user has been granted a photography license if the unphotographable object or the unphotographable avatar is detected; and a display processing unit that performs processing to prevent the display of the unphotographable object or the unphotographable avatar if the user has not been granted a photography license.

[0017] According to this configuration, when the captured image range includes an object or an embodiment that cannot be photographed, and the user has not been granted permission to photograph, a process is implemented to prevent the object or the embodiment from being displayed, thereby enabling the user who has not been granted permission to photograph to be unable to obtain image data of the object or the embodiment that cannot be photographed.

[0018] The procedure of the fifth aspect of the present invention is based on the procedure of the fourth aspect, wherein the above-mentioned processing for not displaying is a transparency processing or mosaic processing of the unphotographable object or the unphotographable embodiment, or a transparency processing or mosaic processing of the unphotographable object or the unphotographable embodiment captured in the image data.

[0019] This configuration prevents users without photographic permission from obtaining image data of objects or avatars that cannot be photographed.

[0020] The sixth aspect of the present invention is based on the procedure of any one of the first to fifth aspects, and includes: a detection unit that detects objects or avatars that cannot be photographed without permission by referring to object information within the capture range; a determination unit that determines whether the user has been granted a photographing permit if the object or avatar that cannot be photographed without permission is detected; and a display processing unit that performs processing to prevent the object or avatar that cannot be photographed without permission from being displayed if the user has not been granted a photographing permit.

[0021] According to this configuration, when the captured image range includes objects or avatars that cannot be photographed without permission, and the user has not been granted permission to photograph, a process is implemented to prevent the objects or avatars that cannot be photographed without permission from being displayed, thereby enabling users who have not been granted permission to photograph to be unable to obtain image data of the objects or avatars that cannot be photographed without permission.

[0022] The procedure of the seventh aspect of the present invention is based on the procedure of any one of the first to sixth aspects, wherein the above-described processing for not displaying is a transparency processing or mosaic processing of the object that cannot be photographed without authorization or the unauthorized photographing avatar, or a transparency processing or mosaic processing of the object that cannot be photographed without authorization or the unauthorized photographing avatar photographed in the image data.

[0023] This configuration prevents users without permission from obtaining image data of objects or avatars that cannot be photographed without authorization.

[0024] The head-mounted display of the eighth aspect of the present invention comprises: a determining unit that determines a capture range in a virtual space using a gesture formed by a user's hand in real space or a gesture formed by an object of the hand in virtual space; and a capturing unit that acquires content displayed within the capture range in the virtual space as image data.

[0025] Based on this configuration, it is possible to capture the range indicated by the user's hand in real space or the range indicated by the hand's object in virtual space and obtain it as image data, thus making it easy to obtain image data by specifying the capture range in virtual space.

[0026] The information processing apparatus of the ninth aspect of the present invention includes: a determining unit that determines a capture range in a virtual space using a gesture formed by a user's hand in a real space or a gesture formed by an object of the hand in a virtual space; and a capturing unit that acquires content displayed within the capture range in the virtual space as image data.

[0027] Based on this configuration, it is possible to capture the range indicated by the user's hand in real space or the range indicated by the hand's object in virtual space and obtain it as image data, thus making it easy to obtain image data by specifying the capture range in virtual space.

[0028] (Invention Effects)

[0029] According to one aspect of the invention, it is possible to capture the range indicated by a user's hand in real space or the range indicated by the hand in virtual space and obtain it as image data, thus making it easy to obtain image data by specifying the capture range in virtual space. Attached Figure Description

[0030] Figure 1 This is a schematic diagram of the head-mounted display system according to the first embodiment.

[0031] Figure 2 This is a schematic diagram of the head-mounted display according to the first embodiment.

[0032] Figure 3 It is a diagram used to illustrate the range indicated by a hand object in virtual space.

[0033] Figure 4A This is an example of the positional relationship of a head-mounted display and a glove-type device in real space and the captured image data.

[0034] Figure 4B This is another example of the positional relationship between head-mounted displays and glove-type devices in real space and the captured image data.

[0035] Figure 5 This is a flowchart illustrating an example of the processing according to the first embodiment.

[0036] Figure 6 This is a schematic diagram of the head-mounted display system according to the second embodiment.

[0037] Figure 7 This is a schematic configuration diagram of the information processing apparatus according to the second embodiment. Detailed Implementation

[0038] The various embodiments will now be described with reference to the accompanying drawings. However, sometimes overly detailed descriptions are omitted. For example, detailed descriptions of matters already known to the public or repeated descriptions of substantially the same configurations are sometimes omitted. This is to avoid unnecessary redundancy in the following description and to facilitate understanding by those skilled in the art.

[0039] <First Implementation Method>

[0040] Figure 1This is a schematic diagram of the head-mounted display system according to the first embodiment. Figure 1 As shown, the head-mounted display system S1 according to the first embodiment includes a head-mounted display 1 and an example of an operating device used by a user, namely glove-type devices 3L and 3R. The head-mounted display 1 is connected to a server 4 via a communication circuit network NW. The server 4 stores user information, world information related to the virtual reality world (referred to as "world"), and information about other users within the world. This information, or information that processes this information, is sent from the server 4 to the head-mounted display 1 via the communication circuit network NW.

[0041] Figure 2 This is a schematic configuration diagram of a head-mounted display according to the first embodiment. Figure 2 As shown, the head-mounted display 1 according to the first embodiment includes a storage unit 11, a memory unit 12, a sound input unit 13, a display 14, a communication module 15, and a processor 16. Furthermore, the head-mounted display 1 may also include a camera.

[0042] Storage 11 stores the program read and executed by processor 16. Memory 12 temporarily stores information. Voice input unit 13 receives the user's voice. Display 14 displays VR images according to commands from processor 16 and provides virtual reality to the user. Communication module 15 communicates with server 4 and glove-type devices 3L and 3R. This communication can be wired or wireless.

[0043] The processor 16 reads and executes a program from the memory 11, thereby functioning as a determination unit 161, a capture unit 162, a distance detection unit 163, a range detection unit 164, a detection unit 165, a judgment unit 166, a display processing unit 167, and a mode switching unit 168.

[0044] The determining unit 161 uses the gestures formed by the user's hand in real space or the gestures formed by an object of the hand in virtual space to determine the capture range in virtual space. Here, a gesture refers to a posture expressed using the user's hand or an object of the hand.

[0045] The capture unit 162 acquires the content displayed within the capture range determined by the determination unit 161 in the virtual space as image data. In this embodiment, as an example, when the sound input unit 13 receives a user instruction (e.g., a shooting instruction or a capture instruction), the capture unit 162 acquires the content displayed within the capture range determined by the determination unit 161 in the virtual space as image data.

[0046] The distance detection unit 163 detects the distance between the user's head and the user's hand in real space. Specifically, for example, the distance detection unit 163 detects the distance between the glove-type devices 3L and 3R worn by the user and the head-mounted display 1 as the distance between the user's head and the user's hand. Furthermore, if a handheld controller is used instead of the glove-type devices 3L and 3R, the distance detection unit 163 can detect the distance between the handheld controller (e.g., a hand-tracking controller or a grip controller) and the head-mounted display 1 as the distance between the user's head and the user's hand. In any configuration, the distance between the user's head and hand can be detected. Here, the distance can be determined, for example, from images captured by a camera installed in the head-mounted display 1 of the glove-type devices 3L and 3R, or from images captured by an external camera of the head-mounted display 1 and the glove-type devices 3L and 3R, or from the round-trip time of communication (e.g., infrared communication) between the glove-type devices 3L and 3R and the head-mounted display 1, or by other known methods.

[0047] The range detection unit 164 detects the range indicated by the user's hand in real space or the range indicated by the hand object in virtual space. Regarding the range indicated by the user's hand in real space, for example, if the glove-type devices 3L and 3R have sensors capable of tracking each finger, detection can be performed using the tracking signal received from the glove-type devices 3L and 3R by the communication module 15. If the head-mounted display 1 is equipped with a camera, the range indicated by the user's hand in real space can be detected from images of the glove-type devices 3L and 3R captured by the camera. Other known methods can also be employed.

[0048] The determining unit 161 determines the capture range in the virtual space based on the range detected by the range detection unit 164 and the distance detected by the distance detection unit 163, according to, for example, a predetermined rule or correspondence. With this configuration, since the capture range in the virtual space varies according to the distance between the user's head and hand, it is possible to acquire capture image data whose viewing angle varies according to the distance between the user's head and hand.

[0049] The detection unit 165 refers to the object information within the capture range and detects objects or avatars that cannot be photographed.

[0050] The determination unit 166 determines whether the user has been granted permission to take photos if the unphotographable object or the unphotographable avatar is detected.

[0051] The display processing unit 167 implements a process to prevent the display of the unphotographable object or the unphotographable avatar if the user has not been granted permission to take a picture. This process of preventing display involves either transparency processing or mosaic processing of the unphotographable object or the unphotographable avatar, or transparency processing or mosaic processing of the unphotographable object or the unphotographable avatar captured in the image data.

[0052] In addition, the detection unit 165 refers to the object information within the capture range and detects objects or avatars that cannot be photographed without authorization.

[0053] The determination unit 166 determines whether the user has been granted a shooting permit if it detects an object or avatar that cannot be photographed.

[0054] The display processing unit 167 implements a process to prevent the unauthorized photographing object or the unauthorized photographing avatar from being displayed when the user has not been granted photographing permission. According to this configuration, when the captured image range includes an unauthorized photographing object or the unauthorized photographing avatar, and the user has not been granted photographing permission, the process to prevent the unauthorized photographing object or the unauthorized photographing avatar from being displayed is implemented, thereby preventing the user without photographing permission from obtaining image data of the unauthorized photographing object or the unauthorized photographing avatar. This process of not displaying is either a transparency or mosaic processing of the unauthorized photographing object or the unauthorized photographing avatar, or a transparency or mosaic processing of the unauthorized photographing object or the unauthorized photographing avatar captured in the image data.

[0055] Figure 3 This is a diagram used to illustrate the range indicated by a hand in virtual space. For example... Figure 3 As shown, the left-hand object HL and the right-hand object HR are displayed in virtual space in a manner corresponding to the positional relationship of the glove-type devices 3L and 3R in real space. Then, the capture range R1 is defined by specifying two opposite corners of the four corners of a rectangle using the left-hand object HL and the right-hand object HR, and by specifying the hand objects themselves. A portion of the object OB1 is displayed within this capture range R1. In this way, the capture range (also called the shooting size) varies according to the size of the quadrilateral (square) formed by the hand objects in virtual space. This capture range can be saved as image data in standard recording formats such as FHD (Full High Definition) and 4K.

[0056] Here, if the glove-shaped devices 3L and 3R in the real space are moved away, the left-hand object HL and the right-hand object HR in the virtual space are correspondingly moved away, and the capture range expands from capture range R1 to capture range R2. Thus, the entirety of the same object OB1 is displayed within this capture range R2. In this way, corresponding to the positional relationship of the glove-shaped devices 3L and 3R in the real space, the left-hand object HL and the right-hand object HR in the virtual space move, and the capture range within the virtual space changes, for example, according to a predetermined algorithm.

[0057] Then, using Figure 4A and 4B This illustrates how the image displayed on a head-mounted display varies depending on the distance between the head-mounted display and the glove-type device in actual space.

[0058] Figure 4A This is an example of the positional relationship between a head-mounted display and a glove-type device in real space, as well as the captured image data. For example... Figure 4A As shown, the shorter the distance between the head-mounted display 1 and the glove-type devices 3L and 3R, the wider the capture range displayed in the virtual space. The content displayed within the capture range is acquired as image data according to the user's shooting instructions. Thus, for example, image IM1 can be obtained.

[0059] Figure 4B This is another example of the spatial relationship between head-mounted displays and glove-type devices in real space, and the captured image data. For example... Figure 4B As shown, the longer the distance between the head-mounted display 1 and the glove-type devices 3L and 3R, the narrower the capture range displayed in the virtual space. The content displayed within the capture range is acquired as image data according to the user's shooting instructions. Thus, for example, image IM2 can be obtained. In this way, the viewing angle varies depending on the distance between the head-mounted display 1 and the glove-type devices 3L and 3R (i.e., the distance between the user's hand and head).

[0060] Figure 5 This is a flowchart illustrating an example of the processing according to the first embodiment.

[0061] (Step S10) The determination unit 166 determines whether a specific gesture (also known as a hand gesture) formed by the user's hand is detected. Depending on the operating device used by the user, the gesture can be the user's actual hand or an object of the hand in virtual space.

[0062] (Step S20) If the user's hand gesture is detected in step S10, the mode switching unit 168 switches to the shooting mode.

[0063] (Step S30) The determination unit 166 determines whether the sound input unit 13 has received a capture command with a sound such as "still image capture". Furthermore, when capturing moving images, a moving image capture command can be received via a sound command such as "recording start". Alternatively, the capture of still or moving images can be started using other input signals (e.g., a button switch signal sent from the controller when the user presses a button on the user's operating device) without using a sound command.

[0064] (Step S40) The detection unit 165 refers to the object information within the capture range (also called the frame range).

[0065] (Step S50) Determination unit 166 determines whether detection unit 165 has detected an object that cannot be photographed. If no object that cannot be photographed is detected, the process proceeds to step S80.

[0066] (Step S60) If an object that cannot be photographed is detected in step S50, the determination unit 166 determines whether the photographer has permission to photograph the detected object. If the photographer has permission to photograph the detected object, the process proceeds to step S80.

[0067] (Step S70) If the photographer did not grant permission to photograph the detected unphotographable object in step S60, the object may be processed to prevent it from being displayed, for example, by making it transparent or mosaicked. Then, the process proceeds to step S80.

[0068] (Step S80) Determination unit 166 determines whether detection unit 165 has detected an avatar that cannot be photographed without authorization.

[0069] (Step S90) If an unauthorized photographing avatar is detected in step S80, the determination unit 166 determines whether the photographer has permission for the detected unauthorized photographing avatar. If the photographer has permission for the detected unauthorized photographing avatar, the process proceeds to step S120.

[0070] (Step S100) In step S90, if the photographer does not have permission for the detected unauthorized photographing avatar, a photographing permission is requested from the user corresponding to the unauthorized photographing avatar. Here, the user is, for example, the user who created and / or manages and / or owns the unauthorized photographing avatar.

[0071] (Step S110) Determination unit 166 determines whether shooting permission has been obtained from the user. For example, it performs transparency processing, mosaic processing, or other processing on the object to prevent it from being displayed. Then, the process proceeds to step S80.

[0072] (Step S120) If shooting permission is obtained from the user in step S110, the image within the capture range (frame range) is extracted. Then, the process proceeds to step S140.

[0073] (Step S130) If no permission to shoot is obtained from the user in step S110, the avatar is subjected to processes such as transparency processing and mosaic processing to prevent it from being displayed, and the image within the processed capture range is extracted. Then, the process proceeds to step S140.

[0074] (Step S140) The capture unit 162 saves the image data within the capture range to, for example, storage 11. The destination of the save may not be storage 11, but may be server 4 or cloud storage.

[0075] Furthermore, the capture unit 162 can obtain pre-rendered image data from the server 4 or the storage 11. Here, the pre-rendered image data is a pre-rendered image, and it is image data with a higher resolution compared to the image captured normally. Then, the capture unit 162 can save the pre-rendered image data within the capture range (frame range). Alternatively, the pre-rendered image data can also be saved on the server 4 or in the cloud.

[0076] (Step S150) Determination unit 166 determines whether the specific posture (gesture) formed by the user's hand has stopped.

[0077] (Step S160) If it is determined in step S150 that the specific posture (gesture) formed by the user's hand has stopped, the mode switching unit 168 ends the shooting mode.

[0078] The program described above according to the first embodiment is a program executed in the head-mounted display 1 to provide virtual reality, which enables the head-mounted display 1 to function as a device for: determining unit 161, which uses a gesture formed by a user's hand in real space or a gesture formed by an object of the hand in virtual space to determine a capture range in virtual space; and capturing unit 162, which acquires the content displayed within the capture range in the virtual space as image data.

[0079] Furthermore, the head-mounted display 1 according to the first embodiment includes: a determination unit 161 that determines the capture range in the virtual space using a gesture formed by a user's hand in real space or a gesture formed by an object of the hand in virtual space; and a capture unit 162 that acquires the content displayed within the capture range in the virtual space as image data.

[0080] Based on this configuration, it is possible to capture the range indicated by the user's hand in real space or the range indicated by the hand's object in virtual space and obtain it as image data, thus making it easy to obtain image data by specifying the capture range in virtual space.

[0081] <Second Implementation Method>

[0082] Next, the second embodiment will be described. In the first embodiment, the head-mounted display 1 executes a program, but in the second embodiment, the information processing device 2 connected to the head-mounted display 1 executes a program.

[0083] Figure 6 This is a schematic configuration diagram of a head-mounted display system according to the second embodiment. Figure 1 Compared to the head-mounted display system S1, in the head-mounted display system S2, the information processing device 2 connected to the head-mounted display 1 is an additional component. The information processing device 2 is, for example, a computer.

[0084] Figure 7 This is a schematic configuration diagram of the information processing apparatus according to the second embodiment. (Example) Figure 7 As shown, the information processing device 2 includes: a storage device 21, a memory 22, an input interface 23, an output interface 24, a communication interface 25, and a processor 26.

[0085] Storage 21 stores the program of this embodiment. Memory 22 temporarily stores data. Input interface 23 accepts input from the user. Output interface 24 is connected to the head-mounted display 1, for example, via wiring, and outputs image signals to the head-mounted display 1. Furthermore, as an example, the connection is described as wired, but it can also be wireless. Communication module 15 communicates with server 4 and glove-type devices 3L and 3R. This communication can be wired or wireless.

[0086] The processor 26 reads and executes the program from the storage 21, thereby functioning as the determination unit 161, the capture unit 162, the distance detection unit 163, the range detection unit 164, the detection unit 165, the judgment unit 166, the display processing unit 167, and the mode switching unit 168. The processing of these devices is the same as in the first embodiment, so their description is omitted.

[0087] The program of the second embodiment described above is executed in the information processing device 2 connected to the head-mounted display 1 in order to provide virtual reality in the head-mounted display 1. The program causes the information processing device 2 to function as the following: a determination unit 161, which uses a gesture formed by a user's hand in real space or a gesture formed by an object of the hand in virtual space to determine the capture range in the virtual space; and a capture unit 162, which acquires the content displayed within the capture range in the virtual space as image data.

[0088] The information processing apparatus 2 according to the second embodiment further includes: a determining unit 161, which uses a gesture formed by a user's hand in real space or a gesture formed by an object of the hand in virtual space to determine a capture range in virtual space; and a capturing unit 162, which acquires the content displayed within the capture range in the virtual space as image data.

[0089] Based on this configuration, it is possible to capture the range indicated by the user's hand in real space or the range indicated by the hand's object in virtual space and obtain it as image data, thus making it easy to obtain image data by specifying the capture range in virtual space.

[0090] Furthermore, in various implementations, the cloud can be used instead of server 4.

[0091] Furthermore, at least a portion of the head-mounted display 1 or information processing device 2 described in the above embodiments can be constructed using hardware or software. When constructed using software, the program implementing at least a portion of the functions of the head-mounted display 1 or information processing device 2 can be stored on a recording medium such as a floppy disk or CD-ROM, and read and executed on a computer. The recording medium is not limited to removable media such as disks or optical discs, but can also be a fixed type of recording medium such as a hard disk or memory.

[0092] Furthermore, programs that implement at least a portion of the functions of the head-mounted display 1 or the information processing device 2 can be disseminated via Internet communication lines (including wireless communication). Additionally, the same program can be disseminated via wired or wireless lines such as the Internet, or stored in a recording medium, while being encrypted, modulated, or compressed.

[0093] Furthermore, the functions of information processing device 2 can be implemented using one or more information processing devices. When multiple information processing devices are used, one of the multiple information processing devices can be a computer, and the device that is at least one of the information processing devices 2 can be made to function by executing a predetermined program through the computer.

[0094] This invention is not limited to the original embodiments described above, but can be embodied by modifying the constituent elements during the implementation stage without departing from its essence. Furthermore, various inventions can be formed by appropriately combining the multiple constituent elements disclosed in the above embodiments. For example, several constituent elements can be deleted from all the constituent elements shown in the embodiments. Moreover, constituent elements from different embodiments can be appropriately combined.

[0095] (Label Explanation)

[0096] 1 Head-mounted display

[0097] 11. Storage

[0098] 12 Memory

[0099] 13 Audio Input Unit

[0100] 14 Monitors

[0101] 15. Communication Module

[0102] 16 processors

[0103] 161 Determining the Unit

[0104] 162 capture units

[0105] 163 Distance Detection Unit

[0106] 164 range detection units

[0107] 165 detection units

[0108] 166 Decision Units

[0109] 167 Display Processing Unit

[0110] 168 Mode Switching Unit

[0111] 2. Information processing device

[0112] 21 storage devices

[0113] 22MB memory

[0114] 23 Input Interface

[0115] 24 Output Interfaces

[0116] 25 Communication Interface

[0117] 26 processors

[0118] 3L and 3R glove-type equipment

[0119] 4 servers

[0120] S1 and S2 head-mounted display systems.

Claims

1. A recording medium having a program executed in a head-mounted display or an information processing device connected to the head-mounted display for providing virtual reality in the head-mounted display. The program is used to enable the head-mounted display or the information processing device to function as the following unit: The determining unit uses the gestures formed by the user's hand in real space or the gestures formed by the object of the hand in virtual space to determine the capture range in virtual space; A capture unit that acquires the content displayed within the capture range in the virtual space as image data; A distance detection unit that detects the distance between the user's head and the user's hand in real space; as well as The range detection unit detects the range indicated by the user's hand in real space or the range indicated by the hand's object in virtual space. The determining unit determines the capture range in the virtual space based on the range and the distance.

2. The recording medium according to claim 1, wherein, The distance detection unit detects the distance between the user's glove-type device or the controller held by the user and the head-mounted display to determine the distance between the user's head and the user's hand.

3. The recording medium according to claim 1 or 2, wherein, The program is used to enable the head-mounted display or the information processing device to function as the following unit: The detection unit refers to the object information within the capture range and detects objects or avatars that cannot be photographed. The determination unit determines whether the user is granted a shooting permit when it detects the unphotographable object or the unphotographable avatar. as well as The display processing unit performs processing to prevent the display of the unphotographable object or the unphotographable avatar if the user is not granted permission to take photos.

4. The recording medium according to claim 3, wherein, The aforementioned processing for not displaying is either a transparency or mosaic processing of the unphotographable object or the unphotographable avatar, or a transparency or mosaic processing of the unphotographable object or the unphotographable avatar captured in the image data.

5. The recording medium according to claim 1, wherein, The program is used to enable the head-mounted display or the information processing device to function as the following unit: The detection unit refers to the object information within the capture range and detects objects or avatars that cannot be photographed without authorization. The determination unit determines whether the user is granted a shooting permit when it detects the object or the avatar that cannot be photographed without permission. as well as The display processing unit performs processing to prevent the display of the object or avatar that cannot be photographed without permission if the user has not been granted permission to photograph.

6. The recording medium according to claim 5, wherein, The aforementioned processing for not displaying is either a transparent or mosaic processing of the object that cannot be photographed without permission or the avatar that cannot be photographed without permission, or a transparent or mosaic processing of the object that cannot be photographed without permission or the avatar that cannot be photographed without permission captured in the image data.

7. A head-mounted display, comprising: The determining unit uses the gestures formed by the user's hand in real space or the gestures formed by the object of the hand in virtual space to determine the capture range in virtual space; A capture unit that acquires the content displayed within the capture range in the virtual space as image data; A distance detection unit that detects the distance between the user's head and the user's hand in real space; as well as The range detection unit detects the range indicated by the user's hand in real space or the range indicated by the hand's object in virtual space. The determining unit determines the capture range in the virtual space based on the range and the distance.

8. An information processing device, comprising: The determining unit uses the gestures formed by the user's hand in real space or the gestures formed by the object of the hand in virtual space to determine the capture range in virtual space; A capture unit that acquires the content displayed within the capture range in the virtual space as image data; A distance detection unit that detects the distance between the user's head and the user's hand in real space; as well as The range detection unit detects the range indicated by the user's hand in real space or the range indicated by the hand's object in virtual space. The determining unit determines the capture range in the virtual space based on the range and the distance.

Citation Information

Patent Citations

  • Program to be executed by computer for providing virtual reality, and information processing apparatus

    JP2019067456A

  • Human-body-gesture-based region and volume selection for HMD

    CN105027033A

  • Method, device and system for modifying image including photographing restricted element

    CN105323473A