Head-mounted display and content display system
The integration of a selectively assignable function button on HMDs addresses the need for enhanced convenience by enabling intuitive operation and reducing operational burdens through customizable functions like video see-through and screen navigation.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- SONY INTERACTIVE ENTERTAINMENT LLC
- Filing Date
- 2022-06-03
- Publication Date
- 2026-04-20
AI Technical Summary
The convenience of head-mounted displays (HMDs) needs improvement as they become more widespread, particularly in enhancing user interaction and reducing operational burdens.
Incorporating a function button on the HMD that can be selectively assigned to various functions, such as video see-through, microphone mute, and screen transition control, allowing for intuitive operation based on user needs.
Enhances usability by allowing users to easily switch between functions like checking the outside environment, muting audio, and navigating content screens without needing additional input devices, thus improving the overall convenience and ease of use.
Smart Images

Figure 0007848057000001 
Figure 0007848057000002 
Figure 0007848057000003
Abstract
Description
Technical Field
[0001] The present invention relates to a head-mounted display and a content display system.
Background Art
[0002] An image display system in which a user wearing a head-mounted display can view a target space from a free viewpoint has become widespread. For example, there is known electronic content (hereinafter also referred to as "VR content") that realizes virtual reality (VR) by using a virtual three-dimensional space as a display target and displaying an image corresponding to the user's line-of-sight direction on the head-mounted display. By using a head-mounted display, it is possible to enhance the sense of immersion in video and improve the operability of applications such as games. In addition, a walk-through system has been developed in which a user wearing a head-mounted display can virtually walk around in the space displayed as VR content by physically moving.
Summary of the Invention
Problems to be Solved by the Invention
[0003] The head-mounted display is expected to become more widespread in the future, and it is required to improve the convenience of the head-mounted display. One object of the present invention is to provide a technology for improving the convenience of a head-mounted display.
Means for Solving the Problems
[0004] In order to solve the above problems, a head-mounted display according to an aspect of the present invention includes a power button and a function button that is different from the power button and is a button to which any one of a plurality of functions related to the operation of the present head-mounted display can be selectively assigned.
[0005] Another aspect of the present invention is a content display system. This content display system comprises a head-mounted display and a display control unit. The head-mounted display includes a power button and a function button, which is a different button from the power button and to which one of a plurality of functions relating to the operation of the head-mounted display can be selectively assigned. The plurality of functions include a function that controls the screen transition of content displayed on the display unit. When a function that controls the screen transition of content is assigned to a function button, pressing the function button for a relatively short time becomes an operation that transitions the content screen in a first direction, and pressing the function button for a relatively long time becomes an operation that transitions the content screen in a second direction opposite to the first direction. If the function button remains pressed, the display control unit displays an image on the display unit indicating that the function button remains pressed.
[0006] Furthermore, any combination of the above components, as well as conversions of the expression of the present invention between methods, computer programs, recording media on which computer programs are recorded in a readable manner, data structures, etc., are also valid embodiments of the present invention. [Brief explanation of the drawing]
[0007] [Figure 1] This figure shows an example configuration of the content display system in the embodiment. [Figure 2] This figure shows an example of the external shape of an HMD (Head-Mounted Display). [Figure 3] This figure shows an example of the external shape of an HMD (Head-Mounted Display). [Figure 4] This diagram shows the functional blocks of the HMD (Head-Mounted Display). [Figure 5] This diagram shows the functional blocks of an information processing device. [Figure 6] This is a flowchart showing the operation of the content display system. [Figure 7] This figure shows an example of the settings screen for function buttons. [Figure 8] This is a flowchart showing the operation of the content display system. [Figure 9] This figure shows an example of a setup screen. [Figure 10] This figure shows an example of a setup screen. [Modes for carrying out the invention]
[0008] Figure 1 shows an example configuration of the content display system 1 in an embodiment. The content display system 1 is an information processing system in which an information processing device 10, a recording device 11, a head-mounted display (HMD) 100, an input device 16 that the user holds and operates with their fingers, and an output device 15 that outputs images and sound work in coordination. The HMD 100 can also be called a VR headset. The output device 15 may be a television.
[0009] The information processing device 10 is connected to an external network 2, such as the Internet, via an access point (AP) 17. The information processing device 10 can be connected to other information processing devices or servers via network 2. The AP 17 has the functions of a wireless access point and router, and the information processing device 10 may be connected to the AP 17 by cable or by a known wireless communication protocol.
[0010] The recording device 11 records system software and applications such as game software. The information processing device 10 may download game software from the content server to the recording device 11 via the network 2. The information processing device 10 executes applications such as game software and supplies image data and audio data of the applications to the HMD 100. The information processing device 10 and the HMD 100 may be connected by a known wireless communication protocol or by a cable.
[0011] The HMD100 is a display device that, when worn on the user's head, displays images on a display panel (also called a display unit) positioned in front of the user's eyes. The HMD100 displays the left eye image on the left eye display panel and the right eye image on the right eye display panel separately. These images constitute parallax images viewed from the left and right viewpoints, achieving stereoscopic vision. Since the user views the display panel through optical lenses, the information processing device 10 supplies parallax image data corrected for optical distortion caused by the lenses to the HMD100.
[0012] The user wearing the HMD100 does not need the output device 15, but by providing the output device 15, another user can view the image displayed on the output device 15. The information processing device 10 may display the same image on the output device 15 as the image seen by the user wearing the HMD100, or it may display a different image. For example, if the user wearing the HMD and another user are playing a game together, the output device 15 may display the game image from the perspective of the other user's character. The information processing device 10 may also display a setup screen on the output device 15 that assists with the initial setup of the HMD100 and the correct wearing of the HMD100.
[0013] The information processing device 10 and the input device 16 may be connected by a known wireless communication protocol or by a cable. The input device 16 is equipped with multiple operating elements such as operation buttons, and the user operates the operating elements with their fingers while holding the input device 16. The input device 16 is used as a controller for the information processing device 10 and the HMD 100. For example, when the information processing device 10 runs a game, the input device 16 is used as a game controller. The input device 16 is equipped with an inertial measurement unit (IMU) including a 3-axis accelerometer and a 3-axis angular velocity sensor, and transmits sensor data to the information processing device 10 at a predetermined period (e.g., 800 Hz).
[0014] The HMD100 is equipped with multiple imaging units 14. The multiple imaging units 14 are mounted in different positions and orientations on the front of the HMD100 so that the combined shooting range of each unit covers the entire field of view of the user. The imaging units 14 may have visible light sensors, such as CCD (Charge Coupled Device) sensors or CMOS (Complementary Metal Oxide Semiconductor) sensors, which are commonly used in digital video cameras, or they may have invisible light sensors. The multiple imaging units 14 capture images in front of the user at a predetermined period (e.g., 120 frames / second) at synchronized timings and transmit the image data capturing the real space to the information processing device 10.
[0015] Figure 2 shows an example of the external shape of the HMD100. The HMD100 consists of an output mechanism 102 and a mounting mechanism 104. The mounting mechanism 104 includes a mounting band 106 that wraps around the user's head to secure the HMD100 to the head. The mounting band 106 has a material or structure that allows its length to be adjusted to the user's head circumference.
[0016] The output mechanism 102 includes a housing 108 shaped to cover the left and right eyes when the HMD 100 is worn by the user, and inside is a display panel that faces the eyes when worn. The display panel may be an LCD panel or an organic EL panel. Inside the housing 108 is a pair of left and right optical lenses positioned between the display panel and the user's eyes to expand the user's field of view. The HMD 100 may also be equipped with speakers or earphones at positions corresponding to the user's ears, and may be configured to allow connection of external headphones.
[0017] On the front outer surface of the housing 108, a plurality of imaging devices 14a, 14b, 14c, and 14d are provided as the imaging unit 14. Based on the front direction of the user's face, the imaging device 14a is attached to the upper right corner of the front outer surface so that the camera optical axis faces diagonally upward to the right, the imaging device 14b is attached to the upper left corner of the front outer surface so that the camera optical axis faces diagonally upward to the left, the imaging device 14c is attached to the lower right corner of the front outer surface so that the camera optical axis faces diagonally downward to the right, and the imaging device 14d is attached to the lower left corner of the front outer surface so that the camera optical axis faces diagonally downward to the left.
[0018] By installing a plurality of imaging units 14 in this way, the overall imaging range obtained by adding up the respective imaging ranges includes all of the user's field of view. That is, the imaging unit 14 including the plurality of imaging devices 14a, 14b, 14c, and 14d images the real space in the front direction of the user wearing the HMD100. In other words, it images the real space within the user's field of view. Hereinafter, the data of the image captured by the imaging unit 14 of the HMD100 is also referred to as "captured image data".
[0019] The HMD100 transmits the sensor data detected by the IMU (inertial measurement unit) and the image data captured by the imaging unit 14 to the information processing device 10, and also receives the image data and audio data of an application (such as a game) generated by the information processing device 10.
[0020] FIG. 3 also shows an example of the external shape of the HMD100. This figure shows the shape when the HMD100 is viewed from below. On the lower outer surface of the housing 108, the microphone 126, the power button 110, and the function button 112 are arranged side by side in positions adjacent to each other, starting from the left as viewed from the user wearing the HMD100. The microphone 126 is an acoustic device that converts the voice uttered by the user into an electrical signal (also referred to as "audio data"). The power button 110 is a button that switches the on / off of the power supply from a predetermined power source (such as a battery not shown in the figure) to each part of the HMD100 (such as the control unit 120 and the display panel 130 described later). The function button 112 is a button to which any one of a plurality of functions related to the operation of the HMD100 can be selectively assigned.
[0021] Figure 4 shows the functional blocks of the HMD 100. The control unit 120 is a main processor that processes and outputs various data such as image data, audio data, and sensor data, as well as commands. The control unit 120 may include a CPU (Central Processing Unit) and a GPU (Graphics Processing Unit). The storage unit 122 temporarily stores data and commands processed by the control unit 120. The IMU 124 acquires sensor data related to the movement of the HMD 100. The IMU 124 may include at least a three-axis acceleration sensor and a three-axis angular velocity sensor. The IMU 124 detects the values of each axis component (also referred to as "sensor data") at a predetermined period (for example, 800 Hz).
[0022] The communication control unit 128 transmits the data output from the control unit 120 to the external information processing device 10 by wired communication or wireless communication via a network adapter or an antenna. Also, the communication control unit 128 receives data from the information processing device 10 and outputs it to the control unit 120.
[0023] When the control unit 120 receives image data and audio data of various applications (such as games) from the information processing device 10, it supplies the image data to the display panel 130 for display, and also supplies the audio data to the audio output unit 132 (such as a speaker) for audio output. The display panel 130 includes a left-eye display panel 130a and a right-eye display panel 130b, and a pair of parallax images are displayed on each display panel. Also, the control unit 120 causes the communication control unit 128 to transmit the sensor data from the IMU 124, the audio data from the microphone 126, and the captured image data from the imaging unit 14 to the information processing device 10.
[0024] Figure 5 shows the functional blocks of the information processing device 10. The information processing device 10 comprises a processing unit 200 and a communication unit 202. The processing unit 200 comprises an acquisition unit 210, an application execution unit 220, an image generation unit 222, an image output unit 224, an audio output unit 228, an audio transfer unit 230, and a function setting unit 232. The acquisition unit 210 comprises a captured image acquisition unit 212, a sensor data acquisition unit 214, an audio data acquisition unit 215, and an operation information acquisition unit 216.
[0025] The communication unit 202 communicates with external devices according to a predetermined communication protocol. The external devices include the HMD 100, output device 15, input device 16, and servers and other information processing devices (not shown). For example, the communication unit 202 receives operation information and sensor data transmitted from the input device 16 and supplies it to the acquisition unit 210. The communication unit 202 also receives captured image data and sensor data transmitted from the HMD 100 and supplies it to the acquisition unit 210.
[0026] The information processing device 10 includes a computer, and various functions shown in Figure 5 are realized by the computer executing a program. The computer includes, as hardware, a memory into which the program is loaded, one or more processors (such as a CPU or GPU) that execute the loaded program, an auxiliary storage device, and other LSIs. The processor is composed of multiple electronic circuits, including semiconductor integrated circuits and LSIs, and these multiple electronic circuits may be mounted on one chip or on multiple chips. The functional blocks shown in Figure 8 are realized through the cooperation of hardware and software, and therefore, it will be understood by those skilled in the art that these functional blocks can be realized in various ways by hardware alone, software alone, or a combination thereof.
[0027] The image acquisition unit 212 acquires captured image data transmitted from the HMD 100 and provides it to the application execution unit 220 and the image generation unit 222. The sensor data acquisition unit 214 acquires sensor data transmitted from the input device 16 and the HMD 100 and provides it to the application execution unit 220 and the image generation unit 222.
[0028] The voice data acquisition unit 215 acquires voice data of a remote user (hereinafter also referred to as "external voice data") transmitted from an external device (a device other than the HMD 100) and transmitted via the network 2, and provides it to the voice output unit 228. The voice data acquisition unit 215 also acquires voice data of the user wearing the HMD 100 (hereinafter also referred to as "user voice data") transmitted from the HMD 100, and provides it to the voice transfer unit 230.
[0029] The operation information acquisition unit 216 acquires operation information transmitted from the input device 16, which indicates the user's operation entered into the input device 16. The operation information acquisition unit 216 also acquires operation information transmitted from the HMD 100, which indicates the user's operation entered into the HMD 100 (for example, a function button 112). The operation information acquisition unit 216 provides the acquired operation information to each part of the HMD 100.
[0030] The application execution unit 220 executes an application based on operation information input from the operation information acquisition unit 216 and sensor data input from the sensor data acquisition unit 214, for example, to run a VR game.
[0031] The image generation unit 222 and the image output unit 224 function as a display control unit 226 that controls the display of electronic content on the display unit (specifically, at least one of the display panel 130 of the HMD 100 and the display of the output device 15). Specifically, the image generation unit 222 generates display image data (e.g., VR image data) to be displayed on the HMD 100 based on captured image data input from the captured image acquisition unit 212 and the results of application execution by the application execution unit 220. The image output unit 224 transmits the display image data generated by the image generation unit 222 to the HMD 100 and displays it on its display panel 130.
[0032] Furthermore, the image generation unit 222 generates display image data to be displayed on the output device 15 based on the execution results of the application by the application execution unit 220. This image data may be, for example, image data of content explaining how to set up the HMD 100. The image output unit 224 transmits the display image data generated by the image generation unit 222 to the output device 15 for display. The image output unit 224 may also transmit the image data to be sent to the HMD 100 to the output device 15 for display.
[0033] The audio output unit 228 transmits the audio data of the remote user (external audio data) and the audio data of the application, acquired by the audio data acquisition unit 215, to the HMD 100, thereby causing the HMD 100 to play audio based on this audio data.
[0034] The voice transmission unit 230 transmits the voice data of the user wearing the HMD 100 (user voice data), acquired by the voice data acquisition unit 215, to an external device (for example, a remote user's device) via the network 2, thereby causing the external device to play back audio based on the user voice data.
[0035] When the operation information acquisition unit 216 receives an operation instructing the HMD100 to assign a specific function to the function button 112, the function setting unit 232 executes a setting process corresponding to the function assigned to the function button 112.
[0036] The operation of content display system 1 with the above configuration will now be explained. Figure 6 is a flowchart illustrating the operation of the content display system 1. The user wearing the HMD 100 uses the input device 16 to input an operation requesting the display of the setting screen for the function to be assigned to the function button 112. The input device 16 transmits operation information indicating that the setting screen has been requested to the information processing device 10. When this operation information is acquired by the operation information acquisition unit 216 of the information processing device 10 (Y in S10), the image generation unit 222 of the information processing device 10 generates data for the setting screen of the function button 112. The image output unit 224 of the information processing device 10 transmits the data for the setting screen of the function button 112 to the HMD 100. The control unit 120 of the HMD 100 displays the setting screen of the function button 112 on the display panel 130 (S11).
[0037] Figure 7 shows an example of the settings screen for the function button 112. The settings screen 40 is configured so that the user can arbitrarily select any of several functions that can be assigned to the function button 112. In this embodiment, the multiple functions that can be assigned to the function button 112 include the following functions (1) to (3).
[0038] (1) Video see-through function. Specifically, a function that displays an image of the user's front view, captured by the imaging unit 14, on the display panel 130. When a user is wearing the HMD100, it is difficult to immediately check the outside. Also, if the user removes the HMD100 from their head to check the outside, it is difficult to put it back in the best position. If the video see-through function is assigned to function button 112, the user can check the outside while wearing the HMD100 by pressing function button 112. In this embodiment, the video see-through function is set as the default function among the multiple functions that can be assigned to function button 112.
[0039] (2) Microphone mute function. Specifically, a function that blocks the transmission of the user's voice input to microphone 126 to the outside. By making it easy to switch between muting and unmuting the microphone 126 by pressing the function button 112 on the HMD100, the convenience of the HMD100 for users who are voice chatting with other users can be enhanced.
[0040] (3) Screen transition control function. Specifically, a function to control the screen transitions of content displayed on the display unit. This display unit may be the display of the output device 15, or it may be the display panel 130 of the HMD 100. Among the content displayed on the display unit, there is content that users want to proceed with without holding the input device 16, such as content that teaches how to wear the HMD 100. When such content is displayed, the convenience of the HMD 100 can be enhanced by making it easy to control the screen transitions of the content (for example, forward or backward) by pressing the function button 112 of the HMD 100. For example, if a user wants to control the screen transitions of content without holding the input device 16, the user does not need to hold the input device 16, thus reducing the burden on the user.
[0041] Returning to Figure 6, the user selects the desired function to be assigned to the function button 112 on the settings screen 40 and inputs a predetermined decision operation to the input device 16. For example, when the user wears the HMD 100 to view VR content and play VR games, they select either (1) the video see-through function or (2) the microphone mute function. Also, when the user views content on the output device 15 in which the story progresses while switching between multiple screens (for example, content that teaches how to wear the HMD 100), they select the (3) screen transition control function.
[0042] When the operation information acquisition unit 216 of the information processing device 10 acquires the decision operation (Y in S12), the function setting unit 232 of the information processing device 10 identifies the function that was selected on the setting screen 40 at that time as the function to be assigned to the function button 112. The function setting unit 232 then executes a setting process according to the function to be assigned to the function button 112 (S13).
[0043] For example, suppose the user selects the video see-through function as the function to assign to the function button 112 on the settings screen 40. In this case, the function setting unit 232 configures the image generation unit 222 to generate a display image for the HMD 100 based on the image data captured by the HMD 100's imaging unit 14, which is acquired by the image capture unit 212. The display image for the HMD 100 in this case is an image showing the real space in front of the user.
[0044] As another example, suppose the user selects the microphone mute function as the function to assign to the function button 112 on the settings screen 40. In this case, the function setting unit 232 configures the audio transfer unit 230 so that the audio data of the user wearing the HMD 100, acquired by the audio data acquisition unit 215, is not transferred to an external device. As a variation, the function setting unit 232 may achieve muting by configuring the audio data acquisition unit 215 so that it does not acquire or output the user's audio data transmitted from the HMD 100. Alternatively, the function setting unit 232 may achieve muting by configuring the microphone 126 of the HMD 100 so that it does not output electrical signals (audio data) based on audio input from an external source.
[0045] As yet another example, suppose that on the settings screen 40, the user selects the screen transition control function as the function to be assigned to the function button 112. In this case, the function setting unit 232 configures the application execution unit 220 and / or the image generation unit 222 to recognize an operation of pressing the function button 112 relatively for a short time (hereinafter also referred to as a "short press operation") as an operation to transition the content screen in the first direction.
[0046] Furthermore, the function setting unit 232 configures the application execution unit 220 and / or the image generation unit 222 to recognize an operation in which the function button 112 is pressed for a relatively long time (hereinafter also referred to as "long press operation") as an operation in which the content screen transitions to a second direction opposite to the first direction. A short press operation may be an operation in which the function button 112 is pressed for less than a first time (e.g., 0.5 seconds). A long press operation may be an operation in which the function button 112 is pressed for a second time (e.g., 2 seconds) or longer than the first time.
[0047] In the embodiment, the first direction can be described as the direction of time progression in content that progresses by sequentially switching between multiple screens as time passes, and can also be described as the direction of the next screen when the screens are arranged in chronological order. The second direction can be described as the direction of time reversal in the above content, and can also be described as the direction of the previous screen when the screens are arranged in chronological order. In other words, in the embodiment, a short press of the function button 112 is an operation that instructs the user to proceed to the next screen, and a long press of the function button 112 is an operation that instructs the user to return to the previous screen.
[0048] If no operation is entered to determine the function to be assigned to the function button 112 on the settings screen 40 (N in S12), the function assignment process in S13 is skipped. Also, if the display of the settings screen 40 is not requested (N in S10), the processes from S11 onwards are skipped and the process shown in Figure 6 is terminated.
[0049] Figure 8 is also a flowchart showing the operation of the content display system 1. When viewing content displayed on the display panel 130 of the HMD 100 or content displayed on the output device 15, the user presses the function button 112 when using a function assigned to the function button 112. When the function button 112 is pressed (Y in S20), the control unit 120 of the HMD 100 transmits operation information indicating that the function button 112 has been pressed to the information processing device 10 via the communication control unit 128. The operation information acquisition unit 216 of the information processing device 10 acquires the operation information indicating that the function button 112 has been pressed and notifies each part of the information processing device 10 that the function button 112 has been pressed.
[0050] If the video see-through function is assigned to function button 112 (Y in S21), the processing unit 200 of the information processing device 10 switches the video see-through function on or off in response to the pressing of function button 112 (S22). For example, if the function button 112 is pressed while the video see-through function is off, the video see-through function is switched on. While the video see-through function is on, the image generation unit 222 generates a display image based on image data captured by the imaging unit 14 of the HMD 100, that is, a display image showing the real space in the direction in front of the user, instead of an image of content (e.g., a VR game image) based on the execution result of the application by the application execution unit 220. The image output unit 224 of the information processing device 10 displays the display image showing the real space in the direction in front of the user on the display panel 130 of the HMD 100.
[0051] On the other hand, if the function button 112 is pressed while the video see-through function is ON, the video see-through function is switched OFF. When the video see-through function is turned OFF again, the image generation unit 222 restarts generating content images (e.g., VR game images) based on the application execution results by the application execution unit 220. The image output unit 224 of the information processing device 10 resumes displaying content images based on the application execution results on the display panel 130 of the HMD 100. Note that the information processing device 10 may switch the video see-through function from ON to OFF not only when the function button 112 of the HMD 100 is pressed, but also when a predetermined operation (such as pressing a specific button) is input to the input device 16.
[0052] If the microphone mute function is assigned to function button 112 (N in S21) (Y in S23), the processing unit 200 of the information processing device 10 switches the microphone mute function on or off in response to the pressing operation of function button 112 (S24). For example, if the function button 112 is pressed while the microphone mute function is off, the microphone mute function is switched on. While the microphone mute function is on, the audio transfer unit 230 suppresses the transmission of user audio data acquired by the audio data acquisition unit 215 to a remote external device via the network 2.
[0053] On the other hand, if the function button 112 is pressed while the microphone mute function is on, the microphone mute function is switched off. When the microphone mute function is turned off again, the audio transmission unit 230 resumes transmitting the user audio data acquired by the audio data acquisition unit 215 to a remote external device via the network 2.
[0054] If the function button 112 is assigned the screen transition control function (N in S23), and the function button 112 is operated as a short press (N in S25), the image generation unit 222 generates an image indicating the next screen for the currently displayed content screen. The image output unit 224 causes the output device 15 to display the image indicating the next screen (S26). If the function button 112 is operated as a long press (Y in S25), the image generation unit 222 generates an image indicating the previous screen for the currently displayed content screen. The image output unit 224 causes the output device 15 to display the image indicating the previous screen (S27). If no press operation is input for the function button 112 (N in S20), the processing from S21 onwards is skipped and the process in Figure 8 is terminated.
[0055] Figure 9 shows an example of the setup screen 42. The setup screen 42 is one of the screens in the content displayed on the output device 15 that teaches how to set up the HMD 100 (how to put it on the head, etc.). While viewing this content displayed on the output device 15, the user tries to put on the HMD 100 by holding the output mechanism 102 and the mounting mechanism 104 of the HMD 100 in their hands. Here, it is assumed that the screen transition control function is assigned to the function button 112.
[0056] If the user inputs a short press on the function button 112 while the setup screen 42 is displayed, the system transitions to the setup screen 44. Figure 10 shows an example of the setup screen 44. The setup screen 44 is one of the screens in the above content and is the next screen after the setup screen 42 in the timeline.
[0057] While the setup screen 44 is displayed, if the user continues to press the function button 112, the image generation unit 222 generates a setup screen 44 with a press time indicator 46, or in other words, places the press time indicator 46 on the setup screen 44. The press time indicator 46 is an image that suggests that the function button 112 is being pressed and also suggests the length of time the function button 112 is being pressed. The image output unit 224 transmits the setup screen 44 with the press time indicator 46 to the output device 15, updating the setup screen 44 displayed on the output device 15. The press time indicator 46 is updated to complete a full circle when the press time of the function button 112 meets the condition for a long press operation.
[0058] If the duration for pressing the function button 112 on the setup screen 44 exceeds a predetermined time (for example, 2 seconds or more) which is the condition for a long press, the image generation unit 222 generates the setup screen 42 again, and the image output unit 224 displays the setup screen 42 on the HMD 100 again. If the duration for pressing the function button 112 on the setup screen 44 is 1 hour or more (for example, 0.5 seconds or more) which is the condition for a short press, and less than 2 hours (for example, less than 2 seconds) which is the condition for a long press, that is, if the pressing of the function button 112 ends before reaching the 2 hours which is the condition for a long press, the screen transition to the setup screen 42 is canceled, and the display of the setup screen 44 is maintained.
[0059] According to the content display system 1 of the embodiment, a function that suits the type of content the user is viewing and the content viewing status can be assigned to the function button of the HMD100 from among multiple functions, thereby improving the usability of the HMD100.
[0060] The present invention has been described above based on examples. These examples are illustrative, and it will be understood by those skilled in the art that various modifications are possible for each component or combination of each processing process, and that such modifications also fall within the scope of the present invention.
[0061] Although not mentioned in the embodiments, an application executed by the information processing device 10 may dynamically set the function of the function button 112. In other words, the function of the function button 112 may be dynamically set according to the content displayed on the HMD 100 or the output device 15. For example, the program for the content that teaches how to wear the HMD 100 (referred to here as "target content") shown in Figures 9 and 10 may be implemented to assign a screen transition control function to the function button 112. The function setting unit 232 of the information processing device 10 may perform setting processing according to the screen transition control function assigned to the function button 112, in accordance with the program of the target content. As a result, when the target content is played, the screen transition control function is automatically assigned to the function button 112. The user can control the screen transitions of the target content by operating the function button 112 while viewing the target content, without having to manually assign a screen transition control function to the function button 112.
[0062] The functions of the information processing device 10 described in the embodiment may be implemented in the HMD 100. In other words, the HMD 100 may include the functions of the information processing device 10 described in the embodiment. Also, although the imaging unit 14 is attached to the HMD 100 in the embodiment, the imaging unit 14 may be attached to a location other than the HMD 100.
[0063] Any combination of the above-described embodiments and modifications is also useful as an embodiment of the present disclosure. The new embodiments resulting from such combinations will possess the combined effects of the respective embodiments and modifications. Furthermore, it will be understood by those skilled in the art that the functions to be performed by each component described in the claims can be achieved by each component shown in the embodiments and modifications individually or in combination thereof.
[0064] The technical concepts described in the above embodiments and modifications can be expressed in the manner described in the following sections. [Item 1] Power button, A function button, distinct from the aforementioned power button, to which one of several functions related to the operation of this head-mounted display can be selectively assigned; A head-mounted display equipped with [specific features / features]. This head-mounted display allows users to assign functions to function buttons that are suitable for the type of content they are watching or their viewing situation, thereby enhancing the convenience of the head-mounted display. [Item 2] An imaging unit that captures images in the direction in front of the user wearing a head-mounted display, The system further comprises a display unit that displays an image in front of the user, The aforementioned plurality of functions include a function that displays an image of the user's front view, captured by the imaging unit, on the display unit. Head-mounted display as described in item 1 In this configuration, the user can check the outside environment by operating a function button at any time, thereby enhancing the convenience of the head-mounted display. [Item 3] Equipped with an additional microphone, The aforementioned multiple functions include a function to mute the sound input to the microphone. A head-mounted display as described in item 1 or 2. In this configuration, the user can suppress external voice transmission by operating a function button at any time, thereby enhancing the convenience of the head-mounted display. [Item 4] The aforementioned multiple functions include a function that controls the screen transition of content displayed on the display unit. A head-mounted display as described in any of items 1 through 3. According to this embodiment, users can be provided with a variety of means of controlling the content they are viewing, and a decrease in usability in situations such as when the user is unable to grasp an input device can be suppressed. [Item 5] The power button and the function button are located adjacent to each other. A head-mounted display as described in any of items 1 through 4. According to this embodiment, operations can be completed more easily within a specific area on the housing of the head-mounted display, thereby improving usability. [Item 6] A head-mounted display and It comprises a display control unit, The aforementioned head-mounted display is Power button, It includes a function button, which is a button different from the aforementioned power button, and to which one of several functions related to the operation of this head-mounted display can be selectively assigned, The aforementioned multiple functions include a function that controls the screen transition of content displayed on the display unit, If a function to control the screen transition of the content is assigned to the function button, then pressing the function button for a relatively short time will cause the content screen to transition in a first direction, and pressing the function button for a relatively long time will cause the content screen to transition in a second direction opposite to the first direction. The display control unit, if the function button remains pressed, causes the display unit to display an image indicating that the function button is still pressed. Content display system. This content display system makes it easier to prevent input errors and avoid screen transitions that are contrary to the user's intentions, especially when the screen transition behavior differs depending on whether a function button is pressed briefly or held down. [Explanation of symbols]
[0065] 1 Content display system, 10 Information processing device, 15 Output device, 100 HMD, 110 Power button, 112 Function button, 126 Microphone, 130 Display panel, 226 Display control unit, 232 Function setting unit.
Claims
1. Power button, A function button, distinct from the aforementioned power button, to which one of several functions related to the operation of this head-mounted display can be selectively assigned; Equipped with, The aforementioned multiple functions include a function that controls the screen transition of content displayed on the display unit, If a function for controlling the screen transition of the content is assigned to the function button, the content screen will transition in a first direction in response to a relatively short press of the function button, and the content screen will transition in a second direction opposite to the first direction in response to a relatively long press of the function button. Head-mounted display.
2. An imaging unit that captures images in the direction in front of the user wearing a head-mounted display, The system further comprises a display unit that displays an image in front of the user, The aforementioned plurality of functions include a function that displays an image of the user's front view, captured by the imaging unit, on the display unit. The head-mounted display according to claim 1.
3. Equipped with an additional microphone, The aforementioned multiple functions include a function to mute the sound input to the microphone. The head-mounted display according to claim 1.
4. The power button and the function button are located adjacent to each other. The head-mounted display according to claim 1.
5. A head-mounted display and It comprises a display control unit, The aforementioned head-mounted display is Power button, It includes a function button, which is a button different from the aforementioned power button, and to which one of several functions related to the operation of this head-mounted display can be selectively assigned, The aforementioned multiple functions include a function that controls the screen transition of content displayed on the display unit, If a function to control the screen transition of the content is assigned to the function button, then pressing the function button for a relatively short time will cause the content screen to transition in a first direction, and pressing the function button for a relatively long time will cause the content screen to transition in a second direction opposite to the first direction. The display control unit, if the function button remains pressed, causes the display unit to display an image indicating that the function button remains pressed. Content display system.
Citation Information
Patent Citations
A gadget for multimedia management of computing devices for persons who are blind or visually impaired
CN109074167A
Head mounted display
JP2008070817A
Head-mounted display system
JP2008085854A
Head-mounted apparatus
JP2011164955A
Head-mounted display
JP2013200325A