Display control system, display control method, and program

Abstract

A display control system (S) includes: a display device (100) that has display panels (112R, 112L) for displaying a display image (D1) and that can be worn independently on the head of a user; a display device (200) that has display panels (211R, 211L) for displaying a display image (D2), that can be worn independently on the head of the user, and that is configured to be attachable to and detachable from the display device (100); a detection unit (501) that detects a mounted state in which the display device (200) is mounted on the display device (100); and a display control unit (503) that controls the display panels (112R, 112L) and the display panels (211R, 211L) such that, in the mounted state, a display region (A1) where the display image (D1) is displayed and a display region (A2) where the display image (D2) is displayed are visible to the user in a superimposed manner.

Description

Display control system, display control method, program

[0001] The present disclosure relates to a display control system, a display control method, and a program.

[0002] Conventionally, as shown in Patent Document 1, a display device having a structure that covers in front of a user's eyes is known. Also, as shown in Patent Document 2, a glasses-type display device is known.

[0003] International Publication No. 2016 / 136657 Japanese Patent Application Laid-Open No. 2022-183177

[0004] The inventors of the present application have been considering performing image display that makes use of the characteristics of each display device using a plurality of display devices.

[0005] One object of the present disclosure is to provide a display control system, a display control method, and a program that perform image display that makes use of the characteristics of a plurality of display devices.

[0006] The display control system proposed in the present disclosure includes a first display panel that displays a first display image, a first display device that can be independently worn on the user's head, a second display panel that displays a second display image, a second display device that can be independently worn on the user's head and is configured to be detachably attached to the first display device, a detection unit that detects a state in which the second display device is attached to the first display device, and a display control unit that controls the first display panel and the second display panel so that a first display area where the first display image is displayed and a second display area where the second display image is displayed overlap and are visually recognized by the user in the attached state.

[0007] The display control method proposed in this disclosure is a display control method for a display unit including a first display device having a first display panel for displaying a first display image and independently mountable on a user's head, and a second display device having a second display panel for displaying a second display image and independently mountable on the user's head and configured to be detachable from the first display device, wherein the processor performs the steps of: detecting a mounted state in which the second display device is mounted on the first display device; and controlling the first display panel and the second display panel in the mounted state so that a first display area on which the first display image is displayed and a second display area on which the second display image is displayed are superimposed and visible to the user.

[0008] The program proposed in this disclosure provides a computer to function as follows: detection means for detecting an attached state in which a second display device is attached to a first display device having a first display panel for displaying a first display image and independently attachable to the user's head, and a second display device having a second display panel for displaying a second display image and independently attachable to the user's head and detachably attached to the first display device; and display control means for controlling the first display panel and the second display panel in the attached state so that the first display area where the first display image is displayed and the second display area where the second display image is displayed are superimposed and visible to the user.

[0009] This is a perspective view showing an example of a display unit. This is a schematic plan view showing a VR HMD. This is a schematic perspective view showing a VR HMD. This is a schematic perspective view showing an AR HMD. This is a schematic exploded perspective view showing an AR HMD. This is a schematic diagram showing an example of an image viewed by the user. This is a block diagram showing an example of the hardware configuration of a VR HMD. This is a block diagram showing an example of the hardware configuration of an AR HMD. This is a block diagram showing an example of the hardware configuration of a display unit. This is a block diagram showing an example of the functional configuration of a display control system.

[0010] Hereinafter, embodiments of the present invention (hereinafter referred to as "this embodiment") will be described with reference to the drawings.

[0011] [Outline of Display Unit 1] An overview of the display unit 1 according to this embodiment will be described with reference to Figures 1 to 5B. The display unit 1 includes a VR (Virtual Reality) head-mounted display 100 and an AR (Augmented Reality) head-mounted display 200. In the following description, the VR head-mounted display 100 will also be referred to as "VR HMD 100" and the AR head-mounted display 200 as "AR HMD 200". The VR HMD 100 and the AR HMD 200 are each display devices that can be independently attached to the user's head.

[0012] Display unit 1 effectively utilizes the respective characteristics of VR HMD 100 and AR HMD 200 to provide a more comfortable image display for the user. The VR HMD 100 should ideally display images with a wider field of view than the AR HMD 100. The AR HMD 200 should ideally be able to display images with a higher pixel density than the VR HMD 100. The AR HMD 200 should ideally be able to display images with higher brightness than the VR HMD 100. The AR HMD 200 should ideally have a visual acuity correction function and a function to resolve convergence accommodation discrepancies. Note that the above characteristics are examples only and are not limited to these.

[0013] Figure 1 is a perspective view showing an example of a display unit. Figure 2A is a schematic plan view of a VR HMD. Figure 2B is a schematic perspective view of a VR HMD. Figure 3A is a schematic perspective view of an AR HMD. Figure 3B is a schematic exploded perspective view of an AR HMD. Figure 4 is a schematic diagram showing an example of an image viewed by the user. Figure 5A is a block diagram showing an example of the hardware configuration of a VR HMD. Figure 5B is a block diagram showing an example of the hardware configuration of an AR HMD.

[0014] Note that the VR HMD 100 shown in Figure 1 and the VR HMD 100 shown in Figures 2A and 2B have different external shapes, but they represent a common embodiment. Similarly, the AR HMD 200 shown in Figure 1 and the AR HMD 200 shown in Figures 3A and 3B have different external shapes, but they represent a common embodiment. Furthermore, the external shapes of the VR HMD 100 and AR HMD 200 are not limited to those shown.

[0015] [VR HMD 100] The VR HMD 100 is a display device having a mounting belt (not shown) that surrounds the user's head and a main body housing 110 supported by the mounting belt. The main body housing 110 is preferably positioned to cover the user's eyes when the mounting belt is attached to the user's head. In other words, the VR HMD 100 is preferably a non-transparent, immersive head-mounted display.

[0016] The main housing 110 houses lenses 111R and 111L, corresponding to the user's left and right eyes, respectively. The main housing 110 also houses display panels 112R and 112L (see Figure 5A), corresponding to lenses 111R and 111L, respectively. The display panels 112R and 112L may be, for example, liquid crystal panels or organic electroluminescent panels, but their type is not particularly limited. In addition to lenses 111R and 111L, the main housing 110 may also house an optical system for allowing the user to view the images displayed on the display panels 112R and 112L.

[0017] The main housing 110 may be provided with a plurality of tracking cameras 113, as shown in Figures 2A and 5A. The tracking cameras 113 are imaging devices for tracking the position and orientation of the head of the user using the VR HMD 100.

[0018] The main housing 110 may be provided with a pair of gaze cameras 114, as shown in Figures 2B and 5A. The gaze cameras 114 are imaging devices for tracking the eye movements of the user using the VR HMD 100.

[0019] The main housing 110 may be equipped with a video see-through camera 115, as shown in Figure 5A. The video see-through camera 115 is an imaging device that captures images of the real space around the user and displays the captured real space in real time on display panels 112R and 112L. However, the main housing 110 does not necessarily have to be equipped with a video see-through camera 115.

[0020] The VR HMD 100 should display images on the display panels 112R and 112L based on the information acquired by each of the cameras described above.

[0021] [AR HMD200] The AR HMD200 is preferably a pair of eyeglasses-type so-called AR glasses. That is, the AR HMD200 is preferably a transparent type of AR glasses. The AR HMD200 is preferably an optical see-through display device capable of displaying digital information superimposed on real space. The AR HMD200 may have a pair of lens parts 210R, 210L, a rim part 220 that holds the pair of lens parts 210R, 210L, and a pair of temples 230R, 230L that extend from the rim part 220.

[0022] The lens sections 210R and 210L may include a translucent material with a background transmittance of approximately 25% to 90%. The lens section 210R may be provided with a display panel 211R, and the lens section 210L may be provided with a display panel 211L (see Figure 5B). The lens sections 210R and 210L may be connected via a bridge 212. The display panels 211R and 211L may be, for example, liquid crystal panels or organic electroluminescent panels, but their type is not particularly limited. Although a detailed explanation is omitted, the lens sections 210R and 210L may be provided with an optical system for allowing the user to view the images displayed on the display panels 211R and 211L.

[0023] The AR HMD 200 may have multiple tracking cameras 231, as shown in Figures 3B and 5B. The tracking cameras 231 are imaging devices for tracking the position and orientation of the user's head when using the AR HMD 200. In Figure 3B, an example is shown in which a pair of tracking cameras 231 are provided on the rim portion 220, but the tracking cameras 231 may also be provided on the lens portions 210R, 210L or the temples 230R, 230L.

[0024] The AR HMD 200 may have a pair of gaze cameras 213, as shown in Figures 3A and 5B. The gaze cameras 213 are imaging devices for tracking the eye movements of the user using the AR HMD 200. In Figure 3A, an example is shown in which the gaze cameras 213 are provided on the lens sections 210R and 210L, but the gaze cameras 213 may also be provided on the rim section 220.

[0025] The AR HMD200 should display images on the display panels 211R and 211L based on the information acquired by each of the cameras described above.

[0026] The AR HMD 200 should be detachable from the VR HMD 100. For example, the lens section 210R, 210L, or bridge 212 should be configured to be detachable from the main housing 110.

[0027] The AR HMD200 is preferably mounted on the main body housing 110 by electrically and physically connecting a connection terminal 212a provided on the bridge 212 and a connection terminal 110a provided on the main body housing 110. The connection terminals 212a and 110a are preferably configured to be alignable by magnetic attraction.

[0028] Furthermore, as shown in Figure 3B, the rim portion 220 and the temples 230R and 230L are preferably configured to be detachable from the lens portions 210R and 210L and the bridge 212. The lens portions 210R and 210L and the bridge 212 are preferably mountable to the main body housing 110 with the rim portion 220 and the temples 230R and 230L removed. Because the rim portion 220 and the temples 230R and 230L can be removed, the user can use the display unit 1 without discomfort even while wearing separate eyeglasses.

[0029] [Display Image] The user can use the display unit 1 with the AR HMD 200 attached to the VR HMD 100. While using the display unit 1, the user can see the display image D1 displayed on the display panels 112R and 112L of the VR HMD 100 and the display image D2 displayed on the display panels 211R and 211L of the AR HMD 200.

[0030] Display image D1 should be visible to the user in display area A1 located in front of the user's eyes. Display image D2 should be visible to the user in display area A2 located in front of the user's eyes.

[0031] As shown in Figure 4, in the display unit 1, the optical system is arranged and display control is performed such that display area A2 is located in the center of the user's field of view, and display area A1 is located around display area A2. In other words, display area A1 should be larger than display area A2. The area of ​​display area A1 that overlaps with display area A2 should be an area where black is displayed or an area where no image is displayed.

[0032] Display image D2 should have higher resolution and brightness than display image D1. In the example shown in Figure 4, the image with higher resolution and brightness will be displayed in the center of the user's field of view, which is the most easily visible area for the user.

[0033] When a two-dimensional image is displayed on the AR HMD 200, the displayed image D2 may include an image whose virtual image distance is adjusted according to the image displayed on the VR HMD 100. For example, the displayed image D2 may be displayed with the same virtual image distance as the displayed image D1. If the AR HMD 200 is a light field display or a display capable of variable focus, the AR HMD 200 can avoid a phenomenon called convergence adjustment inconsistency, which puts a strain on the eyes, by displaying according to the distance of the object. In either case, at the edges, image processing such as gradually blending by matching the color, resolution, and virtual image distance is performed to make the boundaries less visible. The displayed image D2 may include an image whose virtual image distance is adjusted for each displayed object. By allowing the user to view an image whose virtual image distance is adjusted for each displayed object, it is possible to suppress visual fatigue and discomfort. In the example shown in Figure 4, the image whose virtual image distance is adjusted will be displayed in the center of the user's field of view, which is the easiest to see.

[0034] [Hardware configuration of VR HMD 100] As shown in Figure 5A, the VR HMD 100 may have a control unit 150, a storage unit 160, a battery 170, and an IMU (Inertial Measurement Unit) 180 in addition to the tracking camera 113, gaze camera 114, video see-through camera 115, and display panels 112R and 112L described above.

[0035] The control unit 150 includes at least one processor. The control unit 150 may be, for example, a program control device such as a CPU that operates according to a program installed on the VR HMD 100. The control unit 150 may also include a GPU (Graphics Processing Unit) that draws images to a frame buffer based on graphics commands and data supplied from the CPU.

[0036] The storage unit 160 may include, for example, a main memory such as ROM or RAM, and an auxiliary storage device such as an HDD or SSD. The storage unit 160 may store programs executed by the control unit 150. In addition to programs for realizing the various functions of the VR HMD 100, the storage unit 160 may also store, for example, game programs (game software). Furthermore, the storage unit 160 may have an area reserved for a frame buffer on which images are rendered by the GPU.

[0037] The battery 170 is a rechargeable power source. However, the VR HMD 100 may not have a battery 170 and may receive power from an external commercial power source.

[0038] The IMU180 is a sensor for acquiring information about the head movements of a user using the VR HMD100. Ideally, the IMU180 should be able to acquire information about the user's head rotation, tilt, and acceleration, for example.

[0039] Furthermore, the VR HMD 100 may include a communication interface such as an Ethernet® module or a wireless LAN module. Additionally, the VR HMD 100 may receive signals indicating the content of user input through a user interface such as a controller that accepts user input, and these signals may be input to the control unit 150.

[0040] [Hardware configuration of AR HMD200] As shown in Figure 5B, the AR HMD200 may have a control unit 250, a memory unit 260, a battery 270, an IMU 280, and a memory unit 290, in addition to the tracking camera 231, gaze camera 213, and display panels 211R and 211L described above.

[0041] The control unit 250 includes at least one processor. The control unit 250 may be, for example, a program control device such as a CPU that operates according to a program installed on the AR HMD 200. The control unit 250 may also include a GPU (Graphics Processing Unit) that draws images to a frame buffer based on graphics commands and data supplied from the CPU.

[0042] The storage unit 260 may include, for example, a main storage device such as a ROM or a RAM, and an auxiliary storage device such as an HDD or an SSD. Programs executed by the control unit 250 and the like may be stored in the storage unit 260. In addition to programs for realizing various functions of the AR HMD 200, the storage unit 260 may store, for example, a game program (game software). Also, an area of a frame buffer in which an image is drawn by the GPU may be secured in the storage unit 260.

[0043] The battery 270 is a rechargeable power supply. Note that the AR HMD 200 may not include the battery 270 and may receive power supply from an external commercial power supply.

[0044] The control unit 250, the storage unit 260, and the battery 270 may be provided in the rim unit 220 or the arms 230R, 230L.

[0045] The IMU 280 is a sensor for acquiring information regarding the head of a user who uses the AR HMD 200. The IMU 280 may be able to acquire, for example, information regarding the rotation and tilt of the user's head, and acceleration. The IMU 280 may be provided in the lens units 210R, 210L.

[0046] The storage unit 290 may include, for example, a main storage device such as a ROM or a RAM, and an auxiliary storage device such as an HDD or an SSD. The storage unit 290 may store information regarding calibration data based on information regarding the display performance of the display panels 211R, 211L and information regarding the movement of the user's head acquired by the IMU 280. The display performance of the display panels 211R, 211L is, for example, pixel density, luminance, viewing angle, and the like. The storage unit 290 may be provided in the lens units 210R, 210L.

[0047] In addition, the AR HMD 200 may include a communication interface such as an Ethernet (registered trademark) module or a wireless LAN module. Further, a signal indicating the content of the user's operation input may be input to the control unit 250 through a user interface such as a controller that receives the user's operation input in the AR HMD 200.

[0048] [Hardware Configuration of Display Unit 1] FIG. 5C is a block diagram showing an example of the hardware configuration of the display unit. That is, FIG. 5C shows the hardware configuration in a state where the AR HMD 200 is attached to the VR HMD 100. In FIG. 5C, the illustration of the configuration in which the function is not used even if it is a hardware configuration included in the display unit 1 is omitted. Specifically, the illustration of the gaze camera 114 in the VR HMD 100 and the control unit 250, the storage unit 260, the battery 270, the IMU 280, and the tracking camera 231 in the AR HMD 200 are omitted. Each of these configurations may be physically removed from the display unit 1, or may be physically provided in the display unit 1 and its function may be disabled.

[0049] [Functions Realized by Display Control System] FIG. 6 is a block diagram showing an example of the functions realized by the display control system according to the present embodiment. The display control system S preferably includes at least the display unit 1, and may further include other computers. The other computer may be, for example, a game console or a personal computer. Some or all of the functions described below may be realized by other computers. In the present embodiment, an example in which the display control system S is the display unit 1 without including other computers will be described.

[0050] As shown in Figure 6, the display control system S includes a detection unit 501, a function setting unit 502, a display control unit 503, and an AR HMD information storage unit 504. The detection unit 501, the function setting unit 502, and the display control unit 503 are mainly implemented by the control unit 150. However, these functions are not limited to this, and each of these functions may be implemented by the control unit 250 or by a control unit provided by another computer. The AR HMD information storage unit 504 is mainly implemented by the storage unit 290.

[0051] The detection unit 501 should detect the mounting state in which the AR HMD 200 is attached to the VR HMD 100. Specifically, the detection unit 501 should detect the connection state in which the connection terminal 110a and the connection terminal 212a are electrically connected. Note that the detection of the mounting state by the detection unit 501 may be performed by other means, such as using information acquired by an imaging unit such as a camera.

[0052] The function setting unit 502 may disable at least some of the functions included in the VR HMD 100 and the AR HMD 200 that overlap when connected.

[0053] For example, the function setting unit 502 may disable the function of the gaze camera 114 if it overlaps with the function of the gaze camera 213. Similarly, the function setting unit 502 may disable the function of the tracking camera 231 if it overlaps with the function of the tracking camera 113. Furthermore, the function setting unit 502 may disable the function of the IMU 280 if it overlaps with the function of the IMU 180. Each device whose function is disabled should be in a state where its operation is stopped.

[0054] On the other hand, the function setting unit 502 may set the functions to be used in the display unit 1 when connected. For example, the function setting unit 502 may set the devices to use at least the tracking camera 113, memory unit 160, battery 170, IMU 180, gaze camera 213, and memory unit 290 when connected.

[0055] Furthermore, the gaze camera 114 may be covered by the lens sections 210R and 210L when the device is mounted, making its use less necessary. Also, it is positioned further from the user's eyes than the gaze camera 213. Therefore, it is preferable to use only the gaze camera 213 for tracking the user's eye movements. However, to improve the accuracy of tracking the user's eye movements, the gaze camera 114 may be configured as a device that uses it. In this case, the gaze camera 114 should be positioned below the lens sections 210R and 210L so that it is not covered by them.

[0056] Furthermore, the tracking camera 231 is difficult to use because it is covered by the main housing 110 when the lens units 210R and 210L are attached to the main housing 110. For this reason, it is preferable to configure the device to use the tracking camera 113, which is exposed to the outside.

[0057] The IMU280 may be configured as a device to acquire information about the user's head rotation, tilt, and acceleration with greater accuracy. In other words, both the IMU180 and IMU280 may be used to acquire information about the user's head movements.

[0058] The display control unit 503 may control the display panels 112R, 112L and 211R, 211L based on image data included in the video signal input to the control unit 150, and information regarding the user's head and eye movements. The display control unit 503 may include a first display control unit 503a and a second display control unit 503b. The second display control unit 503b may set the position and size of display area A so that display area A2 is located in the center of the user's field of view. The first display control unit 503a may set the position and size of display area A1 so that display area A1 is visible around display area A2.

[0059] The AR HMD information storage unit 504 may store information regarding the display performance of the display panels 211R and 211L, information regarding calibration data acquired by the IMU 280, and information regarding the mounting position of the AR HMD 200. This enables tracking of the user's head movements using the IMU 280 and the tracking camera 113.

[0060] Here, as shown in Figure 4, display image D1 and display image D2 are superimposed to form one image, so it is important to make their boundaries inconspicuous.

[0061] Therefore, the display control unit 503 should control the display panels 112R and 112L according to their respective display performances, and the display panels 211R and 211L accordingly. For example, the display control unit 503 should adjust the color information (pixel values) to display the display images D1 and D2 so that no unnatural feeling occurs at the boundary between display area A1 and display area A2.

[0062] The alignment accuracy of display area A1 and display area A2 also depends on the positional accuracy of the lens sections 210R and 210L relative to the main housing 110. In this embodiment, as described above, a configuration is adopted in which the connection terminal 110a and the connection terminal 212a are connected using magnetic attraction, making it possible to attach the lens sections 210R and 210L to the main housing 110 with high positional accuracy.

[0063] Furthermore, the display control unit 503 may set the positions of display area A1 and display area A2 using the portion where the connection terminals 110a and 212a physically contact as the reference position. This allows for accurate alignment of the relative position of display area A2 with respect to display area A1. The reference position may be, for example, the center position of the connection terminals 110a and 212a in the direction connecting the user's left and right eyes.

[0064] In this embodiment described above, multiple display devices can be used to display images that take advantage of the characteristics of each display device. Specifically, it is possible to display images with a wide field of view by taking advantage of the characteristics of the VR HMD 100, and to display high-quality images in the center of the field of view by taking advantage of the characteristics of the AR HMD 200. Furthermore, in this embodiment, by disabling some of the functions that overlap with each other in the connected state, it is possible to suppress the unnecessary control burden on the control unit 150 and suppress the unnecessary load on the battery 170.

[0065] [Note] For example, the display control system can also be configured as follows: (1) A display control system comprising: a first display device having a first display panel for displaying a first display image and independently attachable to the user's head; a second display device having a second display panel for displaying a second display image and independently attachable to the user's head and detachably attached to the first display device; a detection unit for detecting the attached state in which the second display device is attached to the first display device; and a display control unit for controlling the first display panel and the second display panel so that, in the attached state, the first display area where the first display image is displayed and the second display area where the second display image is displayed are superimposed and visible to the user. (2) The display control system according to (1), wherein the first display device has a first connection terminal, the second display device has a second connection terminal electrically connectable to the first connection terminal, the attached state is a connected state in which the first connection terminal and the second connection terminal are electrically connected, and the display control system comprises a function setting unit for disabling at least some of the functions included in the first display device and the functions included in the second display device that overlap with each other in the connected state. (3) The display control system according to (2), wherein the first display device has one or more first imaging units, the second display device has one or more second imaging units, and the function setting unit disables any overlapping functions among the functions of the one or more first imaging units and the functions of the one or more second imaging units in the connected state. (4) The display control system according to (3), wherein the function to be disabled by the function setting unit is a function to track the user's eye movements using the first imaging unit. (5) The display control system according to any one of (2) to (4), wherein the first display device has a first sensor for acquiring information regarding the head movements of the user using the first display device, the second display device has a second sensor for acquiring information regarding the head movements of the user using the second display device, and the function to be disabled by the function setting unit is a function to acquire information regarding the user's movements using the first sensor or the second sensor.(6) The display control system according to any one of (2) to (5), wherein the second display device has a second sensor for acquiring information regarding the head movements of the user using the second display device, and a storage unit for storing information regarding the user's head movements, the function to be disabled by the function setting unit is a function for acquiring information regarding the user's head movements by the second sensor, and the display control unit controls the first display panel and the second display panel based on the information regarding the user's head movements stored in the storage unit in the connected state. (7) The display control system according to any one of (1) to (6), wherein the display control unit sets the position and size of the second display area so that the second display area is located in the center of the user's field of view, and sets the position and size of the first display area so that the first display area is visible around the second display area, and the second display image has a higher pixel density than the first display image. (8) The display control unit sets the position and size of the second display area so that the second display area is located in the center of the user's field of view, sets the position and size of the first display area so that the first display area is visible around the second display area, and the second display image has a higher brightness than the first display image, the display control system according to any one of (1) to (7). (9) The display control unit sets the position and size of the second display area so that the second display area is located in the center of the user's field of view, sets the position and size of the first display area so that the first display area is visible around the second display area, and the second display image includes an image whose virtual image distance has been adjusted according to the first display image, the display control system according to any one of (1) to (8).(10) The display control system according to any one of (1) to (9), wherein the first display device is an immersive head-mounted display having a main housing that accommodates a pair of first display panels corresponding to the left and right eyes and covers the user's eyes, and the second display device is a spectacle-type head-mounted display having a pair of lens parts on which the second display panels are each provided, and a pair of temples extending from the lens parts and hooked onto the user's ears. (11) The display control system according to (10), wherein the pair of temples are configured to be detachable from the pair of lens parts. (12) The display control system according to (10) or (11), wherein the second display device has a rim part that connects the pair of temples to each other, and an imaging part for tracking the position and orientation of the user's head, and the imaging part is provided on the pair of temples or the rim part. (13) The display control system according to any one of (10) to (12), wherein the first display device is a non-transparent head-mounted display and the second display device is a transparent head-mounted display. (14) The display control system according to any one of (1) to (13), wherein the first connection terminal and the second connection terminal are aligned by magnetic attraction and electrically connected by physical contact. (15) The display control system according to any one of (1) to (14), wherein the display control unit sets the positions of the first display area and the second display area with the portion where the first connection terminal and the second connection terminal are in physical contact as the reference position. (16) The display control system according to any one of (1) to (15), wherein the first display device has a first battery and the second display device has a second battery, and the first battery is capable of supplying power to the second display device through the first connection terminal and the second connection terminal in the connected state.

[0066] 112R, 112L display panel, 100 VR HMD, 211R, 211L display panel, 200 AR HMD, 501 detection unit, 503 display control unit.

Claims

1. A display control system comprising: a first display device having a first display panel for displaying a first display image and independently mountable on the user's head; a second display device having a second display panel for displaying a second display image and independently mountable on the user's head and detachably mounted on the first display device; a detection unit for detecting the mounted state in which the second display device is mounted on the first display device; and a display control unit that controls the first display panel and the second display panel so that, in the mounted state, the first display area on which the first display image is displayed and the second display area on which the second display image is displayed are superimposed and visible to the user.

2. The display control system according to claim 1, wherein the first display device has a first connection terminal, the second display device has a second connection terminal that can be electrically connected to the first connection terminal, the mounting state is a connected state in which the first connection terminal and the second connection terminal are electrically connected, and the system has a function setting unit that disables at least some of the functions included in the first display device and the functions included in the second display device that overlap with each other in the connected state.

3. The display control system according to claim 2, wherein the first display device has one or more first imaging units, the second display device has one or more second imaging units, and the function setting unit disables any overlapping functions among the functions of the one or more first imaging units and the one or more second imaging units in the connected state.

4. The display control system according to claim 3, wherein the function to be disabled by the function setting unit is the function of tracking the user's eye movements by the first imaging unit.

5. The display control system according to claim 2, wherein the first display device has a first sensor for acquiring information regarding the head movements of the user using the first display device, the second display device has a second sensor for acquiring information regarding the head movements of the user using the second display device, and the function that the function setting unit disables is a function for acquiring information regarding the user's movements by the first sensor or the second sensor.

6. The display control system according to claim 2, wherein the second display device includes a second sensor for acquiring information regarding the head movements of the user using the second display device, and a storage unit for storing information regarding the user's head movements, the function to be disabled by the function setting unit is the function for acquiring information regarding the user's head movements by the second sensor, and the display control unit controls the first display panel and the second display panel based on the information regarding the user's head movements stored in the storage unit in the connected state.

7. The display control system according to any one of claims 1 to 6, wherein the display control unit sets the position and size of the second display area so that the second display area is located in the center of the user's field of view, and sets the position and size of the first display area so that the first display area is visible around the second display area, and the second display image has a higher pixel density than the first display image.

8. The display control unit sets the position and size of the second display area so that the second display area is located in the center of the user's field of vision, sets the position and size of the first display area so that the first display area is visible around the second display area, and the second display image has a higher brightness than the first display image, the display control system according to any one of claims 1 to 6.

9. The display control system according to any one of claims 1 to 6, wherein the display control unit sets the position and size of the second display area so that the second display area is located in the center of the user's field of view, sets the position and size of the first display area so that the first display area is visible around the second display area, and the second display image includes an image whose virtual image distance has been adjusted according to the first display image.

10. The display control system according to any one of claims 1 to 6, wherein the first display device is an immersive head-mounted display having a main housing that accommodates a pair of first display panels corresponding to the left and right eyes and covers the user's eyes, and the second display device is a spectacle-type head-mounted display having a pair of lens parts on which the second display panels are each provided, and a pair of temples that extend from the lens parts and are hooked onto the user's ears.

11. The display control system according to claim 10, wherein the pair of temples are configured to be detachably attached to the pair of lens portions.

12. The display control system according to claim 11, wherein the second display device comprises a rim portion connecting the pair of temples to each other, and an imaging unit for tracking the position and orientation of the user's head, the imaging unit being provided on the pair of temples or the rim portion.

13. The display control system according to claim 10, wherein the first display device is a non-transparent head-mounted display, and the second display device is a transparent head-mounted display.

14. The display control system according to any one of claims 2 to 6, wherein the first connection terminal and the second connection terminal are aligned by magnetic attraction and electrically connected by physical contact.

15. The display control system according to claim 14, wherein the display control unit sets the positions of the first display area and the second display area with the portion where the first connection terminal and the second connection terminal are in physical contact as the reference position.

16. The display control system according to any one of claims 2 to 6, wherein the first display device has a first battery, the second display device has a second battery, and the first battery is capable of supplying power to the second display device through the first connection terminal and the second connection terminal in the connected state.

17. A display control method for a display unit including a first display device having a first display panel for displaying a first display image and independently mountable on a user's head, and a second display device having a second display panel for displaying a second display image and independently mountable on the user's head and configured to be detachable from the first display device, the method comprising: a step of a processor detecting a mounted state in which the second display device is mounted on the first display device; and a step of controlling the first display panel and the second display panel in the mounted state such that a first display area on which the first display image is displayed and a second display area on which the second display image is displayed are superimposed and visible to the user.

18. A program for causing a computer to function as follows: a first display device having a first display panel for displaying a first display image and independently mountable on the user's head, and a second display device having a second display panel for displaying a second display image and independently mountable on the user's head, and configured to be detachable from the first display device; a detection means for detecting a mounted state in which a second display device having a second display panel for displaying a second display image and independently mountable on the user's head, is mounted; a display control means for controlling the first display panel and the second display panel so that, in the mounted state, the first display area where the first display image is displayed and the second display area where the second display image is displayed are superimposed and visible to the user;

Images