Display control device, control method thereof, and program

Abstract

To allow a captured image to be displayed upon signal reception or the like.SOLUTION: A display control device is provided, comprising an image capturing unit for capturing images, and a control unit configured to provide control to display a captured image or an image of a virtual space on a display unit according to incoming call information, call conversation information, or received information.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present disclosure relates to a display control device, a control method for a display control device, and a program. [Background technology]

[0002] In recent years, head-mounted display (HMD)-type XR information processing devices have started to become popular. XR is a general term for VR (VIRTUAL REALITY), AR (AUGMENTED REALITY), and MR (MIXED REALITY).

[0003] HMD-type XR information processing terminals are available in two types: see-through, which displays CG (computer graphics) on a transparent display, and non-see-through, which displays CG or live-action images captured by a camera on a non-transparent display. See-through displays allow the HMD wearer to check the state of the real space, whereas non-see-through displays do not, but instead provide a greater sense of immersion in the VR space. However, even with non-see-through types, some allow the wearer to check the state of the real space by displaying images from a camera built into the HMD on the display. The state in which the display is switched from VR space display to real space display is called video see-through mode.

[0004] Smartphones and audio devices such as headsets that support the BLUETOOTH (registered trademark) HSP / HFP profile can use the audio device to make calls instead of the smartphone's microphone and speaker. HSP (HEADSET PROFILE) is a specification for the function of sending and receiving audio data between a smartphone and an audio device, and HFP (HANDS-FREE PROFILE) is a specification for the function of making and receiving calls.

[0005] Patent Document 1 discloses that messages and incoming calls from an external smartphone are displayed as icons on an HMD. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] U.S. Pat. No. 10,324,294 Summary of the Invention [Problem to be solved by the invention]

[0007] When a phone call comes in in the real world while a virtual space is being displayed using a non-see-through HMD, it is not possible to determine the situation in the real world, such as whether or not other people are present, and it is therefore not possible to immediately determine whether or not it is appropriate to start the call.

[0008] An object of the present disclosure is to make it possible to display a captured image when, for example, a call is received. [Means for solving the problem]

[0009] The display control device has an imaging unit that captures an image, and a control unit that controls the display unit to display the captured image or an image of a virtual space based on incoming call information, call information, or received information. Effect of the Invention

[0010] According to the present disclosure, a captured image can be displayed when a call is received, for example. [Brief description of the drawings]

[0011] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of a head mounted display. [Diagram 2] 11 is a flowchart illustrating a call receiving operation. [Diagram 3] 11 is a flowchart illustrating a call receiving operation. [Figure 4] 11 is a flowchart illustrating a call receiving operation. [Diagram 5] FIG. 13 is a diagram illustrating a user interface screen when a call is received. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] (First embodiment) 1 is a diagram showing an example of the configuration of a head mounted display (HMD) 120 according to a first embodiment. The HMD 120 is an example of a display control device that responds to an incoming call signal. The HMD 120 has a bus 100, a CPU 101, a GPU 102, a posture sensor 103, an audio AD / DA conversion unit 104, and a wireless unit 105. Furthermore, the HMD 120 has an image processing processor 106, a display 107, a microphone 108, a speaker 109, a camera unit 110, a RAM 111, and a non-volatile memory 112.

[0013] Next, the role of each component will be described. The bus 100 manages the flow of data in the HMD 120. The CPU 101 executes programs stored in the non-volatile memory 112 or the like to control the entire HMD 120 and executes system software and application software. The CPU 101 also analyzes a digital audio signal to determine whether it is a ringtone or not.

[0014] The GPU 102 generates a virtual reality image and outputs the image data to the display 107. The attitude sensor 103 has a gyro sensor and an acceleration sensor, and acquires information related to the attitude and position of the HMD 120. In this embodiment, the CPU 101 processes raw data from the attitude sensor 103 to acquire attitude and position information of the HMD 120. The attitude and position information are reflected in the generation of a virtual reality image. That is, the HMD 120 generates a virtual reality image corresponding to the forward direction of the HMD 120 in accordance with the movement of the HMD 120 incorporating the attitude sensor 103, and displays the image on the display 107.

[0015] The AD / DA conversion unit 104 digitizes an analog audio signal from a microphone 108, and converts the digital audio signal into an analog signal and outputs it to a speaker 109. The wireless unit 105 is capable of connecting to other terminals via a number of wireless standards (such as BLUETOOTH and WIFI) and exchanging data. Specifically, the wireless unit 105 connects to a controller device to obtain operation information, and connects to a smartphone to exchange audio data and obtain incoming call information.

[0016] The image processor 106 acquires mosaic image data from the camera unit 110 and performs demosaic and color correction processing. The display 107 displays the image of real space captured by the camera unit 110 and the virtual reality image generated by the GPU 102. The CPU 101 controls which one to display on the display 107. The control logic will be described later. The display 107 has two panels, one for the right eye and one for the left eye, and divides the input stereo image and displays it on each panel. The display 107 can also input a monocular image, in which case the same image is displayed on the panels for the left eye and the right eye. The CPU 101 controls switching between images to be displayed on the display 107.

[0017] The microphone 108 physically captures sound and converts it into an analog electrical signal. The speaker 109 outputs the analog signal as physical sound.

[0018] The camera unit 110 has two lenses and two sensors, and is arranged so as to capture images corresponding to the positions of the two eyes of the user wearing the HMD 120, and outputs captured and digitized mosaic image data to the image processor 106. The image processor 106 integrates the images received from the two sensors of the camera unit 110 and treats them as a single stereo image. Furthermore, when the distance between the centers of the lenses of the camera unit 110 differs from the distance between the user's eyes, the image processor 106 may correct the displayed image to make the user's depth perception consistent with reality.

[0019] When the HMD 120 is started up, the RAM 111 loads the programs and data stored in the non-volatile memory 112 and functions as a work area for the CPU 101. The RAM 111 also stores acquired images and generated images. The non-volatile memory 112 records the programs and data. These operations are carried out continuously, allowing the user to view a moving image.

[0020] FIG. 2 is a flowchart showing a control method of the HMD 120 according to the first embodiment, and describes the incoming call operation of the HMD 120 in response to an incoming call. Unless otherwise specified, the steps are executed in the order of the arrows in FIG. 2. Note that the order may be changed if there is no dependency on the input / output relationship of data in each step. Each step is executed by the CPU 101, but part of the processing, such as drawing processing, is executed by another processor such as the GPU 102. In this embodiment, the description will be given assuming that a VR game application is being executed.

[0021] In step S2010, the CPU 101 acquires the incoming call / communication status information via the wireless unit 105. In this embodiment, the smartphone connected to the HMD 120 via the wireless unit 105 transmits the incoming call / communication status information to the HMD 120, whereby the CPU 101 acquires the incoming call / communication status information via the wireless unit 105.

[0022] In step S2020, CPU 101 determines whether or not a call is being received or a call is in progress based on the call reception / call status information. If it is determined that a call is being received or a call is in progress, the process proceeds to step S2030, and otherwise the process proceeds to step S2060.

[0023] In step S2030, CPU 101 suspends the processing of the above-mentioned running application. In this embodiment, CPU 101 puts the game application into a so-called pause state and transfers control to the system.

[0024] In step S2040, the CPU 101 acquires an image of the real space by the camera unit 110 and the image processor 106. The image of the real space is acquired by the camera unit 110 built in the HMD 120, and is a stereo image capturing an image in front of the HMD 120.

[0025] In step S2050, CPU 101 renders an image in real space. Specifically, CPU 101 converts the image acquired in step S2040 into a format suitable for display 107, and sends the converted stereo image data to display 107 via GPU 102. The stereo image is displayed on display 107. Also, in step S2050, CPU 101 performs a process of waiting for processing in synchronization with a video signal. After that, the process proceeds to step S2080.

[0026] In step S2060, CPU 101 executes the above application processing. In this embodiment, CPU 101 executes processing for one frame to create application data necessary for generating drawing data. Note that, when the application processing is executed in a separate thread, this processing may acquire the application data while being synchronized with the processing of the separate thread.

[0027] In step S2070, CPU 101 renders an image of a virtual space based on application processing. Based on the application data generated in step S2050 and information from attitude sensor 103, CPU 101 sends an image of the virtual space shown in front to display 107 via GPU 102. The image of the virtual space is displayed on display 107. In addition, in step S2070, CPU 101 also performs a process of waiting for processing in synchronization with a video signal. The image of the virtual space may be a stereo image based on computer graphics, or may be a stereo real-life image captured with a stereo fisheye lens. After that, the process proceeds to step S2080.

[0028] In step S2080, CPU 101 determines whether or not to terminate the application. If it is determined that the application is not to be terminated, the process returns to step S2010. If it is determined that the application is to be terminated, the process of the flowchart in FIG. 2 ends.

[0029] During normal game play, the user holds the controller in his / her hand and does not hold the smartphone. According to this embodiment, when a phone call in the real space is received, the CPU 101 proceeds to step S2030, automatically switches to the video see-through mode, and displays an image in the real space. This allows the user to look at the real space, instantly find a smartphone that may be nearby, and answer the phone call by operating the smartphone, without the need to remove the HMD 120. In addition, by checking whether there are people around, the user can easily determine whether to answer the phone call or not, and whether to refrain from important conversations even if the user answers the phone and starts talking.

[0030] In this embodiment, the microphone and speaker used by the user for a call are not limited, but the HMD 120 may transmit and receive voice information to and from the smartphone using the microphone 108 and speaker 109 of the HMD 120. The user may also make a call using the microphone and speaker built into the smartphone.

[0031] In this embodiment, an example is shown in which the user responds to an incoming call by operating the smartphone, but the CPU 101 may display an incoming call response screen on the display 107 of the HMD 120 and transmit and receive voice information to and from the smartphone. In that case, the user talks using the microphone 108 and speaker 109 of the HMD 120.

[0032] In this embodiment, the target application has been described as a game, but the application is not limited to this and may be any application such as a VR video player, a work support application, a virtual office application, etc. In the VR video player, the CPU 101 decodes video data to generate frame images, and renders them as virtual reality images.

[0033] Although the present embodiment has been described with reference to a telephone call, the CPU 101 may switch the smartphone to the video see-through mode when the smartphone receives a message.

[0034] In this embodiment, the incoming call may be from a smartphone connected to a public line or from a calling application of the system. However, when users communicate with each other within an application such as a game, the screen is not automatically switched when an incoming call is received within the application.

[0035] In this embodiment, the display image is switched only depending on whether or not there is an incoming call, but various sensors and cameras are mounted on the HMD 120. The CPU 101 may use information obtained from these sensors and cameras to detect whether there is a person near the user, and if there is an incoming call and a person near the user, proceed to step S2030 and switch the display of the image in real space.

[0036] In this embodiment, the CPU 101 generates a virtual reality image corresponding to the forward direction of the HMD 120 in accordance with the movement of the HMD 120 which has a built-in orientation sensor 103; however, it is also possible to have an image displayed in a fixed direction without the orientation sensor 103.

[0037] In this embodiment, a stereo image is described as being handled, but a monocular image may be handled instead of a stereo image.

[0038] In this embodiment, the CPU 101 waits for an incoming call and switches to displaying an image in real space, but the present invention is not limited to this. For example, the CPU 101 may blend and display an image in virtual space and an image in real space, or may create a small window on the image in virtual space upon receiving an incoming call and display an image in real space in video see-through mode only in the small window.

[0039] As described above, the camera unit 110 and the image processing processor 106 function as an imaging unit and capture an image. The display 107 is an example of a display unit. In step S2010, the CPU 101 acquires incoming call information, call information, or received information from an external device. The external device is, for example, a smartphone. The CPU 101 functions as a control unit and controls the display 107 to display the captured image or an image of the virtual space based on the incoming call information, call information, or received information.

[0040] If there is no incoming call or no call in progress, then in step S2070, CPU 101 performs control to display an image of the virtual space on display 107. If there is an incoming call or a call in progress, then in step S2050, CPU 101 performs control to display a captured image on display 107.

[0041] In step S2050, CPU 101 may perform control so as to display the captured image and the image of the virtual space on display 107. For example, CPU 101 may blend the captured image and the image of the virtual space and display them, or display the captured image in a small window on the image of the virtual space.

[0042] It may also be applied to message reception on a smartphone. CPU 101 can control so that an image of a virtual space is displayed on display 107 when no message is received. CPU 101 can control so that a captured image is displayed on display 107 for a predetermined period when a message is received. As described above, CPU 101 may also control so that a captured image and an image of a virtual space are displayed on display 107 for a predetermined period when a message is received.

[0043] In addition, when a person other than the person wearing the HMD 120 is within a specified range, the CPU 101 may control the display 107 to display a captured image or an image of a virtual space based on incoming call information, call information, or received information.

[0044] As described above, according to this embodiment, when a phone call is received, the user can check the situation in the real space without removing the HMD 120, and can immediately determine whether or not the call can be answered.

[0045] Second Embodiment Fig. 3 is a flowchart showing a control method of the HMD 120 according to the second embodiment, and explains the incoming call operation of the HMD 120 in response to an incoming call. Fig. 3 is different from Fig. 2 in that steps S3000, S3005, and S3010 are provided instead of steps S2010 and S2020, and unless otherwise specified, the operation is the same as in the first embodiment.

[0046] In step S3000, CPU 101 acquires audio information via microphone 108 and AD / DA conversion unit 104. The audio information is acquired as digital audio data by AD-converting audio received by microphone 108 built into HMD 120 by AD / DA conversion unit 104. CPU 101 acquires audio data for the past 10 seconds up to the point in time when step S3000 is executed.

[0047] In step S3005, CPU 101 analyzes the audio information in step S3000 and generates an audio information analysis result. In this embodiment, CPU 101 performs FFT (Fast Fourier Transform) on the audio information to obtain information in the range of 15 Hz to 16 kHz as the analysis result.

[0048] In step S3010, CPU 101 determines whether the audio information analysis result in step S3005 indicates a ringtone. If it indicates a ringtone, the process proceeds to step S2030, and if it does not indicate a ringtone, the process proceeds to step S2060. In this embodiment, CPU 101 determines that the audio information analysis result indicates a ringtone when the sound pressure of at least one or more frequency peaks is 60 dB or more as a result of FFT. The peak can be determined to exist, for example, when an amplitude is 10 times the median amplitude on a log scale of the FFT result. In this embodiment, CPU 101 can detect the ringtone of the smartphone in an analog manner using microphone 108 and switch to the video see-through mode in step S2050, even if it is not possible to digitally transmit and receive signals via wireless unit 105. This embodiment can obtain the same advantages as the first embodiment.

[0049] In this embodiment, the result of the analysis of the sound is obtained by applying FFT in the range of 15 Hz to 10 kHz, but the present invention is not limited to this. For time-series waveform changes, the number of consecutive occurrences of the same pattern may be calculated, and if there are two or more occurrences, the sound may be determined to be a ringtone. In this case, warning sounds such as fire alarms often have the same pattern of repeated audio information, and the video see-through mode is automatically switched to, but this is also an effective operation in the sense that the occurrence of the warning sound can be noticed and the cause of the occurrence can be visually confirmed. In addition, the ringtone may be recorded in advance and determined to be a ringtone based on whether it matches the recorded sound. This makes it possible to determine that the ringtone is a ringtone even if a song is set as the ringtone.

[0050] As described above, the CPU 101 controls the display 107 to display a captured image or an image of a virtual space based on the incoming call sound or received sound picked up by the microphone 108.

[0051] (Third embodiment) Fig. 4 is a flowchart showing a control method of the HMD 120 according to the third embodiment, and describes the incoming call operation of the HMD 120 in response to an incoming call. Fig. 4 is a flowchart showing a control method of the HMD 120 according to the third embodiment, and illustrates the incoming call operation of the HMD 120 in response to an incoming call. Fig. 4 is a flowchart showing a control method of the HMD 120 according to the third embodiment, and illustrates the operation of the HMD 120 in response to an incoming call.

[0052] In step S4000, CPU 101 sets the video see-through mode to OFF, which is the initial state.

[0053] In step S2010, the CPU 101 acquires incoming call / communication state information via the wireless unit 105.

[0054] In step S4011, CPU 101 acquires the video see-through mode. Specifically, CPU 101 acquires the video see-through mode set in step S4000 described above or step S4073 described below.

[0055] In step S4012, CPU 101 determines whether or not the video see-through mode is on. If the video see-through mode is on, the process proceeds to step S4071 via steps S2030 to S2050, and if the video see-through mode is off, the process proceeds to step S4071 via steps S2060 to S2070.

[0056] In step S4071, CPU 101 determines whether or not a call is being received or a call is in progress based on the call reception / call status information in step S2010. If it is determined that a call is being received or a call is in progress, the process proceeds to step S4072, and otherwise the process proceeds to step S2080.

[0057] In step S4072, CPU 101 renders a video see-through mode selection screen. When the video see-through mode is off, CPU 101 displays a video see-through mode selection screen 5010 shown in FIG. 5(a) on display 107 via GPU 102, superimposed on an image in the virtual space. The user sees the video see-through mode selection screen 5010 floating in three-dimensional space. Video see-through mode selection screen 5010 has a video see-through on button 5001, a call button 5003, and a call rejection button 5004. Video see-through on button 5001 is a button for switching the video see-through mode from off to on.

[0058] When the video see-through mode is on, the CPU 101 displays a video see-through mode selection screen 5020 shown in Fig. 5(b) on the display 107 via the GPU 102, superimposed on an image in real space. The video see-through mode selection screen 5020 has a video see-through off button 5002, a call button 5003, and a call rejection button 5004. The video see-through off button 5002 is a button for switching the video see-through mode from on to off.

[0059] The user uses a controller or a finger to press a button on video see-through mode selection screen 5010 or 5020. When call button 5003 or call reject button 5004 is pressed, CPU 101 starts or rejects the call, respectively.

[0060] In step S4073, CPU 101 acquires user operation information and sets the video see-through mode. When an operation of pressing video see-through ON button 5001 is performed, CPU 101 sets the video see-through mode to ON. When an operation of pressing video see-through OFF button 5002 is performed, CPU 101 sets the video see-through mode to OFF.

[0061] In step S2080, CPU 101 determines whether or not to terminate the application. If it is determined that the application is not to be terminated, the process returns to step S2010. If it is determined that the application is to be terminated, the process of the flowchart in FIG. 4 ends.

[0062] According to this embodiment, when CPU101 receives an incoming call, it does not immediately turn on the video see-through mode, but displays a video see-through mode selection screen 5010 or 5020 for the user to turn on or off the video see-through mode. Then, CPU101 switches the video see-through mode on or off based on the selection result of the video see-through mode selection screen 5010 or 5020. This makes it possible to prevent the entire screen (the space itself for the user) from suddenly switching without the user's intention. Note that, in this embodiment, CPU101 switches the screen by pressing the video see-through on button 5001, but the screen may also be switched by pressing the call button 5003.

[0063] As described above, if a call is coming in or a call is in progress in step S4071, the process proceeds to step S4072. In step S4072, CPU 101 performs control so that an instruction button is superimposed on the image in the virtual space and displayed on display 107. The instruction button is video see-through on button 5001 or call button 5003.

[0064] In step S4073, when an instruction is given by operating the instruction button, CPU 101 performs control so that an image captured by camera unit 110 is displayed on display 107. Note that when an instruction is given by operating the instruction button, CPU 101 may perform control so that an image captured by camera unit 110 and an image of the virtual space are displayed on display 107. Furthermore, when an instruction is not given by operating the instruction button, CPU 101 performs control so that an image of the virtual space is displayed on display 107.

[0065] (Other embodiments) The present disclosure can also be realized by a process in which a program for implementing one or more functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) for implementing one or more functions.

[0066] It should be noted that the above-described embodiments are merely illustrative of specific examples of implementing the present disclosure, and the technical scope of the present disclosure should not be interpreted as being limited by these embodiments. In other words, the present disclosure can be implemented in various forms without departing from its technical concept or main features.

[0067] The disclosure of this embodiment includes the following configuration, method, and program. (Configuration 1) An imaging unit that captures an image; a control unit that controls the display unit to display the captured image or the virtual space image on the display unit based on incoming call information, call information, or received information; A display control device comprising: (Configuration 2) The control unit is When there is no incoming call or no call in progress, the display unit is controlled to display an image of the virtual space; 2. The display control device according to configuration 1, wherein when a call is coming in or a call is in progress, the display control device controls so that the captured image is displayed on the display unit. (Configuration 3) The control unit is When there is no incoming call or no call in progress, the display unit is controlled to display an image of the virtual space; 2. The display control device according to configuration 1, wherein, when an incoming call or a call is in progress, the display unit is controlled to display the captured image and the image of the virtual space. (Configuration 4) The control unit is If no signal is received, the display unit is controlled to display an image of the virtual space. 2. The display control device according to configuration 1, wherein when a signal is received, the display control device controls so that the captured image is displayed on the display unit for a predetermined period of time. (Configuration 5) The control unit is If no signal is received, the display unit is controlled to display an image of the virtual space. 2. The display control device according to configuration 1, wherein when reception is detected, the display device is controlled so as to display the captured image and the image of the virtual space for a predetermined period of time. (Configuration 6) The display control device according to any one of configurations 1 to 5, characterized in that when a person other than the person wearing the display control device is within a predetermined range, the control unit controls the display unit to display the captured image or an image of a virtual space based on incoming call information, call information or received information. (Configuration 7) 7. The display control device according to any one of configurations 1 to 6, wherein the control unit obtains the incoming call information, the call information, or the received information from an external device. (Configuration 8) The display control device according to any one of configurations 1 to 6, wherein the control unit controls the display unit to display the captured image or an image of a virtual space based on a ringtone or a received sound. (Configuration 9) 9. The display control device according to configuration 8, wherein the ringtone or the received sound is a ringtone or a received sound picked up by a microphone. (Configuration 10) The control unit is When a call is being received or a call is being made and an instruction has been given, control is performed so that the captured image is displayed on the display unit; 3. The display control device according to configuration 2, wherein when there is an incoming call or a call is in progress and no instruction is given, the display control device controls so that an image of a virtual space is displayed on the display unit. (Configuration 11) The control unit is When a call is being received or a call is being made, control is performed so that an instruction button is superimposed on an image of the virtual space and displayed on the display unit; When a call is being received or a call is being made and an instruction is given by operating the instruction button, control is performed so that the captured image is displayed on the display unit; 11. The display control device according to configuration 10, characterized in that when there is an incoming call or a call in progress and no operation instruction is given by the instruction button, the display control device controls so that an image of a virtual space is displayed on the display unit. (Configuration 12) The control unit is When an incoming call or a call is in progress and an instruction is given, control is performed so that the captured image and an image of the virtual space are displayed on the display unit; 4. The display control device according to configuration 3, wherein when there is an incoming call or a call is in progress and no instruction is given, the display control device controls so that an image of a virtual space is displayed on the display unit. (Configuration 13) The control unit is When a call is being received or a call is being made, control is performed so that an instruction button is superimposed on an image of the virtual space and displayed on the display unit; When a call is being received or a call is being made and an instruction is given by operating the instruction button, the captured image and an image of the virtual space are controlled to be displayed on the display unit; 13. A display control device according to claim 12, characterized in that when a call is coming in or a call is in progress and no operation instruction is given by the instruction button, the display control device controls so that an image of a virtual space is displayed on the display unit. (Configuration 14) 14. The display control device according to any one of configurations 1 to 13, wherein the display control device is a head-mounted display. (Method 1) A control method for a display control device, comprising a control step of controlling so that an image captured by an imaging section or an image of a virtual space is displayed on a display section based on incoming call information, call information or received information. (Program 1) A program for causing a computer to execute a control step of controlling a display unit to display an image captured by an imaging unit or an image of a virtual space on a display unit based on incoming call information, call information, or received information. [Explanation of symbols]

[0068] 100 bus, 101 CPU, 102 GPU, 103 attitude sensor, 104 AD / DA conversion unit, 105 wireless unit, 106 image processing processor, 107 display, 108 microphone, 109 speaker, 110 camera unit, 111 RAM, 112 non-volatile memory

Claims

1. A display control device for controlling a head-mounted display device that has an imaging unit that images real space and is capable of communicating with an external device, a receiving unit that acquires output information output from the external device and determines whether the output information represents any of incoming call information, call information, and received information; a control unit that causes the imaging unit to start imaging the real space and causes the head-mounted display device to display a selection screen for controlling the imaging unit to stop a rendering process that renders the virtual space to be displayed on the head-mounted display device; and A display control device comprising:

2. The control unit When it is determined that the output information is not an incoming call or a call is not in progress, the image of the virtual space is controlled to be displayed on the display unit of the head-mounted display device; 2. The display control device according to claim 1, wherein, when it is determined that the output information indicates an incoming call or an ongoing call, the display device is controlled so that an image of the real space captured by the imaging unit is displayed on the display device.

3. The control unit When it is determined that the output information is not an incoming call or a call is not in progress, the image of the virtual space is controlled to be displayed on the display unit of the head-mounted display device; The display control device according to claim 1, characterized in that when it is determined that the output information indicates an incoming call or a call in progress, the display device is controlled to display an image of the real space captured by the imaging unit and an image of the virtual space.

4. The control unit If it is determined that the output information has not been received, control is performed so that an image of the virtual space is displayed on a display unit of the head-mounted display device; 2. The display control device according to claim 1, wherein, when it is determined that the output information has been received, the display device is controlled so that an image of the real space captured by the imaging unit is displayed on the display device for a predetermined period of time.

5. The control unit If it is determined that the output information has not been received, control is performed so that an image of the virtual space is displayed on a display unit of the head-mounted display device; The display control device according to claim 1, characterized in that, when it is determined that the output information has been received, the display device is controlled so that an image of the real space captured by the imaging unit and an image of the virtual space are displayed on the display device for a predetermined period of time.

6. The display control device according to claim 1, characterized in that, when a person other than the wearer of the display control device is within a predetermined range, the control unit controls the display unit of the head-mounted display device to display an image of the real space captured by the imaging unit or an image of the virtual space based on the incoming call information, the call information, or the received information.

7. The display control device according to claim 1 , wherein the control unit acquires the incoming call information, the call information, or the received information from the external device.

8. The display control device according to claim 1, characterized in that the control unit controls the display unit of the head-mounted display device to display an image of the real space captured by the imaging unit or an image of the virtual space based on an incoming call sound or a received sound.

9. 9. The display control device according to claim 8, wherein the ringtone or the received sound is a ringtone or a received sound picked up by a microphone.

10. The control unit when it is determined that the output information indicates an incoming call or a call in progress and that an instruction has been given, controlling the display unit of the head-mounted display device to display an image of the real space captured by the imaging unit; The display control device according to claim 2, characterized in that when it is determined that the output information indicates an incoming call or a call in progress and no instruction has been given, the display device is controlled to display an image of the virtual space.

11. The control unit When it is determined that the output information indicates an incoming call or an ongoing call, control is performed so that an instruction button is superimposed on the image of the virtual space and displayed on the display unit of the head-mounted display device; when it is determined that the output information indicates an incoming call or a call in progress and that an operation instruction has been given by the instruction button, control is performed so that an image of the real space captured by the imaging unit is displayed on the display unit; The display control device according to claim 10, characterized in that when it is determined that the output information indicates an incoming call or a call in progress and that there is no operation instruction from the instruction button, the display control device controls the display unit to display an image of the virtual space.

12. The control unit when it is determined that the output information indicates an incoming call or a call in progress and that an instruction has been given, controlling the display unit of the head-mounted display device to display an image of the real space captured by the imaging unit and an image of the virtual space; The display control device according to claim 3, characterized in that when it is determined that the output information indicates an incoming call or a call in progress and no instruction has been given, the display device is controlled to display an image of the virtual space.

13. The control unit When it is determined that the output information indicates an incoming call or an ongoing call, control is performed so that an instruction button is superimposed on the image of the virtual space and displayed on the display unit; when it is determined that the output information indicates an incoming call or a call in progress and that an operation instruction has been given by the instruction button, control is performed so that an image of the real space captured by the imaging unit and an image of the virtual space are displayed on the display unit; The display control device according to claim 12, characterized in that when it is determined that the output information indicates an incoming call or a call in progress and that there is no operation instruction from the instruction button, the display control device controls the display unit to display an image of the virtual space.

14. The display control device according to claim 1 , wherein the display control device is a head-mounted display.

15. A control method for a display control device for controlling a head-mounted display device having an imaging unit that images real space and is capable of communicating with an external device, comprising: a determination step of acquiring output information output from the external device and determining whether the output information represents any of incoming call information, call information, and received information; a control step of causing the imaging unit to start imaging the real space and causing the head-mounted display device to display a selection screen for controlling the imaging unit to stop a rendering process for rendering the virtual space to be displayed on the head-mounted display device; A control method for a display control device, comprising:

16. A program for causing a computer to function as a display control device described in any one of claims 1 to 14.

Images