Virtual image presentation method and virtual image presentation system

By defining the target area in the display screen of the head-mounted display device and presenting virtual alternative images, the problem of degradation of external image resolution in hybrid reality technology is solved, and the user experience is improved.

CN120215679APending Publication Date: 2025-06-27ACER INC
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202311788598.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-12-25
Publication Date
2025-06-27

AI Technical Summary

Technical Problem

In this stage of hybrid reality technology, when the head-mounted monitor captures external images through the lens, the resolution will drop significantly, affecting the user experience.

Method used

Positioning information is obtained through the sensor in the mobile control device, the target area is defined in the display screen of the head-mounted display device, the display interface of the external display device is replaced, and a virtual replacement image is placed in the target area according to the target image data.

Benefits of technology

It effectively improves the clarity of external monitor images viewed by users through head-mounted monitors and improves user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120215679A_ABST
    Figure CN120215679A_ABST
Patent Text Reader

Abstract

A virtual image presentation method and a virtual image presentation system are provided. The method comprises the following steps: acquiring positioning information of the mobile control device through a sensor in the mobile control device; defining a target area in a display picture of the head-mounted display device according to the positioning information, wherein the target area is used for replacing a display interface of an external display device in the display picture; obtaining target image data; and when the display frame is displayed through a display interface of the head-mounted display device, a virtual replacement image is projected in the target area according to the target image data.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a virtual imaging technology, and particularly to a method and a system for presenting virtual images. Background Art

[0002] With the progress of technology, Mixed Reality (MR) technology has gradually replaced the simple virtual reality technology as the mainstream display technology for head-mounted displays. However, one of the problems encountered by the current mixed reality technology is that when the external image captured by the head-mounted display through the lens contains the image displayed by a real display in the physical space, even if the display is preset to present the image at a very high resolution (such as FHD or 4K, etc.), once the image captured through the lens is presented by the head-mounted display, the resolution of the image presented on the display screen of the head-mounted display often drops significantly, thus affecting the user experience. Summary of the Invention

[0003] The present invention provides a method and a system for presenting virtual images, which can solve the above problems.

[0004] An embodiment of the present invention provides a method for presenting virtual images, which is used for a head-mounted display device. The method for presenting virtual images includes: obtaining the positioning information of the mobile control device through a sensor in the mobile control device; defining a target area in the display screen of the head-mounted display device according to the positioning information, where the target area is used to replace the display interface of an external display device in the display screen; obtaining target image data; and during the presentation of the display screen through the display interface of the head-mounted display device, placing a virtual replacement image in the target area according to the target image data.

[0005] Another embodiment of the present invention provides a system for presenting virtual images, which includes a mobile control device, a head-mounted display device, and a processor. The mobile control device is configured with a sensor. The processor is coupled to the mobile control device and the head-mounted display device. The processor is used to: obtain the positioning information of the mobile control device through the sensor in the mobile control device; define a target area in the display screen of the head-mounted display device according to the positioning information, where the target area is used to replace the display interface of an external display device in the display screen; obtain target image data; and during the presentation of the display screen through the display interface of the head-mounted display device, place a virtual replacement image in the target area according to the target image data.

[0006] Based on the above, after obtaining the positioning information of the mobile control device through the sensors in the mobile control device, the target area can be defined in the display screen of the head-mounted display device according to this positioning information. In particular, this target area is used to replace the display interface of the external display device in the display screen of the head-mounted display device. After obtaining the target image data, during the period when the display screen is presented through the display interface of the head-mounted display device, the virtual replacement image can be projected into this target area according to this target image data. Thereby, the clarity of the image presented by the external display device viewed by the user through the head-mounted display can be effectively improved, and thus the user experience can be enhanced. Description of the Drawings

[0007] Figure 1 is a schematic diagram of a virtual image presentation system illustrated according to an embodiment of the present invention.

[0008] Figure 2 is a schematic diagram of an operation scenario illustrated according to an embodiment of the present invention.

[0009] Figure 3 is a schematic diagram of the display screen of a head-mounted display device illustrated according to an embodiment of the present invention.

[0010] Figure 4 is a schematic diagram of defining a target area in the display screen of a head-mounted display device illustrated according to an embodiment of the present invention.

[0011] Figure 5 is a schematic diagram of projecting a virtual replacement image into a target area illustrated according to an embodiment of the present invention.

[0012] Figure 6 is a schematic diagram of a target area illustrated according to an embodiment of the present invention.

[0013] Figure 7 is a flowchart of a virtual image presentation method illustrated according to an embodiment of the present invention.

[0014] Wherein,

[0015] 10: Virtual image presentation system;

[0016] 11: Head-mounted display device;

[0017] 111, 201: Display interface;

[0018] 112, 122: Communication interface;

[0019] 113: Image capture interface;

[0020] 114: Processor;

[0021] 12: Mobile control device;

[0022] 121: Sensor;

[0023] 21: External display device;

[0024] 31: Display screen;

[0025] 301: Image (target image);

[0026] 401, 601: Area (target area);

[0027] P0 to P4: Coordinate positions;

[0028] W: Width;

[0029] H: Height;

[0030] S701 to S704: Steps. Detailed implementation

[0031] Figure 1 is a schematic diagram of a virtual image presentation system shown according to an embodiment of the present invention. Please refer to Figure 1 , the virtual image presentation system 10 includes a head-mounted display device 11 and a mobile control device 12. The head-mounted display device 11 may include various types of head-mounted displays. The mobile control device 12 may include a remote control, a control stick, or a similar operating device paired with the head-mounted display device 11. The head-mounted display device 11 may be coupled to the mobile control device 12 in a wired or wireless manner.

[0032] The head-mounted display device 11 includes a display interface 111, a communication interface 112, an image capture interface 113, and a processor 114. The display interface 111 is used to display images. For example, the display interface 111 may include a plasma display, a liquid-crystal display (LCD), a thin-film transistor liquid-crystal display (TFT-LCD), an organic light-emitting diode (OLED), and a light-emitting diode display (LED display), etc., and the type of the display interface 111 is not limited thereto.

[0033] The communication interface 112 is used to couple to the mobile control device 12 in a wired or wireless manner. For example, the communication interface 112 may include communication circuitry and may transmit signals to or receive signals from the mobile control device 12 in a wired or wireless manner. For example, the communication interface 112 may support various wired or wireless communication standards such as Bluetooth, Wifi, and / or Universal Serial Bus (USB), and the communication standards supported by the communication interface 112 are not limited thereto.

[0034] The image capture interface 113 is used to capture external images. For example, the image capture interface 113 may include an image capture module. This image capture module at least includes a lens and a photosensitive element. This image capture module (including the lens and the photosensitive element) can be used to capture the external images. For example, the image capture interface 113 may be disposed outside the head-mounted display device 11 and can be used to capture the image directly in front of the head-mounted display device 11.

[0035] The processor 114 is coupled to the display interface 111, the communication interface 112, and the image capture interface 113. The processor 114 is responsible for the overall or partial operation of the head-mounted display device 11. For example, the processor 114 may include a Central Processing Unit (CPU) or other programmable general-purpose or special-purpose microprocessors, Digital Signal Processors (DSPs), programmable controllers, Application-Specific Integrated Circuits (ASICs), Programmable Logic Devices (PLDs), or other similar devices or combinations of these devices.

[0036] The mobile control device 12 includes a sensor 121 and a communication interface 122. The sensor 121 is used to sense the position and orientation of the mobile control device 12 in the physical space and generate sensing information (also referred to as positioning information). This positioning information can reflect the position and orientation of the mobile control device 12 in the physical space. For example, the position of the mobile control device 12 in the physical space may include the position of the mobile control device 12 in a three-dimensional (3D) space and is represented by three-dimensional coordinates. In addition, the orientation of the mobile control device 12 in the physical space can reflect the tilt state of the mobile control device 12 in the three-dimensional space. For example, the sensor 121 may include a gravity sensor, an acceleration sensor, a magnetic sensor, a gyroscope, a distance sensor, a light sensor, a capacitance sensor, a resistance sensor, and a pressure sensor, etc., and the types and quantities of the sensor 121 in the present invention are not limited.

[0037] The communication interface 122 is used to couple to the head-mounted display device 11 in a wired or wireless manner. For example, the communication interface 122 may include a communication circuit and may transmit signals to or receive signals from the head-mounted display device 11 in a wired or wireless manner. For example, the communication interface 122 may support various wired or wireless communication standards such as Bluetooth, Wifi, and / or USB, and the communication standards supported by the communication interface 122 are not limited thereto.

[0038] In one embodiment, the processor 114 may obtain the positioning information of the mobile control device 12 through the sensor 121 in the mobile control device 12. For example, after the sensor 121 generates the positioning information, the mobile control device 12 may transmit this positioning information to the processor 114 through the communication interface 122. The processor 114 may obtain the position (such as the coordinates of the mobile control device 12 in the physical space) and the attitude (such as the tilt state of the mobile control device 12 in the physical space) of the mobile control device 12 based on this positioning information.

[0039] In one embodiment, the processor 114 may define a region (also referred to as a target region) in the display screen of the head-mounted display device 11 based on this positioning information. For example, the external image captured through the image capture interface 113 may be presented in this display screen. In particular, this target region can be used to replace the display interface of another display device (also referred to as an external display device) in this display screen. For example, this external display device is another display device located in the physical space, and the display interface of the external display device refers to the display of the external display device.

[0040] In one embodiment, after determining the target region, the processor 114 may obtain image data (also referred to as target image data). During the period when the display screen is presented through the display interface 111 of the head-mounted display device 11, the processor 114 may project a replacement image (also referred to as a virtual replacement image) in the target region according to the target image data. For example, this virtual replacement image can be used to replace the image originally presented by the display interface of the external display device in the physical space in the display screen, so as to improve the clarity of the image presented by the display interface of the external display device in the display screen.

[0041] In one embodiment, during the projection of the virtual replacement image, in the display screen presented by the display interface 111, this virtual replacement image will cover the display interface of the external display device. Thus, in the display screen presented by the display interface 111, this virtual replacement image can be used to replace the image currently presented by the display interface of the external display device in the physical space.

[0042] In one embodiment, during the projection of the virtual replacement image, the image corresponding to the virtual replacement image (also referred to as the target image) can be synchronously presented on the display interface of the external display device. For example, the virtual replacement image and this target image can include the same or different image contents. Thereby, when the user views the target image presented on the display interface of the external display device through the display screen presented on the display interface 111 of the head-mounted display device 11, in the display screen presented on the display interface 111, the target image actually presented by the display interface of the external display device will be automatically replaced by the virtual replacement image. Thereby, even if the clarity of the target image captured by the image capture interface 113 is not good, the user can still view a virtual replacement image with higher clarity in the display screen presented on the display interface 111, thereby improving the user experience.

[0043] Figure 2 is a schematic diagram of an operation scenario illustrated according to an embodiment of the present invention. Please refer to Figure 2 and the user can wear the head-mounted display device 11 at an appropriate position on the head (covering at least one or both eyes of the user) and operate the mobile control device 12 with the hand. In particular, after wearing the head-mounted display device 11 at an appropriate position on the head, the user's eyes can view the external image through the display screen presented by the head-mounted display device 11 (i.e., the display interface 111). For example, when the user is facing the display interface 201 of the external display device 21, the display interface 201 of the external display device 21 can be presented in this external image.

[0044] It should be noted that in Figure 2 the embodiment, the external display device 21 takes a notebook computer as an example, so the display interface 201 of the external display device 21 refers to the screen of the notebook computer. However, in other embodiments, the external display device 21 can also include various display devices such as smart phones, televisions, game consoles, etc. that have a display interface and support the image display function, and the present invention does not limit the type of the external display device 21.

[0045] Figure 3 is a schematic diagram of the display screen of the head-mounted display device illustrated according to an embodiment of the present invention. Please refer to Figure 2 and Figure 3 , in the case where the virtual replacement image is not presented, the display screen 31 can be presented in the display interface 111 of the head-mounted display device 11. In particular, when the user is facing the display interface 201 of the display device 21 (as in Figure 2As shown, on the display screen 31, the display interface 201 of the display device 21 and the image (i.e., the target image) 301 presented by the display interface 201 can be presented. However, in practice, the image clarity and / or resolution of the target image presented on the display screen 31 often fail to meet expectations, resulting in a reduced user experience.

[0046] Please return to Figure 2 , in an embodiment, the user can move the mobile control device 12 to the center of the display interface 201 and adjust the posture of the mobile control device 12 (such as the tilt state) to reflect the position (such as the coordinates of the display interface 201 in the three-dimensional space) and posture (such as the tilt state of the display interface 201 in the three-dimensional space) of the current display interface 201 in the physical space. At this time, according to the positioning information from the mobile control device 12, the processor 114 can synchronously obtain (or evaluate) the position and posture of the current display interface 201 in the physical space.

[0047] Figure 4 is a schematic diagram of defining a target area in the display screen of the head-mounted display device according to an embodiment of the present invention. Please refer to Figure 4 , in an embodiment, according to the positioning information of the mobile control device 12, the processor 114 can define an area 401 (i.e., the target area) in the display screen 31 of the head-mounted display device 11. The processor 114 can adjust the position (such as the position of the area 401 in the virtual space) and posture (such as the tilt state of the area 401 in the virtual space) of the area 401 in the display screen 31 according to the positioning information of the mobile control device 12. The adjusted position and posture of the area 401 can reflect the position and posture of the display interface 201 of the external display device 21 in the physical space.

[0048] Figure 5 is a schematic diagram of projecting a virtual replacement image in the target area according to an embodiment of the present invention. Please refer to Figure 5 , continuing with the Figure 4 embodiment, after configuring the area 401, during the period when the display screen 31 is presented through the display interface 11 of the head-mounted display device 11, the processor 114 can project a replacement image (i.e., a virtual replacement image) in the area 401 according to specific image data (i.e., target image data). For example, after projecting the virtual replacement image, in the display screen 31, this virtual replacement image can obscure (i.e., replace) the image (i.e., the target image) currently presented by the display interface 201 of the external display device 21. Thereby, compared with Figure 3 the target image that is preset to be presented on the display screen 31, in the Figure 5 embodiment, the user can view a virtual replacement image with higher image clarity and / or resolution in the display screen 31, thereby improving the user experience.

[0049] In one embodiment, according to the positioning information of the mobile control device 12, the processor 114 can set the position of the target area in the display screen of the head-mounted display device 11. For example, the processor 114 can set the position of the center point of the target area in the display screen of the head-mounted display device 11 according to the positioning information of the mobile control device 12 (i.e., the position of the mobile control device 12).

[0050] In one embodiment, the processor 114 can obtain the screen size information corresponding to the external display device. This screen size information can reflect the size (such as width and height) of the display interface of the external display device in the physical space. The processor 114 can define the target area in the display screen of the head-mounted display device 11 according to this screen size information.

[0051] In one embodiment, the processor 114 can receive a user operation. This user operation can be used to select the external display device from at least one candidate device. According to this user operation, the processor 114 can obtain the identification information corresponding to the external display device. For example, this identification information can reflect the number, model, or other information that can be used to identify the external display device of the external display device. Then, the processor 114 can query the database according to this identification information to obtain the screen size information of the external display device.

[0052] In one embodiment, the processor 114 can obtain the device description information corresponding to the external display device. For example, this device description information can include the Extended Display Identification Data (EDID) of the external display device or other similar information. This device description information can carry the screen size information of the external display device. After obtaining the device description information of the external display device, the processor 114 can obtain the screen size information of the external display device from this device description information.

[0053] Figure 6 is a schematic diagram of the target area shown according to an embodiment of the present invention. Please refer to Figure 6 , assuming that the area 601 is the target area. The center point of the area 601 corresponds to the coordinate position P0, and the four corners of the area 601 respectively correspond to the coordinate positions P1 to P4.

[0054] In one embodiment, the processor 114 can determine the coordinate positions P0 to P4 according to the positioning information of the mobile control device 12 and the screen size information of the external display device 21. Then, the processor 114 can define the area 601 in the image screen presented by the display interface 11 of the head-mounted display device 11 (such as Figure 4 andFigure 5 in the display screen 31).

[0055] In one embodiment, according to the positioning information of the mobile control device 12, the processor 114 can determine the coordinate position P0. For example, the processor 114 can convert the coordinates of the mobile control device 12 in the physical space (also known as physical space coordinates) into the coordinates of the mobile control device 12 in the virtual space (also known as virtual space coordinates) through a coordinate conversion formula. The processor 114 can set the coordinate position P0 according to this virtual space coordinate. Then, the processor 114 can determine the center point position of the area 601 in the image screen presented on the display interface 11 according to the coordinate position P0.

[0056] In one embodiment, after determining the coordinate position P0, the processor 114 can determine the width W and height H of the area 601 according to the screen size information of the external display device 21. For example, the ratio of the width W to the height H of the area 601 can be the same as or similar to the ratio of the actual width to the height of the display interface 201.

[0057] In one embodiment, the processor 114 can adjust the width W and height H according to the distance between the head-mounted display device 11 and the mobile control device 12. For example, the width W and height H can be negatively correlated with the distance between the head-mounted display device 11 and the mobile control device 12. That is, if the distance between the head-mounted display device 11 and the mobile control device 12 is farther, the width W and height H are smaller.

[0058] In one embodiment, the processor 114 can set the parameters (also known as distance parameters) in the distance conversion formula according to the distance between the head-mounted display device 11 and the mobile control device 12. Then, the processor 114 can substitute the screen size information of the external display device 21 into this distance conversion formula to obtain the width W and height H. After obtaining the width W and height H, the processor 114 can obtain the coordinate positions P1 to P4 according to the coordinate position P0, the width W, and the height H.

[0059] In one embodiment, according to the positioning information of the mobile control device 12, the processor 114 can also set the attitude (such as the tilt state) of the target area in the display screen of the head-mounted display device 11. For example, the processor 114 can set the attitude (such as the tilt state) of the plane (also known as the target plane) where the target area is located in the display screen of the head-mounted display device 11 according to the positioning information of the mobile control device 12 (that is, the attitude of the mobile control device 12).

[0060] To Figure 6For example, based on the positioning information of the mobile control device 12 (such as the attitude of the mobile control device 12), the processor 114 can perform an attitude transformation on the plane formed by the four corners of the area 601 (i.e., the coordinate positions P1 to P4) (i.e., the target plane). This attitude transformation can be used to change the attitude (i.e., the tilt state) of the target plane in the virtual space. After adjusting the attitude of the target plane in the virtual space, the attitude of the area 601 in the virtual space can correspond to, be consistent with, or match the attitude of the display interface 201 of the external display device 21 in the physical space.

[0061] In one embodiment, the processor 114 can set the parameters (also called attitude parameters) in the attitude transformation formula according to the positioning information of the mobile control device 12. For example, this attitude parameter can reflect the current attitude (i.e., the tilt state) of the display interface 201 of the external display device 21 in the physical space. Then, the processor 114 can adjust the coordinate positions P1 to P4 according to this attitude transformation formula. For example, the adjusted coordinate positions P1 to P4 can correspond to the new coordinate positions of the four corners of the area 601 after the attitude transformation.

[0062] In one embodiment, assume that the coordinate positions P1 to P4 are [x1, y1, z1], [x2, y2, z2], [x3, y3, z3], and [x4, y4, z4] respectively, and the attitude transformation formula is R(q), where the parameter q is the attitude parameter. For example, R(q) can include a 3×3 matrix. After setting the parameter q in the attitude transformation formula R(q) according to the positioning information of the mobile control device 12, the processor 114 can substitute the coordinate positions P1 to P4 into the attitude transformation formula R(q) for calculation and obtain the new coordinate positions P1' to P4'. For example, the coordinate positions P1' to P4' can be obtained through P1×R(q), P2×R(q), P3×R(q), and P4×R(q) respectively. Those skilled in the art should know how to establish and set the attitude transformation formula, which will not be elaborated here. Then, the processor 114 can define the area 601 in the image screen presented by the display interface 11 of the head-mounted display device 11 according to the coordinate positions P0 and P1' to P4' (i.e., the adjusted P1 to P4) (such as Figure 4 and Figure 5 the display screen 31). Thereby, the tilt state of the virtual replacement image presented in the target area can be the same as or similar to the tilt state of the target image presented synchronously (or preset) in the display interface 201 of the external display device 21, thereby further improving the fidelity of the presented virtual replacement image.

[0063] In one embodiment, the head-mounted display device 11 and the external display device operate in a wired and / or wireless network connection environment. Therefore, the processor 114 of the head-mounted display device 11 can obtain the image data (i.e., the target image data) of the target image that is preset to be presented by the display interface of the external display device (such as Figure 2 the display interface 201 of the external display device 21). Then, the processor 114 can project a virtual replacement image according to this target image data. In one embodiment, the above operations performed by the processor 114 can also be performed by a control host or server disposed outside the head-mounted display device 11, and the present invention is not limited thereto.

[0064] Figure 7 is a flowchart of a virtual image presentation method according to an embodiment of the present invention. Please refer to Figure 7 , in step S701, the positioning information of the mobile control device is obtained through a sensor in the mobile control device. In step S702, a target area is defined in the display screen of the head-mounted display device according to the positioning information, where the target area is used to replace the display interface of the external display device in the display screen. In step S703, the target image data is obtained. In step S704, during the period when the display screen is presented through the display interface of the head-mounted display device, a virtual replacement image is projected in the target area according to the target image data.

[0065] However, Figure 7 The steps in Figure 7 have been described in detail above and will not be repeated here. It should be noted that Figure 7 The steps in

[0066] can be implemented as multiple program codes or circuits, and the present invention is not limited thereto. In addition, Figure 7 The method of

[0066] can be used in conjunction with the above exemplary embodiments or used alone, and the present invention is not limited thereto.

[0066] In summary, the virtual image presentation method and the virtual image presentation system proposed by the exemplary embodiments of the present invention can use a virtual replacement image to replace the image preset or actually presented by the display interface of the external display device in the display screen of the head-mounted display device during the period when the user views the external image through the display interface of the head-mounted display device. Thereby, the clarity of the image presented by the external display device viewed by the user through the head-mounted display can be effectively improved, and the user experience can be further enhanced.

[0067] Although the present invention has been disclosed above with embodiments, it is not intended to limit the present invention. Any person skilled in the art can make some modifications and refinements without departing from the spirit and scope of the present invention. Therefore, the protection scope of the present invention shall be subject to what is defined by the claims.

Claims

1. A virtual image presentation method for a head-mounted display device, the virtual image presentation method comprising: Obtaining positioning information of the mobile control device through a sensor in the mobile control device; Defining a target area in the display screen of the head-mounted display device according to the positioning information, wherein the target area is used to replace the display interface of an external display device in the display screen; Obtaining target image data; And During the presentation of the display screen through the display interface of the head-mounted display device, projecting a virtual replacement image in the target area according to the target image data.

2. The virtual image presentation method according to claim 1, wherein The positioning information reflects the position and attitude of the mobile control device in the physical space.

3. The virtual image presentation method according to claim 1, characterized in that During the projection of the virtual replacement image, in the display screen, the virtual replacement image obscures the display interface of the external display device.

4. The virtual image presentation method according to claim 1, wherein, During the projection of the virtual replacement image, the target image corresponding to the virtual replacement image is synchronously presented in the display interface of the external display device.

5. The virtual image presentation method according to claim 1, characterized in that, The step of defining the target area in the display screen of the head-mounted display device according to the positioning information includes: Setting the position and attitude of the target area in the display screen according to the positioning information.

6. The virtual image presentation method according to claim 1, wherein The step of defining the target area in the display screen of the head-mounted display device according to the positioning information includes: Obtaining screen size information corresponding to the external display device; and Defining the target area in the display screen of the head-mounted display device according to the screen size information.

7. The virtual image presentation method according to claim 6, wherein The step of obtaining the screen size information corresponding to the external display device includes: Receiving a user operation; Obtaining identification information corresponding to the external display device according to the user operation; and Querying a database according to the identification information to obtain the screen size information.

8. The virtual image presentation method according to claim 6, wherein The step of obtaining the screen size information corresponding to the external display device includes: Obtaining device description information corresponding to the external display device; and Obtaining the screen size information from the device description information.

9. A virtual image presentation system, comprising: A mobile control device configured with a sensor; A head-mounted display device; And A processor coupled to the mobile control device and the head-mounted display device, wherein the processor is configured to: Obtain positioning information of the mobile control device through the sensor in the mobile control device; Define a target area in the display screen of the head-mounted display device according to the positioning information, wherein the target area is used to replace the display interface of an external display device in the display screen; Obtain target image data; And During the presentation of the display screen through the display interface of the head-mounted display device, project a virtual replacement image in the target area according to the target image data.

10. The virtual image presentation system according to claim 9, wherein The positioning information reflects the position and attitude of the mobile control device in the physical space.

11. The virtual image presentation system according to claim 9, wherein During the projection of the virtual replacement image, in the display screen, the virtual replacement image obscures the display interface of the external display device.

12. The virtual image presentation system according to claim 9, wherein, During the projection of the virtual replacement image, the target image corresponding to the virtual replacement image is synchronously presented in the display interface of the external display device.

13. The virtual image presentation system according to claim 9, characterized in that, The operation of the processor to define the target area in the display screen of the head-mounted display device according to the positioning information includes: Setting the position and orientation of the target area in the display screen according to the positioning information.

14. The virtual image presentation system according to claim 9, wherein The operation of the processor to define the target area in the display screen of the head-mounted display device according to the positioning information includes: Obtaining screen size information corresponding to the external display device; and Defining the target area in the display screen of the head-mounted display device according to the screen size information.

15. The virtual image presentation system according to claim 14, wherein The operation of the processor to obtain the screen size information corresponding to the external display device includes: Receiving a user operation; Obtaining identification information corresponding to the external display device according to the user operation; and Querying a database according to the identification information to obtain the screen size information.

16. The virtual image presentation system according to claim 14, wherein The operation of the processor to obtain the screen size information corresponding to the external display device includes: Obtaining device description information corresponding to the external display device; and Obtaining the screen size information from the device description information.