Super-resolution screen projection method, head-mounted display device and computer readable medium
By creating a virtual display screen in a head-mounted display device and combining the screen projection data container and display window object, the display quality problems caused by the low resolution of the screen projection device are solved, and a high-resolution and immersive screen projection experience is achieved.
Patent Information
- Application Number
- CN202411495351.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-24
- Publication Date
- 2025-02-18
Smart Images
Figure CN119477692A_ABST
Abstract
Description
Technical Field
[0001] Embodiments of the present disclosure relate to the field of computer technology, and in particular to a super-resolution screen projection method, a head-mounted display device, and a computer-readable medium. Background Art
[0002] Screen projection refers to the technology of displaying the screen content of a device on another device (such as a monitor or TV). In actual application, users prefer to project the display content of portable mobile devices (such as mobile phones or laptops) to devices with larger display screens in pursuit of a wider field of view and a better viewing experience. At present, when performing screen projection, the commonly used method is: the mobile terminal transmits the screen content to the projection device, and the projection device displays the received screen content.
[0003] However, when the above method is used for screen projection, the following technical problems often occur: when the inherent resolution of the projection device is lower than the resolution of the mobile terminal, the displayed content of the projection is limited by the inherent resolution of the projection device, resulting in poor display quality, thereby reducing the user's projection viewing experience.
[0004] The above information disclosed in this Background section is only for enhancement of understanding of the background of the inventive concept and therefore it may contain information that does not form the prior art that is already known in this country to a person of ordinary skill in the art. Summary of the invention
[0005] The content of this disclosure is used to introduce concepts in a brief form, which will be described in detail in the detailed implementation section below. The content of this disclosure is not intended to identify the key features or essential features of the technical solution claimed for protection, nor is it intended to limit the scope of the technical solution claimed for protection.
[0006] Some embodiments of the present disclosure propose a super-resolution screen projection method, a head-mounted display device, and a computer-readable medium to solve one or more of the technical problems mentioned in the above background technology section.
[0007] In a first aspect, some embodiments of the present disclosure provide a super-resolution screen projection method based on a head-mounted display device, the method comprising: creating a screen projection data container and a display window object according to a target operating system, wherein the screen projection data container is bound to the display window object, and the target operating system is the operating system of the head-mounted display device; creating a virtual display screen according to the target operating system, wherein the resolution of the virtual display screen corresponds to the target resolution; in response to receiving a screen projection request sent by a target terminal, obtaining content to be projected, wherein the target terminal is a terminal device in the same local area network as the head-mounted display device; and projecting the received content to be projected to the three-dimensional space in the head-mounted display device according to the screen projection data container, the display window object and the virtual display screen.
[0008] Optionally, the above-mentioned creation of a projection data container and a display window object according to the target operating system includes: creating a projection data container, wherein the above-mentioned texture data container is used to cache the content to be projected; creating a display window object according to the above-mentioned target operating system, wherein the above-mentioned display window object is used to render the content to be projected; and binding the above-mentioned display window object to the above-mentioned projection data container.
[0009] Optionally, the above-mentioned acquisition of the content to be projected includes: establishing a communication connection with the above-mentioned target terminal through a local area network; receiving the content to be projected transmitted by the above-mentioned target terminal through the established communication connection; and caching the received content to be projected into the above-mentioned projection data container.
[0010] Optionally, the above-mentioned projecting the received content to be projected to the three-dimensional space in the above-mentioned head-mounted display device according to the above-mentioned projection data container, the above-mentioned display window object and the above-mentioned virtual display screen includes: rendering the content to be projected cached in the above-mentioned projection data container to the above-mentioned virtual display screen through the above-mentioned display window object; and displaying the virtual display screen after projection in the three-dimensional space in the above-mentioned head-mounted display device.
[0011] Optionally, before obtaining the content to be projected, the method further includes: running a target projection application on the virtual display screen, wherein the running target projection application is used to receive a projection request.
[0012] In a second aspect, some embodiments of the present disclosure provide a head-mounted display device, comprising: one or more processors; an optical display system, comprising at least one display screen and an optical element for imaging in front of the eyes of a user; and a storage device, on which one or more programs are stored, and when the one or more programs are executed by the one or more processors, the one or more processors implement the method described in any implementation manner of the first aspect.
[0013] In a third aspect, some embodiments of the present disclosure provide a computer-readable medium having a computer program stored thereon, wherein when the program is executed by a processor, the method described in any implementation manner of the above-mentioned first aspect is implemented.
[0014] The above-mentioned embodiments of the present disclosure have the following beneficial effects: through the super-resolution screen projection method based on the head-mounted display device of some embodiments of the present disclosure, a screen projection method that exceeds the inherent resolution limit of the screen projection device is provided, and the resolution of the screen projection content and the screen projection display effect are improved, thereby improving the user viewing experience. Specifically, the reason for the poor screen projection display effect and the poor user viewing experience is that when the inherent resolution of the screen projection device is lower than the resolution of the mobile terminal, the displayed screen content is limited by the inherent resolution of the screen projection device, and the display quality is poor, thereby reducing the user viewing experience. Based on this, the super-resolution screen projection method of some embodiments of the present disclosure, first, according to the target operating system, creates a screen projection data container and a display window object. Among them, the above-mentioned screen projection data container is bound to the above-mentioned display window object. The above-mentioned target operating system is the operating system of the above-mentioned head-mounted display device. Thus, a screen projection data container for caching the screen projection data sent by the mobile terminal and a display window object for displaying the screen projection content can be created, so as to process the screen projection display data to be sent by the subsequent mobile terminal. Then, according to the above-mentioned target operating system, a virtual display screen is created. Among them, the resolution of the above-mentioned virtual display screen corresponds to the target resolution. Thus, a virtual display screen with a high resolution corresponding to the target resolution can be created. Afterwards, in response to receiving a projection request sent by the target terminal, the content to be projected is obtained. Among them, the above-mentioned target terminal is a terminal device in the same local area network as the above-mentioned head-mounted display device. Thus, after the target terminal initiates a projection request, the content data to be projected transmitted by the target terminal can be received through the local area network. Finally, according to the above-mentioned projection data container, the above-mentioned display window object and the above-mentioned virtual display screen, the received content to be projected is projected to the three-dimensional space in the above-mentioned head-mounted display device. Thus, the virtual display screen displaying the projection content can be mapped to the three-dimensional display environment displayed by the head-mounted display device. By creating a virtual display screen corresponding to the target resolution, the projection content can exceed the inherent resolution limit of the traditional display device, thereby improving the resolution of the projection content and the projection display effect, thereby improving the user's projection viewing experience. In addition, by displaying the virtual display screen in the three-dimensional space in the head-mounted display device, a more immersive projection viewing experience can also be provided to the head-mounted display device user. BRIEF DESCRIPTION OF THE DRAWINGS
[0015] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the accompanying drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and that components and elements are not necessarily drawn to scale.
[0016] Figure 1 is an architectural diagram of an exemplary system in which some embodiments of the present disclosure may be applied;
[0017] Figure 2 is a flowchart of some embodiments of a super-resolution screen projection method based on a head-mounted display device according to the present disclosure;
[0018] Figure 3 is a flowchart of other embodiments of the super-resolution screen projection method based on a head-mounted display device according to the present disclosure;
[0019] Figure 4 is a schematic diagram of a projection scene in a three-dimensional space displayed by a head-mounted display device according to the present disclosure;
[0020] Figure 5 It is a schematic diagram of the structure of an electronic device suitable for implementing some embodiments of the present disclosure. DETAILED DESCRIPTION
[0021] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.
[0022] It should also be noted that, for ease of description, only the parts related to the invention are shown in the drawings. In the absence of conflict, the embodiments and features in the embodiments of the present disclosure can be combined with each other.
[0023] It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.
[0024] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".
[0025] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.
[0026] The present disclosure will be described in detail below with reference to the accompanying drawings and in conjunction with embodiments.
[0027] Figure 1 An exemplary system architecture 100 of a super-resolution screen projection method based on a head-mounted display device to which some embodiments of the present disclosure can be applied is shown.
[0028] like Figure 1 As shown, the system architecture 100 may include terminal devices 101, 102, 103, a network 104 and a server 105. The network 104 is used to provide a medium for communication links between the terminal devices 101, 102, 103 and the server 105. The network 104 may include various connection types, such as wired, wireless communication links or optical fiber cables, etc.
[0029] Users can use terminal devices 101, 102, 103 to interact with server 105 through network 104 to receive or send messages, etc. Various communication client applications can be installed on terminal devices 101, 102, 103, such as web browser applications, program development applications, search applications, instant messaging tools, email clients, social platform software, etc. Terminal device 103 can be a head-mounted display device. Various screen projection applications can be installed on terminal device 103.
[0030] Terminal devices 101 and 102 can be hardware or software. When terminal devices 101 and 102 are hardware, they can be various electronic devices with display screens and supporting information display, including but not limited to smart phones, tablet computers, e-book readers, laptop computers, desktop computers, etc. When terminal devices 101 and 102 are software, they can be installed in the electronic devices listed above. They can be implemented as multiple software or software modules for providing distributed services, or they can be implemented as a single software or software module. No specific limitation is made here.
[0031] The server 105 may be a server that provides various services, such as a background server that provides support for information displayed on the terminal devices 101, 102, and 103. The background server may analyze and process the received request and other data, and feed back the processing results to the terminal device.
[0032] It should be noted that the super-resolution screen projection method based on the head-mounted display device provided in the embodiment of the present disclosure can be executed by the smart terminal included in the terminal device 103.
[0033] It should be noted that the server can be hardware or software. When the server is hardware, it can be implemented as a distributed server cluster consisting of multiple servers, or it can be implemented as a single server. When the server is software, it can be implemented as multiple software or software modules for providing distributed services, or it can be implemented as a single software or software module. No specific limitation is made here.
[0034] Continue to refer Figure 2 , shows a process 200 of some embodiments of the super-resolution screen projection method based on a head-mounted display device according to the present disclosure. The super-resolution screen projection method based on a head-mounted display device includes the following steps:
[0035] Step 201, create a screen projection data container and display window object according to the target operating system.
[0036] In some embodiments, an execution subject (eg, Figure 1 The computing device 103 shown in the figure can create a projection data container and a display window object according to the target operating system. Among them, the projection data container is bound to the display window object. The target operating system is the operating system of the head-mounted display device. As an example, the target operating system may be an Android system. The execution subject may be a head-mounted display device. The projection data container may be a data container for caching the received projection content. As an example, the projection data container may be a texture object for caching graphic data. The display window object may be an interface object for rendering graphics to be projected. The head-mounted display device may be a device for a wearing user to view a virtual scene or a three-dimensional space scene. For example, the head-mounted display device may be, but is not limited to, one of the following: AR glasses, MR glasses, VR glasses.
[0037] In some optional implementations of some embodiments, the execution subject may create a screen projection data container and a display window object according to the target operating system through the following steps:
[0038] The first step is to create a projection data container. The texture data container is used to cache the content to be projected. In practice, the execution subject can call the relevant library function in the open graphics library (for example, the glGenTextures() method in the OpenGL library) to create a texture object as the projection data container.
[0039] The second step is to create a display window object according to the target operating system. The display window object is used to render the content to be projected. In practice, the execution subject can call the Surface() class in the target operating system to create a Surface object as the display window object.
[0040] The third step is to bind the above-mentioned display window object to the above-mentioned projection data container. In practice, the above-mentioned execution subject can create a SurfaceTexture object and associate the texture identification information representing the above-mentioned projection data container. The above-mentioned texture identification information can be a string. Then, the above-mentioned execution subject can determine the above-mentioned SurfaceTexture object as the object parameter of the above-mentioned display window object to bind the above-mentioned display window object to the above-mentioned projection data container.
[0041] Step 202: Create a virtual display screen according to the target operating system.
[0042] In some embodiments, the execution subject may create a virtual display screen according to the target operating system. The resolution of the virtual display screen corresponds to the target resolution. The target resolution may be a resolution set in advance or set by the target user. The target user may be a user wearing the head-mounted display device. As an example, the target resolution may be 3840x1080 resolution. In practice, the execution subject may call an interface service (e.g., DisplayManagerService interface service) in the target operating system to create a display area of a preset size corresponding to the target resolution as a virtual display screen. The display area corresponding to the target resolution may be a display area with the same resolution as the target resolution. It should be noted that the shape type of the virtual display screen may be, but is not limited to, a flat screen and a curved screen, which is not limited here.
[0043] Step 203, in response to receiving the screen projection request sent by the target terminal, obtaining the content to be projected.
[0044] In some embodiments, the above-mentioned execution entity may obtain the content to be projected in response to receiving a projection request sent by the target terminal. The above-mentioned target terminal is a terminal device in the same local area network as the above-mentioned head-mounted display device. The above-mentioned content to be projected may be but is not limited to images, videos and screen mirroring of the target terminal display screen. As an example, the above-mentioned target terminal may be a terminal device with a projection service turned on. For example, when the above-mentioned target terminal is a terminal device of the IOS operating system, the above-mentioned projection service may be the AirPlay projection service. When the above-mentioned target terminal is a terminal device of the Windows operating system or the Android operating system, the above-mentioned projection service may be the Miracast projection service.
[0045] Optionally, before obtaining the content to be projected, the execution body may also run the target projection application on the virtual display screen. The target projection application is an application for receiving projection requests. In practice, the execution body may run the target projection application and display the application interface of the target projection application on the virtual display screen.
[0046] Step 204, based on the projection data container, the display window object and the virtual display screen, the received content to be projected is projected into the three-dimensional space of the head mounted display device.
[0047] In some embodiments, the execution entity may project the received content to be projected to the three-dimensional space in the head mounted display device according to the projection data container, the display window object and the virtual display screen.
[0048] The above-mentioned embodiments of the present disclosure have the following beneficial effects: through the super-resolution screen projection method based on the head-mounted display device of some embodiments of the present disclosure, a screen projection method that exceeds the inherent resolution limit of the screen projection device is provided, and the resolution of the screen projection content and the screen projection display effect are improved, thereby improving the user viewing experience. Specifically, the reason for the poor screen projection display effect and the poor user viewing experience is that when the inherent resolution of the screen projection device is lower than the resolution of the mobile terminal, the displayed screen content is limited by the inherent resolution of the screen projection device, and the display quality is poor, thereby reducing the user viewing experience. Based on this, the super-resolution screen projection method of some embodiments of the present disclosure, first, according to the target operating system, creates a screen projection data container and a display window object. Among them, the above-mentioned screen projection data container is bound to the above-mentioned display window object. The above-mentioned target operating system is the operating system of the above-mentioned head-mounted display device. Thus, a screen projection data container for caching the screen projection data sent by the mobile terminal and a display window object for displaying the screen projection content can be created, so as to process the screen projection display data to be sent by the subsequent mobile terminal. Then, according to the above-mentioned target operating system, a virtual display screen is created. Among them, the resolution of the above-mentioned virtual display screen corresponds to the target resolution. Thus, a virtual display screen with a high resolution corresponding to the target resolution can be created. Afterwards, in response to receiving a projection request sent by the target terminal, the content to be projected is obtained. Among them, the above-mentioned target terminal is a terminal device in the same local area network as the above-mentioned head-mounted display device. Thus, after the target terminal initiates a projection request, the content data to be projected transmitted by the target terminal can be received through the local area network. Finally, according to the above-mentioned projection data container, the above-mentioned display window object and the above-mentioned virtual display screen, the received content to be projected is projected to the three-dimensional space in the above-mentioned head-mounted display device. Thus, the virtual display screen displaying the projection content can be mapped to the three-dimensional display environment displayed by the head-mounted display device. By creating a virtual display screen corresponding to the target resolution, the projection content can exceed the inherent resolution limit of the traditional display device, thereby improving the resolution of the projection content and the projection display effect, thereby improving the user's projection viewing experience. In addition, by displaying the virtual display screen in the three-dimensional space in the head-mounted display device, a more immersive projection viewing experience can also be provided to the head-mounted display device user.
[0049] Further references Figure 3 , shows a process 300 of other embodiments of the super-resolution screen projection method based on a head-mounted display device according to the present disclosure. The super-resolution screen projection method based on a head-mounted display device includes the following steps:
[0050] Step 301, create a screen projection data container and display window object according to the target operating system.
[0051] Step 302: Create a virtual display screen according to the target operating system.
[0052] In some embodiments, the specific implementation of steps 301-302 and the technical effects brought about can be referred to Figure 2 The corresponding steps 201-202 in the embodiments are not described in detail here.
[0053] Step 303, in response to receiving the screen projection request sent by the target terminal, executing the following steps of obtaining the content to be projected:
[0054] Step 3031, establishing a communication connection with the target terminal through the local area network.
[0055] In some embodiments, the execution subject may establish a communication connection with the target terminal through a local area network. For example, the target terminal may be a MAC laptop. The screen projection request may be an Airplay screen projection request. In practice, the execution subject may establish a wireless communication connection with the target terminal through a local area network.
[0056] Step 3032: Receive the screen content to be projected transmitted by the target terminal through the established communication connection.
[0057] In some embodiments, the above-mentioned execution entity can receive the screen content to be projected transmitted by the above-mentioned target terminal through the established communication connection.
[0058] Step 3033, cache the received screen content to be projected into the screen projection data container.
[0059] In some embodiments, the execution subject may cache the received content to be projected into a projection data container. In practice, the execution subject may cache the received content to be projected into a projection data container to update the data of the projection data container.
[0060] Step 304: Project the received content to be projected into the three-dimensional space of the head-mounted display device according to the projection data container, the display window object and the virtual display screen.
[0061] In some embodiments, the execution subject may project the received content to be projected to the three-dimensional space of the head-mounted display device according to the projection data container, the display window object and the virtual display screen. Figure 4 As shown, it includes a three-dimensional space 401, a virtual display screen 402 and a projection content 403.
[0062] In some optional implementations of some embodiments, the above execution subject may perform the following steps:
[0063] The first step is to render the content to be projected cached in the projection data container onto the virtual display screen through the display window object. In practice, the subject can render the content to be projected cached in the projection data container onto the virtual display screen through the object method of the display window object.
[0064] The second step is to display the virtual display screen after projection in the three-dimensional space of the head-mounted display device. In practice, the execution subject may display the virtual display screen after projection at a preset depth in the three-dimensional space of the head-mounted display device. For example, the preset depth may be 1.4m.
[0065] Reference below Figure 5 , which shows a head mounted display device 500 (eg, Figure 1 A schematic diagram of the structure of the terminal device 103). Figure 5 The head mounted display device shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.
[0066] like Figure 5 As shown, the head mounted display device 500 may include a processing device 501 (e.g., a central processing unit, a graphics processor, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 502 or a program loaded from a storage device 508 to a random access memory (RAM) 503. In the RAM 503, various programs and data required for the operation of the head mounted display device 500 are also stored. The processing device 501, the ROM 502, and the RAM 503 are connected to each other via a bus 504. An input / output (I / O) interface 505 is also connected to the bus 504.
[0067] Typically, the following devices may be connected to the I / O interface 505: input devices 506 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; output devices 507 including, for example, at least one display screen, a speaker, a vibrator, etc.; and communication devices 509. At least one display screen may be combined with optical elements to image the display content in front of the user. The communication device 509 may allow the head mounted display device 500 to communicate with other devices wirelessly or wired to exchange data. Although Figure 5 The head mounted display device 500 having various devices is shown, but it should be understood that it is not required to implement or have all the devices shown. More or fewer devices may be implemented or have instead. Figure 5 Each block shown in the figure may represent one device, or may represent multiple devices as required.
[0068] In particular, according to some embodiments of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, some embodiments of the present disclosure include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In some such embodiments, the computer program can be downloaded and installed from the network through the communication device 509, or installed from the storage device 508, or installed from the ROM 502. When the computer program is executed by the processing device 501, the above-mentioned functions defined in the method of some embodiments of the present disclosure are executed.
[0069] It should be noted that the computer-readable medium recorded in some embodiments of the present disclosure may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In some embodiments of the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In some embodiments of the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.
[0070] In some embodiments, the client and the server may communicate using any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or future developed network.
[0071] The computer-readable medium may be included in the head-mounted display device; or it may exist independently without being assembled into the head-mounted display device. The computer-readable medium carries one or more programs. When the one or more programs are executed by the head-mounted display device, the head-mounted display device: creates a projection data container and a display window object according to the target operating system, wherein the projection data container is bound to the display window object, and the target operating system is the operating system of the head-mounted display device; creates a virtual display screen according to the target operating system, wherein the resolution of the virtual display screen corresponds to the target resolution; obtains the content to be projected in response to receiving a projection request sent by the target terminal, wherein the target terminal is a terminal device in the same local area network as the head-mounted display device; projects the received content to be projected to the three-dimensional space in the head-mounted display device according to the projection data container, the display window object and the virtual display screen.
[0072] Computer program code for performing the operations of some embodiments of the present disclosure may be written in one or more programming languages or a combination thereof, including object-oriented programming languages such as Java, Smalltalk, C++, and conventional procedural programming languages such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).
[0073] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.
[0074] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.
[0075] The above descriptions are only some preferred embodiments of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of the invention involved in the embodiments of the present disclosure is not limited to the technical solutions formed by a specific combination of the above-mentioned technical features, but should also cover other technical solutions formed by any combination of the above-mentioned technical features or their equivalent features without departing from the above-mentioned inventive concept. For example, the above-mentioned features are replaced with the technical features with similar functions disclosed in the embodiments of the present disclosure (but not limited to) and the technical solutions formed.
Claims
1. A super-resolution screen projection method based on a head-mounted display device, comprising: According to a target operating system, creating a screen projection data container and a display window object, wherein the screen projection data container is bound to the display window object, and the target operating system is an operating system of the head mounted display device; Creating a virtual display screen according to the target operating system, wherein a resolution of the virtual display screen corresponds to a target resolution; In response to receiving a screen projection request sent by a target terminal, obtaining the screen content to be projected, wherein the target terminal is a terminal device in the same local area network as the head mounted display device; According to the projection data container, the display window object and the virtual display screen, the received content to be projected is projected to the three-dimensional space in the head-mounted display device.
2. The method according to claim 1, wherein: The step of creating a screen projection data container and a display window object according to the target operating system includes: Creating a screen projection data container, wherein the texture data container is used to cache the content to be projected; According to the target operating system, create a display window object, wherein the display window object is used to render the content to be projected; Bind the display window object to the projection data container.
3. The method according to claim 1, wherein: The obtaining of the content to be projected includes: Establishing a communication connection with the target terminal via a local area network; Receiving the screen content to be projected transmitted by the target terminal through the established communication connection; The received screen content to be projected is cached in the screen projection data container.
4. The method according to claim 3, wherein: The step of projecting the received content to be projected to a three-dimensional space in the head mounted display device according to the projection data container, the display window object and the virtual display screen includes: Rendering the content to be projected cached in the projection data container onto the virtual display screen through the display window object; The projected virtual display screen is displayed in the three-dimensional space of the head mounted display device.
5. The method according to claim 1, wherein: Before obtaining the content to be projected, the method further includes: A target screen projection application is run on the virtual display screen, wherein the run target screen projection application is used to receive a screen projection request.
6. A head mounted display device, comprising: one or more processors; At least one optical module, the optical module including at least one display screen and optical elements, used for imaging in front of the user's eyes; a storage device having one or more programs stored thereon; When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 5.
7. The head mounted display device according to claim 6, wherein: The head mounted display device comprises a head mounted display device body and a smart terminal, and the smart terminal is communicatively connected with the head mounted display device body.
8. A computer readable medium having a computer program stored thereon, wherein: When the computer program is executed by a processor, the method according to any one of claims 1 to 5 is implemented.