Method for displaying global message and VR (Virtual Reality) equipment

By receiving global message broadcast, image drawing and overlay technology in VR devices, the problem that global messages cannot be displayed in the user's field of view is solved, the effect that users can see and interact with messages is achieved, and the display effect of global messages is improved.

CN119478303APending Publication Date: 2025-02-18HISENSE VISUAL TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410659861.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-05-27
Publication Date
2025-02-18

AI Technical Summary

Technical Problem

In existing VR devices, global messages cannot be displayed in the normal field of view of the user and cannot interact with the messages, resulting in the user being unable to effectively see and process global messages.

Method used

By receiving global message broadcast, the global message type to be displayed is determined, and image is drawn, the current displayed image is obtained as the background, the display position is determined according to the message type, the global message image is superimposed in the background image, and the target image is generated and displayed.

Benefits of technology

It realizes the effective display of global messages on VR devices, allowing users to see and interact with messages in normal field of view, and improves the display effect of global messages.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119478303A_ABST
    Figure CN119478303A_ABST
Patent Text Reader

Abstract

The invention provides a method for displaying a global message and VR equipment, and the method comprises the steps: determining a to-be-displayed global message and the type of the to-be-displayed global message based on a global message broadcast after the global message broadcast is received; for any one to-be-displayed global message, performing image drawing on the to-be-displayed global message to obtain a to-be-displayed global message image; determining a display position of the to-be-displayed global message based on the type of the to-be-displayed global message; and acquiring a current display image of the VR equipment, taking the current display image as a background image, and based on the display position of the to-be-displayed global message image, overlapping the to-be-displayed global message image in the current display image to obtain a target image and displaying the target image. Therefore, the global message is displayed on the VR equipment, so that a user can perform interaction and other operations after seeing the global message, and the global message display effect is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Background Art

[0002] On VR (Virtual Reality) devices, displaying system global messages (e.g., toast, notification, dialog) and interacting with global messages (e.g., dialog) are essential functions.

[0003] In the prior art, these global messages are directly displayed on the VR device without being processed. The content of these global messages is directly displayed in the middle of the device. Figure 1 However, this display method makes it impossible for users to see the global message normally on VR devices, and even more impossible to interact with the message. Therefore, a method for displaying global messages is needed. Summary of the invention

[0004] The present application provides a method for displaying a global message and a VR device, which are used to display a global message so that a user can see the global message and improve the display effect of the global message.

[0005] In a first aspect, an embodiment of the present application provides a method for displaying a global message, which is applied to a VR device, and the method includes:

[0006] After receiving the global message broadcast, determining the global message to be displayed and the type of the global message to be displayed based on the global message broadcast;

[0007] For any global message to be displayed, image drawing is performed on the global message to be displayed to obtain an image of the global message to be displayed;

[0008] Determining a display position of the global message to be displayed based on the type of the global message to be displayed;

[0009] The current display image of the VR device is obtained, and the current display image is used as the background image. Based on the display position of the global message image to be displayed, the global message image to be displayed is superimposed on the current display image to obtain the target image and display it.

[0010] A second aspect of the present application provides a VR device, including a processor and a memory, wherein the processor and the memory are connected via a bus;

[0011] The memory stores a computer program, and the processor is configured to perform the following operations based on the computer program:

[0012] After receiving the global message broadcast, determining the global message to be displayed and the type of the global message to be displayed based on the global message broadcast;

[0013] For any global message to be displayed, image drawing is performed on the global message to be displayed to obtain an image of the global message to be displayed;

[0014] Determining a display position of the global message to be displayed based on the type of the global message to be displayed;

[0015] The current display image of the VR device is obtained, and the current display image is used as the background image. Based on the display position of the global message image to be displayed, the global message image to be displayed is superimposed on the current display image to obtain the target image and display it.

[0016] According to a third aspect provided by an embodiment of the present invention, a computer storage medium is provided, wherein the computer storage medium stores a computer program, and the computer program is used to execute the method as described in the first aspect.

[0017] In the above-mentioned embodiment of the present application, after receiving the global message broadcast, the global message to be displayed and the type of the global message to be displayed are determined based on the global message broadcast; for any global message to be displayed, the image of the global message to be displayed is drawn to obtain the image of the global message to be displayed; then based on the type of the global message to be displayed, the display position of the global message to be displayed is determined; and the current display image of the VR device is obtained, and the current display image is used as the background image, and based on the display position of the global message image to be displayed, the global message image to be displayed is superimposed on the current display image to obtain the target image and display it. As a result, the embodiment of the present application realizes the display of global messages on VR devices, so that users can interact and perform other operations after seeing the global messages, thereby improving the global message display effect in VR devices. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0019] Figure 1 One of the schematic diagrams of global message display provided by an embodiment of the present application is exemplarily shown;

[0020] Figure 2 The system architecture diagram of the global message display provided by the embodiment of the present application is exemplarily shown;

[0021] Figure 3 The second schematic diagram of the global message display provided by the embodiment of the present application is exemplarily shown;

[0022] Figure 4 One of the flowcharts of the method for displaying a global message provided in an embodiment of the present application is exemplarily shown;

[0023] Figure 5 A schematic diagram of a flow chart for exemplarily showing the execution order of determining global messages to be displayed provided in an embodiment of the present application;

[0024] Figure 6 A schematic diagram exemplarily shows the correspondence between target head tracking data and display position provided in an embodiment of the present application;

[0025] Figure 7 A schematic diagram of a target image provided by an embodiment of the present application is exemplarily shown;

[0026] Figure 8 The second flowchart of the method for displaying a global message provided in an embodiment of the present application is exemplarily shown;

[0027] Fig. 9 A schematic diagram of a device for displaying a global message provided by an embodiment of the present application is exemplarily shown;

[0028] Fig.10 The hardware structure diagram of the VR device provided in the embodiment of the present application is exemplified. DETAILED DESCRIPTION

[0029] In order to make the purpose, implementation mode and advantages of the present application clearer, the exemplary implementation mode of the present application will be clearly and completely described below in conjunction with the drawings in the exemplary embodiments of the present application. Obviously, the described exemplary embodiments are only part of the embodiments of the present application, rather than all the embodiments.

[0030] Based on the exemplary embodiments described in this application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the claims attached to this application. In addition, although the disclosure in this application is introduced according to one or several exemplary examples, it should be understood that each aspect of the disclosure can also constitute a complete implementation method separately.

[0031] It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their common and usual meanings.

[0032] The terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the numbers used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover but not exclude inclusion, for example, a product or device comprising a series of components is not necessarily limited to those components clearly listed, but may include other components not clearly listed or inherent to these products or devices.

[0033] The term "module" as used in this application refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0034] The idea of ​​the embodiments of the present application is summarized below.

[0035] Currently, these global messages are displayed directly on the VR device without any processing. The content of these global messages is directly displayed in the middle of the device. Figure 1 However, this display method makes it impossible for users to see the message normally in VR devices, and even more impossible to interact with the message. Therefore, a method that can display global messages is needed.

[0036] Based on the problem that users cannot normally see global messages in VR devices in the prior art. An embodiment of the present application provides a method for displaying global messages. After receiving a global message broadcast, the global message to be displayed and the type of global message to be displayed are determined based on the global message broadcast; for any global message to be displayed, an image is drawn for the global message to be displayed to obtain a global message image to be displayed; then, based on the type of global message to be displayed, the display position of the global message to be displayed is determined; and the current display image of the VR device is obtained, and the current display image is used as the background image, and based on the display position of the global message image to be displayed, the global message image to be displayed is superimposed on the current display image to obtain the target image and display it. As a result, the embodiment of the present application realizes the display of global messages in VR devices, so that users can perform operations such as interaction after seeing the global message in the VR device, thereby improving the display effect of global messages in VR devices.

[0037] Before introducing the method for displaying a global message in the embodiment of the present application, the system architecture of the method for displaying a global message in the embodiment of the present application is first described. Figure 2As shown, it is a system architecture diagram in an embodiment of the present application, which includes a global message application 201, a VR application 202 and an image synthesizer 203. The image synthesizer 203 runs in the system as an independent process. In the embodiment of the present application, the image synthesizer 203 as a server communicates with the global message application 201 and the VR application 202 respectively through the inter-process communication IPC, wherein:

[0038] The global message application 201 is used to determine the global message to be displayed and the type of the global message to be displayed based on the global message broadcast after receiving the global message broadcast; and for any global message to be displayed, draw an image of the global message to be displayed through the global message application to obtain an image of the global message to be displayed;

[0039] A receiving VR application 202 is used to send a currently displayed image to an image synthesizer 203;

[0040] The image synthesizer 203 determines the display position of the global message to be displayed based on the type of the global message to be displayed; and uses the currently displayed image as a background image, and based on the display position of the global message image to be displayed, superimposes the global message image to be displayed on the currently displayed image to obtain a target image.

[0041] In the embodiment of the present application, the image synthesizer is run as an independent process in the system. The image synthesizer communicates with the VR application and the global message application respectively through inter-process communication, and can receive image data from different applications and synthesize the final image output. The global message application that draws the global message is used as a client of the image synthesizer. The global message application is superimposed on the VR application through the processing of the image synthesizer to provide a more seamless user experience. Specifically, Figure 3 As shown, from Figure 3 As can be seen, the global messages of the global application are displayed on the upper layer of the VR application.

[0042] The method for displaying a global message in an embodiment of the present application is described below with reference to the accompanying drawings. Figure 4 FIG. 1 is a flow chart of a method for displaying a global message, which may include the following steps:

[0043] Step 401: after receiving a global message broadcast, determining a global message to be displayed and a type of the global message to be displayed based on the global message broadcast;

[0044] In the embodiment of the present application, it is ensured that a system service runs automatically when the VR device is started or the user manually starts the system service when necessary; the task of the system service is to monitor the global message broadcast sent in the VR system. The system service can monitor actions of specific intents by registering broadcast receivers, and these actions represent various types of global messages. For example, toast, notification, dialog, etc. That is, the global message broadcast in the embodiment of the present application includes the global message to be displayed and the type of global message to be displayed.

[0045] In one embodiment, after the execution step, the global message needs to be added to the message queue, such as Figure 5 FIG. 1 is a flow chart of determining the execution order of global messages to be displayed. Specifically, the following steps may be included:

[0046] Step 501: Determine the priority of the global message to be displayed based on the type of the global message to be displayed;

[0047] The types of global messages in the embodiment of the present application include toast type, notification type and dialog type. The priority of each type of global message to be displayed is pre-set, and the embodiment of the present application does not limit the priority of each type of global message to be displayed.

[0048] Step 502: determining a target position of the global message to be displayed in a message queue according to the priority of the global message to be displayed, and adding the global message to be displayed to the target position in the message queue;

[0049] In the embodiment of the present application, if there is a global message of the same type as the global message to be displayed in the message queue, the position behind the position of the global message of the same type as the global message to be displayed and the position in front of the position of the global message of a different type from the global message to be displayed are determined as the target position of the global message to be displayed.

[0050] For example, if the message queue includes: global message a, global message b, global message c, global message d, global message e. If the target position of global message m needs to be determined, if the types of global message a, global message b and global message m are the same, then the middle of global message b and global message c is determined as the target position of global message m. That is, global message m is added to the message queue, and the message queue is: global message a, global message b, global message m, global message c, global message d, global message e.

[0051] In the embodiment of the present application, if there is no global message of the same type as the global message to be displayed in the message queue, the target position of the global message to be displayed in the message queue is determined according to the priority of the global message to be displayed.

[0052] For example, if the message queue includes: global message a, global message c, global message d, global message e. If the target location of global message m needs to be determined, and the message queue does not include global messages of the same type as global message m, then global message m is added to the message queue, and the message queue is: global message a, global message m, global message c, global message d, global message e.

[0053] Step 503: Obtain the global messages to be displayed in sequence according to the sequence of the global messages to be displayed in the message queue.

[0054] The higher the priority of the global message to be displayed in the message queue in the embodiment of the present application, the higher the priority is. For example, the message queue is: global message a, global message m, global message c, global message d, global message e. Then the order of obtaining each global message to be displayed is: global message a→global message m→global message c→global message d→global message e.

[0055] Step 402: for any global message to be displayed, draw an image of the global message to be displayed to obtain an image of the global message to be displayed;

[0056] In the embodiment of the present application, the global message to be displayed can be drawn by using openGL or MGUI. Since the image drawing method belongs to the method in the prior art, the embodiment of the present application will not be repeated. And the specific image drawing method can be set according to the actual situation. The embodiment of the present application does not limit the image drawing method here.

[0057] Step 403: Determine a display position of the global message to be displayed based on the type of the global message to be displayed;

[0058] In one embodiment, the display position of the global message to be displayed is determined by the following two methods:

[0059] Mode 1: If the type of the global message is a type that does not require interaction, the designated position is determined as the display position of the global message to be displayed.

[0060] The designated location in the embodiment of the present application can be set according to the specific actual situation, and the embodiment of the present application does not limit the designated location. For global messages that do not require user interaction (such as toast), in the embodiment of the present application, they are displayed in an optimized manner in the appropriate position of the VR environment to ensure that the user can see it without interfering with the current activity.

[0061] Method 2: If the type of the global message is a type that requires interaction, the display position of the global message to be displayed is obtained based on the current actual head tracking data and predicted head tracking data of the VR device, wherein the predicted head tracking data is obtained based on historical head tracking data that is before the current actual head tracking data.

[0062] The predicted head tracking data in the embodiment of the present application is obtained by inputting the historical head tracking data into the prediction model, wherein the prediction model may be ARIMA (Autoregressive Integrated Moving Average Model) or other time series models. The prediction model is not limited in the embodiment of the present application, and the prediction model in the embodiment of the present application may be set according to the specific actual situation.

[0063] In one embodiment, the display position of the global message to be displayed is determined in the following manner:

[0064] Utilizing the pre-set correspondence between the target head tracking data and the display position, the target display position corresponding to the current target head tracking data is determined, and the target display position is determined as the display position of the global message to be displayed, wherein the current target head tracking data includes the current actual head tracking data and the predicted head tracking data.

[0065] For example, Figure 6 As shown, it is a schematic diagram of the correspondence between the target head tracking data and the display position. If the current actual head tracking data is data 1, and the predicted head tracking data is data 2, then based on the correspondence in the figure, it can be determined that the target display position is position A.

[0066] For global messages that users need to interact with, an interactive interface is created in the embodiment of the present application. When the user interacts with the interactive interface, these interactive events are captured; corresponding operations are performed based on the interactive events, and the operation results are fed back to the user.

[0067] The feedback in the embodiment of the present application can be visual, such as updating the interactive interface, or through other sensory means, such as sound or vibration. The interaction method in the embodiment of the present application is the same as the interaction method in the VR device, and the embodiment of the present application will not be repeated here.

[0068] Step 404: Acquire the current display image of the VR device, and use the current display image as the background image, and based on the display position of the global message image to be displayed, superimpose the global message image to be displayed on the current display image to obtain the target image and display it.

[0069] The currently displayed image in the embodiment of the present application includes the currently displayed image for the left eye and the currently displayed image for the right eye, and the target image includes the target image for the left eye and the target image for the right eye. And the display position in the embodiment of the present application includes the display position for the left eye and the display position for the right eye.

[0070] In one embodiment, step 404 can be specifically implemented as follows: obtaining the left eye currently displayed image and the right eye currently displayed image of the VR device, taking the left eye currently displayed image as the background image, and based on the left eye display position of the global message image to be displayed, superimposing the global message image to be displayed on the left eye currently displayed image to obtain a left eye target image; and taking the right eye currently displayed image as the background image, and based on the right eye display position of the global message image to be displayed, superimposing the global message image to be displayed on the right eye currently displayed image to obtain a right eye target image.

[0071] like Figure 7 As shown, in the embodiment of the present application, the global message image is used as the foreground image, and the current display image is used as the background image, and the two images are synthesized to obtain the target image.

[0072] In the embodiment of the present application, the target image may be time-warped or asynchronously time-warped to adjust the target image, and the adjusted target image may be displayed so that the displayed target image matches the actual viewing angle of the user.

[0073] In order to avoid repeated display of global messages, in one embodiment, after executing step 404, the global message to be displayed corresponding to the target image is deleted from the message queue.

[0074] For example, the message queue is: global message a, global message m, global message c, global message d, global message e. If global message a has been displayed, the message queue becomes: global message m, global message c, global message d, global message e.

[0075] In order to further understand the method in this application, Figure 8FIG. 1 is a flow chart of a method for displaying a global message in the present application, which may include the following steps:

[0076] Step 801: after receiving a global message broadcast, determining a global message to be displayed and a type of the global message to be displayed based on the global message broadcast;

[0077] Step 802: Determine the priority of the global message to be displayed based on the type of the global message to be displayed;

[0078] Step 803: determining a target position of the global message to be displayed in the message queue according to the priority of the global message to be displayed;

[0079] Step 804: adding the global message to be displayed to the target position in the message queue;

[0080] Step 805: sequentially acquiring the global messages to be displayed in the message queue according to the order of the global messages to be displayed;

[0081] Step 806: for any global message to be displayed, draw an image of the global message to be displayed to obtain an image of the global message to be displayed;

[0082] Step 807: Determine whether any of the global messages to be displayed is of a type that requires interaction, if so, execute step 808, if not, execute step 809;

[0083] Step 808: determining the designated position as the display position of the global message to be displayed;

[0084] Step 809: obtaining a display position of the global message to be displayed based on the current actual head tracking data and the predicted head tracking data of the VR device, wherein the predicted head tracking data is obtained based on the historical head tracking data that is before the current actual head tracking data;

[0085] Step 810: Obtain the left eye current display image and the right eye current display image of the VR device;

[0086] Step 811: using the left eye current display image as a background image, and based on the left eye display position of the global message image to be displayed, superimposing the global message image to be displayed on the left eye current display image to obtain the left eye target image;

[0087] Step 812: using the right eye current display image as a background image, and based on the right eye display position of the global message image to be displayed, superimposing the global message image to be displayed on the right eye current display image to obtain the right eye target image;

[0088] The execution sequence of step 811 and step 812 in the embodiment of the present application is not limited in the embodiment of the present application. Step 811 may be executed first, and then step 812. Step 812 may also be executed first, and then step 811. Step 811 and step 812 may also be executed simultaneously.

[0089] Step 813: Delete the global message to be displayed corresponding to the target image from the message queue.

[0090] Based on the same inventive concept, the method for displaying global messages as described above in the present disclosure can also be implemented by a device for displaying global messages. The effect of the device for displaying global messages is similar to that of the aforementioned method, and will not be described in detail here.

[0091] Fig. 9 The figure is a schematic diagram of the structure of a device for displaying a global message according to an embodiment of the present disclosure.

[0092] like Fig. 9 As shown, the device 900 for displaying a global message of the present disclosure may include a global message determination module 910 , a global message image determination module 920 , a display position determination module 930 , and a global message display module 940 .

[0093] A global message determination module 910, configured to determine, after receiving a global message broadcast, a global message to be displayed and a type of the global message to be displayed based on the global message broadcast;

[0094] The global message image determination module 920 is used to draw an image of any global message to be displayed to obtain an image of the global message to be displayed;

[0095] A display position determination module 930, configured to determine a display position of the global message to be displayed based on the type of the global message to be displayed;

[0096] The global message display module 940 is used to obtain the current display image of the VR device, and use the current display image as the background image, and based on the display position of the global message image to be displayed, superimpose the global message image to be displayed on the current display image to obtain the target image and display it.

[0097] In one embodiment, if the type of the global message is a type that does not require interaction;

[0098] The display position determination module 930 is specifically used for:

[0099] The designated position is determined as the display position of the global message to be displayed.

[0100] In one embodiment, if the type of the global message is a type that requires interaction;

[0101] The display position determination module 930 is specifically used for:

[0102] Based on the current actual head tracking data and predicted head tracking data of the VR device, the display position of the global message to be displayed is obtained, wherein the predicted head tracking data is obtained based on historical head tracking data that is before the current actual head tracking data.

[0103] In one embodiment, the display position determination module 930 is specifically configured to:

[0104] Utilizing the pre-set correspondence between the target head tracking data and the display position, the target display position corresponding to the current target head tracking data is determined, and the target display position is determined as the display position of the global message to be displayed, wherein the current target head tracking data includes the current actual head tracking data and the predicted head tracking data.

[0105] In one embodiment, the apparatus further comprises:

[0106] A priority determination module 950 is used to determine the priority of the global message to be displayed based on the type of the global message to be displayed after determining the global message to be displayed and the type of the global message to be displayed based on the global message broadcast; and,

[0107] A target position determination module 960, configured to determine a target position of the global message to be displayed in the message queue according to the priority of the global message to be displayed, and add the global message to be displayed to the target position in the message queue;

[0108] The acquisition module 970 is used to sequentially acquire the global messages to be displayed according to the sequence of the global messages to be displayed in the message queue.

[0109] In one embodiment, the apparatus further comprises:

[0110] The deleting module 980 is used to superimpose the global message image to be displayed on the current display image, obtain the target image and display it, and then delete the global message to be displayed corresponding to the target image from the message queue.

[0111] In one embodiment, the currently displayed image includes a left-eye currently displayed image and a right-eye currently displayed image, the target image includes a left-eye target image and a right-eye target image, and the display position includes a left-eye display position and a right-eye display position;

[0112] The global message display module 940 is specifically used for:

[0113] Using the left eye current display image as a background image, and based on the left eye display position of the global message image to be displayed, superimposing the global message image to be displayed on the left eye current display image to obtain the left eye target image; and

[0114] The right eye current display image is used as a background image, and based on the right eye display position of the global message image to be displayed, the global message image to be displayed is superimposed on the right eye current display image to obtain the right eye target image.

[0115] In one embodiment, the VR device includes a global messaging application, a VR application, and an image synthesizer;

[0116] The global message image determination module 920 is specifically used to:

[0117] Drawing an image of the global message to be displayed by a global message application to obtain an image of the global message to be displayed;

[0118] The display position determination module 930 is specifically used for:

[0119] Determining, by an image synthesizer, a display position of the global message to be displayed based on the type of the global message to be displayed;

[0120] The global message display module 940 executes the acquisition of the current display image of the VR device, specifically for:

[0121] Receive the current display image sent by the VR application through the image synthesizer;

[0122] The global message display module 940 executes the process of using the current display image as a background image and, based on the display position of the global message image to be displayed, superimposing the global message image to be displayed on the current display image to obtain a target image, which is specifically used for:

[0123] The current display image is used as a background image by an image synthesizer, and based on the display position of the global message image to be displayed, the global message image to be displayed is superimposed on the current display image to obtain a target image.

[0124] After introducing a method and apparatus for displaying a global message according to an exemplary embodiment of the present invention, a VR device according to another exemplary embodiment of the present invention is introduced next.

[0125] It will be appreciated by those skilled in the art that various aspects of the present invention may be implemented as a system, method or program product. Therefore, various aspects of the present invention may be specifically implemented in the following forms, namely: a complete hardware implementation, a complete software implementation (including firmware, microcode, etc.), or a combination of hardware and software, which may be collectively referred to herein as a "circuit", "module" or "system".

[0126] In some possible implementations, the VR device according to the present invention may include at least one processor and at least one computer storage medium. The computer storage medium stores program code, and when the program code is executed by the processor, the processor executes the steps of the method for displaying a global message according to various exemplary embodiments of the present invention described above in this specification. For example, the processor may execute the following steps: Figure 4 Steps 401-404 shown in .

[0127] Refer to the following Fig.10 The VR device 1000 according to this embodiment of the present invention is described. Fig.10 The VR device 1000 shown is merely an example and should not limit the functions and scope of use of the embodiments of the present invention.

[0128] like Fig.10 As shown, the VR device 1000 is presented in the form of a general AR device. The components of the VR device 1000 may include, but are not limited to: the at least one processor 1001, the at least one computer storage medium 1002, and a bus 1003 connecting different system components (including the computer storage medium 1002 and the processor 1001).

[0129] Bus 1003 represents one or more of several types of bus structures, including a computer storage media bus or computer storage media controller, a peripheral bus, a processor, or a local bus using any of a variety of bus architectures.

[0130] The computer storage medium 1002 may include readable media in the form of volatile computer storage media, such as random access computer storage media (RAM) 1021 and / or cache storage media 1022 , and may further include read-only computer storage media (ROM) 1023 .

[0131] The computer storage medium 1002 may also include a program / utility 1025 having a set (at least one) of program modules 1024, such program modules 1024 including but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment.

[0132] The VR device 1000 may also communicate with one or more external devices 1004 (e.g., keyboards, pointing devices, etc.), one or more devices that enable a user to interact with the VR device 1000, and / or any device that enables the VR device 1000 to communicate with one or more other AR devices (e.g., routers, modems, etc.). Such communication may be performed via an input / output (I / O) interface 1005. Furthermore, the VR device 1000 may also communicate with one or more networks (e.g., a local area network (LAN), a wide area network (WAN), and / or a public network, such as the Internet) via a network adapter 1006. As shown, the network adapter 1006 communicates with other modules for the VR device 1000 via a bus 1003. It should be understood that, although not shown in the figure, other hardware and / or software modules may be used in conjunction with the VR device 1000, including but not limited to: microcode, device drivers, redundant processors, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0133] In some possible implementations, various aspects of a method for displaying a global message provided by the present invention may also be implemented in the form of a program product, which includes program code. When the program product is run on a computer device, the program code is used to enable the computer device to execute the steps of the method for displaying a global message according to various exemplary embodiments of the present invention described above in this specification.

[0134] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims

1. A method for displaying a global message, characterized in that: Applied to VR equipment, the method includes: After receiving the global message broadcast, determining the global message to be displayed and the type of the global message to be displayed based on the global message broadcast; For any global message to be displayed, image drawing is performed on the global message to be displayed to obtain an image of the global message to be displayed; Determining a display position of the global message to be displayed based on the type of the global message to be displayed; The current display image of the VR device is obtained, and the current display image is used as the background image. Based on the display position of the global message image to be displayed, the global message image to be displayed is superimposed on the current display image to obtain the target image and display it.

2. The method according to claim 1, characterized in that: If the type of the global message is a type that does not require interaction; The determining, based on the type of the global message to be displayed, a display position of the global message to be displayed includes: The designated position is determined as the display position of the global message to be displayed.

3. The method according to claim 1, characterized in that If the type of the global message is a type that requires interaction; The determining, based on the type of the global message to be displayed, a display position of the global message to be displayed includes: Based on the current actual head tracking data and predicted head tracking data of the VR device, the display position of the global message to be displayed is obtained, wherein the predicted head tracking data is obtained based on historical head tracking data that is before the current actual head tracking data.

4. The method according to claim 3, characterized in that Based on the actual head tracking data and the predicted head tracking data of the VR device, obtaining the display position of the global message to be displayed includes: Utilizing the pre-set correspondence between the target head tracking data and the display position, the target display position corresponding to the current target head tracking data is determined, and the target display position is determined as the display position of the global message to be displayed, wherein the current target head tracking data includes the current actual head tracking data and the predicted head tracking data.

5. The method according to claim 1, characterized in that After determining the global message to be displayed and the type of the global message to be displayed based on the global message broadcast, the method further includes: determining the priority of the global message to be displayed based on the type of the global message to be displayed; and, Determining a target position of the global message to be displayed in a message queue according to the priority of the global message to be displayed, and adding the global message to be displayed to the target position in the message queue; The global messages to be displayed are acquired in sequence according to the sequence of the global messages to be displayed in the message queue.

6. The method according to claim 5, characterized in that After superimposing the global message image to be displayed on the current display image to obtain the target image and displaying it, the method further includes: The global message to be displayed corresponding to the target image is deleted from the message queue.

7. The method according to claim 1, characterized in that The currently displayed image includes a left-eye currently displayed image and a right-eye currently displayed image, the target image includes a left-eye target image and a right-eye target image, and the display position includes a left-eye display position and a right-eye display position; The method of using the currently displayed image as a background image and, based on the display position of the global message image to be displayed, superimposing the global message image to be displayed on the currently displayed image to obtain a target image includes: Using the left eye current display image as a background image, and based on the left eye display position of the global message image to be displayed, superimposing the global message image to be displayed on the left eye current display image to obtain the left eye target image; as well as, The right eye current display image is used as a background image, and based on the right eye display position of the global message image to be displayed, the global message image to be displayed is superimposed on the right eye current display image to obtain the right eye target image.

8. The method according to claim 1 or 7, characterized in that: The VR device includes a global message application, a VR application and an image synthesizer; The step of drawing an image of the global message to be displayed to obtain an image of the global message to be displayed includes: Drawing an image of the global message to be displayed by a global message application to obtain an image of the global message to be displayed; The determining, based on the type of the global message to be displayed, a display position of the global message to be displayed includes: Determining, by an image synthesizer, a display position of the global message to be displayed based on the type of the global message to be displayed; The obtaining of the current display image of the VR device includes: Receive the current display image sent by the VR application through the image synthesizer; The method of using the currently displayed image as a background image and, based on the display position of the global message image to be displayed, superimposing the global message image to be displayed on the currently displayed image to obtain a target image includes: The current display image is used as a background image by an image synthesizer, and based on the display position of the global message image to be displayed, the global message image to be displayed is superimposed on the current display image to obtain a target image.

9. A VR device, characterized in that: comprising a processor and a memory, wherein the processor and the memory are connected via a bus; The memory stores a computer program, and the processor is configured to perform the following operations based on the computer program: After receiving the global message broadcast, determining the global message to be displayed and the type of the global message to be displayed based on the global message broadcast; For any global message to be displayed, image drawing is performed on the global message to be displayed to obtain an image of the global message to be displayed; Determining a display position of the global message to be displayed based on the type of the global message to be displayed; The current display image of the VR device is obtained, and the current display image is used as the background image. Based on the display position of the global message image to be displayed, the global message image to be displayed is superimposed on the current display image to obtain the target image and display it.

10. The VR device according to claim 9, characterized in that: If the type of the global message is a type that does not require interaction; The processor performs the step of determining the display position of the global message to be displayed based on the type of the global message to be displayed, and is specifically configured as follows: The designated position is determined as the display position of the global message to be displayed.