Display method, device, equipment and storage medium for near-eye display device

Abstract

The present application relates to the field of display technology and provides a display method, apparatus, device and storage medium for a near-eye display device, wherein a first display module and a second display module are provided on the near-eye display device, and the setting position of the first display module is different from the setting position of the second display module; the display method comprises: obtaining data to be displayed of the near-eye display device; rendering the data to be displayed to obtain an image to be displayed corresponding to the data to be displayed; displaying the image to be displayed on the first display module according to display parameters of the first display module; and displaying the image to be displayed on the second display module according to display parameters of the second display module, so as to improve the display efficiency of the near-eye display device for the image to be displayed.

Description

Technical Field

[0001] The present application relates to the field of display technology, and in particular to a display method, apparatus, device, and storage medium for a near-eye display device. Background Art

[0002] Near-eye display devices have display functions. In related technologies, when a near-eye display device uses multiple displays to collaboratively display the same content, the near-eye display device often needs to repeatedly render the data corresponding to the same content to determine the display content on each of the multiple displays. Repeated rendering of data corresponding to the same content increases the rendering time of the near-eye display device for the same content, resulting in poor display efficiency. Summary of the Invention

[0003] The main purpose of this application is to provide a display method, apparatus, device and storage medium for a near-eye display device, aiming to solve the technical problem of poor display efficiency of the near-eye display device due to repeated rendering of data corresponding to the same display content when the near-eye display device uses multiple display screens to collaboratively display the same display content.

[0004] In a first aspect, the present application provides a display method for a near-eye display device, wherein the near-eye display device is provided with a first display module and a second display module, and the arrangement position of the first display module is different from the arrangement position of the second display module;

[0005] The display method includes:

[0006] Acquiring data to be displayed by the near-eye display device;

[0007] Rendering the data to be displayed to obtain an image to be displayed corresponding to the data to be displayed;

[0008] displaying the image to be displayed on the first display module according to the display parameters of the first display module;

[0009] The image to be displayed is displayed on the second display module according to the display parameters of the second display module.

[0010] In a second aspect, the present application provides a display device of a near-eye display apparatus, the display device comprising:

[0011] A data acquisition module, used to acquire data to be displayed by a near-eye display device;

[0012] An image determination module, configured to render the data to be displayed to obtain an image to be displayed corresponding to the data to be displayed;

[0013] a first display module, configured to display the image to be displayed on the first display module according to display parameters of the first display module of the near-eye display device;

[0014] The second display module is configured to display the image to be displayed on the second display module according to the display parameters of the second display module of the near-eye display device.

[0015] In a third aspect, the present application provides a near-eye display device, wherein the near-eye display device is provided with a first display module and a second display module, wherein the first display module is provided at a different location than the second display module; the near-eye display device includes a memory and a processor;

[0016] The memory is used to store computer programs;

[0017] The processor is configured to execute the computer program and implement the steps of the display method of the near-eye display device as described above when executing the computer program.

[0018] In a fourth aspect, the present application provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the steps of the display method of the near-eye display device as described above are implemented.

[0019] The present application provides a display method, apparatus, device and storage medium for a near-eye display device, wherein a first display module and a second display module are provided on the near-eye display device, and the setting position of the first display module is different from the setting position of the second display module; the display method includes: obtaining data to be displayed of the near-eye display device; rendering the data to be displayed to obtain an image to be displayed corresponding to the data to be displayed; displaying the image to be displayed on the first display module according to display parameters of the first display module; and displaying the image to be displayed on the second display module according to the display parameters of the second display module.

[0020] When the near-eye display device obtains the data to be displayed, it can render the data to be displayed to obtain the image to be displayed corresponding to the data to be displayed. The image to be displayed can be used as the common display content of the first display module and the second display module of the near-eye display device, so the near-eye display device does not need to repeatedly render the same data to be displayed, so as to save the rendering process of the near-eye display device for the same data to be displayed, thereby improving the rendering rate of the near-eye display device for the data to be displayed. Accordingly, the near-eye display device can display the image to be displayed based on the respective display parameters of the first display module and the second display module. Since the respective display parameters of the first display module and the second display module can be different, when the near-eye display device collaboratively displays the same image to be displayed through the first display module and the second display module, the presentation effects of the images to be displayed displayed by the first display module and the second display module to the user can be different, which is equivalent to the near-eye display device having a multi-screen display function. When the first display module and the second display module each display different images to be displayed, the images to be displayed by the first display module and the second display module can be adapted to the viewing requirements of the user's left eye and right eye, respectively, which is conducive to improving the display effect of the near-eye display device on the images to be displayed. Based on the improvement of the rendering rate of the near-eye display device for the data to be displayed and the improvement of the convenience of the near-eye display device in displaying the images to be displayed, it is conducive to improving the display efficiency of the near-eye display device for the images to be displayed. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following is a brief introduction to the drawings required for use in the description of the embodiments. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0022] Figure 1 This is a flow chart of a display method for a near-eye display device provided in an embodiment of the present application;

[0023] Figure 2 is a schematic block diagram of a display device of a near-eye display device provided in an embodiment of the present application;

[0024] Figure 3 This is a schematic block diagram of a near-eye display device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0025] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0026] The flowcharts shown in the accompanying drawings are for illustrative purposes only and do not necessarily include all contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps may be decomposed, combined, or partially merged, so the actual execution order may vary depending on the actual situation.

[0027] The embodiments of the present application provide a display method, apparatus, device, and storage medium for a near-eye display device. The display method of the near-eye display device can be applied to a near-eye display device. The near-eye display device may include augmented reality (AR) glasses, mixed reality (MR) glasses, AR helmets, MR helmets, and the like, without limitation. The display method of the near-eye display device can also be applied to a server, which can be a separate server or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDNs), and big data and artificial intelligence platforms.

[0028] The following describes some embodiments of the present application in detail with reference to the accompanying drawings. In the absence of conflict, the following embodiments and features in the embodiments may be combined with each other.

[0029] See also Figure 1 , Figure 1 1 is a flow chart of a display method for a near-eye display device provided in an embodiment of the present application. It should be noted that the display method for a near-eye display device provided in an embodiment of the present application can be used in a near-eye display device or in a server, without limitation.

[0030] Exemplarily, a first display module and a second display module are provided on the near-eye display device, and a setting position of the first display module is different from a setting position of the second display module.

[0031] For example, the first display module can be arranged on the left side of the second display device, so that the first display module is arranged at a position corresponding to the left eye of a user wearing the near-eye display device, and the second display module is arranged at a position corresponding to the right eye of the user. Of course, this is not limited to this. The first display module can be arranged on the right side of the second display device, so that the first display module is arranged at a position corresponding to the right eye of the user, and the second display module is arranged at a position corresponding to the left eye of the user. This is not limited here.

[0032] like Figure 1 As shown, the display method of the near-eye display device includes steps S101 to S104.

[0033] S101: Acquire data to be displayed from a near-eye display device.

[0034] Exemplarily, the data to be displayed of the near-eye display device may include navigation data to be displayed, user data to be displayed, etc. The data to be displayed is used to indicate data that determines the display content of the near-eye display device.

[0035] The navigation data to be displayed may include, without limitation, road data, path planning data, traffic data, point of information (POI) data, weather data, and the like corresponding to the near-eye display device. The road data may also include, without limitation, data such as road slope and road curvature that can be used to determine three-dimensional road information.

[0036] The user data to be displayed may include, without limitation, user physiological indicator data, user interaction data with the near-eye display device, and the like. Physiological indicator data may include, without limitation, heart rate, blood oxygen saturation, and exercise data. Interaction data may include, without limitation, interaction type and interaction time data.

[0037] In some embodiments, the near-eye display device may obtain the data to be displayed by the near-eye display device through the application layer.

[0038] For example, the data to be displayed on a near-eye display device includes navigation data to be displayed. The near-eye display device can obtain the navigation data to be displayed from the near-eye display device using a preset navigation data acquisition tool. The navigation data acquisition tool may include a software development kit (SDK) related to navigation data acquisition.

[0039] For example, the near-eye display device may have a positioning function. Based on the positioning function, the near-eye display device can obtain the positioning information of the near-eye display device. Accordingly, when the near-eye display device obtains navigation data to be displayed, it can combine the positioning information of the near-eye display device to obtain the navigation data to be displayed.

[0040] For example, when a user needs to move from the current location of the near-eye display device to a destination, the near-eye display device can determine corresponding path planning data, traffic data, POI data, etc. based on its own positioning information and the positioning information of the destination to determine the navigation data to be displayed on the near-eye display device. Of course, this is not limited to this and is not intended to be a limitation here.

[0041] When the data to be displayed of the near-eye display device is acquired, the data to be displayed can be used to determine the display content of the near-eye display device.

[0042] S102: Render the data to be displayed to obtain an image to be displayed corresponding to the data to be displayed.

[0043] For example, upon obtaining data to be displayed from a near-eye display device, the near-eye display device may render the data to obtain an image to be displayed corresponding to the data to be displayed. The image to be displayed may serve as display content of the near-eye display device, allowing the near-eye display device to subsequently display the image to be displayed.

[0044] In some embodiments, when the near-eye display device obtains the data to be displayed through the application layer, the near-eye display device can transmit the data to be displayed to the composition layer of the near-eye display device, so that the composition layer can render the data to be displayed to obtain a to-be-displayed image corresponding to the data to be displayed. The composition layer of the near-eye display device may include a compositor, which is not limited here.

[0045] Take the example of the data to be displayed including navigation data to be displayed. When the near-eye display device obtains the navigation data to be displayed, it can render the navigation data to be displayed to obtain the image to be displayed corresponding to the navigation data to be displayed. For example, when the navigation data to be displayed includes road data, the image to be displayed may include the road name, road-passage buildings, etc. corresponding to the road data, which are not limited here. When the navigation data to be displayed includes path planning data, the image to be displayed may include the navigation route corresponding to the path planning data, the length of the navigation route, etc., which are not limited here. When the navigation data to be displayed includes traffic data, the image to be displayed may include traffic congestion conditions, traffic road recommendation information, etc., which are not limited here. When the navigation data to be displayed includes POI data, the image to be displayed may include POI identification, such as the starting point identification of the navigation route, the end point identification of the navigation route, navigation arrows, road condition labels, etc., which are not limited here. When the navigation data to be displayed includes weather data, the image to be displayed may include weather effects, weather information, etc., which are not limited here.

[0046] When rendering the data to be displayed can obtain the image to be displayed corresponding to the data to be displayed, it is beneficial to improve the convenience of the near-eye display device in determining the image to be displayed. The image to be displayed can be used as the display content of the first display module or as the display content of the second display module. Based on this, the near-eye display device does not need to repeatedly render the same data to be displayed to determine the common display content of the first display module and the second display module, which can save the near-eye display device from the rendering process of the same data to be displayed, thereby improving the rendering rate of the near-eye display device for the data to be displayed.

[0047] S103 : Displaying the image to be displayed on the first display module according to the display parameters of the first display module.

[0048] For example, the near-eye display device may obtain display parameters of a first display module and display an image to be displayed on the first display module according to the first display parameters.

[0049] For example, a near-eye display device includes AR glasses, and the first display module of the near-eye display device includes the first lens of the AR glasses. The AR glasses can display the image to be displayed on the first lens according to the display parameters of the first lens. The first display module is set in a position on the near-eye display device, for example, corresponding to the user's left eye. When the user views the environment of the near-eye display device through the AR glasses, the user can view the image to be displayed displayed by the first display module through the left eye.

[0050] S104 : Displaying the image to be displayed on the second display module according to the display parameters of the second display module.

[0051] For example, the near-eye display device may obtain display parameters of the second display module and display the image to be displayed on the second display module according to the second display parameters.

[0052] For example, a near-eye display device includes AR glasses, and the second display module of the near-eye display device includes the second lens of the AR glasses. The AR glasses can display the image to be displayed on the second lens based on the display parameters of the second lens. The second display module is set in a position on the near-eye display device, for example, corresponding to the user's right eye. When the user views the environment of the near-eye display device through the AR glasses, the user can view the image to be displayed displayed by the second display module through the right eye.

[0053] In some embodiments, when determining an image to be displayed, the near-eye display device may employ an asynchronous submission mechanism to display the image to be displayed on the first display module and the second display module, respectively, based on the display parameters of the first display module and the second display module, respectively. For example, when determining an image to be displayed corresponding to the data to be displayed, the image to be displayed may be displayed on the first display module based on the display parameters of the first display module. For another example, when determining an image to be displayed corresponding to the data to be displayed, the image to be displayed may be displayed on the second display module based on the display parameters of the second display module.

[0054] The display parameters of the first display module and the display parameters of the second display module may be pre-acquired by the near-eye display device. For example, the near-eye display device may acquire the display parameters of the first display module and the second display module respectively in the process of rendering the data to be displayed and obtaining the image to be displayed corresponding to the data to be displayed. Based on this, when the near-eye display device displays the image to be displayed on the first display module according to the display parameters of the first display module and displays the image to be displayed on the second display module according to the display parameters of the second display module, the time difference between the display times of the images to be displayed by the first display module and the second display module respectively can be reduced, thereby reducing the possibility of the user feeling dizzy when viewing the image to be displayed through the first display module and the second display module respectively due to the large time difference between the display times of the first display module and the second display module, thereby improving the user's viewing experience of the images to be displayed.

[0055] The first and second display modules can have different display parameters. For example, the display parameters of the first and second display modules can be determined based on the interpupillary distance (IPD) between the centers of the user's pupils. This distance can be referred to as the interpupillary distance. If the first and second display modules are positioned differently on the near-eye display device, the directions of the interpupillary distances corresponding to the first and second display modules are different. Under the influence of the different interpupillary distances, the images displayed by the first and second display modules can also be different. For example, the first display position of the image to be displayed on the first display module can be different from the second display position of the image to be displayed on the second display module. Based on this, the near-eye display device can have a multi-screen display function. When a user views content displayed on the near-eye display device, the user's left eye and right eye can view the image to be displayed at different display positions through the first and second display modules, respectively, to meet the viewing needs of the user's left and right eyes. The images to be displayed at different display positions can present a three-dimensional effect, which helps improve the display effect of the images to be displayed by the near-eye display device. For example, the near-eye display device can present the slope of a road, the height of a bridge, etc. to the user through the images to be displayed displayed by the first display module and the second display module, allowing the user to intuitively perceive the slope of the road, the height of the bridge, etc., thereby helping to enhance the user's immersive experience when viewing the images to be displayed.

[0056] In some embodiments, texture rendering is performed on the data to be displayed to obtain texture data corresponding to the data to be displayed; and texture data corresponding to multiple data to be displayed are synthesized to obtain images to be displayed corresponding to multiple data to be displayed.

[0057] For example, when the near-eye display device obtains data to be displayed, it can perform texture rendering processing on the data to be displayed to obtain texture data corresponding to the data to be displayed. The texture data can be shared by the first display module and the second display module, and the texture data can be called shared texture data.

[0058] For example, the near-eye display device can perform texture rendering processing on the data to be displayed through the application layer to obtain texture data corresponding to the data to be displayed, and transmit the texture data corresponding to the data to be displayed to the synthesis layer of the near-eye display device through the application layer. When the synthesis layer receives texture data corresponding to multiple data to be displayed, it can synthesize the multiple texture data to obtain images to be displayed corresponding to the multiple data to be displayed.

[0059] For example, the application layer of the near-eye display device can use the application layer to create a texture manager, such as SurfaceTexture, in the process of transmitting the texture data corresponding to the data to be displayed to the synthesis layer of the near-eye display device. Correspondingly, the application layer can set the texture data corresponding to the data to be displayed to be associated with SurfaceTexture, so that SurfaceTexture can manage the texture data, such as updating the texture data and callback, etc., which is not limited here. For another example, the near-eye display device can use the synthesis layer to receive the texture data corresponding to the data to be displayed. The synthesis layer includes, for example, a texture synthesizer, such as SurfaceFlinger. When SurfaceFlinger receives the texture data, it can synthesize the multiple texture data according to the corresponding synthesis rules to obtain the images to be displayed corresponding to the multiple data to be displayed. Of course, it is not limited to this and is not limited here.

[0060] Take the example of an image to be displayed including a navigation route. The near-eye display device can obtain the data to be displayed corresponding to the navigation route. The data to be displayed corresponding to the navigation route can be determined based on the positioning information of the near-eye display device, the positioning information of the destination corresponding to the near-eye display device, and the preset navigation map of the near-eye display device. The data to be displayed corresponding to the navigation route may include data such as the geometry of the navigation route and the texture of the navigation route. The near-eye display device can perform texture rendering on the data to be displayed corresponding to the navigation route to obtain texture data corresponding to the data to be displayed. For example, the near-eye display device can map the texture of the navigation route, such as the color, brightness or other surface attribute data of the navigation route, to the geometry of the navigation route to bind the texture of the navigation route to the geometry of the navigation route to form texture data of the navigation route.

[0061] Take the example of an image to be displayed that includes a navigation arrow for guiding the navigation route. The near-eye display device can obtain the data to be displayed corresponding to the navigation arrow. The data to be displayed corresponding to the navigation arrow may include data such as the geometric shape of the navigation arrow and the texture of the navigation arrow. The near-eye display device can perform texture rendering on the data to be displayed corresponding to the navigation arrow to obtain texture data corresponding to the data to be displayed. For example, the near-eye display device can map the texture of the navigation arrow, such as the color, brightness or other surface attribute data of the navigation arrow, to the geometric shape of the navigation arrow to bind the texture of the navigation arrow to the geometric shape of the navigation arrow to form the texture data of the navigation arrow.

[0062] Of course, the data to be displayed and the texture data corresponding to the data to be displayed are not limited thereto and are not limited here.

[0063] For example, when determining the texture data corresponding to the data to be displayed, the near-eye display device can synthesize the texture data corresponding to the multiple data to be displayed to obtain the images to be displayed corresponding to the multiple data to be displayed.

[0064] Take the example of an image to be displayed that can present navigation information to the user. The navigation information includes, for example, at least one of a navigation route and a navigation arrow that guides the navigation route. When the near-eye display device determines the texture data of the navigation route and the texture data of the navigation arrow, the near-eye display device can synthesize an image to be displayed based on the texture data of the navigation route and the texture data of the navigation arrow. For example, the near-eye display device can synthesize the texture data of the navigation route and the texture data of the navigation arrow to obtain the corresponding image to be displayed. The image to be displayed can present both the navigation route and the navigation arrow to the user. Based on this, when the near-eye display device subsequently displays the image to be displayed, the user can act according to the guidance of the navigation route and the navigation arrow in the image to be displayed when viewing the image to be displayed through the near-eye display device.

[0065] Of course, the image to be displayed is not limited to this and is not limited here.

[0066] When texture rendering is performed on the data to be displayed to obtain texture data corresponding to the data to be displayed, the near-eye display device can synthesize the texture data corresponding to each of the multiple data to be displayed to obtain images to be displayed corresponding to the multiple data to be displayed, which is equivalent to multiple data to be displayed being used to determine the same image to be displayed. The image to be displayed can be displayed by the first display module and the second display module of the near-eye display device. Based on this, the near-eye display device does not need to repeatedly render the same data to be displayed to determine the common display content of the first display module and the second display module, which is conducive to improving the rendering rate of the near-eye display device for the data to be displayed, and thereby improving the convenience and determination rate of the image to be displayed.

[0067] In some implementations, a synthesis process is performed on layers corresponding to the plurality of texture data to obtain images to be displayed corresponding to the plurality of data to be displayed.

[0068] For example, when determining an image to be displayed corresponding to a plurality of data to be displayed, the near-eye display device may perform synthesis processing on layers corresponding to the plurality of texture data.

[0069] When the near-eye display device performs synthesis processing on the layers corresponding to the multiple texture data, it can perform synthesis processing on the vertices of the multiple layers to simplify the synthesis process of the multiple texture data.

[0070] In one exemplary embodiment, when the near-eye display device obtains texture data corresponding to certain to-be-displayed data through application layer rendering and includes 100,000 vertices, the compositing layer, when compositing the layer corresponding to the texture data, only needs to composite the vertices of the layer corresponding to the texture data to generate the corresponding to-be-displayed image. For example, when the layer corresponding to the texture data is a quadrilateral, the near-eye display device only needs to composite the four vertices of the layer corresponding to the texture data through the compositing layer. And so on.

[0071] The simplification of the synthesis process based on multiple texture data is conducive to improving the synthesis rate of the near-eye display device for multiple texture data, reducing the rendering time required to render the data to be displayed, and thus improving the convenience and determination rate of the near-eye display device for determining the image to be displayed. When the convenience and determination rate of determining the image to be displayed are improved, it can effectively avoid the performance bottleneck of the near-eye display device in the process of displaying the image to be displayed due to the limitation of the computing resources of the near-eye display device, so that the near-eye display device can have sufficient computing resources to display and render the image to be displayed, and then display the image to be displayed on the first display module and the second display module respectively. Accordingly, when the near-eye display device has sufficient computing resources to display and render the image to be displayed, it can be used to subsequently reduce the display rendering delay of the near-eye display device when displaying the image to be displayed on the first display module and the second display module respectively, which is conducive to reducing the possibility of the user feeling dizzy when viewing the image to be displayed through the first display module and the second display module respectively, thereby improving the user's viewing experience of the image to be displayed.

[0072] In some embodiments, the display parameters of the first display module and the display parameters of the second display module are determined based on one or more of the pupil distance corresponding to the near-eye display device, the focal length of the near-eye display device, and the display size corresponding to the near-eye display device.

[0073] The near-eye display device can obtain one or more of the pupil distance corresponding to the near-eye display device, the focal length of the near-eye display device, and the display size corresponding to the near-eye display device, so as to determine the display parameters of the first display module and the display parameters of the second display module based on one or more of the pupil distance, the focal length, and the display size.

[0074] For example, the pupil distance corresponding to the near-eye display device can be changed. For example, in the case where the user wearing the near-eye display device changes, since the pupil distances of different users can be different, the pupil distance corresponding to the near-eye display device can change in response to the change of the user wearing the near-eye display device. For example, in the process of obtaining the pupil distance corresponding to the near-eye display device, the near-eye display device can photograph the eyes of the user wearing the near-eye display device to obtain the corresponding eye image; based on the user's eye image, the user's pupil distance is determined to determine the pupil distance corresponding to the near-eye display device. Of course, it is not limited to this. The near-eye display device can also store the pupil distances of different users, so that when a user is detected wearing the near-eye display device, the pupil distance of the user can be obtained to determine the pupil distance corresponding to the near-eye display device. This is not limited here. When the pupil distance corresponding to the near-eye display device is changeable and the display parameters of the first display module and the second display module are determined according to the pupil distance corresponding to the near-eye display device, the near-eye display device can dynamically change the display parameters of the first display module and the second display module in response to the change of the pupil distance corresponding to the near-eye display device, so that the image to be displayed displayed by the near-eye display device through the first display module and the second display module can be adapted to the viewing needs of different users, thereby improving the viewing experience of different users for the displayed image.

[0075] The pupil distance corresponding to the near-eye display device may also be fixed. For example, the pupil distance corresponding to the near-eye display device may be fixed to one of 60mm, 65mm, 67mm, 70mm, etc., which is not limited here. When the pupil distance corresponding to the near-eye display device is fixed, and the display parameters of the first display module and the second display module are determined according to the pupil distance corresponding to the near-eye display device, the near-eye display device can directly obtain the pupil distance corresponding to the near-eye display device without dynamically changing the pupil distance corresponding to the near-eye display device, which is beneficial to improving the display rate of the near-eye display device for the image to be displayed.

[0076] For example, the focal length of the near-eye display device can be pre-set. For example, before the near-eye display device leaves the factory, the camera parameters of the near-eye display device can be calibrated to determine the focal length of the near-eye display device. The near-eye display device can directly obtain the focal length of the near-eye display device.

[0077] For example, the near-eye display device can determine the display size of the near-eye display device based on the first display size of the first display module and the second display size of the second display module. The near-eye display device can obtain the first display size and the second display size to determine the display size of the near-eye display device.

[0078] When one or more of the pupil distance corresponding to the near-eye display device, the focal length of the near-eye display device, and the display size corresponding to the near-eye display device are obtained, the near-eye display device can, for example, determine the display parameters of the first display module and the display parameters of the second display module based on the pupil distance corresponding to the near-eye display device and the focal length of the near-eye display device, such as determining at least two of the first view matrix corresponding to the first display module, the second view matrix corresponding to the second display module, and the projection matrix corresponding to the near-eye display device, to determine the display parameters of the first display module and the display parameters of the second display module.

[0079] When the display parameters of the first display module and the display parameters of the second display module are determined based on one or more of the pupil distance corresponding to the near-eye display device, the focal length of the near-eye display device, and the display size corresponding to the near-eye display device, the display parameters of the first display module can be used by the near-eye display device to subsequently display the image to be displayed on the first display module, and the display parameters of the second display module can be used by the near-eye display device to subsequently display the image to be displayed on the second display module, which is conducive to subsequently improving the display convenience of the near-eye display device for the image to be displayed.

[0080] In some embodiments, the projection matrix corresponding to the near-eye display device is determined based on the focal length of the near-eye display device and the display size corresponding to the near-eye display device; the first view matrix corresponding to the first display module and the second view matrix corresponding to the second display module are determined based on the pupil distance of the near-eye display device and the focal length corresponding to the near-eye display device; the display parameters of the first display module are determined based on the projection matrix and the first view matrix; and the display parameters of the second display module are determined based on the projection matrix and the second view matrix.

[0081] For example, the near-eye display device may determine a projection matrix corresponding to the near-eye display device based on the focal length of the near-eye display device and the display size corresponding to the near-eye display device. The projection matrix corresponding to the near-eye display device may include a perspective matrix.

[0082] For example, when the near-eye display device displays the image to be displayed on the first display module and the second display module respectively according to the perspective matrix, the user can perceive the change of the image to be displayed in which the image is larger when near and smaller when far.

[0083] For example, if the image to be displayed includes a navigation arrow, and the navigation arrow can be used to guide the user from the location information of the near-eye display device to the navigation route corresponding to the location information of the destination, as the user gradually approaches the destination, the size of the navigation arrow displayed by the first display module and the second display module can gradually increase. Correspondingly, as the user gradually moves away from the destination, the size of the navigation arrow displayed by the first display module and the second display module can gradually decrease.

[0084] Of course, the projection matrix corresponding to the near-eye display device is not limited to the perspective matrix, and no limitation is made here.

[0085] For example, the near-eye display device may determine a first view matrix corresponding to the first display module and a second view matrix corresponding to the second display module according to the pupil distance and the focal length corresponding to the near-eye display device.

[0086] Take the example of a first display module being set at a position on the near-eye display device corresponding to the user's left eye, and a second display module being set at a position on the near-eye display device corresponding to the user's right eye. When the near-eye display device obtains the pupil distance corresponding to the near-eye display device, the near-eye display device can determine the size of the pupil distance included in the first view matrix and the second view matrix, as well as the direction of the pupil distance, based on the correspondence between the first display module and the second display module and the user's eyes. For example, the pupil distance in the first view matrix can be expressed as -ipd / 2, and the pupil distance in the second view matrix can be expressed as ipd / 2, to indicate that the pupil distances included in the first view matrix and the second view matrix are the same in size but opposite in direction. The difference between the first view matrix and the second view matrix is ​​determined based on the pupil distance ipd corresponding to the near-eye display device. At this time, the first view matrix can also be called a left view matrix, and the second view matrix can also be called a right view matrix, without limitation here.

[0087] When the near-eye display device determines the projection matrix corresponding to the near-eye display device, the first view matrix corresponding to the first display module, and the second view matrix corresponding to the second display module, the near-eye display device can determine the display parameters of the first display module based on the projection matrix and the first view matrix, and determine the display parameters of the second display module based on the projection matrix and the second view matrix, which is conducive to improving the convenience of determining the display parameters of the first display module and the second display module. The display parameters of the first display module can be used by the near-eye display device to subsequently display the image to be displayed on the first display module, and the display parameters of the second display module can be used by the near-eye display device to subsequently display the image to be displayed on the second display module, which is conducive to subsequently improving the convenience of the near-eye display device in displaying the image to be displayed.

[0088] In some embodiments, the first display position of each pixel in the image to be displayed on the first display module is determined based on the display parameters of the first display module; and based on the first display position, each pixel of the image to be displayed is displayed and rendered to display the image to be displayed on the first display module.

[0089] For example, the near-eye display device can perform position conversion processing on the pixel position of each pixel in the image to be displayed based on the display parameters of the first display module to obtain the first display position of each pixel on the first display module. After determining the first display position of each pixel in the image to be displayed, the near-eye display device can render each pixel of the image to be displayed based on the first display position, and then display the image to be displayed on the first display module.

[0090] When determining the first display position of each pixel in the image to be displayed based on the display parameters of the first display module, since the display parameters of the first display module can change based on changes in the pupil distance corresponding to the near-eye display device, when the user wearing the near-eye display device changes, the near-eye display device can still determine the display parameters of the first display module based on the changed pupil distance, and thus determine the first display position of each pixel. Based on this, when the near-eye display device displays and renders each pixel of the image to be displayed based on the first display position to display the image to be displayed on the first display module, it is beneficial to reduce the display error of the image to be displayed by the first display module.

[0091] In some embodiments, the second display position of each pixel in the image to be displayed on the second display module is determined based on the display parameters of the second display module; based on the second display position, each pixel of the image to be displayed is displayed and rendered to display the image to be displayed on the second display module.

[0092] For example, the near-eye display device can perform position conversion processing on the pixel position of each pixel in the image to be displayed based on the display parameters of the second display module to obtain the second display position of each pixel on the second display module. After determining the second display position of each pixel in the image to be displayed, the near-eye display device can render each pixel of the image to be displayed based on the second display position, and then display the image to be displayed on the first display module.

[0093] When determining the second display position of each pixel in the image to be displayed based on the display parameters of the second display module, since the display parameters of the second display module can change based on the change in the pupil distance corresponding to the near-eye display device, when the user wearing the near-eye display device changes, the near-eye display device can still determine the display parameters of the second display module based on the changed pupil distance, and thus determine the second display position of each pixel. Based on this, when the near-eye display device displays and renders each pixel of the image to be displayed based on the second display position to display the image to be displayed on the second display module, it is beneficial to reduce the display error of the image to be displayed by the second display module.

[0094] When the near-eye display device determines the image to be displayed, it can adopt an asynchronous submission mechanism to display the image to be displayed on the first display module and the second display module respectively. For example, the near-eye display device can determine the first display position of each pixel in the image to be displayed on the first display module based on the display parameters of the first display module. When the near-eye display device determines the first display position of each pixel, it can submit each first display position as display rendering content for the near-eye display device to display the image to be displayed on the first display module. For another example, the near-eye display device can determine the second display position of each pixel in the image to be displayed on the second display module based on the display parameters of the second display module. When the near-eye display device determines the second display position of each pixel, it can submit each second display position as display rendering content for the near-eye display device to display the image to be displayed on the second display module.

[0095] Based on this, when the near-eye display device displays and renders each pixel of the image to be displayed based on the first display position of each pixel, there is no need to wait for the near-eye display device to determine the second display position of each pixel. Accordingly, when the near-eye display device displays and renders each pixel of the image to be displayed based on the second display position of each pixel, there is no need to wait for the near-eye display device to determine the first display position of each pixel, which is conducive to improving the display convenience of the near-eye display device for the image to be displayed.

[0096] In some embodiments, the posture change of the near-eye display device from displaying the current frame of the image to be displayed to displaying the next frame of the image to be displayed is obtained; based on the posture change, the current frame of the image to be displayed displayed on the first display module and the second display module is updated and displayed.

[0097] For example, the near-eye display device may have a device posture detection function. For example, the near-eye display device may be provided with a sensor, such as at least one of a gyroscope and an accelerometer, to enable the near-eye display device to detect its own device posture and thereby determine the amount of posture change of the near-eye display device.

[0098] In the process of the near-eye display device displaying the image to be displayed through the first display module and the second display module respectively, the device posture of the near-eye display device can change in response to the user's head movement. After the near-eye display device displays the current frame of the image to be displayed and before displaying the next frame of the image to be displayed, when the near-eye display device detects that the device posture has changed, the near-eye display device cannot display the next frame of the image to be displayed because the near-eye display device has not completed the display rendering of the next frame of the image to be displayed. However, if the near-eye display device maintains displaying the current frame of the image to be displayed, it is easy for the current frame of the image to be displayed displayed by the near-eye display device to be incompatible with the user's viewing requirements for the image to be displayed. Based on this, the near-eye display device can adopt asynchronous time warping technology to use the posture change of the near-eye display device to update the display of the current frame of the image to be displayed displayed by the near-eye display device.

[0099] For example, the near-eye display device can update and display the current frame of the image to be displayed on the first display module and the second display module in response to the change in the device posture.

[0100] The near-eye display device can obtain a position change amount of the near-eye display device between displaying a current frame of an image to be displayed and displaying a next frame of an image to be displayed. The position change amount can be used to indicate a corresponding change amount of the device position of the near-eye display device. Accordingly, the near-eye display device can update and display the current frame of an image to be displayed displayed on the first display module and the second display module based on each position change amount of the near-eye display device between displaying a current frame of an image to be displayed and displaying a next frame of an image to be displayed.

[0101] For example, based on the amount of posture change, the first display position of each pixel in the current frame of the image to be displayed displayed by the first display module is transformed to obtain the processed first display position; based on the processed first display position, the current frame of the image to be displayed is updated and displayed. Correspondingly, based on the amount of posture change, the second display position of each pixel in the current frame of the image to be displayed displayed by the second display module is transformed to obtain the processed second display position; based on the processed second display position, the current frame of the image to be displayed is updated and displayed.

[0102] For example, the position change amount of the near-eye display device between displaying the current frame of the image to be displayed and displaying the next frame of the image to be displayed includes position change amount 1 and position change amount 2, and the acquisition time corresponding to position change amount 1 is earlier than the acquisition time corresponding to position change amount 2. The near-eye display device can perform a geometric transformation on the current frame of the image to be displayed, which has been rendered, based on position change amount 1 and position change amount 2. For example, if position change amount 1 indicates that the device position of the near-eye display device has shifted, the first display position and second display position of each pixel included in the current frame of the image to be displayed can be subjected to a translation transformation based on position change amount 1 to obtain the first display position and second display position after the shift. Accordingly, the near-eye display device can update and display the current frame of the image to be displayed on the first display module based on the shifted first display position. The near-eye display device can update and display the current frame of the image to be displayed on the second display module based on the shifted second display position. When updating and displaying the current frame of the image to be displayed, the near-eye display device can determine the updated current frame of the image to be displayed as the current frame of the image to be displayed. For another example, when the posture change 2 indicates that the device posture of the near-eye display device has rotated, the first display position and the second display position of each pixel point included in the current frame of the image to be displayed can be subjected to rotation transformation processing according to the posture change 2 to obtain the rotated first display position and the second display position. Accordingly, the near-eye display device can update and display the current frame of the image to be displayed on the first display module according to the rotated first display position. The near-eye display device can update and display the current frame of the image to be displayed on the second display module according to the rotated second display position. And so on.

[0103] In the case of obtaining the amount of posture change of the near-eye display device after displaying the current frame of the image to be displayed and before displaying the next frame of the image to be displayed, and updating and displaying the current frame of the image to be displayed displayed on the first display module and the second display module based on the amount of posture change, the near-eye display device can update and display the rendered and displayed current frame of the image to be displayed before displaying the next frame of the image to be displayed, so that the updated and displayed current frame of the image to be displayed can be closer to the user's perspective. In the case where the updated and displayed current frame of the image to be displayed can be closer to the user's perspective, the dizziness caused to the user when viewing the image to be displayed due to the rendering and display delay of the image to be displayed can be reduced during the process of changing the device posture of the near-eye display device, which is conducive to improving the display effect of the near-eye display device on the image to be displayed, and improving the user's experience of using the near-eye display device.

[0104] In an exemplary embodiment, the rendering process of the near-eye display device for the data to be displayed and the display rendering process for the image to be displayed include:

[0105] (1) Obtaining data to be displayed from a near-eye display device and determining an image to be displayed corresponding to the data to be displayed.

[0106] For example, the near-eye display device may obtain navigation data to be displayed, such as road and traffic data, through a navigation data acquisition tool. The road data may include three-dimensional information such as road slope and road curvature. The near-eye display device may determine the navigation data to be displayed as the data to be displayed.

[0107] The near-eye display device can render the data to be displayed to obtain the image to be displayed corresponding to the data to be displayed. For example, the near-eye display device can use the compositing layer to composite the SurfaceTexture objects generated by elements such as navigation arrows and road condition labels to obtain the corresponding image to be displayed.

[0108] For example, the rendering architecture of the near-eye display device for display data includes an application layer, a compositing layer, SurfaceTexture, and SurfaceFlinger. When the near-eye display device renders an image to be displayed, the data to be displayed by the near-eye display device can be processed in sequence by the application layer, the compositing layer, SurfaceTexture, and SurfaceFlinger to obtain the rendered image. The rendered image can be displayed by the first display module and the second display module of the near-eye display device.

[0109] (2) Calculate the dynamic MVP matrix of the near-eye display device.

[0110] The MVP matrix can be used to indicate the model matrix, view matrix, and projection matrix of a near-eye display device. Since one or more of the model matrix, view matrix, and projection matrix of a near-eye display device can change, the MVP matrix of a near-eye display device can also be called a dynamic MVP matrix.

[0111] The view matrix may include a first view matrix and a second view matrix. The code logic involved in determining the view matrix by the near-eye display device may be expressed as follows:

[0112] float ipd = Settings.System.getFloat(context.getContentResolver(), "ipd_value", 0.065f); / / Default interpupillary distance is 65mm

[0113] Matrix.setLookAtM(V_left, 0, -ipd / 2, 0, 1.5f, 0, 0, 0, 0, 1, 0); / / Left eye coordinate system

[0114] Matrix.setLookAtM(V_right, 0, ipd / 2, 0, 1.5f, 0, 0, 0, 0, 1, 0); / / Right eye coordinate system

[0115] The near-eye display device may determine a view matrix in a left-eye coordinate system as one of a first view matrix and a second view matrix, and determine a view matrix in a right-eye coordinate system as the other of the first view matrix and the second view matrix. The coordinate system corresponding to the first view matrix is ​​adapted to the arrangement position of the first display module on the near-eye display device, and the coordinate system corresponding to the second view matrix is ​​adapted to the arrangement position of the second display module on the near-eye display device.

[0116] The code logic involved in determining the projection matrix of the near-eye display device can be expressed as follows:

[0117] Matrix.perspectiveM(P, 0, 60.0f, (float)width / height, 0.1f, 1000.0f); / / Perspective projection

[0118] When a dynamic MVP matrix of a near-eye display device is calculated, the dynamic MVP matrix may be used to determine display parameters of a first display module and a second display module of the near-eye display device.

[0119] For example, when calculating the dynamic MVP matrix, the near-eye display device may obtain the pupil distance corresponding to the near-eye display device; determine a first view matrix and a second view matrix based on the pupil distance corresponding to the near-eye display device; determine a projection matrix corresponding to the near-eye display device; bind the first view matrix and the projection matrix to the first display module, and bind the second view matrix and the projection matrix to the second display module. This is not limiting and is not intended to be limiting herein.

[0120] (3) Displaying the image to be displayed on the first display module according to the display parameters of the first display module, and displaying the image to be displayed on the second display module according to the display parameters of the second display module.

[0121] For example, in the process of determining the image to be displayed corresponding to the data to be displayed, the near-eye display device may create a layer corresponding to the texture data corresponding to the data to be displayed. The code logic involved in the near-eye display device creating the layer corresponding to the texture data may be expressed as follows:

[0122] SurfaceControl.Builder builder = new SurfaceControl.Builder(display);

[0123] builder.setLayerStack(layerStack);

[0124] SurfaceControl leftSurface = builder.build();

[0125] SurfaceControl rightSurface = builder.build();

[0126] Accordingly, the near-eye display device can bind the texture data corresponding to the data to be displayed with the MVP matrix of the near-eye display device, so that the first display module and the second display module can share the texture data and then share the data to be displayed. Accordingly, the first display module and the second display module can display and render the same image to be displayed.

[0127] The code logic involved in binding the same texture data to the first display module and the second display module of the near-eye display device and binding different MVP matrices can be expressed as follows:

[0128] leftSurface.getSurface().setTexture(navTexture);

[0129] leftSurface.setMatrix(V_left, P);

[0130] rightSurface.getSurface().setTexture(navTexture);

[0131] rightSurface.setMatrix(V_right, P);

[0132] The near-eye display device can also control the display rendering order of the image to be displayed, such as using an asynchronous submission mechanism to control the near-eye display device to display and render the image to be displayed.

[0133] The code logic involved in the first display module and the second display module of the near-eye display device performing display rendering on the image to be displayed can be expressed as follows:

[0134] leftSurface.show();

[0135] rightSurface.show();

[0136] For example, when the display parameters of the first display module are determined, the first display position of each pixel in the image to be displayed on the first display module can be determined based on the display parameters of the first display module. When the first display position of each pixel is determined, each pixel of the image to be displayed can be rendered based on the first display position, and the image to be displayed can be displayed on the first display module.

[0137] For another example, when the display parameters of the second display module are determined, the second display position of each pixel in the image to be displayed on the second display module can be determined based on the display parameters of the second display module. When the second display position of each pixel is determined, each pixel of the image to be displayed can be rendered based on the second display position, and the image to be displayed can be displayed on the second display module.

[0138] When the near-eye display device renders the data to be displayed to obtain the image to be displayed, and displays and renders the image to be displayed based on the display parameters of the first display module and the second display module, respectively, so as to display the image to be displayed on the first display module and the second display module, respectively, the following can be achieved:

[0139] ① The graphics processing unit (GPU) computing power of near-eye display devices is reduced by 50% (reduced to the original value under double the load). This reduction in GPU computing power helps improve the battery life of near-eye display devices.

[0140] ② The three-dimensional dizziness is reduced by 60%. For example, the time difference between the display time of the first display module and the second display module of the near-eye display device for displaying the image can be reduced from 5ms (depending on the complexity of the scene, it may be larger) to less than 2ms.

[0141] ③ The rendering delay corresponding to the display rendering of the image to be displayed by the first display module and the second display module is less than 2ms (a reduction of more than 60%).

[0142] ④ Since the first display module and the second display module can share the data to be displayed and the image to be displayed, the memory usage of the near-eye display device is reduced by 50%.

[0143] ⑤ Because the near-eye display device's synthesis layer, such as SurfaceFlinger, is closer to the display side, the process from rendering the data to generate the image to be displayed to displaying the image to be displayed can reduce the near-eye display device's display error. For example, if the image to be displayed on the near-eye display device includes navigation information, and the navigation information includes 3D navigation altitude, the 3D navigation altitude error can be reduced from over 10% to within 5%.

[0144] Of course, the rendering process of the near-eye display device for display data and the display rendering process for display images are not limited to this and are not limited here.

[0145] The display method of the near-eye display device provided in the above embodiment includes: obtaining the data to be displayed of the near-eye display device; rendering the data to be displayed to obtain the image to be displayed corresponding to the data to be displayed; displaying the image to be displayed on the first display module according to the display parameters of the first display module; and displaying the image to be displayed on the second display module according to the display parameters of the second display module.

[0146] When the near-eye display device obtains the data to be displayed, it can render the data to be displayed to obtain the image to be displayed corresponding to the data to be displayed. The image to be displayed can be used as the common display content of the first display module and the second display module of the near-eye display device, so the near-eye display device does not need to repeatedly render the same data to be displayed, so as to save the rendering process of the near-eye display device for the same data to be displayed, thereby improving the rendering rate of the near-eye display device for the data to be displayed. Accordingly, the near-eye display device can display the image to be displayed based on the respective display parameters of the first display module and the second display module. Since the respective display parameters of the first display module and the second display module can be different, when the near-eye display device collaboratively displays the same image to be displayed through the first display module and the second display module, the presentation effects of the images to be displayed displayed by the first display module and the second display module to the user can be different, which is equivalent to the near-eye display device having a multi-screen display function. When the first display module and the second display module each display different images to be displayed, the images to be displayed by the first display module and the second display module can be adapted to the viewing requirements of the user's left eye and right eye, respectively, which is conducive to improving the display effect of the near-eye display device on the images to be displayed. Based on the improvement of the rendering rate of the near-eye display device for the data to be displayed and the improvement of the convenience of the near-eye display device in displaying the images to be displayed, it is conducive to improving the display efficiency of the near-eye display device for the images to be displayed.

[0147] See also Figure 2 , Figure 2: This is a schematic block diagram of a display device of a near-eye display device provided in an embodiment of the present application. The display device of the near-eye display device can be configured in a near-eye display device or a server to execute the display method of the aforementioned near-eye display device. The near-eye display device may include AR glasses, MR glasses, AR helmets, MR helmets, and the like, without limitation. The server may be a separate server or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content distribution networks, and big data and artificial intelligence platforms.

[0148] like Figure 2 As shown, the display device of the near-eye display apparatus includes a data acquisition module 110 , an image determination module 120 , a first display module 130 and a second display module 140 .

[0149] The data acquisition module 110 is used to acquire data to be displayed by the near-eye display device.

[0150] The image determination module 120 is configured to render the data to be displayed to obtain an image to be displayed corresponding to the data to be displayed.

[0151] The first display module 130 is configured to display the image to be displayed on the first display module according to the display parameters of the first display module.

[0152] The second display module 140 is configured to display the image to be displayed on the second display module according to the display parameters of the second display module.

[0153] Exemplarily, the image determination module 120 includes a texture rendering submodule and an image synthesis submodule.

[0154] The texture rendering submodule is used to perform texture rendering processing on the data to be displayed to obtain texture data corresponding to the data to be displayed.

[0155] The image synthesis submodule is used to synthesize the texture data corresponding to the plurality of data to be displayed to obtain the plurality of images to be displayed corresponding to the data to be displayed.

[0156] Exemplarily, the image synthesis submodule includes a layer synthesis submodule.

[0157] The layer synthesis submodule is used to synthesize the layers corresponding to the plurality of texture data to obtain images to be displayed corresponding to the plurality of data to be displayed.

[0158] Exemplarily, the display device further includes: a display parameter determination submodule.

[0159] The display parameter determination submodule is used to determine the display parameters of the first display module and the display parameters of the second display module based on one or more of the pupil distance corresponding to the near-eye display device, the focal length of the near-eye display device, and the display size corresponding to the near-eye display device.

[0160] Exemplarily, the display parameter determination submodule includes a first matrix determination submodule, a second matrix determination submodule, a first parameter determination submodule, and a second parameter determination submodule.

[0161] The first matrix determination submodule is configured to determine a projection matrix corresponding to the near-eye display device according to a focal length of the near-eye display device and a display size corresponding to the near-eye display device.

[0162] The second matrix determination submodule is used to determine a first view matrix corresponding to the first display module and a second view matrix corresponding to the second display module according to the pupil distance of the near-eye display device and the focal length corresponding to the near-eye display device.

[0163] The first parameter determination submodule is configured to determine display parameters of the first display module according to the projection matrix and the first view matrix.

[0164] The second parameter determination submodule is configured to determine display parameters of the second display module according to the projection matrix and the second view matrix.

[0165] Exemplarily, the first display module 130 includes a first position determination submodule and a first display rendering submodule.

[0166] The first position determination submodule is configured to determine a first display position of each pixel point in the image to be displayed on the first display module according to the display parameters of the first display module.

[0167] The first display rendering submodule is configured to perform display rendering on each pixel of the image to be displayed according to the first display position, so as to display the image to be displayed on the first display module.

[0168] The second display module 140 includes a second position determination submodule and a second display rendering submodule.

[0169] The second position determination submodule is configured to determine a second display position of each pixel point in the image to be displayed on the second display module according to the display parameters of the second display module.

[0170] The second display rendering submodule is configured to perform display rendering on each pixel of the image to be displayed according to the second display position, so as to display the image to be displayed on the second display module.

[0171] Exemplarily, the display device further includes a posture acquisition submodule and an image update submodule.

[0172] The posture acquisition submodule is used to obtain the posture change of the near-eye display device after displaying the current frame of the image to be displayed and before displaying the next frame of the image to be displayed.

[0173] The image updating submodule is used to update and display the current frame to be displayed on the first display module and the second display module according to the posture change amount.

[0174] It should be noted that those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described devices and modules and units can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0175] The method of the present application can be used in many general or special computer system environments or configurations. For example: personal computers, server computers, handheld devices or portable devices, tablet devices, multi-processor systems, microprocessor-based systems, set-top boxes, programmable consumer electronic devices, network PCs, minicomputers, mainframe computers, distributed computing environments including any of the above systems or devices, etc. The present application can be described in the general context of computer-executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform specific tasks or implement specific abstract data types. The present application can also be practiced in distributed computing environments, in which tasks are performed by remote processing devices connected through a communication network. In a distributed computing environment, program modules can be located in local and remote computer storage media, including storage devices.

[0176] Exemplarily, the above-mentioned method and apparatus may be implemented in the form of a computer program that can be run on a near-eye display device or a server to control the near-eye display device. Exemplarily, the near-eye display device may include AR glasses, MR glasses, AR helmets, MR helmets, and the like, without limitation. The server may be a separate server or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content distribution networks, and big data and artificial intelligence platforms.

[0177] See also Figure 3 , Figure 3 This is a schematic block diagram of the structure of a near-eye display device provided in an embodiment of the present application.

[0178] like Figure 3 As shown, the near-eye display device is provided with a first display module and a second display module, and the first display module is provided at a different location than the second display module. The near-eye display device includes a memory and a processor. The memory and the processor may be connected via a system bus, and the memory may include a storage medium and an internal memory.

[0179] The storage medium may store an operating system and a computer program. When the computer program is executed, the processor may execute any one of the display methods of the near-eye display device.

[0180] The processor is used to provide computing and control capabilities to support the operation of the entire near-eye display device.

[0181] The internal memory provides an environment for the operation of the computer program in the storage medium. When the computer program is executed by the processor, the processor can execute any display method of the near-eye display device.

[0182] Those skilled in the art will understand that Figure 3 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the electronic device to which the solution of the present application is applied. The specific electronic device may include more or fewer components than shown in the figure, or combine certain components, or have a different component arrangement.

[0183] It should be understood that the processor may be a central processing unit (CPU), other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor.

[0184] In one embodiment, the processor is configured to execute a computer program and implement the following steps when executing the computer program:

[0185] Acquiring data to be displayed by the near-eye display device;

[0186] Rendering the data to be displayed to obtain an image to be displayed corresponding to the data to be displayed;

[0187] displaying the image to be displayed on the first display module according to the display parameters of the first display module;

[0188] The image to be displayed is displayed on the second display module according to the display parameters of the second display module.

[0189] It should be noted that, those skilled in the art can clearly understand that, for the convenience and conciseness of description, the above-mentioned specific working process of the display of the near-eye display device can refer to the corresponding process in the aforementioned embodiment of the display method of the near-eye display device, and will not be repeated here.

[0190] An embodiment of the present application also provides a computer-readable storage medium, on which a computer program is stored. The method implemented when the computer program is executed by a processor can refer to the various embodiments of the display method of the near-eye display device of the present application.

[0191] The computer-readable storage medium may be an internal storage unit of the near-eye display device described in the aforementioned embodiment, such as a hard disk or memory of the near-eye display device. The computer-readable storage medium may also be an external storage device of the near-eye display device, such as a plug-in hard disk, a smart memory card (SMC), a secure digital (SD) card, a flash card, etc., equipped on the near-eye display device.

[0192] It should be understood that the terms used in this specification are only for the purpose of describing specific embodiments and are not intended to limit the present application. As used in this specification and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms unless the context clearly indicates otherwise.

[0193] It should also be understood that the term "and / or" used in this specification and the appended claims refers to any combination of one or more of the associated listed items and all possible combinations, including these combinations. It should be noted that, in this article, the terms "include", "comprise" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system that includes a series of elements includes not only those elements, but also other elements that are not explicitly listed, or also includes elements that are inherent to such process, method, article or system. In the absence of further limitations, an element defined by the sentence "including a..." does not exclude the presence of other identical elements in the process, method, article or system that includes the element.

[0194] The serial numbers of the embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments. The above description is only a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed in this application, and these modifications or replacements should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A display method for a near-eye display device, characterized in that: The near-eye display device is provided with a first display module and a second display module, and the arrangement position of the first display module is different from the arrangement position of the second display module; The display method includes: Acquiring data to be displayed by the near-eye display device; the data to be displayed includes navigation data to be displayed; the navigation data to be displayed includes three-dimensional information of road slope and / or road curvature; Performing texture rendering processing on the data to be displayed to obtain texture data corresponding to the data to be displayed; Obtaining a first view matrix in a left-eye coordinate system and a second view matrix in a right-eye coordinate system according to the pupil distance information corresponding to the near-eye display device and the focal length of the near-eye display device, and obtaining a projection matrix corresponding to the near-eye display device according to the focal length of the near-eye display device and the display size corresponding to the near-eye display device; Obtaining display parameters of the first display module according to the first view matrix and the projection matrix, and obtaining display parameters of the second display module according to the second view matrix and the projection matrix; According to the texture data and the display parameters of the first display module, the image to be displayed is displayed on the first display module, and according to the texture data and the display parameters of the second display module, the image to be displayed is displayed on the second display module, and the image to be displayed displayed by the first display module and the image to be displayed displayed by the second display module are the same image to be displayed.

2. The display method according to claim 1, wherein: After displaying the image to be displayed on the first display module according to the texture data and the display parameters of the first display module, and displaying the image to be displayed on the second display module according to the texture data and the display parameters of the second display module, and the image to be displayed displayed by the first display module and the image to be displayed displayed by the second display module are the same image to be displayed, the method further includes: Obtaining a position change amount of the near-eye display device after displaying a current frame of an image to be displayed and before displaying a next frame of an image to be displayed; According to the posture change amount, the current frame image to be displayed displayed on the first display module and the second display module is updated and displayed.

3. A display device of a near-eye display device, characterized in that: The display device includes: a data acquisition module, configured to acquire data to be displayed by the near-eye display device; the data to be displayed includes navigation data to be displayed; the navigation data to be displayed includes three-dimensional information of road slope and / or road curvature; A texture rendering module, configured to perform texture rendering processing on the data to be displayed to obtain texture data corresponding to the data to be displayed; a matrix determination module, configured to obtain a first view matrix in a left-eye coordinate system and a second view matrix in a right-eye coordinate system based on pupil distance information corresponding to the near-eye display device and the focal length of the near-eye display device, and obtain a projection matrix corresponding to the near-eye display device based on the focal length of the near-eye display device and the display size corresponding to the near-eye display device; a parameter determination module, configured to obtain display parameters of a first display module of the near-eye display device according to the first view matrix and the projection matrix, and to obtain display parameters of a second display module of the near-eye display device according to the second view matrix and the projection matrix; A display module is configured to display an image to be displayed on the first display module based on the texture data and the display parameters of the first display module, and to display an image to be displayed on the second display module based on the texture data and the display parameters of the second display module, wherein the image to be displayed displayed by the first display module and the image to be displayed displayed by the second display module are the same image to be displayed.

4. A near-eye display device, characterized in that: The near-eye display device is provided with a first display module and a second display module, wherein the first display module is provided at a different position than the second display module; the near-eye display device includes a memory and a processor; The memory is used to store computer programs; The processor is configured to execute the computer program and implement the steps of the display method of the near-eye display device according to any one of claims 1 to 2 when executing the computer program.

5. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the display method of the near-eye display device according to any one of claims 1 to 2 are implemented.

Images