Near-to-eye display device control method and apparatus, and device

Abstract

A near-to-eye display device control method, comprising: acquiring an image obtained by photographing a target object by a near-to-eye display device (S101); on the basis of the image, determining a target display object corresponding to the target object (S102); determining a target display pose of the target display object on the basis of position information of the near-to-eye display device and position information of the target object (S103); and on the basis of the target display pose, controlling the near-to-eye display device to display the target display object (S104). Also provided are an apparatus and a device.

Description

Control method, device and equipment for near-eye display device

[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on October 24, 2023, with application number 2023113921282, and invention name “Control method, device and equipment for near-eye display device”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of data processing technology, and in particular to a control method, apparatus, and device for a near-eye display device. Background Art

[0003] Currently, near-eye display devices are used in daily life. For example, users can use them to view objects they encounter in daily life, such as food, daily necessities, and clothing. However, when viewing these objects, the near-eye display devices only display an image of the object, or display the object in a fixed position, which can easily lead to a poor viewing experience for the user.

[0004] Summary of the Invention

[0005] The main purpose of this application is to provide a control method, device and equipment for a near-eye display device, aiming to improve the convenience and flexibility of displaying target objects and enhance the user's viewing experience of the target objects.

[0006] In a first aspect, the present application provides a method for controlling a near-eye display device, the method comprising the following steps:

[0007] Acquire an image of a target object captured by a near-eye display device;

[0008] determining, according to the image, a target display object corresponding to the target object;

[0009] determining a target display posture of the target display object according to the position information of the near-eye display device and the position information of the target object;

[0010] According to the target display posture, the near-eye display device is controlled to display the target display object.

[0011] In a second aspect, the present application further provides a control device for a near-eye display device, the control device for the near-eye display device comprising:

[0012] An acquisition module is used to acquire an image of a target object captured by a near-eye display device;

[0013] A first determining module, configured to determine a target display object corresponding to the target object according to the image;

[0014] a second determining module, configured to determine a target display posture of the target display object according to the position information of the near-eye display device and the position information of the target object;

[0015] A control module is used to control the near-eye display device to display the target display object according to the target display posture.

[0016] In a third aspect, the present application further provides a near-eye display device, the near-eye display device comprising a memory and a processor;

[0017] The memory is used to store computer programs;

[0018] The processor is configured to execute the computer program and implement the above-mentioned method for controlling the near-eye display device when executing the computer program.

[0019] The present application provides a method, apparatus, and device for controlling a near-eye display device. The method includes: obtaining an image obtained by the near-eye display device photographing a target object; determining a target display object corresponding to the target object based on the image; determining a target display posture of the target display object based on position information of the near-eye display device and the position information of the target object; and controlling the near-eye display device to display the target display object based on the target display posture. For example, the near-eye display device can determine a target display object corresponding to the target object, such as text, a picture, an animation, a video, etc., corresponding to the target object, based on the image obtained by the near-eye display device photographing the target object. Furthermore, the target display posture of the target display object can be determined based on the position information of the near-eye display device and the position information of the target object, so as to display the target display object based on the target display posture. Based on this, when the position information of at least one of the near-eye display device and the target object changes, the target display posture will also change accordingly. The near-eye display device can then display the target display object corresponding to the target object in accordance with the change in the target display posture, thereby improving the convenience and flexibility of displaying the target object and enhancing the user's viewing experience of the target object. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following is a brief introduction to the drawings required for use in the description of the embodiments. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0021] FIG1 is a schematic flow chart of a method for controlling a near-eye display device according to an embodiment of the present application;

[0022] FIG2 is a flowchart of a human-computer interaction of a near-eye display device according to an embodiment of the present application;

[0023] FIG3 is a schematic block diagram of a control device for a near-eye display device provided in an embodiment of the present application;

[0024] FIG4 is a schematic block diagram of the structure of a near-eye display device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0025] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0026] The flowcharts shown in the accompanying drawings are for illustrative purposes only and do not necessarily include all contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps may be decomposed, combined, or partially merged, so the actual execution order may vary depending on the actual situation.

[0027] The embodiments of the present application provide a method, apparatus, and device for controlling a near-eye display device, wherein the method for controlling a near-eye display device can be applied to a near-eye display device.

[0028] Exemplarily, near-eye display devices may include VR glasses, AR glasses, VR helmets, AR helmets, and the like, without limitation herein.

[0029] The following describes some embodiments of the present application in detail with reference to the accompanying drawings. In the absence of conflict, the following embodiments and features in the embodiments may be combined with each other.

[0030] Please refer to Figure 1, which is a flow chart of a method for controlling a near-eye display device provided in an embodiment of the present application. It should be noted that the method for controlling a near-eye display device provided in an embodiment of the present application can be used for a near-eye display device.

[0031] As shown in FIG1 , the control method of the near-eye display device includes steps S101 to S104 .

[0032] S101: Acquire an image of a target object captured by a near-eye display device.

[0033] Exemplarily, a camera module may be provided on the near-eye display device. For example, the camera module may be used to photograph an object, such as a target object. Of course, this is not limited to this and is not a limitation herein. In some embodiments, the image may include an image of the target object in at least one direction, such as a left view, a right view, a front view, a rear view, an upward view, or a downward view of the target object, or a stereoscopic image of the target object, such as an image of the left side, the front side, and the top side of the target object, and of course, this is not limited to this. For example, the image includes the entire target object, or includes a portion of the target object.

[0034] In some embodiments, the near-eye display device can be controlled to capture a target object to obtain an image based on user operation information on the near-eye display device, wherein the user may be a user wearing the near-eye display device.

[0035] For example, the operation information may include user posture information. For example, the near-eye display device may be provided with a posture sensor for acquiring user posture information, such as an inertial measurement unit (IMU sensor), which is not limited here.

[0036] For example, when a user wears a near-eye display device, as the user's posture information changes, such as when the user turns their head, walks, or runs, the near-eye display device will also move accordingly. As the near-eye display device moves in response to changes in the user's posture information, the amount of change in the near-eye display device's posture also changes accordingly. Based on this, it can be determined whether the user has a need to take photos with the near-eye display device based on the amount of change in the near-eye display device's posture.

[0037] In some embodiments, when the posture change amount of the near-eye display device is less than or equal to a preset posture change threshold, the target object is photographed by the near-eye display device to obtain an image.

[0038] For example, the pose change of the near-eye display device can be obtained using a preset pose detection algorithm. For example, the preset pose detection algorithm may include an IMU stable state algorithm, which is not limited here. When the pose change of the near-eye display device is obtained, if the pose change of the near-eye display device is less than or equal to a preset pose change threshold, it can be determined that the near-eye display device is in a stable state.

[0039] When a user continuously views a target object through a near-eye display device, the user's posture information collected by the IMU sensor changes little within a preset time period. Accordingly, the posture change of the near-eye display device, as determined by the IMU steady-state algorithm, is also small. For example, the posture change of the near-eye display device is less than or equal to a preset posture change threshold.

[0040] Based on this, when the posture change of the near-eye display device is less than or equal to the preset posture change threshold, it can be determined that the user has a need to take pictures of the near-eye display device, and the near-eye display device can take pictures in response to the user's need to take pictures, such as taking pictures of the target object to obtain an image.

[0041] In an exemplary embodiment, when the posture change of the near-eye display device is less than or equal to a preset posture change threshold, and the duration of the posture change being less than or equal to the preset posture change threshold is greater than or equal to a first duration threshold, the target object is photographed by the near-eye display device to obtain an image.

[0042] For example, when the posture change of the near-eye display device is less than or equal to the preset posture change threshold, there may be a situation where the user briefly views an object and then walks away. The user does not need to further view the object through the near-eye display device, and the user does not have the need to take a photo of the near-eye display device. Based on this, a first duration threshold can be set, and the first duration threshold can be used to further determine whether the user has a need to take a photo of the near-eye display device. For example, when the posture change of the near-eye display device is less than or equal to the preset posture change threshold, and the duration of the posture change is less than or equal to the preset posture change threshold is greater than or equal to the first duration threshold, the target object is photographed by the near-eye display device to obtain an image. When the posture change of the near-eye display device is less than or equal to the preset posture change threshold, and the duration of the posture change is less than or equal to the preset posture change threshold is less than the first duration threshold, there is no need to photograph the object through the near-eye display device. The first duration threshold can include 0.5 seconds, 1 second, etc., and is not limited here. The first duration threshold can be pre-set or set by the user, and is not limited here.

[0043] Of course, the present invention is not limited to this. For example, the operation information may include user touch information, press information, etc. of the near-eye display device. For example, when the user touches or presses a preset position of the near-eye display device, it can be determined that the user has a photo taking request of the near-eye display device, and the near-eye display device can take a photo in response to the user's photo taking request. This is not limited here.

[0044] In some embodiments, the near-eye display device can capture images in real time to obtain an image that includes a target object. For example, the near-eye display device can be provided with an object detection sensor, such as an infrared sensor, etc. When the near-eye display device detects the presence of an object, such as a target object, within a preset position range, the near-eye display device can be controlled to capture the target object to obtain an image, without limitation.

[0045] In this manner, based on the acquired image of the target object captured by the near-eye display device, when the user views the target object, or an image including the target object, through the near-eye display device, the user's viewing needs for the target object can be subsequently determined. For example, the user can subsequently identify the target object's type and other recognition results based on the image, understand object feature information of the target object, and so on, without limitation herein.

[0046] S102: Determine the target display object corresponding to the target object according to the image.

[0047] For example, in daily life, users may encounter target objects that they do not recognize, and they need to identify the object type of the target object. In some embodiments, when an image of the target object is obtained by a near-eye display device, the near-eye display device can identify the object type of the target object based on the image to obtain an object type recognition result. For example, the near-eye display device can identify the target object in the image based on an object recognition algorithm to determine the object type recognition result corresponding to the target object. For another example, the near-eye display device can perform object recognition on the target object based on information such as the QR code, radio frequency identification code (RFID code) of the target object in the image to obtain an object type recognition result. Of course, this is not limited to this and is not limited here. Based on this, the object type recognition result can be determined as the target display object corresponding to the target object, so that the subsequent near-eye display device can display the object type recognition result.

[0048] For example, when a user purchases a target object in daily life, they may need to compare multiple target objects to determine at least one target object to purchase from the multiple target objects. In some embodiments, when an image of a target object is captured by a near-eye display device, the near-eye display device can determine object feature information of the target object based on the image. For example, if the multiple target objects included in the image are multiple food items, at least one of the object feature information, such as the production date, shelf life, ingredient list, and consumption method, can be obtained based on the image to allow the user to compare the multiple food items. Of course, this is not limited to this. The multiple target objects can also be multiple pieces of clothing. For example, at least one of the object feature information, such as price, fabric composition, and cleaning method, can be compared for multiple pieces of clothing. The multiple target objects can also be multiple electronic devices. For example, at least one of the object feature information, such as price, battery life, and usage method, can be compared for multiple electronic devices. Based on this, the object feature information can be determined as the target display object corresponding to the target object, so that the near-eye display device can subsequently display the object feature information.

[0049] Of course, the target display object corresponding to the target object is not limited to the object type recognition result corresponding to the target object and the object feature information corresponding to the target object, and no limitation is made here.

[0050] In some embodiments, when the near-eye display device determines the target display object corresponding to the target object, the target display object may be displayed in at least one of the following display modes: text, picture, video, animation, etc. The near-eye display device may then display the target display object in the form of text, picture, video, animation, etc.

[0051] In this way, when the target display object corresponding to the target object is determined based on the image, the determined target display object can be used for subsequent display by the near-eye display device. Based on the viewed target display object, the user can gain a deeper understanding of the target object, such as understanding the target object's identification information, object feature information, etc., which helps meet the user's viewing needs for the target object. Furthermore, the target display object can be displayed in various ways, including text, images, videos, animations, etc., which helps improve the convenience and flexibility of displaying the target object.

[0052] In some embodiments, based on the image, the target object is identified in the image area corresponding to the image to obtain a recognition result corresponding to the target object; when it is determined based on the recognition result that the image area corresponding to the image includes text, the text is translated according to a preset text language to obtain a target display object corresponding to the target object.

[0053] For example, an image obtained by a near-eye display device capturing a target object may include an image region corresponding to the target object, and may also include an image region corresponding to a non-target object. For example, non-target objects may include preset objects other than the target object, the target object's surrounding environment, and the like, without limitation.

[0054] For example, when determining the target display object corresponding to the target object based on an image, the image region corresponding to non-target objects can be first eliminated to reduce the adverse effect of non-target objects in the image region on the determination of the target display object corresponding to the target object. For example, the image can be segmented to obtain the image region corresponding to the target object. This is of course not limiting and is not intended to be limiting herein.

[0055] In some embodiments, text recognition can be performed on the image region corresponding to the target object in the image. For example, optical character recognition (OCR) can be used to recognize text on the target object in the image region corresponding to the image, without limitation. For example, after recognizing the target object in the image region corresponding to the image, a recognition result corresponding to the target object is obtained.

[0056] Based on the obtained recognition result corresponding to the target object, it can be determined whether the image area corresponding to the image includes text. If the image area corresponding to the image includes text, the text can be translated according to a preset text language to obtain a target display object corresponding to the target object. The preset text language can be determined based on the default text language of the near-eye display device or based on user settings, and is not limited here.

[0057] For example, if the image region corresponding to the image is determined to include text based on the recognition results, it can be determined whether the text language corresponding to the text matches the preset text language. If not, the text can be translated to replace the text included in the image region corresponding to the image with the translated text, thereby obtaining a target display object corresponding to the target object.

[0058] In some embodiments, when the target display object corresponding to the target object is determined, the near-eye display device may subsequently display the target display object in the form of pictures, videos, animations, etc., which are not limited here.

[0059] In this way, by recognizing the image, obtaining the recognition result corresponding to the target object, and when it is determined based on the recognition result that the image area corresponding to the image includes text, translating the text to obtain the target display object corresponding to the target object, the text can be translated according to the user's language habits and the preset text language. Then, when the near-eye display device subsequently displays the target display object corresponding to the target object, the user can view and understand the target display object according to their own language habits, which is conducive to improving the user's viewing experience of the target object. Furthermore, in the process of determining the target display object corresponding to the target object, the near-eye display device can choose to recognize the image area corresponding to the target object in the image, which is conducive to improving the convenience and efficiency of text recognition of the target object. Moreover, the near-eye display device can flexibly determine at least one of whether the image area corresponding to the image includes text and whether the text language corresponding to the text is consistent with the preset text language based on the recognition result, thereby determining whether the text in the recognition result needs to be translated to obtain the target display object, which is conducive to improving the flexibility of text recognition of the target object, thereby improving the convenience and flexibility of displaying the target object.

[0060] Exemplarily, when the image includes a plurality of preset objects, the target object is determined from the plurality of preset objects according to size information of each of the plurality of preset objects.

[0061] For example, when an image includes multiple preset objects, the user needs to determine the target object from the multiple preset objects in order to view the target object. This is equivalent to determining that the at least one preset object is the target object when the user has a viewing requirement for at least one preset object.

[0062] In some embodiments, the near-eye display device may determine the user's viewing requirements for multiple preset objects based on size information of each of the multiple preset objects in the image.

[0063] For example, when a user desires to view a preset object, they may approach or pick up the preset object to view it. If an image includes multiple preset objects and the user approaches or picks up at least one of the preset objects, the size information of the at least one preset object in the image will increase accordingly. The larger the size information of the preset object in the image, the greater the user's desire to view the preset object. Based on this, when an image is captured, the size information of each of the multiple preset objects in the image can be determined using a preset object detection algorithm. This size information may include area information of each of the multiple preset objects in the image, without limitation. For example, when an image includes multiple preset objects, the preset object with the largest size information can be selected from the multiple preset objects based on their size information in the image and determined as the target object. Of course, this is not limiting. When an image includes multiple preset objects, the preset object with size information greater than or equal to a preset size threshold can be selected from the multiple preset objects and determined as the target object, without limitation.

[0064] In some embodiments, when a user wears a near-eye display device to view a target object, for example, the user can simultaneously see the target object body and the display content of the near-eye display device. For example, when an image includes multiple preset objects, the size information of each of the multiple preset objects in the user's field of view and the size information of each of the multiple preset objects in the image may be different. Based on this, the target object can be determined from the multiple preset objects according to the size information of each of the multiple preset objects in the image. Of course, this is not limited to this. For example, the user can choose to determine the target object from the multiple preset objects according to at least one of the size information of each of the multiple preset objects in the user's field of view and the size information of each of the multiple preset objects in the image. This is not limited to this. For example, the user can choose to determine the target object from the multiple preset objects according to at least one of the size information of each of the multiple preset objects in the user's field of view and the size information of each of the multiple preset objects in the image. This is not limited to this.

[0065] In this way, when an image includes multiple preset objects, the target object is determined from the multiple preset objects based on their respective size information. The near-eye display device can then determine the user's viewing needs for the multiple preset objects based on their respective size information, thereby determining the target object from the multiple preset objects based on the user's viewing needs, which facilitates improved convenience in determining the target object. Based on the determination of the target object, the target display object corresponding to the target object can be subsequently determined, thereby displaying the target display object. This facilitates improved convenience and flexibility in displaying the target object, and facilitates improving the user's viewing needs for the target object.

[0066] S103 : Determine a target display posture of the target display object according to the position information of the near-eye display device and the position information of the target object.

[0067] Exemplarily, the target display posture of the target display object may include at least one of a display position and a display angle of the target display object.

[0068] For example, the location information of the near-eye display device can be obtained. For example, the location information of the near-eye display device can be determined using a preset positioning technology. The preset positioning technology may include GPS positioning technology, radar positioning technology, etc., which are not limited here.

[0069] For example, the position information of the target object can be determined based on an image obtained by photographing the target object by the near-eye display device. Since the image is obtained by photographing the target object by the near-eye display device, the position information of the target object in the world coordinate system corresponding to the near-eye display device can be determined based on the position information of the target object on the image. In some embodiments, the position information of the target object on the image is equivalent to the position information of the target object in the pixel coordinate system corresponding to the near-eye display device. Based on the position information of the target object in the pixel coordinate system corresponding to the near-eye display device, the position information of the target object in the world coordinate system corresponding to the near-eye display device can be determined in combination with the camera parameters corresponding to the near-eye display device, such as camera intrinsic parameters, camera extrinsic parameters, and camera distortion. The camera parameters corresponding to the near-eye display device can be obtained in advance or determined by camera calibration technology, which is not limited here. Among them, the camera intrinsic parameters can be used to convert the position information of the target object from the camera coordinate system corresponding to the near-eye display device to the pixel coordinate system corresponding to the near-eye display device, and the camera extrinsic parameters can be used to convert the position information of the target object from the world coordinate system corresponding to the near-eye display device to the camera coordinate system corresponding to the near-eye display device. Of course, it is not limited to this. For example, the position information of the target object can also be reversely converted, which is not limited here.

[0070] In some embodiments, when the position information of the near-eye display device is determined, the position of the near-eye display device in the world coordinate system corresponding to the near-eye display device can be determined based on the position information of the near-eye display device. Since the target object and the near-eye display device both process the same world coordinate system, the position information of the target object relative to the near-eye display device can be determined based on the position information of the near-eye display device in the world coordinate system corresponding to the near-eye display device and the position information of the target object in the world coordinate system corresponding to the near-eye display device. The determination of the position information of the target object relative to the near-eye display device can be used to determine the display position of the target display object.

[0071] For example, the angle information of the target object relative to the near-eye display device can also be determined based on the position information of the near-eye display device in the world coordinate system corresponding to the near-eye display device and the position information of the target object in the world coordinate system corresponding to the near-eye display device. Taking the acquired image including multiple faces of the target object as an example, the position information of different faces of the target object relative to the near-eye display device may be different, then the position information of each of the different faces relative to the near-eye display device and the position information of the near-eye display device itself can be combined to determine the angle information of each of the different faces relative to the near-eye display device, thereby determining the display angle of the target display object based on the angle information of the different faces relative to the near-eye display device. In an exemplary embodiment, based on the area information of each of the different faces of the target object in the image, one of the faces with the largest area information in the image can be selected from the multiple faces of the target object as the target display face, and the display angle of the target display object can be determined based on the angle information of the target display face relative to the near-eye display device.

[0072] Of course, this is not limited to the above. For example, an image of a target object captured by a near-eye display device can be input into a trained machine learning model to obtain a target display object corresponding to the target object in three-dimensional space, such as a target display pose in a world coordinate system corresponding to the near-eye display device, as determined by the machine learning model. Optionally, the machine learning model includes a neural network model.

[0073] For example, the near-eye display device may also be provided with a position detection module. The position detection module may include an infrared sensor, etc., without limitation herein. The position detection module may be used to obtain position information of a target object, such as determining the position information of the target object relative to the near-eye display device. Based on the position information of the target object relative to the near-eye display device, combined with the position information of the near-eye display device, the angle of the target object relative to the near-eye display device can be determined. For example, based on the position information of the near-eye display device, the central axis of the field of view corresponding to the near-eye display device when the user is wearing the near-eye display device to view the target object can be determined. Based on the position information of the target object relative to the near-eye display device, combined with the central axis of the field of view corresponding to the near-eye display device, the angle by which the position information of the target object relative to the near-eye display device deviates from the central axis of the field of view corresponding to the near-eye display device can be determined. The central axis of the field of view can be used to indicate an angular reference axis determined based on the center point of the display of the near-eye display device as the origin, and is not a physical structure of the near-eye display device, and is not limited herein. Based on the angle by which the position information of the target object relative to the near-eye display device deviates from the central axis of the field of view corresponding to the near-eye display device, the angle information of the target object relative to the near-eye display device is determined. Determining the position information of the target object relative to the near-eye display device can be used to determine the display position of the target display object. Determining the angle information of the target object relative to the near-eye display device can be used to determine the display angle of the target display object. Based on this, the near-eye display device can determine the target display pose of the target display object based on at least one of the display position of the target display object and the display angle of the target display object.

[0074] In this way, the target display posture of the target display object is determined based on the position information of the near-eye display device and the position information of the target object. The near-eye display device can then display the target display object according to the target display posture, which is beneficial to improving the convenience and flexibility of displaying the target object, thereby improving the user's viewing experience of the near-eye display device.

[0075] In some embodiments, the posture relationship between the near-eye display device and the target object is determined based on the position information of the near-eye display device and the position information of the target object; and the target display posture of the target display object is determined based on the posture relationship between the near-eye display device and the target object, so that the target display object displayed according to the target display posture is on the target object.

[0076] Exemplarily, the posture relationship between the near-eye display device and the target object may include at least one of a position association relationship between the target object and the near-eye display device and an angle association relationship between the target object and the near-eye display device.

[0077] For example, at least one of the position information of the target object relative to the near-eye display device and the angle information of the target object relative to the near-eye display device can be determined based on the position information of the near-eye display device and the position information of the target object. When the position information of the target object relative to the near-eye display device is determined, the positional association relationship between the target object and the near-eye display device can be determined based on the position information of the target object relative to the near-eye display device. When the angle information of the target object relative to the near-eye display device is determined, the angle association relationship between the target object and the near-eye display device can be determined based on the angle information of the target object relative to the near-eye display device. Based on at least one of the positional association relationship between the target object and the near-eye display device and the angle association relationship between the target object and the near-eye display device, the posture relationship between the near-eye display device and the target object can be determined.

[0078] When the posture relationship between the near-eye display device and the target object is determined, the target display posture of the target display object can be determined based on the posture relationship between the near-eye display device and the target object.

[0079] For example, the target display position of the target display object is determined based on the positional association relationship between the target object and the near-eye display device. For example, if the positional association relationship between the near-eye display device and the target object determines that the position difference between the target object and the near-eye display device in the world coordinate system is 1 meter, then the target display position of the target display object can be determined to be the position with a position difference of 1 meter from the near-eye display device. This is of course not limiting and is not intended to be limiting herein.

[0080] For example, the target display angle of the target display object is determined based on the angular correlation between the target object and the near-eye display device. For example, if the angular correlation between the near-eye display device and the target object determines that the angular difference between the target object and the central axis of the field of view of the near-eye display device in the world coordinate system is 45°, then the target display angle of the target display object can be determined to be the position where the angle between the target object and the central axis of the field of view of the near-eye display device is 45°. This is of course not limiting and is not intended to be limiting herein.

[0081] Based on the determination of at least one of the target display position and the target display angle of the target display object, the target display position of the target display object in the world coordinate system can be converted into position information of the target object in the display coordinate system corresponding to the near-eye display device, and / or the target display angle of the target display object in the world coordinate system can be converted into position information of the target object in the display coordinate system corresponding to the near-eye display device, according to the association relationship between the display coordinate system corresponding to the near-eye display device and the world coordinate system corresponding to the near-eye display device. In this way, when the target display object is displayed according to the target display posture, the target display object can be displayed on the target object.

[0082] In this way, based on the determination of the positional relationship between the near-eye display device and the target object, the target display position of the target display object can be determined, which is conducive to improving the convenience of determining the target display position of the target display object. Based on the determination of the target display position of the target display object, it can be determined that the target display object displayed according to the target display position is on the target object. Then, based on the target display object being displayed on the target object, the user can determine that there is an association relationship between the target display object and the target object, without having to determine whether the target display object corresponds one-to-one with the target object. This is conducive to improving the convenience and flexibility of displaying the target object, and improving the user's viewing experience of the target object.

[0083] In some embodiments, the target display pose of the target display object is adjusted according to the change in the pose relationship between the near-eye display device and the target object, so that the target display object displayed according to the target display pose is anchored on the target object.

[0084] For example, when a user is viewing a target object through a near-eye display device, the user can, for example, shift his or her viewing angle, or walk around the target object, or move the target object, etc., to observe the target object from multiple angles. In this case, the near-eye display device and the target object will be in a relative motion state. Based on this, the near-eye display device can detect whether the posture relationship between the near-eye display device and the target object has changed. For example, the posture sensor of the near-eye display device, such as an IMU sensor, can be used to determine whether the user's posture has moved, or the camera module of the near-eye display device can be used to determine whether the user's hand has picked up or put down the target object, or the position detection sensor on the near-eye display device, such as an infrared sensor, can be used to determine whether the position information between the near-eye display device and the target object has changed, thereby determining whether the posture relationship between the near-eye display device and the target object has changed. In the case where the posture relationship between the near-eye display device and the target object changes, the target display posture of the target display object can be adjusted in real time following the change in the posture relationship between the near-eye display device and the target object, so that the target display object is anchored and displayed on the target object. In an exemplary embodiment, when an image of a target object is captured by a near-eye display device, optical flow tracking and identification of the target object can be performed based on the image to obtain a tracking result corresponding to the target object. When a change in the posture relationship between the near-eye display device and the target object is determined based on the tracking result, the near-eye display device can adjust the target display posture of the target display object based on the change in the posture relationship between the near-eye display device and the target object. This is of course not limited to this and is not intended to be limiting herein.

[0085] In this way, by adjusting the target display position of the target display object based on changes in the positional relationship between the near-eye display device and the target object, the target display object can remain displayed on the target object while the near-eye display device and the target object are in relative motion, thereby improving the convenience of determining the target display position of the target display object. Furthermore, based on the target display object remaining displayed on the target object, the user can determine that there is an association between the target display object and the target object, without having to determine whether the target display object corresponds one-to-one with the target object. This improves the convenience and flexibility of displaying the target object and enhances the user's viewing experience of the target object.

[0086] In some embodiments, a posture change of the near-eye display device is obtained; and a change in the posture relationship between the near-eye display device and the target object is determined based on the posture change of the near-eye display device.

[0087] For example, when the near-eye display device and the target object are in a state of relative motion, the user's posture change can be determined based on the posture sensor provided on the near-eye display device, such as the IMU sensor, to determine the position change of the near-eye display device. For example, when the user's head turns to the left, the IMU sensor can collect the corresponding acceleration. Based on this, the position change of the user's head and the angle change of the user's head in the process of turning the user's head to the left can be determined based on the acceleration and the direction of the acceleration collected by the IMU sensor, combined with the user's head rotation speed. Based on the position change of the user's head and the angle change of the user's head, the position change of the target object relative to the near-eye display device and the angle change of the target object relative to the near-eye display device can be determined. Based on this, the position change of the near-eye display device can be determined based on the position change of the target object relative to the near-eye display device and the angle change of the target object relative to the near-eye display device. When the posture change of the near-eye display device is not zero, it can be determined that the posture relationship between the near-eye display device and the target object has changed, so that the change of the posture relationship between the near-eye display device and the target object can be followed in real time, and the target display posture of the target display object can be adaptively adjusted so that the target display object can be anchored and displayed on the target object.

[0088] For example, while the near-eye display device and a target object are in relative motion, a position detection sensor, such as an infrared sensor, provided on the near-eye display device can be used to determine a position change between the near-eye display device and the target object. This can then be used to determine a position change of the near-eye display device. For example, based on the target object's position information acquired by the infrared sensor at a first moment, it can be determined that the position difference between the target object and the near-eye display device is 0.5 meters. Combined with the central axis of the field of view corresponding to the near-eye display device and the position information of the target object, it can be determined that the angle between the position information of the target object relative to the near-eye display device and the central axis of the field of view corresponding to the near-eye display device is 30°. Based on the position information of the target object acquired by the infrared sensor at a second moment after the first moment, it can be determined that the position difference between the target object and the near-eye display device is 1 meter. Combined with the central axis of the field of view corresponding to the near-eye display device and the position information of the target object, it can be determined that the angle between the position information of the target object relative to the near-eye display device and the central axis of the field of view corresponding to the near-eye display device is 45°. Based on this, the position change of the target object can be determined based on the position difference between the target object and the near-eye display device determined at the first moment and the second moment. Correspondingly, the angle change of the target object can also be determined based on the angle between the position information of the target object relative to the near-eye display device determined at the first moment and the second moment and the central axis of the visual field corresponding to the near-eye display device. Since the near-eye display device and the target object are in a relative motion state, the position change of the near-eye display device can be determined based on the position change of the target object, and the angle change of the near-eye display device can also be determined based on the angle change of the target object. Based on this, the posture change of the near-eye display device can be determined based on the position change of the near-eye display device and the angle change of the near-eye display device. When the posture change of the near-eye display device is not zero, it can be determined that the posture relationship between the near-eye display device and the target object has changed, so that the target display posture of the target display object can be adaptively adjusted in real time following the change in the posture relationship between the near-eye display device and the target object, so that the target display object can be anchored and displayed on the target object.

[0089] Of course, it is not limited to this. For example, when the near-eye display device and the target object are in relative motion, the near-eye display device can determine the posture change of the near-eye display device by combining multiple images of the target object captured by a camera module set on the near-eye display device, the posture change of the user determined by a posture sensor such as an IMU sensor, and the position change between the near-eye display device and the target object determined by a position detection sensor such as an infrared sensor to determine at least one of the above, so as to determine the change in the posture relationship between the near-eye display device and the target object. This is not limited here.

[0090] In this way, the posture change of the near-eye display device is obtained; based on the posture change of the near-eye display device, the change in the posture relationship between the near-eye display device and the target object is determined, and the change in the posture relationship between the near-eye display device and the target object can be responded to in a timely manner, and the target display posture of the target display object can be adjusted, so that when the subsequent near-eye display device displays the target display object according to the target display posture, it can follow the change in the posture relationship between the near-eye display device and the target object, so that the target display object can be anchored and displayed on the target object without the user having to judge the one-to-one correspondence between the target display object and the target object. This is conducive to improving the flexibility and convenience of displaying the target object, and is conducive to improving the user's viewing experience of the target object.

[0091] S104: Control the near-eye display device to display the target display object according to the target display posture.

[0092] For example, the near-eye display device can display the target display object on the target object based on the target display position. For example, when the near-eye display device and the target object are in relative motion, the target display object can be anchored and displayed on the target object based on the target display posture adjusted in response to changes in the posture relationship between the near-eye display device and the target object.

[0093] In some embodiments, the target display object can be rendered into the display area of ​​the near-eye display device, such as the software interface view of the near-eye display device, by a rendering engine. Of course, this is not limited to this and is not limited here. Among them, the rendering engine may include a three-dimensional (3D) rendering engine, so that the user has a 3D visual sense when viewing the target display object, which is not limited here. For example, in the process of controlling the near-eye display device to display the target display object according to the target display posture, if the target display object includes text, the display form of the text in the target display object can be optimized. For example, if the text in the target display object is in Chinese, and the text in the recognition result corresponding to the target object recognized by the image is in English, the font size, line breaks and other information of the target display object can be adjusted based on the difference in Chinese and English typesetting to optimize the display effect of the target display object. Of course, this is not limited to this and is not limited here.

[0094] In this way, by controlling the near-eye display device to display the target display object according to the target display posture, the target display object displayed by the near-eye display device can be made to correspond one-to-one with the target object, which is conducive to improving the flexibility and convenience of displaying the target object, and is conducive to improving the user's viewing experience of the target object.

[0095] For example, users of the near-eye display device may be of different age groups. According to the age groups of the users, the near-eye display device may be controlled to display the target display object corresponding to the target object in different display forms.

[0096] In some embodiments, when it is determined that the user corresponding to the near-eye display device is a preset type of user based on user characteristic information corresponding to the near-eye display device, at least one of the display font size and the display screen size of the target display object is increased.

[0097] For example, user characteristic information may include characteristic information such as the user's head circumference information, the user's facial image, and the user's eye focus information. For example, if the user's head circumference information is less than or equal to a preset head circumference threshold, the user can be determined to be a child user. For another example, the user's facial image can be input into a face recognition model to determine whether the facial features corresponding to the user's facial image match the facial features of an elderly user. If so, the user can be determined to be an elderly user. For another example, the user's eye focus information can be input into a vision recognition model to determine whether the user's corresponding vision features match the vision features of a myopic user. If so, the user can be determined to be myopic. Of course, user characteristic information is not limited to this and is not limited here.

[0098] In some embodiments, the preset type of user may include at least one of an elderly user and a myopic user. For example, when it is determined based on the user characteristic information corresponding to the near-eye display device that the user corresponding to the near-eye display device is at least one of an elderly user and a myopic user, since the elderly user may have symptoms of presbyopia and the myopic user has symptoms of myopia, at least one of the display font size and the display screen size of the target display object may be adaptively increased, so that at least one of the elderly user and the myopic user can view the text of the target display object in a larger display font, or view at least one of the pictures, videos, and animations of the target display object in a larger screen size, thereby improving the flexibility and convenience of displaying the target object, and improving the viewing experience of at least one of the elderly user and the myopic user for the target object.

[0099] In some embodiments, the preset user types may include child users. For example, when the user corresponding to the near-eye display device is determined to be a child user based on the user characteristic information corresponding to the near-eye display device, since the child user may recognize fewer characters, the near-eye display device can be adaptively controlled to display auxiliary identification information corresponding to the target display object. Among them, the auxiliary identification information can be Chinese pinyin, English phonetic symbols, text interpretation information, etc., which are not limited here. Based on this, the flexibility and convenience of displaying the target object can be improved, and the viewing experience of the target object for the child user can be improved.

[0100] For example, if the target display object contains too many words, if the target display object is still displayed on the target object, or if the target display object is maintained on the target object, the excessive text may overlap on the target object, making it difficult for the user to clearly see the text in the target display object. Based on this, when the target display object contains more than or equal to a preset text word count threshold, it is necessary to determine at least one of a target display area and a target font size when the near-eye display device displays the target display object.

[0101] For example, the preset text word count threshold can be determined based on the size information of the target object. The larger the size information of the target object, the larger the preset text word count threshold. Of course, this is not limited to this. The preset text word count threshold can also be pre-set or user-defined, and this is not limited here.

[0102] In some embodiments, when the target display object has a text word count greater than or equal to a preset text word count threshold, the font size of the text in the target display object can be reduced to determine the target font size for displaying the target display object on the near-eye display device. This prevents the text in the target display object from overlapping the target object, allowing the user to clearly see the text in the target display object, thereby improving the flexibility of displaying the target object and enhancing the user's viewing experience of the target object.

[0103] In some embodiments, when the number of text characters of the target display object is greater than or equal to a preset text character count threshold, the target display area when the near-eye display device displays the target display object can be determined. For example, the target display area can be switched from the target object to a preset display area of ​​the near-eye display device. The preset display area can be the entire display area of ​​the near-eye display device or a portion of the display area of ​​the near-eye display device, and is not limited here. When the posture relationship between the near-eye display device and the target object changes, and the number of text characters of the target display object is greater than or equal to the preset text character count threshold, the target display object can be fixedly displayed in the preset display area to adaptively adjust the display position of the target display object according to the number of text characters of the target display object.

[0104] For example, after controlling the near-eye display device to display the target display object according to the target display posture, as the near-eye display device and the target object move relative to each other, the near-eye display device can be controlled to photograph the target object to obtain a new image each time the posture change of the near-eye display device is less than or equal to a preset posture change threshold, so that the target display object corresponding to the target object can continue to be anchored and displayed on the target object according to the new image.

[0105] In some embodiments, as the near-eye display device and the target object move relative to each other, the most recently captured image by the near-eye display device may not include the target object. Therefore, it is impossible to continue displaying the target display object corresponding to the target object on the target object, or to continue anchoring the target display object corresponding to the target object on the target object. Based on this, it is necessary to re-determine the target object.

[0106] For example, when the posture change of the near-eye display device is less than or equal to a preset posture change threshold, and the duration of the posture change being less than or equal to the preset posture change threshold is greater than or equal to a second duration threshold, an image is captured by the near-eye display device; and a new target object is determined based on the image captured by the near-eye display device; wherein the second duration threshold is longer than the first duration threshold.

[0107] Taking the original target object as the first target object and the new target object as the second target object as an example, when the user views the first target object through the near-eye display device, for example, the user will view the first target object from different angles. Then, with each movement of the first target object by the user, or each movement of the user, the posture relationship between the first target object and the near-eye display device will change, thereby causing the posture change of the near-eye display device to be greater than the preset posture change threshold. Based on this, when the posture change of the near-eye display device is less than or equal to the preset posture change threshold next time, and the duration of the posture change is less than or equal to the preset posture change threshold is greater than or equal to the first duration threshold, the image of the first target object taken by the near-eye display device can be continued to be obtained to re-determine the target display posture of the target display object corresponding to the first target object, so that the target display object corresponding to the first target object can be anchored and displayed on the target object.

[0108] When the posture change amount of the near-eye display device is obtained to be less than or equal to a preset posture change threshold, and the duration of the posture change amount being less than or equal to the preset posture change threshold is greater than or equal to a second duration threshold, for example, it can be determined that the user is viewing a second target object other than the first target object through the near-eye display device, then an image of the second target object taken by the near-eye display device can be obtained to determine the target display object corresponding to the second target object based on the image, and to determine the target display posture of the target display object, thereby controlling the near-eye display device to display the target display object corresponding to the second target object, and so on.

[0109] In an exemplary embodiment, as shown in FIG2 , when a user is wearing a near-eye display device, the user can activate the shooting function of the near-eye display device. The near-eye display device can initialize the algorithm software development kit (SDK). The user moves his head to identify the object information of the target object through the shooting function of the near-eye display device. The near-eye display device obtains the IMU stable state through the algorithm SDK. When the IMU stable state returned by the algorithm SDK lasts for 0.5 seconds, the image obtained by the near-eye display device shooting the target object can be obtained. The near-eye display device can transmit the image to the algorithm SDK for OCR recognition. After OCR recognition, the recognized text is transmitted to the language translation module to obtain the target display object corresponding to the target object. The target display object is rendered and displayed on the target object using a 3D rendering engine. The image obtained by the near-eye display device shooting the target object is obtained in real time and transmitted to the algorithm SDK for optical flow tracking and recognition of the target object. When the user moves the target object or the user moves the near-eye display device, the position information of the target object can be identified through optical flow tracking and recognition. According to the position information of the target object, the target display posture of the target display object is updated in real time using the 3D rendering engine until the target display object corresponding to the target object is displayed on the target object in real time.

[0110] The control method of the near-eye display device provided in the above embodiment includes: obtaining an image obtained by the near-eye display device shooting the target object; determining the target display object corresponding to the target object based on the image; determining the target display posture of the target display object based on the position information of the near-eye display device and the position information of the target object; and controlling the near-eye display device to display the target display object based on the target display posture, so as to improve the convenience and flexibility of displaying the target object and enhance the user's viewing experience of the target object.

[0111] Please refer to Figure 3, which is a schematic block diagram of a control device for a near-eye display device provided in an embodiment of the present application. The control device for the near-eye display device can be configured in a server or a near-eye display device to execute the aforementioned control method for the near-eye display device.

[0112] As shown in FIG3 , the control device of the near-eye display device includes: an acquisition module 110 , a first determination module 120 , a second determination module 130 and a control module 140 .

[0113] The acquisition module 110 is configured to acquire an image of a target object captured by a near-eye display device.

[0114] The first determining module 120 is configured to determine a target display object corresponding to the target object according to the image.

[0115] The second determining module 130 is configured to determine a target display posture of the target display object according to the position information of the near-eye display device and the position information of the target object.

[0116] The control module 140 is configured to control the near-eye display device to display the target display object according to the target display posture.

[0117] Exemplarily, the first determination module 120 includes an identification submodule and a translation submodule.

[0118] The recognition submodule is used to recognize the target object in the image area corresponding to the image based on the image, and obtain a recognition result corresponding to the target object.

[0119] The translation submodule is configured to, when it is determined according to the recognition result that the image area corresponding to the image includes text, translate the text according to a preset text language to obtain a target display object corresponding to the target object.

[0120] Exemplarily, the control device further includes a selection submodule.

[0121] The selection submodule is configured to determine a target object from among a plurality of preset objects according to size information of each of the plurality of preset objects in the image when the image includes the plurality of preset objects.

[0122] Exemplarily, the second determination module 130 includes a first pose determination submodule and a second pose determination submodule.

[0123] The first posture determination submodule is used to determine the posture relationship between the near-eye display device and the target object according to the position information of the near-eye display device and the position information of the target object.

[0124] The second posture determination submodule is configured to determine a target display posture of the target display object according to a posture relationship between the near-eye display device and the target object, so that the target display object displayed according to the target display posture is on the target object.

[0125] Exemplarily, the second posture determination submodule includes a posture change submodule.

[0126] The posture change submodule is used to adjust the target display posture of the target display object according to the change of the posture relationship between the near-eye display device and the target object, so that the target display object displayed according to the target display posture is anchored on the target object.

[0127] Exemplarily, the control device further includes a change amount acquisition submodule and a posture change determination submodule.

[0128] The variation acquisition submodule is used to obtain the position variation of the near-eye display device.

[0129] The posture change determination submodule is used to determine the change in the posture relationship between the near-eye display device and the target object according to the posture change amount of the near-eye display device.

[0130] Exemplarily, the control device further includes a first adjustment submodule.

[0131] The first adjustment submodule is configured to increase at least one of a display font size and a display screen size of the target display object when it is determined that the user corresponding to the near-eye display device is a preset type of user based on the user characteristic information corresponding to the near-eye display device.

[0132] Exemplarily, the acquisition module 110 includes an acquisition submodule.

[0133] The acquisition submodule is used to capture the target object through the near-eye display device to obtain the image when the posture change amount of the near-eye display device is less than or equal to a preset posture change threshold.

[0134] It should be noted that those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described devices and modules and units can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0135] The method of the present application can be used in many general or special computer system environments or configurations. For example: personal computers, server computers, handheld devices or portable devices, tablet devices, multi-processor systems, microprocessor-based systems, set-top boxes, programmable consumer electronic devices, network PCs, minicomputers, mainframe computers, distributed computing environments including any of the above systems or devices, etc. The present application can be described in the general context of computer-executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform specific tasks or implement specific abstract data types. The present application can also be practiced in distributed computing environments, in which tasks are performed by remote processing devices connected through a communication network. In a distributed computing environment, program modules can be located in local and remote computer storage media, including storage devices.

[0136] For example, the above methods and apparatuses may be implemented as a computer program that can be run on a near-eye display device. For example, the near-eye display device may include VR glasses, AR glasses, VR helmets, AR helmets, etc., without limitation.

[0137] Please refer to FIG4 , which is a schematic block diagram of the structure of a near-eye display device provided in an embodiment of the present application.

[0138] As shown in Figure 4, the near-eye display device includes a memory and a processor. The memory and the processor may be connected via a system bus, and the memory may include a storage medium and an internal memory.

[0139] The storage medium may store an operating system and a computer program. When the computer program is executed, the processor may execute any method for controlling a near-eye display device.

[0140] The processor is used to provide computing and control capabilities to support the operation of the entire near-eye display device.

[0141] The internal memory provides an environment for the operation of the computer program in the storage medium. When the computer program is executed by the processor, the processor can execute any control method of the near-eye display device.

[0142] Those skilled in the art will understand that the structure shown in Figure 4 is merely a block diagram of a portion of the structure related to the scheme of the present application, and does not constitute a limitation on the near-eye display device to which the scheme of the present application is applied. The specific near-eye display device may include more or fewer components than shown in the figure, or combine certain components, or have a different arrangement of components.

[0143] It should be understood that the processor may be a central processing unit (CPU), other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor, etc.

[0144] In one embodiment, the processor is configured to execute a computer program and implement the following steps when executing the computer program:

[0145] Acquire an image of a target object captured by a near-eye display device;

[0146] determining, according to the image, a target display object corresponding to the target object;

[0147] determining a target display posture of the target display object according to the position information of the near-eye display device and the position information of the target object;

[0148] According to the target display posture, the near-eye display device is controlled to display the target display object.

[0149] It should be noted that, those skilled in the art can clearly understand that, for the convenience and conciseness of description, the specific working process of the control of the near-eye display device described above can refer to the corresponding process in the aforementioned embodiment of the control method of the near-eye display device, and will not be repeated here.

[0150] An embodiment of the present application also provides a computer-readable storage medium, on which a computer program is stored. The method implemented when the computer program is executed by a processor can refer to the various embodiments of the control method of the near-eye display device of the present application.

[0151] The computer-readable storage medium may be an internal storage unit of the near-eye display device described in the aforementioned embodiment, such as a hard disk or memory of the near-eye display device. The computer-readable storage medium may also be an external storage device of the near-eye display device, such as a plug-in hard disk, a smart memory card (SMC), a secure digital (SD) card, a flash card, etc., equipped on the near-eye display device.

[0152] It should be understood that the terms used in this specification of the application are only for the purpose of describing specific embodiments and are not intended to limit the application. As used in this specification of the application and the appended claims, unless the context clearly indicates otherwise, the singular forms of "one", "an" and "the" are intended to include plural forms. It should also be understood that the term "and / or" used in this specification of the application and the appended claims refers to any combination of one or more of the associated listed items and all possible combinations, and includes these combinations. It should be noted that, in this article, the term "comprises", "comprising" or any other variant thereof is intended to cover non-exclusive inclusion, so that the process, method, article or system including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of more restrictions, the elements defined by the sentence "comprising one..." do not exclude the presence of other identical elements in the process, method, article or system including the element.

[0153] The serial numbers of the embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments. The above description is only a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed in this application, and these modifications or replacements should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A method for controlling a near-eye display device, comprising: Acquire an image of a target object captured by a near-eye display device; Determining a target display object corresponding to the target object according to the image; Determining a target display posture of the target display object according to the position information of the near-eye display device and the position information of the target object; According to the target display posture, the near-eye display device is controlled to display the target display object.

2. The control method according to claim 1, wherein: Determining, according to the image, a target display object corresponding to the target object includes: According to the image, identifying the target object in an image area corresponding to the image, and obtaining a recognition result corresponding to the target object; When it is determined according to the recognition result that the image area corresponding to the image includes text, the text is translated according to a preset text language to obtain a target display object corresponding to the target object.

3. The control method according to claim 1, wherein: Before identifying the target object in the image area corresponding to the image according to the image to obtain the identification result corresponding to the target object, the method further includes: When the image includes a plurality of preset objects, the target object is determined from the plurality of preset objects according to size information of each of the plurality of preset objects in the image.

4. The control method according to claim 1, wherein: The determining the target display posture of the target display object according to the position information of the near-eye display device and the position information of the target object includes: Determining a positional relationship between the near-eye display device and the target object according to the position information of the near-eye display device and the position information of the target object; According to the posture relationship between the near-eye display device and the target object, a target display posture of the target display object is determined, so that the target display object displayed according to the target display posture is on the target object.

5. The control method according to claim 4, wherein: The determining the target display posture of the target display object according to the posture relationship between the near-eye display device and the target object includes: According to the change of the posture relationship between the near-eye display device and the target object, the target display posture of the target display object is adjusted so that the target display object displayed according to the target display posture is anchored on the target object.

6. The control method according to claim 5, wherein: Before adjusting the target display posture of the target display object according to the change of the posture relationship between the near-eye display device and the target object so that the target display object displayed according to the target display posture is anchored on the target object, the method further includes: Obtaining the position change of the near-eye display device; A change in the posture relationship between the near-eye display device and the target object is determined according to the posture change amount of the near-eye display device.

7. The control method according to claim 2, wherein: The determining the target display posture of the target display object according to the position information of the near-eye display device and the position information of the target object includes: Determining a positional relationship between the near-eye display device and the target object according to the position information of the near-eye display device and the position information of the target object; According to the posture relationship between the near-eye display device and the target object, a target display posture of the target display object is determined, so that the target display object displayed according to the target display posture is on the target object.

8. The control method according to claim 7, wherein: The determining the target display posture of the target display object according to the posture relationship between the near-eye display device and the target object includes: According to the change of the posture relationship between the near-eye display device and the target object, the target display posture of the target display object is adjusted so that the target display object displayed according to the target display posture is anchored on the target object.

9. The control method according to claim 8, wherein: Before adjusting the target display posture of the target display object according to the change of the posture relationship between the near-eye display device and the target object so that the target display object displayed according to the target display posture is anchored on the target object, the method further includes: Obtaining the position change of the near-eye display device; A change in the posture relationship between the near-eye display device and the target object is determined according to the posture change amount of the near-eye display device.

10. The control method according to claim 3, wherein: The determining the target display posture of the target display object according to the position information of the near-eye display device and the position information of the target object includes: Determining a positional relationship between the near-eye display device and the target object according to the position information of the near-eye display device and the position information of the target object; According to the posture relationship between the near-eye display device and the target object, a target display posture of the target display object is determined, so that the target display object displayed according to the target display posture is on the target object.

11. The control method according to claim 10, wherein: The determining the target display posture of the target display object according to the posture relationship between the near-eye display device and the target object includes: According to the change of the posture relationship between the near-eye display device and the target object, the target display posture of the target display object is adjusted so that the target display object displayed according to the target display posture is anchored on the target object.

12. The control method according to claim 11, wherein: Before adjusting the target display posture of the target display object according to the change of the posture relationship between the near-eye display device and the target object so that the target display object displayed according to the target display posture is anchored on the target object, the method further includes: Obtaining the position change of the near-eye display device; A change in the posture relationship between the near-eye display device and the target object is determined according to the posture change amount of the near-eye display device.

13. The control method according to claim 1, wherein: Before controlling the near-eye display device to display the target display object according to the target display posture, the method further includes: When it is determined that the user corresponding to the near-eye display device is a preset type of user according to the user characteristic information corresponding to the near-eye display device, at least one of a display font size and a display screen size of the target display object is increased.

14. The control method according to claim 2, wherein: Before controlling the near-eye display device to display the target display object according to the target display posture, the method further includes: When it is determined that the user corresponding to the near-eye display device is a preset type of user according to the user characteristic information corresponding to the near-eye display device, at least one of a display font size and a display screen size of the target display object is increased.

15. The control method according to claim 3, wherein: Before controlling the near-eye display device to display the target display object according to the target display posture, the method further includes: When it is determined that the user corresponding to the near-eye display device is a preset type of user according to the user characteristic information corresponding to the near-eye display device, at least one of a display font size and a display screen size of the target display object is increased.

16. The control method according to claim 1, wherein: The acquiring of an image of a target object photographed by a near-eye display device comprises: When the posture change amount of the near-eye display device is less than or equal to a preset posture change threshold, the target object is photographed by the near-eye display device to obtain the image.

17. The control method according to claim 2, wherein: The acquiring of an image of a target object photographed by a near-eye display device comprises: When the posture change amount of the near-eye display device is less than or equal to a preset posture change threshold, the target object is photographed by the near-eye display device to obtain the image.

18. The control method according to claim 3, wherein: The acquiring of an image of a target object photographed by a near-eye display device comprises: When the posture change amount of the near-eye display device is less than or equal to a preset posture change threshold, the target object is photographed by the near-eye display device to obtain the image.

19. A control device for a near-eye display device, the control device comprising: An acquisition module, used to acquire an image of a target object photographed by a near-eye display device; A first determining module, configured to determine a target display object corresponding to the target object according to the image; A second determination module, configured to determine a target display posture of the target display object according to the position information of the near-eye display device and the position information of the target object; A control module is used to control the near-eye display device to display the target display object according to the target display posture.

20. A near-eye display device, the near-eye display device comprising a memory and a processor; The memory is used to store computer programs; The processor is used to execute the computer program and implement the following steps when executing the computer program: Acquire an image of a target object captured by a near-eye display device; Determining a target display object corresponding to the target object according to the image; Determining a target display posture of the target display object according to the position information of the near-eye display device and the position information of the target object; According to the target display posture, the near-eye display device is controlled to display the target display object.

Images