Control method, device and equipment of near-to-eye display equipment

Abstract

The invention relates to the technical field of data processing, and provides a control method, device and equipment of near-eye display equipment, and the method comprises the steps: obtaining an image obtained by shooting a target object through the near-eye display equipment; determining a target display object corresponding to the target object according to the image; determining a target display pose of the target display object according to the position information of the near-to-eye display device and the position information of the target object; and according to the target display pose, controlling the near-to-eye display device to display the target display object so as to improve the convenience degree and the flexibility degree of displaying the target object and improve the viewing experience of a user on the target object.

Description

Technical Field

[0001] The present application relates to the field of data processing technology, and in particular to a control method, device and equipment for a near-eye display device. Background Art

[0002] Currently, near-eye display devices can be used in daily life. For example, users can use near-eye display devices to view relevant objects encountered in daily life, such as food, daily necessities, clothes, etc. However, when users use near-eye display devices to view relevant objects, the near-eye display devices only display images of the objects to the users, or display the objects in a fixed position, which can easily lead to poor viewing experience of the users. Summary of the invention

[0003] The main purpose of the present application is to provide a control method, device and equipment for a near-eye display device, aiming to improve the convenience and flexibility of displaying a target object and enhance the user's viewing experience of the target object.

[0004] In a first aspect, the present application provides a method for controlling a near-eye display device, the method comprising the following steps:

[0005] Acquire an image of a target object captured by a near-eye display device;

[0006] Determining a target display object corresponding to the target object according to the image;

[0007] Determining a target display posture of the target display object according to the position information of the near-eye display device and the position information of the target object;

[0008] According to the target display posture, the near-eye display device is controlled to display the target display object.

[0009] In a second aspect, the present application further provides a control device for a near-eye display device, the control device for the near-eye display device comprising:

[0010] An acquisition module, used to acquire an image of a target object photographed by a near-eye display device;

[0011] A first determining module, configured to determine a target display object corresponding to the target object according to the image;

[0012] A second determination module, configured to determine a target display posture of the target display object according to the position information of the near-eye display device and the position information of the target object;

[0013] A control module is used to control the near-eye display device to display the target display object according to the target display posture.

[0014] In a third aspect, the present application further provides a near-eye display device, the near-eye display device comprising a memory and a processor;

[0015] The memory is used to store computer programs;

[0016] The processor is used to execute the computer program and implement the control method of the near-eye display device as described above when executing the computer program.

[0017] The present application provides a control method, device and equipment for a near-eye display device. The control method for the near-eye display device includes: obtaining an image obtained by shooting a target object by the near-eye display device; determining a target display object corresponding to the target object according to the image; determining a target display posture of the target display object according to the position information of the near-eye display device and the position information of the target object; and controlling the near-eye display device to display the target display object according to the target display posture. For example, the near-eye display device can determine a target display object corresponding to the target object, such as text, pictures, animations, videos, etc. corresponding to the target object, according to the image obtained by shooting the target object by the near-eye display device. And, based on the position information of the near-eye display device and the position information of the target object, determine the target display posture of the target display object, so as to display the target display object according to the target display posture. Based on this, when the position information of at least one of the near-eye display device and the target object changes, the target display posture will also change accordingly, and the near-eye display device can display the target display object corresponding to the target object following the change of the target display posture, which is conducive to improving the convenience and flexibility of displaying the target object and improving the user's viewing experience of the target object. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0019] Figure 1 is a flow chart of a control method of a near-eye display device provided in an embodiment of the present application;

[0020] Figure 2 is a human-computer interaction flow chart of a near-eye display device involved in an embodiment of the present application;

[0021] Figure 3 is a schematic block diagram of a control device for a near-eye display device provided in an embodiment of the present application;

[0022] Figure 4 It is a schematic block diagram of the structure of a near-eye display device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0023] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0024] The flowcharts shown in the accompanying drawings are only examples and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps may also be decomposed, combined or partially merged, so the actual execution order may change according to actual conditions.

[0025] The embodiments of the present application provide a control method, device and apparatus for a near-eye display device, wherein the control method for a near-eye display device can be applied to a near-eye display device.

[0026] Exemplarily, the near-eye display device may include VR glasses, AR glasses, VR helmets, AR helmets, and the like, without limitation herein.

[0027] In conjunction with the accompanying drawings, some embodiments of the present application are described in detail below. In the absence of conflict, the following embodiments and features in the embodiments can be combined with each other.

[0028] See also Figure 1 , Figure 1 It is a flow chart of a control method of a near-eye display device provided in an embodiment of the present application. It should be noted that the control method of a near-eye display device provided in an embodiment of the present application can be used for a near-eye display device.

[0029] like Figure 1 As shown, the control method of the near-eye display device includes steps S101 to S104.

[0030] S101 , obtaining an image of a target object photographed by a near-eye display device.

[0031] Exemplarily, a camera module may be provided on the near-eye display device. For example, the camera module may be used to shoot an object, such as a target object. Of course, it is not limited to this and is not limited here. In some embodiments, the image may include an image of the target object in at least one direction, such as a left view, a right view, a front view, a rear view, a top view, or a stereoscopic image of the target object, such as an image of the left side, the front side, and the top side of the target object, and of course it is not limited to this. For example, the image includes the entire target object, or includes a part of the target object.

[0032] In some implementations, the near-eye display device may be controlled to capture a target object to obtain an image based on the user's operation information on the near-eye display device, wherein the user may be a user wearing the near-eye display device.

[0033] For example, the operation information may include user posture information. For example, a posture sensor for obtaining user posture information may be provided on the near-eye display device, such as an inertial measurement unit (IMU sensor), which is not limited here.

[0034] For example, when a user wears a near-eye display device, as the user's posture information changes, such as when the user's head turns, the user walks, the user runs, etc., the near-eye display device will also move accordingly. When the near-eye display device moves along with the change in the user's posture information, the amount of change in the posture of the near-eye display device also changes accordingly. Based on this, it can be determined whether the user has a need to take pictures with the near-eye display device according to the amount of change in the posture of the near-eye display device.

[0035] In some embodiments, when the posture change amount of the near-eye display device is less than or equal to a preset posture change threshold, the target object is photographed by the near-eye display device to obtain an image.

[0036] For example, the posture change of the near-eye display device can be obtained through a preset posture detection algorithm. For example, the preset posture detection algorithm may include an IMU stable state algorithm, which is not limited here. When the posture change of the near-eye display device is obtained, if the posture change of the near-eye display device is less than or equal to the preset posture change threshold, it can be determined that the near-eye display device is in a stable state.

[0037] When a user continuously views a target object through a near-eye display device, the amount of change in the user posture information collected by the IMU sensor within a preset time period is small. Accordingly, the amount of change in the posture of the near-eye display device obtained by the IMU stable state algorithm is also small. For example, the amount of change in the posture of the near-eye display device is less than or equal to a preset posture change threshold.

[0038] Based on this, when the posture change of the near-eye display device is less than or equal to the preset posture change threshold, it can be determined that the user has a need to take pictures of the near-eye display device, and the near-eye display device can take pictures in response to the user's need to take pictures, such as photographing the target object to obtain an image.

[0039] In an exemplary embodiment, when the posture change of the near-eye display device is less than or equal to a preset posture change threshold, and the duration of the posture change being less than or equal to the preset posture change threshold is greater than or equal to a first duration threshold, the target object is photographed by the near-eye display device to obtain an image.

[0040] For example, when the change in the posture of the near-eye display device is less than or equal to the preset posture change threshold, there may be a situation where the user briefly views an object and then walks away, and the user does not need to further view the object through the near-eye display device, so the user does not have a photo-taking demand for the near-eye display device. Based on this, a first duration threshold can be set, and the first duration threshold can be used to further determine whether the user has a photo-taking demand for the near-eye display device. For example, when the change in the posture of the near-eye display device is less than or equal to the preset posture change threshold, and the duration of the posture change being less than or equal to the preset posture change threshold is greater than or equal to the first duration threshold, the target object is photographed by the near-eye display device to obtain an image. When the change in the posture of the near-eye display device is less than or equal to the preset posture change threshold, and the duration of the posture change being less than or equal to the preset posture change threshold is less than the first duration threshold, there is no need to photograph the object through the near-eye display device. The first duration threshold may include 0.5 seconds, 1 second, etc., which are not limited here. The first duration threshold may be pre-set or may be set by the user, which is not limited here.

[0041] Of course, it is not limited to this. For example, the operation information may include the user's touch information, pressing information, etc. of the near-eye display device. For example, when the user touches or presses a preset position of the near-eye display device, it can be determined that the user has a photo-taking demand for the near-eye display device, and the near-eye display device can take photos in response to the user's photo-taking demand, which is not limited here.

[0042] In some embodiments, the near-eye display device can perform real-time shooting to obtain an image including the target object. For example, an object detection sensor, such as an infrared sensor, etc., can be provided on the near-eye display device. When the near-eye display device detects that there is an object, such as a target object, within a preset position range, the near-eye display device can be controlled to shoot the target object to obtain an image, which is not limited here.

[0043] In this way, based on the image obtained by the near-eye display device shooting the target object, when the user views the target object through the near-eye display device, or views the image including the target object, it can be used to subsequently determine the user's viewing needs for the target object. For example, the user can subsequently identify the object type of the target object and other recognition results based on the image, understand the object feature information of the target object, etc., which is not limited here.

[0044] S102: Determine a target display object corresponding to the target object according to the image.

[0045] For example, in daily life, users may encounter target objects that they do not recognize, and they need to identify the object type of the target object. In some embodiments, when an image of a target object is obtained by a near-eye display device, the near-eye display device can identify the object type of the target object based on the image to obtain an object type recognition result. For example, the near-eye display device can identify the target object in the image according to an object recognition algorithm, and determine the object type recognition result corresponding to the target object. For another example, the near-eye display device can perform object recognition on the target object based on information such as a QR code, a radio frequency identification code (Radio Frequency Identification, RFID code) of the target object in the image to obtain an object type recognition result. Of course, it is not limited to this, and no limitation is made here. Based on this, the object type recognition result can be determined as the target display object corresponding to the target object, so that the subsequent near-eye display device can display the object type recognition result.

[0046] For example, when a user purchases a target object in daily life, for example, it is necessary to compare multiple target objects to determine at least one target object to be purchased from the multiple target objects. In some embodiments, when an image of a target object taken by a near-eye display device is obtained, the near-eye display device can determine the object feature information of the target object based on the image. For example, when the multiple target objects included in the image are multiple foods, at least one of the object feature information such as the production date, shelf life, ingredient list, and eating method of the multiple foods can be obtained based on the image, so that the user can compare the multiple foods. Of course, it is not limited to this. The multiple target objects can also be multiple clothes. For example, at least one of the object feature information such as the price, fabric composition, and cleaning method of multiple clothes can be compared. The multiple target objects can also be multiple electronic devices. For example, at least one of the object feature information such as the price, battery life, and usage method of multiple electronic devices can be compared, which is not limited here. Based on this, the object feature information can be determined as the target display object corresponding to the target object, so that the subsequent near-eye display device can display the object feature information.

[0047] Of course, the target display object corresponding to the target object is not limited to the object type recognition result corresponding to the target object and the object feature information corresponding to the target object, and is not limited here.

[0048] In some embodiments, when the near-eye display device determines the target display object corresponding to the target object, the target display object can be displayed in at least one of text, picture, video, animation, etc. The near-eye display device can then display the target display object in the form of text, picture, video, animation, etc.

[0049] In this way, when the target display object corresponding to the target object is determined according to the image, the determined target display object can be displayed by the subsequent near-eye display device, and the user can have a deeper understanding of the target object based on the viewed target display object, such as understanding the identification information and object feature information of the target object, which is conducive to meeting the user's viewing needs for the target object. In addition, the display method of the target display object can include text, pictures, videos, animations, etc., which is conducive to improving the convenience and flexibility of displaying the target object.

[0050] In some embodiments, based on the image, the target object in the image area corresponding to the image is identified to obtain a recognition result corresponding to the target object; when it is determined based on the recognition result that the image area corresponding to the image includes text, the text is translated according to a preset text language to obtain a target display object corresponding to the target object.

[0051] Exemplarily, the image obtained by the near-eye display device photographing the target object may include the image area corresponding to the target object in the image, and may also include the image area corresponding to the non-target object in the image. For example, the non-target object may include a preset object other than the target object, the environment background where the target object is located, etc., which is not limited here.

[0052] For example, in the process of determining the target display object corresponding to the target object according to the image, the image area corresponding to the non-target object in the image can be eliminated first to reduce the adverse effect of the non-target object in the image area corresponding to the image on the determination of the target display object corresponding to the target object. For example, the image can be segmented to obtain the image area corresponding to the target object in the image. Of course, it is not limited to this and is not limited here.

[0053] In some embodiments, text recognition may be performed on the target object in the image region corresponding to the image. For example, optical character recognition (OCR) may be used to recognize the text of the target object in the image region corresponding to the image, which is not limited here. For example, the target object is recognized in the image region corresponding to the image to obtain a recognition result corresponding to the target object.

[0054] Based on the obtained recognition result corresponding to the target object, it can be determined whether the image area corresponding to the image includes text. In the case where the image area corresponding to the image includes text, the text can be translated according to the preset text language to obtain the target display object corresponding to the target object. The preset text language can be determined according to the default text language of the near-eye display device, or according to the user's setting, which is not limited here.

[0055] For example, when it is determined according to the recognition result that the image area corresponding to the image includes text, it can be determined whether the text language corresponding to the text conforms to the preset text language. If it does not conform, the text can be translated to replace the text included in the image area corresponding to the image with the translated text, and obtain the target display object corresponding to the target object.

[0056] In some embodiments, when the target display object corresponding to the target object is determined, the near-eye display device may subsequently display the target display object in the form of pictures, videos, animations, etc., which is not limited here.

[0057] In this way, by recognizing the image, obtaining the recognition result corresponding to the target object, and in the case where it is determined according to the recognition result that the image area corresponding to the image includes text, the text is translated to obtain the target display object corresponding to the target object, and the text can be translated according to the preset text language according to the user's language habits. Then, when the near-eye display device subsequently displays the target display object corresponding to the target object, the user can view and understand the target display object according to his own language habits, which is conducive to improving the user's viewing experience of the target object. Furthermore, in the process of determining the target display object corresponding to the target object, the near-eye display device can choose to recognize the image area corresponding to the image of the target object, which is conducive to improving the convenience and recognition efficiency of text recognition of the target object. In addition, the near-eye display device can flexibly determine whether the image area corresponding to the image includes text and whether the text language corresponding to the text is consistent with the preset text language according to the recognition result, so as to determine whether it is necessary to translate the text in the recognition result to obtain the target display object, which is conducive to improving the flexibility of text recognition of the target object, thereby facilitating the convenience and flexibility of displaying the target object.

[0058] Exemplarily, when the image includes a plurality of preset objects, the target object is determined from the plurality of preset objects according to size information of each of the plurality of preset objects.

[0059] For example, when an image includes multiple preset objects, the user needs to determine the target object from the multiple preset objects to view the target object, which is equivalent to determining that the at least one preset object is the target object when the user has a viewing requirement for at least one preset object.

[0060] In some embodiments, the near-eye display device may determine the user's viewing requirements for multiple preset objects based on size information of each of the multiple preset objects in the image.

[0061] For example, when a user has a need to view a preset object, he or she may approach or pick up the preset object to view it. When the image includes multiple preset objects, and the user approaches or picks up at least one preset object, the size information of the at least one preset object approached or picked up by the user in the image will increase accordingly. The larger the size information of the preset object in the image, the greater the user's need to view the preset object. Based on this, when the image is acquired, the size information of each of the multiple preset objects in the image can be determined by a preset object detection algorithm. Among them, the size information may include the area information of each of the multiple preset objects in the image, which is not limited here. For example, when the image includes multiple preset objects, the preset object with the largest size information can be selected from the multiple preset objects according to the size information of each of the multiple preset objects in the image to be determined as the target object. Of course, it is not limited to this. When the image includes multiple preset objects, the preset object with size information greater than or equal to the preset size threshold can be selected from the multiple preset objects to be determined as the target object, which is not limited here.

[0062] In some embodiments, when a user wears a near-eye display device to view a target object, for example, the user can simultaneously see the target object body and the display content of the near-eye display device. For example, when an image includes multiple preset objects, the size information of each of the multiple preset objects in the user's field of view, and the size information of each of the multiple preset objects in the image may be different. Based on this, the target object can be determined from the multiple preset objects according to the size information of each of the multiple preset objects in the image. Of course, it is not limited to this. For example, the user can choose to determine the target object from the multiple preset objects according to at least one of the size information of each of the multiple preset objects in the user's field of view and the size information of each of the multiple preset objects in the image. This is not limited to this. For example, the user can choose to determine the target object from the multiple preset objects according to at least one of the size information of each of the multiple preset objects in the user's field of view and the size information of each of the multiple preset objects in the image. This is not limited here.

[0063] In this way, when an image includes multiple preset objects, the target object is determined from the multiple preset objects according to the size information of each of the multiple preset objects. Then, the near-eye display device can determine the user's viewing needs for the multiple preset objects according to the size information of each of the multiple preset objects, so as to determine the target object from the multiple preset objects according to the user's viewing needs, which is conducive to improving the convenience of determining the target object. Based on the determination of the target object, the target display object corresponding to the target object can be determined subsequently, so as to display the target display object, which is conducive to improving the convenience and flexibility of displaying the target object, and is conducive to improving the user's viewing needs for the target object.

[0064] S103 . Determine a target display posture of a target display object according to the position information of the near-eye display device and the position information of the target object.

[0065] Exemplarily, the target display posture of the target display object may include at least one of a display position and a display angle of the target display object.

[0066] For example, the location information of the near-eye display device may be obtained. For example, the location information of the near-eye display device may be determined by a preset positioning technology. The preset positioning technology may include GPS positioning technology, radar positioning technology, etc., which are not limited here.

[0067] For example, the position information of the target object can be determined based on the image obtained by photographing the target object by the near-eye display device. Since the image is obtained by photographing the target object by the near-eye display device, the position information of the target object in the world coordinate system corresponding to the near-eye display device can be determined based on the position information of the target object on the image. In some embodiments, the position information of the target object on the image is equivalent to the position information of the target object in the pixel coordinate system corresponding to the near-eye display device. According to the position information of the target object in the pixel coordinate system corresponding to the near-eye display device, the position information of the target object in the world coordinate system corresponding to the near-eye display device can be determined in combination with the camera parameters corresponding to the near-eye display device, such as camera intrinsic parameters, camera extrinsic parameters, and camera distortion. The camera parameters corresponding to the near-eye display device can be obtained in advance or determined by camera calibration technology, which is not limited here. Among them, the camera intrinsic parameters can be used to convert the position information of the target object from the camera coordinate system corresponding to the near-eye display device to the pixel coordinate system corresponding to the near-eye display device, and the camera extrinsic parameters can be used to convert the position information of the target object from the world coordinate system corresponding to the near-eye display device to the camera coordinate system corresponding to the near-eye display device. Of course, it is not limited to this. For example, the position information of the target object can also be reversely converted, which is not limited here.

[0068] In some embodiments, when the position information of the near-eye display device is determined, the position of the near-eye display device in the world coordinate system corresponding to the near-eye display device can be determined based on the position information of the near-eye display device. Since the target object and the near-eye display device are both processed in the same world coordinate system, the position information of the target object relative to the near-eye display device can be determined based on the position information of the near-eye display device in the world coordinate system corresponding to the near-eye display device and the position information of the target object in the world coordinate system corresponding to the near-eye display device. The determination of the position information of the target object relative to the near-eye display device can be used to determine the display position of the target display object.

[0069] For example, the angle information of the target object relative to the near-eye display device can also be determined based on the position information of the near-eye display device in the world coordinate system corresponding to the near-eye display device and the position information of the target object in the world coordinate system corresponding to the near-eye display device. Taking the acquired image including multiple faces of the target object as an example, the position information of different faces of the target object relative to the near-eye display device can be different, then the position information of different faces relative to the near-eye display device and the position information of the near-eye display device itself can be combined to determine the angle information of different faces relative to the near-eye display device, thereby determining the display angle of the target display object based on the angle information of different faces relative to the near-eye display device. In an exemplary embodiment, one of the faces with the largest area information in the image can be selected from the multiple faces of the target object as the target display face based on the area information of each of the different faces of the target object in the image, and the display angle of the target display object can be determined based on the angle information of the target display face relative to the near-eye display device.

[0070] Of course, it is not limited to this. For example, an image of a target object captured by a near-eye display device can be input into a trained machine learning model to obtain a target display object corresponding to the target object obtained by the machine learning model in a three-dimensional space, such as a target display posture in a world coordinate system corresponding to the near-eye display device. Optionally, the machine learning model includes a neural network model.

[0071] For example, a position detection module may also be provided on the near-eye display device. The position detection module may include an infrared sensor, etc., which is not limited here. The position detection module may be used to obtain the position information of the target object, such as determining the position information of the target object in the near-eye display device relative to the near-eye display device. According to the position information of the target object relative to the near-eye display device, combined with the position information of the near-eye display device, the angle of the target object relative to the near-eye display device may be determined. For example, according to the position information of the near-eye display device, the central axis of the field of view corresponding to the near-eye display device when the user wears the near-eye display device to view the target object may be determined. According to the position information of the target object relative to the near-eye display device, combined with the central axis of the field of view corresponding to the near-eye display device, the angle of the position information of the target object relative to the near-eye display device deviates from the central axis of the field of view corresponding to the near-eye display device. Among them, the central axis of the field of view may be used to indicate an angle reference axis determined based on the center point of the display of the near-eye display device as the origin, and is not a physical structure of the near-eye display device, which is not limited here. According to the angle of the position information of the target object relative to the near-eye display device deviates from the central axis of the field of view corresponding to the near-eye display device, the angle information of the target object relative to the near-eye display device is determined. Based on the determination of the position information of the target object relative to the near-eye display device, it can be used to determine the display position of the target display object. Based on the determination of the angle information of the target object relative to the near-eye display device, it can be used to determine the display angle of the target display object. Based on this, the near-eye display device can determine the target display posture of the target display object according to at least one of the display position of the target display object and the display angle of the target display object.

[0072] In this way, the target display posture of the target display object is determined according to the position information of the near-eye display device and the position information of the target object. The near-eye display device can then display the target display object according to the target display posture, which is beneficial to improving the convenience and flexibility of displaying the target object, thereby enhancing the user's viewing experience of the near-eye display device.

[0073] In some embodiments, the posture relationship between the near-eye display device and the target object is determined based on position information of the near-eye display device and position information of the target object; and the target display posture of the target display object is determined based on the posture relationship between the near-eye display device and the target object, so that the target display object displayed according to the target display posture is on the target object.

[0074] Exemplarily, the posture relationship between the near-eye display device and the target object may include at least one of a position association relationship between the target object and the near-eye display device and an angle association relationship between the target object and the near-eye display device.

[0075] For example, at least one of the position information of the target object relative to the near-eye display device and the angle information of the target object relative to the near-eye display device can be determined based on the position information of the near-eye display device and the position information of the target object. When the position information of the target object relative to the near-eye display device is determined, the positional association relationship between the target object and the near-eye display device can be determined based on the position information of the target object relative to the near-eye display device. When the angle information of the target object relative to the near-eye display device is determined, the angle association relationship between the target object and the near-eye display device can be determined based on the angle information of the target object relative to the near-eye display device. Based on at least one of the positional association relationship between the target object and the near-eye display device and the angle association relationship between the target object and the near-eye display device, the posture relationship between the near-eye display device and the target object can be determined.

[0076] When the posture relationship between the near-eye display device and the target object is determined, the target display posture of the target display object can be determined based on the posture relationship between the near-eye display device and the target object.

[0077] For example, the target display position of the target display object is determined according to the position association relationship between the target object and the near-eye display device. For example, if the position difference between the target object and the near-eye display device is 1 meter in the world coordinate system according to the position association relationship between the near-eye display device and the target object, then the target display position of the target display object can be determined as the position with a position difference of 1 meter from the near-eye display device. Of course, this is not limited to this and is not limited here.

[0078] For example, the target display angle of the target display object is determined according to the angle association relationship between the target object and the near-eye display device. For example, when it is determined according to the angle association relationship between the near-eye display device and the target object that the angle difference between the target object and the central axis of the field of view of the near-eye display device in the world coordinate system is 45°, the target display angle of the target display object can be determined to be a position where the angle between the target object and the central axis of the field of view of the near-eye display device is 45°. Of course, this is not limited to this and is not limited here.

[0079] Based on the determination of at least one of the target display position and the target display angle of the target display object, the target display position of the target display object in the world coordinate system can be converted into position information of the target object in the display coordinate system corresponding to the near-eye display device, and / or the target display angle of the target display object in the world coordinate system can be converted into position information of the target object in the display coordinate system corresponding to the near-eye display device, according to the association relationship between the display coordinate system corresponding to the near-eye display device and the world coordinate system corresponding to the near-eye display device. In this way, when the target display object is displayed according to the target display posture, the target display object can be displayed on the target object.

[0080] In this way, based on the determination of the posture relationship between the near-eye display device and the target object, the target display posture of the target display object can be determined, which is conducive to improving the convenience of determining the target display posture of the target display object. Based on the determination of the target display posture of the target display object, the target display object displayed according to the target display posture can be on the target object, and the user can determine that there is an association relationship between the target display object and the target object according to the target display object displayed on the target object, without having to judge whether the target display object corresponds to the target object one-to-one, which is conducive to improving the convenience and flexibility of displaying the target object, and improving the user's viewing experience of the target object.

[0081] In some embodiments, the target display posture of the target display object is adjusted according to the change in the posture relationship between the near-eye display device and the target object, so that the target display object displayed according to the target display posture is anchored on the target object.

[0082] For example, when a user is viewing a target object through a near-eye display device, the user can, for example, shift his or her viewing angle, or walk around the target object, or move the target object, etc., to observe the target object from multiple angles, and the near-eye display device and the target object will be in a relative motion state. Based on this, the near-eye display device can detect whether the posture relationship between the near-eye display device and the target object has changed. For example, a posture sensor of the near-eye display device, such as an IMU sensor, can be used to determine whether the user's posture has moved, or a camera module of the near-eye display device can be used to determine whether the user's hand has picked up or put down the target object, or a position detection sensor on the near-eye display device, such as an infrared sensor, can be used to determine whether the position information between the near-eye display device and the target object has changed, thereby determining whether the posture relationship between the near-eye display device and the target object has changed. In the case where the posture relationship between the near-eye display device and the target object changes, the change in the posture relationship between the near-eye display device and the target object can be followed in real time to adjust the target display posture of the target display object so that the target display object is anchored and displayed on the target object. In an exemplary embodiment, when an image of a target object captured by a near-eye display device is obtained, the target object can be optically tracked and identified based on the image to obtain a tracking result corresponding to the target object. When it is determined based on the tracking result that the posture relationship between the near-eye display device and the target object has changed, the near-eye display device can adjust the target display posture of the target display object based on the change in the posture relationship between the near-eye display device and the target object. Of course, this is not limited to this and is not limited here.

[0083] In this way, according to the change of the posture relationship between the near-eye display device and the target object, the target display posture of the target display object is adjusted, so that the target display object can be maintained on the target object during the relative motion between the near-eye display device and the target object, which is conducive to improving the convenience of determining the target display posture of the target display object. In addition, the user can determine that there is an association relationship between the target display object and the target object based on the target display object being maintained on the target object, without having to determine whether the target display object corresponds to the target object one-to-one, which is conducive to improving the convenience and flexibility of displaying the target object, and improving the user's viewing experience of the target object.

[0084] In some embodiments, a posture change of the near-eye display device is obtained; and a change in the posture relationship between the near-eye display device and the target object is determined based on the posture change of the near-eye display device.

[0085] For example, in the process of relative motion between the near-eye display device and the target object, the user's posture change can be determined based on the posture sensor such as the IMU sensor set on the near-eye display device to determine the posture change of the near-eye display device. For example, when the user's head turns to the left, the IMU sensor can collect the corresponding acceleration. Based on this, the position change of the user's head and the angle change of the user's head can be determined in the process of the user's head turning to the left according to the acceleration collected by the IMU sensor and the direction of the acceleration, combined with the user's head rotation speed. According to the position change of the user's head and the angle change of the user's head, the position change of the target object relative to the near-eye display device can be determined, as well as the angle change of the target object relative to the near-eye display device. Based on this, the posture change of the near-eye display device can be determined according to the position change of the target object relative to the near-eye display device and the angle change of the target object relative to the near-eye display device. When the posture change of the near-eye display device is not zero, it can be determined that the posture relationship between the near-eye display device and the target object has changed, so that the change of the posture relationship between the near-eye display device and the target object can be followed in real time, and the target display posture of the target display object can be adaptively adjusted so that the target display object can be anchored and displayed on the target object.

[0086] For example, in the process of relative motion between the near-eye display device and the target object, the position change between the near-eye display device and the target object can be determined according to the position detection sensor such as an infrared sensor set on the near-eye display device, so as to determine the position change of the near-eye display device according to the position change between the near-eye display device and the target object. For example, according to the position information of the target object acquired by the infrared sensor at the first moment, it can be determined that the position difference between the target object and the near-eye display device is 0.5 meters. Combined with the central axis of the field of view corresponding to the near-eye display device and the position information of the target object, it can be determined that the angle between the position information of the target object relative to the near-eye display device and the central axis of the field of view corresponding to the near-eye display device is 30°. According to the position information of the target object acquired by the infrared sensor at a second moment after the first moment, it can be determined that the position difference between the target object and the near-eye display device is 1 meter. Combined with the central axis of the field of view corresponding to the near-eye display device and the position information of the target object, it can be determined that the angle between the position information of the target object relative to the near-eye display device and the central axis of the field of view corresponding to the near-eye display device is 45°. Based on this, the position change of the target object can be determined according to the position difference between the target object and the near-eye display device determined at the first moment and the second moment. Correspondingly, the angle change of the target object can also be determined according to the angle between the position information of the target object relative to the near-eye display device determined at the first moment and the second moment and the central axis of the field of view corresponding to the near-eye display device. Since the near-eye display device and the target object are in a relative motion state, the position change of the near-eye display device can be determined according to the position change of the target object, and the angle change of the near-eye display device can also be determined according to the angle change of the target object. Based on this, the posture change of the near-eye display device can be determined according to the position change of the near-eye display device and the angle change of the eye display device. When the posture change of the near-eye display device is not zero, it can be determined that the posture relationship between the near-eye display device and the target object has changed, so that the change in the posture relationship between the near-eye display device and the target object can be followed in real time, and the target display posture of the target display object can be adaptively adjusted so that the target display object can be anchored and displayed on the target object.

[0087] Of course, it is not limited to this. For example, when the near-eye display device and the target object are in relative motion, the near-eye display device can determine the posture change of the near-eye display device by combining at least one of the multiple images of the target object captured by a camera module set on the near-eye display device, the posture change of the user determined by a posture sensor such as an IMU sensor, and the position change between the near-eye display device and the target object determined by a position detection sensor such as an infrared sensor, so as to determine the change in the posture relationship between the near-eye display device and the target object. There is no limitation here.

[0088] In this way, the posture change of the near-eye display device is obtained; according to the posture change of the near-eye display device, the change of the posture relationship between the near-eye display device and the target object is determined, and the change of the posture relationship between the near-eye display device and the target object can be responded to in time, and the target display posture of the target display object is adjusted, so that when the subsequent near-eye display device displays the target display object according to the target display posture, it can follow the change of the posture relationship between the near-eye display device and the target object, so that the target display object can be anchored and displayed on the target object without the user having to judge the one-to-one correspondence between the target display object and the target object, which is beneficial to improving the flexibility and convenience of displaying the target object, and is beneficial to improving the user's viewing experience of the target object.

[0089] S104: Control the near-eye display device to display the target display object according to the target display posture.

[0090] For example, the near-eye display device may display the target display object on the target object according to the target display position. For example, when the near-eye display device and the target object are in relative motion, the target display object may be anchored and displayed on the target object according to the target display posture adjusted in response to the change in the posture relationship between the near-eye display device and the target object.

[0091] In some embodiments, the target display object can be rendered into the display area of ​​the near-eye display device, such as in the software interface view of the near-eye display device, by a rendering engine. Of course, it is not limited to this and is not limited here. Among them, the rendering engine may include a 3D rendering engine, so that the user has a 3D visual sense when viewing the target display object, which is not limited here. For example, in the process of controlling the near-eye display device to display the target display object according to the target display posture, if the target display object includes text, the display form of the text in the target display object can be optimized. For example, if the text in the target display object is in Chinese, and the text in the recognition result corresponding to the target object recognized by the image is in English, the font size, line break and other information of the target display object can be adjusted based on the difference in Chinese and English typesetting to optimize the display effect of the target display object. Of course, it is not limited to this and is not limited here.

[0092] In this way, by controlling the near-eye display device to display the target display object according to the target display posture, the target display object displayed by the near-eye display device can be made to correspond one-to-one with the target object, which is beneficial to improving the flexibility and convenience of displaying the target object and improving the user's viewing experience of the target object.

[0093] Exemplarily, users of the near-eye display device may be of different age groups. According to the different age groups of the users, the near-eye display device may be controlled to display the target display object corresponding to the target object in different display forms.

[0094] In some embodiments, when it is determined that the user corresponding to the near-eye display device is a preset type of user based on user characteristic information corresponding to the near-eye display device, at least one of a display font size and a display screen size of the target display object is increased.

[0095] For example, user feature information may include feature information such as the user's head circumference information, the user's facial image, the user's eye focus information, and so on. For example, when the user's head circumference information is less than or equal to a preset head circumference threshold, the user may be determined to be a child user. For another example, the user's facial image may be input into a face recognition model to determine whether the facial features corresponding to the user's facial image match the facial features of an elderly user. If they match, the user may be determined to be an elderly user. For another example, the user's eye focus information may be input into a vision recognition model to determine whether the user's corresponding vision features match the vision features of a myopic user. If they match, the user may be determined to be a myopic user. Of course, the user feature information is not limited to this and is not limited here.

[0096] In some embodiments, the preset type of user may include at least one of an elderly user and a myopic user. For example, when it is determined that the user corresponding to the near-eye display device is at least one of an elderly user and a myopic user according to the user characteristic information corresponding to the near-eye display device, since the elderly user may have symptoms of presbyopia and the myopic user has symptoms of myopia, at least one of the display font size and the display screen size of the target display object may be adaptively increased, so that at least one of the elderly user and the myopic user can view the text of the target display object in a larger display font, or view at least one of the pictures, videos, and animations of the target display object in a larger screen size, so as to improve the flexibility and convenience of displaying the target object, and improve the viewing experience of at least one of the elderly user and the myopic user for the target object.

[0097] In some embodiments, the preset type of user may include a child user. For example, when it is determined that the user corresponding to the near-eye display device is a child user based on the user characteristic information corresponding to the near-eye display device, since the child user may know fewer words, the near-eye display device may be adaptively controlled to display the auxiliary identification information corresponding to the target display object. Among them, the auxiliary identification information can be Chinese pinyin, English phonetic symbols, text interpretation information, etc., which are not limited here. Based on this, the flexibility and convenience of displaying the target object can be improved, and the viewing experience of the child user of the target object can be improved.

[0098] For example, when the target display object has too many words in the text, if the target display object is still displayed on the target object, or the target display object is maintained to be displayed on the target object, too much text may be displayed on the target object, causing the text to overlap and be displayed on the target object, thereby causing the user to be unable to see the text in the target display object clearly. Based on this, when the number of words in the text of the target display object is greater than or equal to the preset text word count threshold, it is necessary to determine at least one of the target display area and the target font size when the near-eye display device displays the target display object.

[0099] For example, the preset text word count threshold may be determined based on the size information of the target object. The larger the size information of the target object, the larger the preset text word count threshold. Of course, it is not limited to this, the preset text word count threshold may also be pre-set, and the preset text word count threshold may also be set by the user, which is not limited here.

[0100] In some embodiments, when the number of words in the target display object is greater than or equal to a preset text word number threshold, the display font size of the text in the target display object can be reduced to determine the target font size when the near-eye display device displays the target display object. Based on this, the text in the target display object can be prevented from overlapping the target object so that the user can clearly see the text in the target display object, which is conducive to improving the flexibility of displaying the target object and improving the user's viewing experience of the target object.

[0101] In some embodiments, when the number of text words of the target display object is greater than or equal to a preset text word count threshold, the target display area when the near-eye display device displays the target display object can be determined. For example, the target display area can be switched from the target object to a preset display area of ​​the near-eye display device. The preset display area can be the entire display area of ​​the near-eye display device, or it can be a partial display area of ​​the near-eye display device, which is not limited here. When the posture relationship between the near-eye display device and the target object changes, and the number of text words of the target display object is greater than or equal to the preset text word count threshold, the target display object can be fixedly displayed in the preset display area to adaptively adjust the display position of the target display object according to the number of text words of the target display object.

[0102] Exemplarily, after controlling the near-eye display device to display the target display object according to the target display posture, as the near-eye display device and the target object move relative to each other, the near-eye display device can be controlled to photograph the target object to obtain a new image each time the posture change amount of the near-eye display device is less than or equal to a preset posture change threshold, so that the target display object corresponding to the target object can continue to be anchored and displayed on the target object according to the new image.

[0103] In some embodiments, as the near-eye display device and the target object move relative to each other, the latest image captured by the near-eye display device may not include the target object, and the target display object corresponding to the target object cannot be displayed on the target object, or the target display object corresponding to the target object cannot be anchored and displayed on the target object. Based on this, the target object needs to be re-determined.

[0104] For example, when the posture change of the near-eye display device is less than or equal to a preset posture change threshold, and the duration of the posture change being less than or equal to the preset posture change threshold is greater than or equal to a second duration threshold, an image is captured by the near-eye display device; and a new target object is determined based on the image captured by the near-eye display device; wherein the second duration threshold is longer than the first duration threshold.

[0105] For example, when the original target object is the first target object and the new target object is the second target object, when the user views the first target object through the near-eye display device, for example, the user will view the first target object from different angles. Then, with each movement of the first target object by the user, or each movement of the user, the posture relationship between the first target object and the near-eye display device will change, thereby causing the posture change amount of the near-eye display device to be greater than the preset posture change threshold. Based on this, when the posture change amount of the near-eye display device is less than or equal to the preset posture change threshold next time, and the duration of the posture change amount being less than or equal to the preset posture change threshold is greater than or equal to the first duration threshold, the image of the first target object taken by the near-eye display device can be continuously obtained to re-determine the target display posture of the target display object corresponding to the first target object, so that the target display object corresponding to the first target object can be anchored and displayed on the target object.

[0106] When the posture change of the near-eye display device is obtained to be less than or equal to a preset posture change threshold, and the duration of the posture change being less than or equal to the preset posture change threshold is greater than or equal to a second duration threshold, for example, it can be determined that the user is viewing a second target object other than the first target object through the near-eye display device. Then, an image of the second target object taken by the near-eye display device can be obtained to determine, based on the image, the target display object corresponding to the second target object and the target display posture of the target display object, thereby controlling the near-eye display device to display the target display object corresponding to the second target object, and so on.

[0107] In an exemplary embodiment, Figure 2 As shown, when the user wears a near-eye display device, the shooting function of the near-eye display device can be activated. The near-eye display device can initialize the algorithm SDK. The user moves the head to identify the object information of the target object through the shooting function of the near-eye display device. The near-eye display device obtains the IMU stable state through the algorithm SDK. When the IMU stable state returned by the algorithm SDK lasts for 0.5 seconds, the image obtained by the near-eye display device shooting the target object can be obtained. The near-eye display device can transmit the image to the algorithm SDK for OCR recognition. After OCR recognition, the recognized text is transmitted to the language translation module to obtain the target display object corresponding to the target object. The target display object is rendered and displayed on the target object using a 3D rendering engine. The image obtained by the near-eye display device shooting the target object is obtained in real time and transmitted to the algorithm SDK for optical flow tracking and recognition of the target object. When the user moves the target object or the user moves the near-eye display device, the position information of the target object can be identified through optical flow tracking and recognition. According to the position information of the target object, the target display posture of the target display object is updated in real time using the 3D rendering engine until the target display object corresponding to the target object is displayed on the target object in real time.

[0108] The control method of the near-eye display device provided in the above-mentioned embodiment includes: obtaining an image of the target object photographed by the near-eye display device; determining a target display object corresponding to the target object based on the image; determining a target display posture of the target display object based on position information of the near-eye display device and position information of the target object; and controlling the near-eye display device to display the target display object based on the target display posture, so as to improve the convenience and flexibility of displaying the target object and enhance the user's viewing experience of the target object.

[0109] See also Figure 3 , Figure 3 1 is a schematic block diagram of a control device for a near-eye display device provided in an embodiment of the present application. The control device for a near-eye display device can be configured in a server or a near-eye display device to execute the aforementioned control method for a near-eye display device.

[0110] like Figure 3 As shown, the control device of the near-eye display device includes: an acquisition module 110, a first determination module 120, a second determination module 130 and a control module 140.

[0111] The acquisition module 110 is used to acquire an image of a target object captured by a near-eye display device.

[0112] The first determination module 120 is configured to determine a target display object corresponding to the target object according to the image.

[0113] The second determination module 130 is configured to determine a target display posture of the target display object according to the position information of the near-eye display device and the position information of the target object.

[0114] The control module 140 is used to control the near-eye display device to display the target display object according to the target display posture.

[0115] Exemplarily, the first determination module 120 includes an identification submodule and a translation submodule.

[0116] The recognition submodule is used to recognize the target object in the image area corresponding to the image according to the image, and obtain the recognition result corresponding to the target object.

[0117] The translation submodule is used to translate the text according to a preset text language to obtain a target display object corresponding to the target object when it is determined according to the recognition result that the image area corresponding to the image includes text.

[0118] Exemplarily, the control device also includes a selection submodule.

[0119] The selection submodule is used to determine the target object from the plurality of preset objects according to size information of each of the plurality of preset objects in the image when the image includes the plurality of preset objects.

[0120] Exemplarily, the second determination module 130 includes a first pose determination submodule and a second pose determination submodule.

[0121] The first posture determination submodule is used to determine the posture relationship between the near-eye display device and the target object according to the position information of the near-eye display device and the position information of the target object.

[0122] The second posture determination submodule is used to determine the target display posture of the target display object according to the posture relationship between the near-eye display device and the target object, so that the target display object displayed according to the target display posture is on the target object.

[0123] Exemplarily, the second posture determination submodule includes a posture change submodule.

[0124] The posture change submodule is used to adjust the target display posture of the target display object according to the change of the posture relationship between the near-eye display device and the target object, so that the target display object displayed according to the target display posture is anchored on the target object.

[0125] Exemplarily, the control device also includes a change amount acquisition submodule and a posture change determination submodule.

[0126] The change acquisition submodule is used to obtain the change of the posture of the near-eye display device.

[0127] The posture change determination submodule is used to determine the change in the posture relationship between the near-eye display device and the target object according to the posture change amount of the near-eye display device.

[0128] Exemplarily, the control device further includes a first adjustment submodule.

[0129] The first adjustment submodule is used to increase at least one of a display font size and a display screen size of the target display object when it is determined that the user corresponding to the near-eye display device is a preset type of user based on user characteristic information corresponding to the near-eye display device.

[0130] Exemplarily, the acquisition module 110 includes an acquisition submodule.

[0131] The acquisition submodule is used to capture the target object through the near-eye display device to obtain the image when the posture change amount of the near-eye display device is less than or equal to a preset posture change threshold.

[0132] It should be noted that technicians in the relevant field can clearly understand that for the convenience and simplicity of description, the specific working processes of the above-described devices and modules and units can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0133] The method of the present application can be used in many general or special computer system environments or configurations. For example: personal computers, server computers, handheld devices or portable devices, tablet devices, multiprocessor systems, microprocessor-based systems, set-top boxes, programmable consumer electronic devices, network PCs, minicomputers, mainframe computers, distributed computing environments including any of the above systems or devices, etc. The present application can be described in the general context of computer-executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform specific tasks or implement specific abstract data types. The present application can also be practiced in distributed computing environments, in which tasks are performed by remote processing devices connected through a communication network. In a distributed computing environment, program modules can be located in local and remote computer storage media including storage devices.

[0134] Exemplarily, the above method and apparatus may be implemented in the form of a computer program, which may be run on a near-eye display device. Exemplarily, the near-eye display device may include VR glasses, AR glasses, VR helmets, AR helmets, etc., which are not limited here.

[0135] See also Figure 4 , Figure 4 It is a schematic block diagram of the structure of a near-eye display device provided in an embodiment of the present application.

[0136] like Figure 4 As shown, the near-eye display device includes a memory and a processor. The memory and the processor may be connected via a system bus, and the memory may include a storage medium and an internal memory.

[0137] The storage medium may store an operating system and a computer program. When the computer program is executed, the processor may execute any method for controlling a near-eye display device.

[0138] The processor is used to provide computing and control capabilities to support the operation of the entire near-eye display device.

[0139] The internal memory provides an environment for the operation of the computer program in the storage medium. When the computer program is executed by the processor, the processor can execute any control method of the near-eye display device.

[0140] Those skilled in the art will understand that Figure 4 The structure shown in the figure is merely a block diagram of a portion of the structure related to the scheme of the present application, and does not constitute a limitation on the near-eye display device to which the scheme of the present application is applied. The specific near-eye display device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0141] It should be understood that the processor may be a central processing unit (CPU), and the processor may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0142] In one embodiment, the processor is used to execute a computer program and implement the following steps when executing the computer program:

[0143] Acquire an image of a target object captured by a near-eye display device;

[0144] Determining a target display object corresponding to the target object according to the image;

[0145] Determining a target display posture of the target display object according to the position information of the near-eye display device and the position information of the target object;

[0146] According to the target display posture, the near-eye display device is controlled to display the target display object.

[0147] It should be noted that technicians in the relevant field can clearly understand that for the convenience and conciseness of description, the specific working process of controlling the near-eye display device described above can refer to the corresponding process in the aforementioned near-eye display device control method embodiment, and will not be repeated here.

[0148] An embodiment of the present application also provides a computer-readable storage medium, on which a computer program is stored. The method implemented when the computer program is executed by a processor can refer to the various embodiments of the control method of the near-eye display device of the present application.

[0149] The computer-readable storage medium may be an internal storage unit of the near-eye display device described in the aforementioned embodiment, such as a hard disk or memory of the near-eye display device. The computer-readable storage medium may also be an external storage device of the near-eye display device, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc., equipped on the near-eye display device.

[0150] It should be understood that the terms used in this application specification are only for the purpose of describing specific embodiments and are not intended to limit the application. As used in this application specification and the appended claims, unless the context clearly indicates otherwise, the singular forms "a", "an" and "the" are intended to include plural forms.

[0151] It should also be understood that the term "and / or" used in the specification of this application and the appended claims refers to any combination of one or more of the associated listed items and all possible combinations, including these combinations. It should be noted that, in this article, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "including a..." does not exclude the presence of other identical elements in the process, method, article or system including the element.

[0152] The serial numbers of the embodiments of the present application are only for description and do not represent the advantages and disadvantages of the embodiments. The above description is only a specific implementation mode of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed in the present application, and these modifications or replacements should be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be based on the protection scope of the claims.

Claims

1. A method for controlling a near-eye display device, characterized in that: include: Acquire an image of a target object captured by a near-eye display device; Determining a target display object corresponding to the target object according to the image; Determining a target display posture of the target display object according to the position information of the near-eye display device and the position information of the target object; According to the target display posture, the near-eye display device is controlled to display the target display object.

2. The control method according to claim 1, characterized in that: Determining, according to the image, a target display object corresponding to the target object includes: According to the image, identifying the target object in an image area corresponding to the image, and obtaining a recognition result corresponding to the target object; When it is determined according to the recognition result that the image area corresponding to the image includes text, the text is translated according to a preset text language to obtain a target display object corresponding to the target object.

3. The control method according to claim 1, characterized in that: Before identifying the target object in the image area corresponding to the image according to the image to obtain the identification result corresponding to the target object, the method further includes: When the image includes a plurality of preset objects, the target object is determined from the plurality of preset objects according to size information of each of the plurality of preset objects in the image.

4. The control method according to any one of claims 1 to 3, characterized in that: The determining the target display posture of the target display object according to the position information of the near-eye display device and the position information of the target object includes: Determining a positional relationship between the near-eye display device and the target object according to the position information of the near-eye display device and the position information of the target object; According to the posture relationship between the near-eye display device and the target object, a target display posture of the target display object is determined, so that the target display object displayed according to the target display posture is on the target object.

5. The control method according to claim 4, characterized in that: The determining the target display posture of the target display object according to the posture relationship between the near-eye display device and the target object includes: According to the change of the posture relationship between the near-eye display device and the target object, the target display posture of the target display object is adjusted so that the target display object displayed according to the target display posture is anchored on the target object.

6. The control method according to claim 5, characterized in that: Before adjusting the target display posture of the target display object according to the change of the posture relationship between the near-eye display device and the target object so that the target display object displayed according to the target display posture is anchored on the target object, the method further includes: Obtaining the position change of the near-eye display device; A change in the posture relationship between the near-eye display device and the target object is determined according to the posture change amount of the near-eye display device.

7. The control method according to any one of claims 1 to 3, characterized in that: Before controlling the near-eye display device to display the target display object according to the target display posture, the method further includes: When it is determined that the user corresponding to the near-eye display device is a preset type of user according to the user characteristic information corresponding to the near-eye display device, at least one of a display font size and a display screen size of the target display object is increased.

8. The control method according to any one of claims 1 to 3, characterized in that: The acquiring of an image obtained by photographing a target object by a near-eye display device comprises: When the posture change amount of the near-eye display device is less than or equal to a preset posture change threshold, the target object is photographed by the near-eye display device to obtain the image.

9. A control device for a near-eye display device, characterized in that: The control device comprises: An acquisition module, used to acquire an image of a target object photographed by a near-eye display device; A first determining module, configured to determine a target display object corresponding to the target object according to the image; A second determination module, configured to determine a target display posture of the target display object according to the position information of the near-eye display device and the position information of the target object; A control module is used to control the near-eye display device to display the target display object according to the target display posture.

10. A near-eye display device, characterized in that: The near-eye display device includes a memory and a processor; The memory is used to store computer programs; The processor is used to execute the computer program and implement the control method of the near-eye display device according to any one of claims 1 to 8 when executing the computer program.

Images