Target object display method and device and storage medium

Abstract

The invention provides a target object display method and device and a storage medium. The provided method is applied to wearable equipment. The method comprises the following steps: acquiring and displaying an image acquired by wearable equipment; and the wearable device obtains the target object from the image and generates a display frame in the displayed image so as to amplify and display the target object in the display frame. Therefore, when the user wears the wearable device, the target object can be quickly selected from the acquired image, and the amplified target object is displayed. The user can clearly and quickly observe the interested object in the sight range by wearing the wearable equipment, so that the use experience of the user is improved, and the eye health of the user is protected.

Description

Technical Field

[0001] The present invention relates to the application field of wearable devices, and in particular to a display method, device and storage medium for a target object. Background Art

[0002] Currently, wearable devices that support augmented reality technology, such as AR (Augmented Reality) glasses, are widely used in film, television, games, industrial inspection and other fields. Wearable devices can superimpose real environment and virtual information on the same screen through computer technology, thereby realizing the interaction between virtual and reality.

[0003] In order to enable users to see the content in front of them more clearly, existing wearable devices that support augmented reality technology will magnify all images within the visual detection range of the wearable device to facilitate users to read related content. However, magnifying all images within the visual detection range of the wearable device will make it difficult for users to quickly obtain the content of interest, resulting in a decrease in user experience. At the same time, magnifying all images within the visual range of smart glasses will also harm the user's eye health. Summary of the invention

[0004] The present application provides a method, device and storage medium for displaying a target object, aiming to solve the problem that, during the wearing process of existing wearable devices supporting augmented reality technology, magnifying all images within the visual detection range of the wearable device will make it difficult for the user to quickly obtain the content of interest, resulting in a decrease in the user's usage experience. At the same time, magnifying all images within the visual range of smart glasses will also cause harm to the user's eye health.

[0005] In a first aspect, the present application provides a method for displaying a target object, the display method being applied to a wearable device, the display method comprising:

[0006] Acquire the collected image and display the image;

[0007] Acquire a target object from the image;

[0008] A display frame is generated in the displayed image, and the target object is displayed in an enlarged manner in the display frame.

[0009] In a second aspect, the present application provides a display device for a wearable device, the display device comprising:

[0010] An image acquisition unit, used to acquire the collected image and display the image;

[0011] An object acquisition unit, used for acquiring a target object from the image;

[0012] The enlarged display unit is used to generate a display frame in the displayed image and to enlarge and display the target object in the display frame.

[0013] In a third aspect, the present application provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the processor implements the steps of the method for displaying a target object provided in any embodiment of the present application.

[0014] The present application provides a method for displaying a target object, and the method provided is through acquiring and displaying an image captured by a wearable device. The wearable device then acquires the target object from the image, and generates a display frame in the displayed image to magnify and display the target object in the display frame. Then, when the user wears the wearable device, the user can quickly select the target object in the captured image and display the magnified target object. The user can clearly and quickly observe the object of interest within the field of vision by wearing the wearable device, thereby improving the user's experience and protecting the user's eye health.

[0015] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0017] Figure 1 is a schematic flow chart of the steps of a method for displaying a target object provided by an embodiment of the present application;

[0018] Figure 2 is a display schematic diagram of a wearable device provided in an embodiment of the present application;

[0019] Figure 3 It is a schematic flow chart of the steps of a target object confirmation method provided by an embodiment of the present application;

[0020] Figure 4 is a display schematic diagram of another wearable device provided in an embodiment of the present application;

[0021] Figure 5 is a display schematic diagram of another wearable device provided in an embodiment of the present application;

[0022] Figure 6 is a display schematic diagram of another wearable device provided in an embodiment of the present application;

[0023] Figure 7 A schematic block diagram of a display device of a wearable device provided in an embodiment of the present application;

[0024] Figure 8 A schematic block diagram of a wearable device provided in an embodiment of the present application.

[0025] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. DETAILED DESCRIPTION

[0026] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0027] The flowcharts shown in the accompanying drawings are only examples and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps may also be decomposed, combined or partially merged, so the actual execution order may change according to actual conditions.

[0028] It should be understood that the terms used in this application specification are only for the purpose of describing specific embodiments and are not intended to limit the application. As used in this application specification and the appended claims, unless the context clearly indicates otherwise, the singular forms "a", "an" and "the" are intended to include plural forms.

[0029] It should be further understood that the term “and / or” used in the specification and appended claims refers to any combination and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0030] In conjunction with the accompanying drawings, some embodiments of the present application are described in detail below. In the absence of conflict, the following embodiments and features in the embodiments can be combined with each other.

[0031] Wearable devices with augmented reality and virtual reality functions can enable users to experience a richer 3D world during use. Wearable devices, such as AR (Augmented Reality) glasses, are currently widely used in film, television, games, and industrial inspection. Wearable devices can use computer technology to superimpose real environments and virtual information on the same screen, thereby realizing the interaction between virtual and reality.

[0032] At present, when a user wears a wearable device and there is an object of interest within the user's field of vision, such as product information on a product packaging box, a traditional wearable device will magnify the entire image within the field of vision to allow the user to obtain information about the object of interest. It is difficult for the user to quickly obtain the content of the object of interest in the magnified image, and the magnified display of the entire image will not only reduce the user's experience, but also cause great damage to the user's eyes.

[0033] To solve the problem that existing wearable devices are difficult to help users quickly obtain content of interest, enlarging all images within the visual range of the wearable device will harm the user's eye health and reduce the user's experience, please refer to Figure 1 , Figure 1 It is a schematic flow chart of the steps of a method for displaying a target object provided in an embodiment of the present application. The display method provided in an embodiment of the present application is applied to a wearable device.

[0034] like Figure 1 As shown, the provided display method includes steps S101 to S103.

[0035] S101. Acquire the collected image and display the image.

[0036] Specifically, when the user needs to enlarge the target object displayed on the wearable device, such as enlarging the target word in the target book, the captured image is displayed by the wearable device, and the user can view the content of the displayed image while wearing the wearable device. Then, the wearable device can analyze the operations performed by the user when viewing the displayed image, such as the gaze point of the user in the image, to obtain the target object that needs to be enlarged in the image, so that the display method provided in the embodiment of the present application can help the user select the target object on the image for enlargement.

[0037] Exemplarily, the image acquired and displayed by the wearable device can be an image acquired by the wearable device in real time, an image acquired in advance by the wearable device, or an image saved by the wearable device. The display method provided in the embodiment of the present application can magnify and display the user's target object on any image, so the embodiment of the present application does not limit the image acquisition method.

[0038] S102. Acquire a target object from an image.

[0039] Specifically, the target object can be any object in the image displayed by the wearable device, such as any one of a word, a phrase, a sentence, a paragraph, and an icon. When the user is viewing the image displayed by the wearable device, when there is a target object of interest in the image, the user can generate object selection information corresponding to the target object through a preset operation. The object selection information is, for example, the position where the user places the identification piece in the image or the position where the user is looking at in the image. The wearable device can obtain the target object in the image according to the user's object selection information, and then the wearable device can clearly identify the target that needs to be enlarged.

[0040] S103. Generate a display frame in the displayed image, and enlarge and display the target object in the display frame.

[0041] Specifically, Figure 2 As shown, Figure 2 is a display schematic diagram of a wearable device provided in an embodiment of the present application. Figure 2 In the figure, from left to right, the user can select the target paragraph, target line and target layout on the image displayed by the wearable device. The wearable device generates a display frame on the display interface to enlarge the target paragraph, target line and target layout on the displayed text. Furthermore, according to the method provided in the present application, the target object can be quickly selected in the captured image and the enlarged target object can be displayed. The user can clearly and quickly observe the object of interest within the field of vision by wearing the wearable device, thereby improving the user experience and protecting the user's eye health.

[0042] In some embodiments, the target object may include a word, a term, a sentence, a paragraph, a layout, or an icon. Through the display method provided in the embodiment of the present application, a user can extract any type of target object from an image for display. Therefore, the embodiment of the present application does not limit the type of the target object.

[0043] In some embodiments, the target object is located on the target object, and the target object can be any object within the visual detection range of the wearable device, for example, the target object can be a book, the target object can be a paper, the target object can be a display screen, and the target object can be a building. The display method provided in the embodiment of the present application can display the corresponding target object from any target object, for example, selecting the corresponding words from the book for display, so the embodiment of the present application does not limit the type of the target object.

[0044] In some embodiments, acquiring a captured image and displaying the image include: acquiring a captured video, the video including multiple images, and displaying the image.

[0045] The wearable device can collect videos within the visual detection range in real time, such as video streams. Videos are composed of multiple continuous frame images, and the display method provided in the embodiment of the present application can magnify and display the target object obtained in the video collected by the wearable device.

[0046] It should be noted that when a user selects a target object for enlarged display in a video captured by a wearable device, the selection can be made on any image containing the target object contained in the video stream, so that the user can dynamically view the changes of the target object through the video, and can also statically view the specific content of the target object through the image.

[0047] In some embodiments, enlarging and displaying the target object in the display frame includes: acquiring a preset magnification ratio of the target object, and enlarging and displaying the target object in the display frame according to the preset magnification ratio.

[0048] When the preset magnification ratio is too large, it is easy to cause poor viewing effect for the user and easily damage the user's eyes. Therefore, the wearable device can improve the user's viewing experience by obtaining the preset magnification ratio of the target object.

[0049] For example, the preset magnification may be pre-set by the user in the wearable device, and the preset magnification may be calculated by the wearable device according to the size of the target object in the image, and the target object is enlarged to the preset magnification corresponding to the preset size. The preset magnification is used to adjust the target object to a magnification corresponding to a size that allows the user to see it clearly, so the embodiment of the present application does not limit the method for obtaining the preset magnification.

[0050] In some embodiments, please refer to Figure 3 , Figure 3 It is a schematic flow chart of the steps of a target object confirmation method provided in an embodiment of the present application.

[0051] like Figure 3 As shown, the provided method includes steps S102a to S102c.

[0052] S102a. Obtain type information, where the type information includes the object type.

[0053] S102b. Acquire multiple objects to be confirmed in the image according to the object type.

[0054] S102c. Obtain the user's selection information, and confirm the target object from multiple objects to be confirmed according to the user's selection information.

[0055] The type information is obtained through the wearable device, for example, the type information includes an object type of any one of a word, a sentence, a paragraph, a layout or an icon. Then, multiple objects to be confirmed can be obtained in the displayed image, for example Figure 4 As shown, Figure 4 is a display schematic diagram of another wearable device provided in an embodiment of the present application. When the type information of the target object is a car, the wearable device will identify and select multiple cars in the image. Figure 4 The candidate objects in the image include 3 cars and a street lamp as an object to be confirmed due to a recognition error. Then the user can determine the target object to be selected from multiple objects to be confirmed. Therefore, the target object to be enlarged can be quickly and accurately confirmed in the image.

[0056] Exemplarily, the wearable device can also display a type information selection window when displaying an image, and the user can select the corresponding object type in the type information selection window so that the wearable device can obtain type information including the object type. Then, the wearable device can obtain multiple objects to be confirmed in the image according to the type information. Exemplarily, confirming the target object from multiple objects to be confirmed according to the user's selection information includes: generating and displaying multiple tags in the image according to the object type, the tags are used to identify the objects to be confirmed in the image; obtaining the object selection information generated by the user controlling the wearable device according to the displayed tags; confirming the target tag in the multiple tags according to the object selection information, and confirming the object corresponding to the target tag as the target object.

[0057] When a user wears and views multiple markers on an image displayed by a wearable device, e.g. Figure 4 In this case, the wearable device can obtain the target mark selected by the user from the multiple marks, and quickly and accurately enlarge and display the object included in the target mark as the target object.

[0058] It should be noted that in some embodiments, the wearable device includes an object selection module, such as buttons installed on the temples and the mirror clips of the wearable device. The object selection module can be triggered in the image to switch and select the target mark corresponding to the corresponding target object in the image displayed by the wearable device, so that the wearable device can quickly confirm the target object and enlarge it for display, thereby improving the user experience.

[0059] It should be noted that, in some embodiments, confirming the target object from multiple objects to be confirmed based on the user's selection information includes: if the image contains a preset identification piece, obtaining the position information of the identification piece in the image; and confirming the target object from multiple objects to be confirmed based on the position information of the identification piece.

[0060] like Figure 5 As shown, Figure 5It is a display schematic diagram of another wearable device provided by an embodiment of the present application. If the image captured by the wearable device contains a preset identification part, such as a user's fingertip, it can then track the position of the identification part on the target object, for example, by using an optical flow tracking method to track the position of the identification part on the image, and then obtain the position information of the identification part relative to the image. Then the wearable device can be based on the position information of the identification part relative to the image, such as the position where the fingertip is placed. Through the position where the identification part is placed, the wearable device can determine the target object selected by the user on the target object, for example, the object closest to the position where the identification part is placed is the target object, and complete the selection of the target object. Thereby, the wearable device does not need to rely on specific target objects and tools in the process of selecting the target object, and greatly expands the scope of application of the wearable device in selecting the target object, thereby improving the user experience.

[0061] It should be noted that, in some embodiments, if the identification element is a user's fingertip; obtaining the position information of the identification element in the image includes: obtaining the position information of the user's palm in the image; and obtaining the position information of the user's fingertip in the image based on the position information of the user's palm in the image.

[0062] like Figure 5 As shown, in order to improve the accuracy of fingertip position recognition by the wearable device, the present application first detects the position of the user's palm, for example, by shape matching to recognize the user's palm in the image collected by the wearable device. Then, the position of the fingertip is further detected in the position of the palm, such as Figure 5 In the example, the user's palm is first marked with a marker box, and then the user's fingertips are circled. This ensures that the wearable device can accurately locate the user's fingertips.

[0063] It should be noted that, in some embodiments, according to the position information of the identification part, the target object is confirmed from multiple objects to be confirmed, including: calculating the intersection and union function value of each object to be confirmed in the image and the position information; according to the intersection and union function value corresponding to the object to be confirmed, confirming the target object from multiple objects to be confirmed. Among them, the higher the intersection and union function value, the higher the overlap between the identification part and the object to be confirmed in the image displayed by the wearable device. By obtaining the highest value of the intersection and union function value corresponding to the multiple objects to be confirmed and the identification part, and taking the object to be confirmed corresponding to the highest value in the intersection and union function value as the target object, the wearable device can quickly and accurately confirm the target object in the image.

[0064] When the image includes multiple objects, by calculating the intersection-over-Union (IoU) function value between the position of each object to be confirmed and the position information of the identification part, the object closest to the identification part can be obtained as the target object, so that the user can quickly select the corresponding target object in the image for display.

[0065] The calculation formula of the intersection-and-union ratio function is as follows:

[0066]

[0067] Among them, area a is the area of ​​the user identification piece in the image collected by the wearable device, area b is the area of ​​each object to be confirmed in the image collected by the wearable device, for example Figure 4 Four objects to be confirmed are selected, and the frame lines corresponding to each object to be confirmed are its area in the image. By dividing the intersection area of ​​the area of ​​the identification part in the image collected by the wearable device and the area of ​​each candidate object in the image collected by the wearable device by the union area, the intersection and union ratio function value of the area of ​​the identification part in the image collected by the wearable device and the area of ​​each candidate object in the image collected by the wearable device can be obtained. The ideal situation is that the two areas completely overlap, and the intersection and union ratio function value is 1.

[0068] In some embodiments, the wearable device includes an eye tracking module; confirming a target object from multiple objects to be confirmed based on user selection information includes: obtaining gaze information of the user on a displayed image monitored by the eye tracking module; and confirming the target object from multiple objects to be confirmed based on the gaze information.

[0069] When the wearable device includes an eye tracking module, the eye tracking module can obtain the target object selected by the user based on the user's gaze information on the image, such as the position of the user's gaze point in the image. For example, after confirming the object to be confirmed corresponding to the user's gaze point, if the user's gaze duration at this time exceeds a preset duration, the object to be confirmed corresponding to the gaze point at this time is confirmed as the target object. The wearable device provided can help the user zoom in on the corresponding target object without performing additional operations.

[0070] Exemplarily, the eye tracking module can, based on the position information of the user's gaze point on the image, calculate the intersection-and-union function of the position information of the gaze point in the image and multiple objects to be confirmed, and then determine the object corresponding to the highest value of the intersection-and-union function as the corresponding target object in the image, so that the wearable device can accurately select the object closest to the user's gaze point as the target object.

[0071] Exemplarily, the eye tracking module can obtain the target object selected by the user based on the user's gaze information on the image. The calculation can be performed based on the distance between the user's gaze area in the image and the target object and the area of ​​the target object. The calculation formulas for the distance to the target object and the area of ​​the target object are as follows:

[0072] P=A*S+B*L

[0073] Among them, S is the area of ​​each object to be confirmed in the image, and L is the distance between the fixation area and the object to be confirmed. A and B are the weights corresponding to the area and distance respectively. Figure 4 As shown in FIG. 1 , although the user's gaze area is on the street lamp, the vehicle occupies a larger area in the image. Therefore, through the reasonable setting of the weights, the target object finally selected by the wearable device will be the vehicle.

[0074] It should be noted that the weights A and B can be set according to the needs of the user. When the user wants the wearable device to select the object to be confirmed that is closest to the gaze area as the target object, the value of B is increased. When the user wants to select the object to be confirmed with a larger area in the image as the target object, the value of A is increased. The embodiment of the present application does not limit the values ​​of weights A and B.

[0075] It should be noted that if Figure 6 As shown, Figure 6 This is another display diagram of a wearable device provided in an embodiment of the present application. In order to improve the display effect of the target object, the wearable device will expand part of the area next to the target object when selecting the target object, to ensure that the main body of the target object can be fully displayed in the display frame, for example Figure 6 The environment around the building will also be partially displayed in the display frame, which can also improve the user's viewing experience.

[0076] The present application provides a display method based on a wearable device, which enables a user to quickly select a target object from a captured image and display the enlarged target object when the user wears the wearable device, so that the user can clearly and quickly observe the object of interest within the field of vision by wearing the wearable device, thereby improving the user's experience and protecting the user's eye health.

[0077] The present application provides a display device for a wearable device, such as Figure 7 As shown, Figure 7 A schematic block diagram of a display device of a wearable device provided in an embodiment of the present application, wherein the display device can be configured in a server.

[0078] like Figure 7As shown, the display device 100 includes: an image acquisition unit 101 , an object acquisition unit 102 , and an enlarged display unit 103 .

[0079] The image acquisition unit 101 is used to acquire the collected image and display the image.

[0080] The object acquisition unit 102 is configured to acquire a target object from the image.

[0081] The magnifying display unit 103 is used to generate a display frame in the displayed image, and magnify and display the target object in the display frame.

[0082] In some embodiments, the display device 100 further includes a magnification acquisition unit 103a, an object confirmation unit 102a, a marker generation unit 102a1, a position acquisition unit 102a2, a fingertip acquisition unit 102a3, a function calculation unit 102a4 and an eye tracking unit 104.

[0083] The magnification acquisition unit 103a is used to acquire a preset magnification of the target object, and to display the target object in the display frame by magnifying the target object according to the preset magnification.

[0084] The object confirmation unit 102a is used to obtain type information, the type information includes object type; obtain multiple objects to be confirmed in the image according to the object type; obtain user selection information, and confirm the target object from the multiple objects to be confirmed according to the user selection information.

[0085] The tag generation unit 102a1 is used to generate and display multiple tags in the image according to the object type, and the tags are used to identify the object to be confirmed in the image; obtain object selection information generated by the user controlling the wearable device according to the displayed tags; confirm the target tag among the multiple tags according to the object selection information, and confirm the object corresponding to the target tag as the target object.

[0086] The position acquisition unit 102a2 is used for acquiring the position information of the identification element in the image if the image contains the preset identification element; and confirming the target object from multiple objects to be confirmed according to the position information of the identification element.

[0087] The fingertip acquisition unit 102a3 is used to acquire the position information of the user's palm in the image; and acquire the position information of the user's fingertip in the image according to the position information of the user's palm in the image.

[0088] The function calculation unit 102a4 is used to calculate the intersection-and-union function value of each object to be confirmed in the image and the position information; and confirm the target object from multiple objects to be confirmed according to the intersection-and-union function value corresponding to the object to be confirmed.

[0089] The eye tracking unit 104 is used to obtain the gaze information of the user on the displayed image monitored by the eye tracking device; and to confirm the target object from a plurality of objects to be confirmed according to the gaze information.

[0090] It should be noted that those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the above-described device and each unit can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0091] The above-mentioned device can be implemented in the form of a computer program. Figure 8 The wearable device shown is running on the

[0092] The present application provides a wearable device. Figure 8 As shown, Figure 8 A schematic block diagram of a wearable device provided in an embodiment of the present application.

[0093] The wearable device may include a processor, a memory, and a network interface. The processor, the memory, and the network interface are connected via a system bus, such as an I2C (Inter-integrated Circuit) bus.

[0094] Specifically, the processor may be a micro-controller unit (MCU), a central processing unit (CPU) or a digital signal processor (DSP).

[0095] Specifically, the memory may be a Flash chip, a read-only memory (ROM) disk, an optical disk, a USB flash drive, or a mobile hard disk.

[0096] The network interface is used for network communication, such as sending assigned tasks, etc. Those skilled in the art will understand that Figure 8 The structure shown in the figure is only a block diagram of a partial structure related to the present application scheme, and does not constitute a limitation on the wearable device to which the present application scheme is applied. The specific wearable device may include more or fewer components than shown in the figure, or combine certain components, or have a different component arrangement.

[0097] The processor is used to run the computer program stored in the memory, and implement the corresponding steps in any one of the display methods provided in the embodiments of the present application when executing the computer program.

[0098] An exemplary wearable device is provided for the following steps:

[0099] The collected image is acquired and displayed.

[0100] A target object is acquired from the image.

[0101] A display frame is generated in the displayed image, and the target object is displayed in an enlarged manner in the display frame.

[0102] In some embodiments, acquiring the collected images and displaying the images include: acquiring a collected video, the video including multiple images, and displaying the images.

[0103] In some embodiments, displaying the target object in the display frame by enlarging the target object includes: acquiring a preset magnification ratio for magnifying the target object, and displaying the target object in the display frame by enlarging the target object according to the preset magnification ratio.

[0104] In some embodiments, obtaining the target object from the image includes: obtaining type information, the type information including the object type; obtaining multiple objects to be confirmed in the image according to the object type; obtaining user selection information, and confirming the target object from the multiple objects to be confirmed according to the user selection information.

[0105] In some embodiments, confirming the target object from multiple objects to be confirmed based on user selection information includes: generating and displaying multiple tags in the image based on the object type, and the tags are used to identify the objects to be confirmed in the image; obtaining object selection information generated by the user controlling the wearable device based on the displayed tags; confirming the target tag among the multiple tags based on the object selection information, and confirming the object corresponding to the target tag as the target object.

[0106] In some embodiments, confirming the target object from multiple objects to be confirmed based on user selection information includes: if the image contains the preset identification part, obtaining the position information of the identification part in the image; and confirming the target object from multiple objects to be confirmed based on the position information of the identification part.

[0107] In some embodiments, if the identification element is the fingertip of the user; obtaining the position information of the identification element in the image includes: obtaining the position information of the palm of the user in the image; and obtaining the position information of the fingertip of the user in the image based on the position information of the palm of the user in the image.

[0108] In some embodiments, confirming the target object from multiple objects to be confirmed based on the position information of the identification part includes: calculating the intersection and union function value of each object to be confirmed in the image and the position information; and confirming the target object from multiple objects to be confirmed based on the intersection and union function value corresponding to the object to be confirmed.

[0109] In some embodiments, the wearable device includes an eye tracking module; confirming the target object from multiple objects to be confirmed based on the user's selection information includes: obtaining the user's gaze information on the displayed image monitored by the eye tracking device; and confirming the target object from multiple objects to be confirmed based on the gaze information.

[0110] It should be noted that those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the computer device described above can refer to the corresponding process in the aforementioned display method, and will not be repeated here.

[0111] In an embodiment of the present application, a computer-readable storage medium is further provided, wherein the computer-readable storage medium stores a computer program, wherein the computer program includes program instructions, and the processor executes the program instructions to implement the steps of the display method provided in the above embodiment. For example, the computer program is loaded by the processor and can execute the following steps:

[0112] The collected image is acquired and displayed.

[0113] A target object is acquired from the image.

[0114] A display frame is generated in the displayed image, and the target object is displayed in an enlarged manner in the display frame.

[0115] The specific implementation of the above operations can be found in the previous embodiments, which will not be described in detail here.

[0116] The computer-readable storage medium may be an internal storage unit of the computer device of the aforementioned embodiment, such as a hard disk or memory of the computer device. The computer-readable storage medium may also be an external storage device of the computer device, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. equipped on the computer device.

[0117] Since the computer program stored in the computer-readable storage medium can execute any one of the display methods provided in the embodiments of the present application, the beneficial effects that can be achieved by any one of the display methods provided in the embodiments of the present application can be achieved. Please refer to the previous embodiments for details and will not be repeated here.

[0118] The serial numbers of the embodiments of the present application are for description only and do not represent the advantages and disadvantages of the embodiments. The above are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed in the present application, and these modifications or replacements should be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be based on the protection scope of the claims.

Claims

1. A method for displaying a target object, characterized in that: The display method is applied to a wearable device, and the display method includes: Acquire the collected image and display the image; Acquire a target object from the image; A display frame is generated in the displayed image, and the target object is displayed in an enlarged manner in the display frame.

2. The method according to claim 1, characterized in that: The wearable device includes an eye tracking module; and the step of confirming the target object from a plurality of objects to be confirmed according to the user's selection information includes: Acquiring gaze information of the user on the displayed image monitored by the eye tracking device; The target object is confirmed from a plurality of objects to be confirmed according to the gaze information.

3. The method according to claim 1, characterized in that The acquiring the target object from the image comprises: Obtaining type information, wherein the type information includes an object type; Acquire a plurality of objects to be confirmed in the image according to the object type; The user's selection information is obtained, and the target object is confirmed from a plurality of objects to be confirmed according to the user's selection information.

4. The method according to claim 3, characterized in that The step of confirming the target object from a plurality of objects to be confirmed according to the user's selection information includes: generating and displaying a plurality of marks in the image according to the object type, the marks being used to identify the object to be confirmed in the image; Acquire object selection information generated by the wearable device controlled by the user according to the displayed mark; A target mark is identified among the multiple marks according to the object selection information, and an object corresponding to the target mark is identified as the target object.

5. The method according to claim 3, characterized in that: The step of confirming the target object from a plurality of objects to be confirmed according to the user's selection information includes: If the image includes the preset identification element, obtaining the position information of the identification element in the image; The target object is confirmed from a plurality of objects to be confirmed according to the position information of the identification member.

6. The method according to claim 5, characterized in that If the identification element is a fingertip of the user, obtaining the position information of the identification element in the image includes: Acquire the position information of the user's palm in the image; The position information of the user's fingertips in the image is obtained according to the position information of the user's palm in the image.

7. The method according to claim 6, characterized in that The step of confirming the target object from a plurality of objects to be confirmed according to the position information of the identification element comprises: Calculating an intersection-over-union function value of each object to be confirmed in the image and the position information; The target object is confirmed from a plurality of objects to be confirmed according to the intersection-and-union function values ​​corresponding to the objects to be confirmed.

8. The method according to claim 1, characterized in that The enlarging and displaying the target object in the display frame includes: A preset magnification ratio of the target object is obtained, and the target object is magnified and displayed in the display frame according to the preset magnification ratio.

9. A display device for a wearable device, characterized in that: The display device comprises: An image acquisition unit, used to acquire the collected image and display the image; An object acquisition unit, used for acquiring a target object from the image; The enlarged display unit is used to generate a display frame in the displayed image and to enlarge and display the target object in the display frame.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor implements the steps of the method for displaying a target object according to any one of claims 1 to 8.

Images