Display method, device, storage medium and wearable device

Abstract

The present application discloses a display method, apparatus, storage medium and wearable device. The display method can be applied to a wearable device, and the method includes: obtaining the identity information of a user; identifying whether the user is a preset user according to the identity information; if so, obtaining the preset display parameters of the corresponding user; and displaying virtual information on the wearable device according to the preset display parameters. In the present application, the wearable device can identify the identity of the user and display virtual information according to the preset display parameters of the corresponding user. Different users can correspond to different preset display parameters, which improves the flexibility of the wearable device in displaying virtual information.

Description

Technical Field

[0001] The present application belongs to the technical field of electronic equipment, and in particular, relates to a display method, device, storage medium and wearable device. Background Art

[0002] With the development of technology, smart wearable devices have begun to emerge and gradually mature. Currently, a common type of smart wearable devices includes head-mounted smart devices, such as smart glasses, smart helmets, smart headbands, etc. These smart wearable devices can achieve powerful functions, such as superimposing virtual information on real images. However, in related technologies, wearable devices have poor flexibility in displaying virtual information. Summary of the invention

[0003] The embodiments of the present application provide a device control method, apparatus, storage medium and wearable device, which can improve the flexibility of the wearable device in displaying virtual information.

[0004] In a first aspect, an embodiment of the present application provides a display method, which is applied to a wearable device, and the method includes:

[0005] Obtain the user's identity information;

[0006] Identify whether the user is a preset user according to the identity information;

[0007] If yes, obtaining preset display parameters corresponding to the user;

[0008] On the wearable device, virtual information is displayed according to the preset display parameters.

[0009] In a second aspect, an embodiment of the present application provides a display device, which is applied to a wearable device, including:

[0010] Identification module, used to obtain the user's identity information;

[0011] A judgment module, used for identifying whether the user is a preset user according to the identity information;

[0012] an acquisition module, configured to acquire preset display parameters corresponding to the user;

[0013] The display module is used to display virtual information on the wearable device according to the preset display parameters.

[0014] In a third aspect, an embodiment of the present application provides a storage medium on which a computer program is stored. When the computer program is executed on a computer, the computer executes the method provided by the embodiment of the present application.

[0015] In a fourth aspect, an embodiment of the present application further provides a wearable device, comprising a memory and a processor, wherein the processor is used to execute the method provided in the embodiment of the present application by calling a computer program stored in the memory.

[0016] In the embodiment of the present application, the wearable device can obtain the identity information of the user; identify whether the user is a preset user based on the identity information; if so, obtain the preset display parameters corresponding to the user; and display virtual information on the wearable device based on the preset display parameters. The wearable device can display virtual information superimposed on the real image. In the embodiment of the present application, the wearable device can identify the identity of the user and display virtual information based on the preset display parameters of the corresponding user. Different users can correspond to different preset display parameters, which can meet the usage habits of different users and facilitate users to view virtual information, thereby improving the flexibility of the wearable device in displaying virtual information. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The technical solution and beneficial effects of the present application will be made apparent by describing in detail the specific implementation methods of the present application in conjunction with the accompanying drawings.

[0018] Figure 1 It is a flow chart of the device control method provided in the embodiment of the present application.

[0019] Figure 2 It is another flow chart of the device control method provided in an embodiment of the present application.

[0020] Figures 3 to 8 It is a scenario diagram of the device control method provided in an embodiment of the present application.

[0021] Fig. 9 It is a structural schematic diagram of the equipment control device provided in an embodiment of the present application.

[0022] Fig.10 It is a schematic diagram of the structure of the wearable device provided in an embodiment of the present application.

[0023] Fig.11 is another structural schematic diagram of the wearable device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0024] Please refer to the drawings, where the same component symbols represent the same components. The principle of the present application is illustrated by implementing it in an appropriate computing environment. The following description is based on the illustrated specific embodiments of the present application, which should not be considered as limiting other specific embodiments of the present application that are not described in detail herein.

[0025] It can be understood that the execution subject of the embodiments of the present application can be a wearable device such as a smart phone or smart glasses.

[0026] See also Figure 1 , Figure 1 is a flow chart of the display method provided in the embodiment of the present application. The device control method can be applied to wearable devices. The process of the device control method provided in the embodiment of the present application may include:

[0027] 101. Obtain the user's identity information.

[0028] With the development of technology, smart wearable devices have begun to emerge and gradually mature. Currently, a common type of smart wearable devices includes head-mounted smart devices, such as smart glasses, smart helmets, smart headbands, etc. These smart wearable devices can achieve powerful functions, such as superimposing virtual information on real images. However, in the related art, wearable devices have poor flexibility in displaying virtual information. For example, in the related art, when displaying virtual information, wearable devices have a unified display mode for each user.

[0029] In the embodiment of the present application, the wearable device can collect and store the identity information of different users. When different users use the wearable device, the wearable device can be the identity information of the current user.

[0030] The user's identity information can be obtained by obtaining at least one of the user's fingerprint information, iris information, voiceprint information, face information, and account password information.

[0031] In one embodiment, the wearable device may include a fingerprint recognition module, and the fingerprint recognition module may be used to obtain the user's fingerprint information. For example, if the wearable device may be a smart glasses, then the side frame of the smart glasses may be provided with a fingerprint recognition module, and the fingerprint recognition module may be used to obtain and store the user's fingerprint information.

[0032] In one embodiment, the wearable device may include an iris recognition module, which includes an iris camera, and the iris image of the user may be obtained through the iris camera. For example, the wearable device may be a pair of smart glasses, and the iris recognition module may be disposed inside the glasses frame of the smart glasses, and the iris image of the user may be obtained and stored through the iris recognition module.

[0033] It should be noted that obtaining the user's identity information may also include obtaining multiple types of the user's identity information at the same time, such as obtaining both fingerprint information and iris information.

[0034] In 102, it is identified whether the user is a preset user according to the identity information.

[0035] In an embodiment of the present application, the wearable device can obtain the identity information of the user, and identify whether the user is a preset user based on the identity information. For example, the obtained identity information can be matched with the stored identity information. If they match, the current user is the preset user. In an embodiment of the present application, the user can pre-set the display mode of virtual information according to his or her own usage habits and preferences. If the user is identified as a preset user, it means that the user has pre-set the display mode of virtual information on the wearable device.

[0036] In one embodiment, the wearable device is, for example, smart glasses, which are provided with a fingerprint recognition module. The fingerprint information of the user is obtained through the fingerprint recognition module, and the obtained fingerprint information is matched with the pre-saved fingerprint information. If they match, the current user is the preset user.

[0037] In one embodiment, the wearable device is, for example, smart glasses, which are provided with an iris recognition module. The iris recognition module includes an iris camera. The iris image of the user is obtained through the iris camera, and the obtained iris image is matched with a pre-saved iris image. If they match, the current user is the preset user.

[0038] In one embodiment, the wearable device can obtain multiple identity information of the user. For example, when the user uses the wearable device for the first time, multiple identity information of the user can be collected and obtained. Therefore, when identifying whether the user is a preset user based on the identity information, multiple identity information can be used for identification, thereby improving the success rate of identifying whether the user is a preset user.

[0039] In 103, if yes, the preset display parameters of the corresponding user are obtained.

[0040] Wearable devices such as smart glasses can achieve many functions, such as superimposing virtual information on real images. Different users have different usage habits and preferences for the display parameters of virtual information when using wearable devices, such as different requirements for the display size, color, and position of virtual information. Virtual information can be text or pictures. Users can pre-set the display parameters of virtual information that suit them according to their own usage habits and preferences.

[0041] In one embodiment, the user can set display parameters according to the type of virtual information. For example, when a user uses a wearable device such as smart glasses, when the user receives a call, instant messaging, email or push information, this information can also be superimposed on the smart glasses to prompt the user. The user can set different display parameters according to different types of information. For example, the instant messaging information or phone calls of important family members or colleagues can be displayed in the center, and a larger, red font can be displayed to facilitate timely viewing by the user. For example, the push information of some merchants can be displayed in a side position, and a smaller, light-colored font can be displayed to minimize the impact on user use.

[0042] In one embodiment, the user can set different display parameters for virtual information according to different usage scenarios. For example, when the user uses a wearable device such as smart glasses for travel, the smart glasses can display virtual information about various buildings, or when viewing an exhibition, the smart glasses can display virtual information about various exhibits. The user can customize the color and size of the font when displaying the relevant information according to his or her preferences. For another example, when the user uses a wearable device such as smart glasses to repair equipment, the smart glasses can display a variety of auxiliary virtual information to the user, including virtual instruments, parts diagrams of the equipment being repaired, etc. The user can customize the display position according to his or her usage habits for easy viewing.

[0043] The wearable device can pre-store preset display parameters of different users and associate the user's identity information with the preset display parameters. If the user is identified as a preset user, the preset display parameters of the corresponding user are obtained.

[0044] In 104, virtual information is displayed on the wearable device according to preset display parameters.

[0045] After obtaining the preset display parameters of the corresponding user, the user can display virtual information according to the preset display parameters of the corresponding user when using the wearable device. For example, the first user is the preset user. When the first user uses the wearable device, if the first user receives a call from an important family member or colleague, the caller information is displayed in the center according to the preset display parameters of the first user, and the font is larger; if the merchant receives a push message, the caller information is displayed in the lower right corner according to the preset display parameters of the first user, and the font is smaller. For another example, the second user is also a preset user. When the second user uses the wearable device, if the second user receives a call from an important family member or colleague, the caller information is displayed in the middle of the top according to the preset display parameters of the second user, and the font color is darker to prompt the user in time; if the merchant receives a push message, the caller information is displayed in the lower left corner according to the preset display parameters of the second user, and the font color is lighter.

[0046] In the embodiment of the present application, different users can pre-set different display parameters of virtual information according to their own usage habits and preferences. In the embodiment of the present application, the wearable device can identify the identity of the user and display virtual information according to the preset display parameters of the corresponding user. Different users can correspond to different preset display parameters. Therefore, the wearable device in the embodiment of the present application can provide users with a personalized display method, and the displayed virtual information can meet the usage habits of different users and also meet the usage preferences of different users, thereby improving the flexibility of the wearable device in displaying virtual information and improving the user experience.

[0047] See also Figure 2 , Figure 2 Another schematic diagram of a process flow of a device control method provided in an embodiment of the present application. The process flow of the device control method provided in an embodiment of the present application may include:

[0048] In 201, the user's identity information is obtained.

[0049] In the embodiment of the present application, the wearable device can collect and store the identity information of different users. When different users use the wearable device, the wearable device can be the identity information of the current user.

[0050] The user's identity information can be obtained by obtaining at least one of the user's fingerprint information, iris information, voiceprint information, face information, and account password information.

[0051] In one embodiment, the wearable device may include an iris recognition module, which includes an iris camera, and the iris image of the user may be obtained through the iris camera. For example, the wearable device may be a pair of smart glasses, and the iris recognition module may be disposed inside the glasses frame of the smart glasses, and the iris image of the user may be obtained and stored through the iris recognition module.

[0052] It should be noted that the embodiments of the present application do not limit how to obtain the user's identity information. In addition, the user's identity information can also be obtained by simultaneously obtaining multiple types of user's identity information, such as obtaining both fingerprint information and iris information.

[0053] In 202, it is identified whether the user is a preset user according to the identity information.

[0054] In an embodiment of the present application, the wearable device can obtain the identity information of the user, and identify whether the user is a preset user based on the identity information. For example, the obtained identity information can be matched with the stored identity information. If they match, the current user is the preset user. In an embodiment of the present application, the user can pre-set the display parameters of the virtual information according to his or her own usage habits and preferences. If the user is identified as a preset user, it means that the user has pre-set the display parameters of the virtual information on the wearable device.

[0055] In one embodiment, the wearable device is, for example, a smart glasses, and the smart glasses are provided with an iris recognition module, and the iris recognition technology is used to identify whether the current user is a preset user. The iris image recognition technology may include the following four steps: First, obtaining an iris image: photographing the entire eye of a person through a camera, and performing image preprocessing on the photographed eye image. Second, image preprocessing: performing the following processing on the acquired iris image to meet the requirements of extracting iris features: iris positioning: determining the positions of the inner circle, outer circle and quadratic curve in the image, wherein the inner circle is the boundary between the iris and the pupil, the outer circle is the boundary between the iris and the sclera, and the quadratic curve is the boundary between the iris and the upper and lower eyelids; iris image normalization: adjusting the size of the iris in the image to a fixed size set by the recognition system; image enhancement: performing brightness, contrast and smoothness processing on the normalized image to improve the recognition rate of iris information in the image. Third, feature extraction: extracting feature point information of the iris image from the iris image using a specific algorithm and encoding it. Fourth, feature matching: the feature codes obtained by feature extraction are matched one by one with the iris image feature codes in the database to determine whether there is an identical iris image, thereby achieving the purpose of user identification. If they match, it means that the user is the preset user. If there is no matching iris image, it means that the user is not the preset user.

[0056] In one embodiment, the wearable device may include an eye recognition module. When the user is using the wearable device, when no image is displayed, the eye recognition module can obtain the user's line of sight direction. It can be understood that when a person's eyes look in different directions, there will be subtle changes in the eyes, such as the position and direction of the pupil center will change. The wearable device can extract these changes through image capture or scanning, and thus obtain the user's line of sight direction, that is, the position of the user's eye gaze point, based on these changes in the position and direction of the pupil center.

[0057] In one embodiment, a wearable device such as smart glasses is provided with an identification module in its inner frame, and the eyeball identification module is designed with a micro directional light source (e.g., an infrared LED) and a sensor (e.g., an infrared camera). Under the reflection of infrared light, the infrared camera obtains an image of the human eye. First, the human eye area is determined based on the human eye image. Secondly, the pupil area is extracted. Specifically, the grayscale information of the image is analyzed. The color of the pupil position is darker, the black pixels are concentrated in one area, the brightness of the pupil edge is higher than that of the pupil, and there is a bright spot in the center of the pupil. Thirdly, the pupil edge is fitted, and the elliptical equation can be used to fit the shape of the pupil and determine the center of the eyeball at the same time. When the human eye looks in different directions, the position direction of the pupil center is different. Finally, the direction of the line of sight of the human eye is determined based on the position of the eyeball center.

[0058] The eye recognition module can obtain multiple sight directions of the user within a preset time period, such as one day, one week or one month, etc. The specific time can be set as needed, and the embodiment of the present application is not limited. The embodiment of the present application determines the sight direction with the longest cumulative stay time from multiple sight directions as the target sight direction; it can be understood that the sight direction with the longest cumulative stay time is determined from multiple sight directions, which means that the user is accustomed to or prefers to view information in this sight direction, so this sight direction is used as the target sight direction. According to the target sight direction, the target display position of the virtual information is determined on the wearable device; the virtual information displayed at the target display position is set to the preset display parameters of the corresponding user. Therefore, the embodiment of the present application does not require the user to set the preset display parameters of the virtual information by himself. The wearable device can automatically obtain the user's eye habits and display the virtual information according to the user's eye habits to improve the user experience.

[0059] In 203, if the user is a preset user, the preset display parameters of the corresponding user are obtained.

[0060] Wearable devices such as smart glasses can achieve many functions, such as superimposing virtual information on real images. Different users have different usage habits and preferences for the display parameters of virtual information when using wearable devices, such as different requirements for the display size, color, and position of virtual information. Virtual information can be text or pictures. Users can pre-set the display parameters of virtual information that suit them according to their own usage habits and preferences.

[0061] In one embodiment, the user can set display parameters according to the type of virtual information. For example, when a user uses a wearable device such as smart glasses, when the user receives a call, instant messaging, email or push information, this information can also be superimposed on the smart glasses to prompt the user. The user can set different display parameters according to different types of information. For example, the instant messaging information or phone calls of important family members or colleagues can be displayed in the center, and a larger, red font can be displayed to facilitate timely viewing by the user. For example, the push information of some merchants can be displayed in a side position, and a smaller, light-colored font can be displayed to minimize the impact on user use.

[0062] In one embodiment, the user can set different display modes for virtual information according to different usage scenarios. For example, when the user uses a wearable device such as smart glasses for travel, the smart glasses can display virtual information about various buildings, or when viewing an exhibition, the smart glasses can display virtual information about various exhibits. The user can customize the color and size of the font when displaying the relevant information according to his or her preferences. For another example, when the user uses a wearable device such as smart glasses to repair equipment, the smart glasses can display a variety of auxiliary virtual information to the user, including virtual instruments, parts diagrams of the equipment being repaired, etc. The user can customize the display position according to his or her usage habits for easy viewing.

[0063] The wearable device can pre-store preset display parameters of different users and associate the user's identity information with the preset display parameters. If the user is identified as a preset user, the preset display parameters of the corresponding user are obtained.

[0064] In 204 , virtual information is displayed on the wearable device according to preset display parameters.

[0065] After obtaining the preset display parameters of the corresponding user, the user can display virtual information according to the preset display parameters of the corresponding user when using the wearable device. For example, the first user is the preset user. When the first user uses the wearable device, if the first user receives a call from an important family member or colleague, the caller information is displayed in the center according to the preset display parameters of the first user, and the font is larger; if the merchant receives a push message, the caller information is displayed in the lower right corner according to the preset display parameters of the first user, and the font is smaller. For another example, the second user is also a preset user. When the second user uses the wearable device, if the second user receives a call from an important family member or colleague, the caller information is displayed in the middle of the top according to the preset display parameters of the second user, and the font color is darker to prompt the user in time; if the merchant receives a push message, the caller information is displayed in the lower left corner according to the preset display parameters of the second user, and the font color is lighter.

[0066] In 205 , if the user is not a preset user, the user is prompted whether to set display parameters.

[0067] If the user is not a preset user, it means that the preset display parameters corresponding to the user are not stored on the wearable device. For example, if the user uses the wearable device for the first time, or the user has not set the display parameters when using the wearable device before, the user can be prompted whether to set the display parameters. The user can set the display parameters according to his or her own usage habits and preferences, such as setting the display parameters of virtual information, so that the display method of virtual information conforms to the user's usage habits and preferences, rather than the display method of virtual information being the same for every user.

[0068] In one embodiment, if the user is not a preset user and the user does not set display parameters, the wearable device can obtain the user's current line of sight direction when displaying virtual information, determine the display position of the virtual information on the wearable device according to the line of sight direction, and display the virtual information at the display position. It can be understood that by obtaining the user's current line of sight direction and automatically displaying the virtual information in the user's line of sight direction, the user can directly and quickly see the virtual information without missing important virtual information.

[0069] In one embodiment, the importance of the virtual information to be displayed can be obtained. If the importance is greater than a preset importance threshold, the virtual information to be displayed is displayed on the wearable device in the current line of sight direction or in the middle position. If the importance is less than the preset importance threshold, the information to be displayed is displayed on the wearable device in an area outside the current line of sight direction or at the side.

[0070] It should be noted that if the user is not a preset user and the user does not set the display parameters, the wearable device may also display the virtual information according to the default display parameters.

[0071] In 206 , if a user instruction to set display parameters is received, a setting interface is displayed.

[0072] If the user confirms that he wants to set the display parameters, the setting interface will be displayed on the wearable device. In the display setting interface, the user can set the display parameters of the virtual information according to his own usage habits and preferences. The user can set the display method according to the type, usage scenario or importance of the virtual information. The virtual information includes text or pictures and other information. The display parameters of the virtual information include but are not limited to the display position, size, font and color, etc. It can also be the background color or various effects such as various glows or shadows.

[0073] In 207, the setting information input in the setting interface is obtained, and preset display parameters corresponding to the user are formed according to the setting information.

[0074] If the user confirms that he wants to set the display parameters, and the user sets the display parameters for the virtual information in the setting interface, the wearable device obtains the setting information entered by the user in the setting interface, and forms the preset display parameters of the corresponding user according to the setting information. For example, the first user sets that when a family member calls, the incoming call information is displayed in the center position, with a larger, red font, and when a push message is received from some merchants, the push message is displayed in a side position, with a smaller, black font, and the setting information entered by the first user is formed into the preset display parameters corresponding to the first user. For another example, the second user sets that when an important family member calls, the incoming call information is displayed in the upper position of the display area, with a larger, green font, and when a push message is received from some merchants, the push message is displayed in the lower position, with a smaller, gray font, and the setting information entered by the second user is formed into the preset display parameters corresponding to the second user.

[0075] After setting the display parameters, the wearable device can associate and store the user's identity information with the preset display parameters. Thus, when the first user or the second user uses the wearable device, the wearable device can identify the user's identity and display virtual information according to the preset display parameters of the corresponding user.

[0076] In the embodiment of the present application, the wearable device can identify the identity of the user. When the user is a preset user, virtual information is displayed according to the preset display parameters of the corresponding user; when the user is not a preset user, that is, the user does not have corresponding preset display parameters, the user can be prompted to set the display parameters according to his own usage habits and preferences, or the user's eye habits can be automatically obtained, and the virtual information is displayed according to the user's eye habits. In the embodiment of the present application, different users can correspond to different preset display parameters, so the wearable device can provide users with personalized display methods, and the displayed virtual information can meet the usage habits of different users and meet the usage preferences of different users, thereby improving the flexibility of the wearable device in displaying virtual information and improving the user's experience.

[0077] See also Figures 3 to 7 , Figures 3 to 7 A schematic diagram of a scene of a display method provided in an embodiment of the present application.

[0078] In the embodiment of the present application, the wearable device may be, for example, smart glasses. Smart glasses may collect and store identity information of different users. When different users use the smart glasses, the smart glasses may obtain the identity information of the current user and identify whether the user is a preset user based on the identity information. For example, the obtained identity information may be matched with the stored identity information. If they match, the current user is the preset user.

[0079] See also Figure 3 In one embodiment, a fingerprint recognition module can be set on the side frame of the smart glasses, and the fingerprint recognition module can collect and store the user's fingerprint information. When the user uses the smart glasses, the acquired fingerprint information is matched with the pre-stored fingerprint information. If they match, the current user is the preset user. If the user is identified as the preset user, it means that the user has pre-set the display parameters of the virtual information on the wearable device.

[0080] See also Figure 4 In one embodiment, an iris recognition module can be set inside the glasses frame of the smart glasses. The iris recognition module can collect and store the user's iris image. When the user uses the smart glasses, the acquired iris image is matched with the pre-stored iris image. If they match, the current user is the preset user.

[0081] In an embodiment of the present application, the smart glasses may pre-store preset display parameters of different users, and if the user is identified as a preset user, the preset display parameters of the corresponding user are obtained.

[0082] Smart glasses can achieve many functions, such as superimposing virtual information on real images. Different users have different usage habits and preferences for display parameters of virtual information when using smart glasses, such as different requirements for display size, color, position, etc. of virtual information. In the embodiment of the present application, users can pre-set display parameters of virtual information that suit them according to their own usage habits and preferences.

[0083] After obtaining the preset display parameters of the corresponding user, the user can display virtual information according to the preset display parameters of the corresponding user when using the smart glasses. Figure 5 As shown, for example, the first user is a preset user. When the first user uses the smart glasses, if he receives a call from an important family member or colleague, the caller information will be displayed in the center according to the preset display parameters of the first user, and the font size will be larger; if he receives a push message from a merchant, the push message will be displayed in the lower right corner according to the preset display parameters of the first user, and the font size will be smaller. Figure 6 As shown, the second user is also a preset user. When the second user uses the smart glasses, if he receives a call from an important family member or colleague, the incoming call information will be displayed in the upper middle position according to the preset display parameters of the second user, and the font color will be darker to prompt the user in time; if the merchant receives a push message, the push message will be displayed in the lower left corner according to the preset display parameters of the second user, and the font color will be lighter.

[0084] In an embodiment of the present application, if the user is not a preset user, the user is prompted whether to set the display parameters. If the user is not a preset user, it means that the preset display parameters corresponding to the user are not stored on the smart glasses. For example, if the user uses the smart glasses for the first time, or the user has not set the display parameters when using the smart glasses before, the user can be prompted whether to set the display parameters. The display parameters of the virtual information include but are not limited to the display position, size, font and color, etc., and can also be background color or various light or shadow effect settings. Among them, the virtual information can be text or pictures and other information, so that the display of the virtual information conforms to the user's usage habits and preferences, rather than the display parameters of the virtual information being the same for every user.

[0085] like Figure 7 As shown, when the user confirms that he wants to set the display parameters, and the user sets the display parameters for the virtual information in the setting interface, the smart glasses obtain the setting information input by the user in the setting interface, and form the preset display parameters for the corresponding user according to the setting information, and associate and store the user identity information and the preset display parameters. Afterwards, when the user uses the smart glasses, the smart glasses can identify the user identity and display the virtual information according to the preset display parameters for the corresponding user.

[0086] like Figure 8 As shown, in one embodiment, the smart glasses may include an eye recognition module. When the user is using the wearable device, when no image is displayed, the eye recognition module can obtain the user's line of sight direction. It can be understood that when a person's eyes look in different directions, there will be subtle changes in the eyes, such as the position and direction of the pupil center will change. The wearable device can extract these changes through image capture or scanning, and thus obtain the user's line of sight direction, that is, the position of the user's glasses gaze point, based on such changes in the position and direction of the pupil center.

[0087] The eye recognition module can obtain multiple sight directions of the user within a preset time period, such as one day, one week or one month, etc. The specific time can be set as needed and is not limited by the embodiments of the present application. Determine the sight direction with the longest cumulative stay time from multiple sight directions as the target sight direction; it can be understood that determining the sight direction with the longest cumulative stay time from multiple sight directions indicates that the user is accustomed to or prefers to view information in this sight direction, so this sight direction is used as the target implementation direction. According to the target sight direction, determine the target display position of the virtual information on the wearable device; set the virtual information displayed at the target display position to the preset display parameters of the corresponding user. Therefore, there is no need for the user to set the preset display parameters of the virtual information by himself. The wearable device can automatically obtain the user's eye habits and display the virtual information according to the user's eye habits, thereby improving the user experience.

[0088] If the user is not a preset user and the user does not set display parameters, the wearable device may also display virtual information according to the default display parameters.

[0089] See also Fig. 9 , Fig. 9 The display device 300 can be applied to a wearable device, and the display device 300 can include: an identity acquisition module 301, an identity recognition module 302, an acquisition module 303 and a display device 304.

[0090] The identity acquisition module 301 is used to: obtain the identity information of the user;

[0091] The identity recognition module 302 is used to: identify whether the user is a preset user according to the identity information;

[0092] The acquisition module 303 is used to: if yes, obtain the preset display parameters of the corresponding user;

[0093] The display module 304 is used to display virtual information on the wearable device according to preset display parameters.

[0094] In one implementation, the acquisition module 303 may be used to:

[0095] At least one of the display position, size, font, and color of the virtual information of the corresponding user is obtained.

[0096] In one embodiment, the display device further includes an eye recognition module 305, which can be used to:

[0097] Acquire multiple sight directions of the user within a preset time period;

[0098] Determine the sight direction with the longest cumulative stay time from multiple sight directions as the target sight direction;

[0099] Determine the target display position of the virtual information on the wearable device according to the target sight direction;

[0100] The target display position is set to the preset display parameter of the corresponding user.

[0101] In one implementation, the acquisition module 303 may be used to:

[0102] If not, obtain the user's current sight direction;

[0103] Determine the display position of the virtual information on the wearable device according to the line of sight direction;

[0104] Display virtual information at the display location.

[0105] In one implementation, the acquisition module 303 may be used to:

[0106] If the user is not a preset user, the user is prompted whether to set display parameters;

[0107] If a user selects to set display parameters, the setting interface is displayed;

[0108] The setting information input in the setting interface is obtained, and preset display parameters corresponding to the user are formed according to the setting information.

[0109] In one implementation, the identity acquisition module 301 may be used to:

[0110] Obtain at least one of the user's fingerprint information, iris information, voiceprint information, face information, and account password information.

[0111] The application embodiment provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed on a computer, the computer executes the process in the device control method provided in this embodiment.

[0112] An embodiment of the present application also provides a wearable device, including a memory and a processor, wherein the processor is used to execute the process in the device control method provided in this embodiment by calling a computer program stored in the memory.

[0113] For example, the wearable device may be a mobile terminal such as smart glasses or a smart phone. Fig.10 , Fig.10 A schematic diagram of the structure of a wearable device provided in an embodiment of the present application.

[0114] The wearable device 400 includes a processor 401 , a memory 402 , and a display screen 403 .

[0115] The processor 401 is the control center of the wearable device 400. It uses various interfaces and lines to connect the various parts of the entire wearable device. By running or calling the computer program stored in the memory 402, and calling the data stored in the memory 402, it executes various functions of the wearable device and processes data, thereby monitoring the wearable device as a whole.

[0116] The memory 402 may be used to store computer programs and data. The computer programs stored in the memory 402 include instructions that can be executed in the processor. The computer programs may constitute various functional modules. The processor 401 executes various functional applications and data processing by calling the computer programs stored in the memory 402.

[0117] The display screen 403 may be used to display information input by a user or information provided to a user and various graphical user interfaces of the wearable device, which may be composed of images, texts, icons, videos and any combination thereof.

[0118] In this embodiment, the processor 401 in the wearable device 400 loads instructions corresponding to the processes of one or more computer programs into the memory 402 according to the following steps, and the processor 401 runs the computer program stored in the memory 402 to implement various functions:

[0119] Obtain the user's identity information;

[0120] Identify whether the user is a preset user based on the identity information;

[0121] If yes, then obtain the preset display parameters of the corresponding user;

[0122] On the wearable device, virtual information is displayed according to preset display parameters.

[0123] In some embodiments, see Fig.11 , Fig.11 A second structural diagram of a wearable device provided in an embodiment of the present application. The wearable device 400 further includes: a radio frequency circuit 404, a control circuit 405, an input unit 406, an audio circuit 407, a sensor 408, and a power supply 409. The processor 401 is electrically connected to the display screen 403, the radio frequency circuit 404, the control circuit 405, the input unit 406, the audio circuit 407, the sensor 408, and the power supply 409, respectively.

[0124] The radio frequency circuit 404 is used to send and receive radio frequency signals to communicate with network devices or other wearable devices through wireless communication.

[0125] The control circuit 405 is electrically connected to the display screen 403 and is used to control the display screen 403 to display information.

[0126] The input unit 406 can be used to receive input numbers, character information or user feature information (such as fingerprints), and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control. The input unit 406 can include a fingerprint recognition module.

[0127] The audio circuit 407 can provide an audio interface between the user and the wearable device through a speaker and a microphone. The audio circuit 407 includes a microphone. The microphone is electrically connected to the processor 401. The microphone is used to receive voice information input by the user.

[0128] The sensor 408 is used to collect external environment information. The sensor 408 may include one or more sensors such as an environment brightness sensor, an acceleration sensor, and a gyroscope.

[0129] The power supply 409 is used to supply power to various components of the wearable device 400. In some embodiments, the power supply 409 can be logically connected to the processor 401 through a power management system, so that the power management system can manage charging, discharging, power consumption and other functions.

[0130] Although not shown in the figure, the wearable device 400 may also include a camera, a Bluetooth module, a fingerprint recognition module, an iris recognition module, a face recognition module, a voiceprint recognition module, an eye recognition module, etc., which will not be repeated here.

[0131] In this embodiment, the processor 401 in the wearable device 400 loads instructions corresponding to the processes of one or more computer programs into the memory 402 according to the following steps, and the processor 401 runs the computer program stored in the memory 402 to implement various functions:

[0132] In one implementation, in acquiring the preset display parameters of the corresponding user, the processor 401 executes to acquire at least one of the display position, size, font, and color of the virtual information of the corresponding user.

[0133] In one implementation, before obtaining the identity information of the user, the processor 401 further executes obtaining multiple sight lines of the user within a preset time period;

[0134] Determine the sight direction with the longest cumulative stay time from multiple sight directions as the target sight direction;

[0135] Determine the target display position of the virtual information on the wearable device according to the target sight direction;

[0136] The target display position is set to the preset display parameter of the corresponding user.

[0137] In one implementation, after identifying whether the user is a preset user according to the identity information, the processor 401 further executes, if the user is not a preset user, obtaining the user's current sight direction;

[0138] Determine the display position of the virtual information on the wearable device according to the line of sight direction;

[0139] Display virtual information at the display location.

[0140] In one implementation, after identifying whether the user is a preset user according to the identity information, the processor 401 further executes, if the user is not a preset user, prompting the user whether to set display parameters;

[0141] If a user selects to set display parameters, the setting interface is displayed;

[0142] The setting information input in the setting interface is obtained, and preset display parameters corresponding to the user are formed according to the setting information.

[0143] In one implementation, in obtaining the user's identity information, the processor 401 executes at least one of obtaining the user's fingerprint information, iris information, voiceprint information, face information, and account password information.

[0144] In the above embodiments, the description of each embodiment has its own focus. For the part that is not described in detail in a certain embodiment, please refer to the detailed description of the device control method above, and will not be repeated here.

[0145] The device control apparatus provided in the embodiment of the present application belongs to the same concept as the device control method in the above embodiment. Any method provided in the device control method embodiment can be run on the device control apparatus. The specific implementation process is detailed in the device control method embodiment and will not be repeated here.

[0146] It should be noted that, for the device control method of the embodiment of the present application, ordinary technicians in this field can understand that all or part of the process of implementing the device control method of the embodiment of the present application can be completed by controlling the relevant hardware through a computer program, and the computer program can be stored in a computer-readable storage medium, such as stored in a memory, and executed by at least one processor, and the execution process may include the process of the embodiment of the device control method. Among them, the storage medium can be a disk, an optical disk, a read-only memory (ROM), a random access memory (RAM), etc.

[0147] For the device control device of the embodiment of the present application, each functional module can be integrated into a processing chip, or each module can exist physically separately, or two or more modules can be integrated into one module. The above-mentioned integrated module can be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it can also be stored in a computer-readable storage medium, such as a read-only memory, a disk or an optical disk.

[0148] The above is a detailed introduction to a device control method, apparatus, storage medium and wearable device provided in the embodiments of the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea; at the same time, for technical personnel in this field, according to the ideas of the present application, there will be changes in the specific implementation methods and application scopes. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A display method, applied to a wearable device, characterized in that: The method comprises: Obtaining identity information of a user using the wearable device; Identifying whether the user is a preset user according to the identity information, wherein the preset user has set preset display parameters of virtual information on the wearable device, wherein the preset display parameters are at least one of display position, size, font, and color of the virtual information; If so, obtaining a preset display parameter corresponding to the preset user, setting different preset display parameters for different types of virtual information, or setting different preset display parameters for different usage scenarios; On the wearable device, displaying virtual information according to the preset display parameters, so that the display methods of virtual information corresponding to different preset users are different; If the user is not the preset user, prompt the user whether to set display parameters; If the display parameters are not set, the importance of the virtual information to be displayed is obtained. If the importance is greater than the preset importance threshold, the virtual information to be displayed is displayed on the wearable device in the current line of sight direction or in the middle position. If the importance is less than the preset importance threshold, the information to be displayed is displayed on the wearable device in an area outside the current line of sight direction or at the side.

2. The display method according to claim 1, characterized in that: Before obtaining the identity information of the user using the wearable device, the method further includes: Acquire multiple sight directions of the user within a preset time period; Determine the sight direction with the longest cumulative stay time from the plurality of sight directions as the target sight direction; Determining a target display position of virtual information on the wearable device according to the target sight line direction; The target display position is set to a preset display parameter corresponding to the user.

3. The display method according to claim 1, characterized in that: After identifying whether the user is a preset user according to the identity information, the method further includes: If the user is not the preset user, obtaining the user's current sight direction; Determining a display position of virtual information on the wearable device according to the line of sight direction; The virtual information is displayed at the display position.

4. The display method according to claim 1, characterized in that: After identifying whether the user is a preset user according to the identity information, the method further includes: If the user is not the preset user, prompt the user whether to set display parameters; If a user selects to set display parameters, the setting interface is displayed; The setting information input in the setting interface is acquired, and preset display parameters corresponding to the user are formed according to the setting information.

5. The display method according to claim 1, characterized in that: The obtaining of identity information of a user using the wearable device includes: Obtain at least one of the user's fingerprint information, iris information, voiceprint information, face information, and account password information.

6. A display device, applied to a wearable device, characterized in that: The device comprises: An identity acquisition module, used to acquire identity information of a user using the wearable device; an identity recognition module, configured to recognize whether the user is a preset user according to the identity information, wherein the preset user has set preset display parameters of virtual information on the wearable device, wherein the preset display parameters are at least one of display position, size, font, and color of the virtual information; an acquisition module, for acquiring, if yes, a preset display parameter corresponding to the preset user, setting different preset display parameters for different types of virtual information, or setting different preset display parameters for different usage scenarios; The display module is used to display virtual information on the wearable device according to the preset display parameters, so that the display methods of virtual information corresponding to different preset users are different; if the user is not the preset user, the user is prompted whether to set the display parameters; if the display parameters are not set, the importance of the virtual information to be displayed is obtained, and if the importance is greater than the preset importance threshold, the virtual information to be displayed is displayed on the wearable device in the current line of sight direction or in the middle position; if the importance is less than the preset importance threshold, the information to be displayed is displayed on the wearable device in an area outside the current line of sight direction or at the side.

7. The display device according to claim 6, characterized in that: The display device further includes an eye recognition module, and the eye recognition module is used to: Acquire multiple sight directions of the user within a preset time period; Determine the sight direction with the longest cumulative stay time from the plurality of sight directions as the target sight direction; Determining a target display position of virtual information on the wearable device according to the target sight line direction; The target display position is set to a preset display parameter corresponding to the user.

8. A storage medium having a computer program stored thereon, characterized in that: When the computer program is executed on a computer, the computer is caused to execute the method according to any one of claims 1 to 5.

9. A wearable device, comprising a memory and a processor, characterized in that: The processor is configured to execute the method according to any one of claims 1 to 5 by calling the computer program stored in the memory.

Images