Information display method, head-mounted device and storage medium
By integrating the face recognition function in the head-mounted device, and obtaining and displaying information matching the target face image, the problem of single information display of existing head-mounted devices is solved, achieving a more intelligent and efficient information acquisition experience.
Patent Information
- Application Number
- CN202411998520.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-31
- Publication Date
- 2025-05-06
AI Technical Summary
Existing head-mounted devices are relatively single in terms of information display and lack intelligent processing, making it difficult to meet users' information acquisition needs in social and work scenarios.
The face is detected and recognized by the camera component of the head-mounted device, the first target information matching the target face image is obtained, and it is associated with the target face image to display in the display interface.
It realizes that when wearing a head-mounted device, information related to specific faces is obtained and displayed through face recognition, which reduces the user's memory burden, improves the intelligence of information display, and enhances the user's information acquisition efficiency in social and work scenarios.
Smart Images

Figure CN119937785A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of information display technology, and in particular to an information display method, a head-mounted device, and a storage medium. Background Art
[0002] Compared with electronic devices such as mobile phones, computers, and smart watches, head-mounted devices are more convenient. When the wearer wears a head-mounted device, he or she can directly obtain various information within the field of vision. However, the current head-mounted devices display information in a relatively simple way. How to improve the intelligence of head-mounted devices' information display is an urgent problem to be solved. Summary of the invention
[0003] The main purpose of this application is to provide an information display method, a head-mounted device and a storage medium, aiming to improve the intelligence of information display of the head-mounted device.
[0004] In a first aspect, the present application provides an information display method, the information display method comprising the following steps:
[0005] Obtaining a current face image recognized by the camera assembly of the head mounted device;
[0006] When detecting that the current facial image is a target facial image, acquiring first target information matching the target facial image;
[0007] The first target information and the target facial image are associated and displayed on a display interface of the head mounted device.
[0008] In some embodiments, when the current facial image is detected to be a target facial image, obtaining first target information matching the target facial image includes:
[0009] When detecting that the current facial image is a target facial image, determining the number of the target facial images;
[0010] If there are at least two target face images, first target information matching the target face image corresponding to the minimum target distance is obtained, wherein the target distance is the distance between the position of the target face image and the preset target position.
[0011] In some embodiments, the associating and displaying the first target information and the target face image in a display interface of the head mounted device includes:
[0012] Displaying the first target information at a position where the distance between the display interface and the target face image is less than a preset distance threshold;
[0013] Alternatively, the first target information is displayed in a first preset area of the display interface, and the first target information is associated with the target facial image through a guide mark.
[0014] In some embodiments, the associating and displaying the first target information and the target face image in a display interface of the head mounted device includes:
[0015] When the target facial image is located in a second preset area of the display interface, the first target information and the target facial image are associated and displayed in the display interface.
[0016] In some embodiments, the method further comprises:
[0017] In the case where it is identified that the current facial image does not belong to the target facial image, second target information corresponding to the current facial image is obtained and the second target information is stored.
[0018] In some embodiments, the step of obtaining second target information corresponding to the current face image when it is recognized that the current face image does not belong to the target face image includes at least one of the following:
[0019] Acquire voice information input for the current face image, and store the voice information as second target information corresponding to the current face image; or
[0020] Acquire text information input for the current face image, and store the text information as second target information corresponding to the current face image.
[0021] In some embodiments, the acquiring first target information matching the target face image includes:
[0022] Acquire second target information stored corresponding to the target face image;
[0023] The first target information is determined according to the second target information, wherein an amount of information of the first target information is less than or equal to an amount of information of the second target information.
[0024] In some embodiments, the method further comprises:
[0025] When the duration for which the camera component fails to recognize a facial image is greater than a preset duration, the camera component is turned off.
[0026] In a second aspect, a head-mounted device is provided, characterized in that the head-mounted device comprises a processor, a memory, and a computer program stored in the memory and executable by the processor, wherein when the computer program is executed by the processor, the steps of the information display method described in any one of the embodiments of the present application are implemented.
[0027] In a third aspect, a computer-readable storage medium is characterized in that a computer program is stored on the computer-readable storage medium, wherein when the computer program is executed by a processor, the steps of the information display method described in any one of the embodiments of the present application are implemented.
[0028] The present application provides an information display method, a head-mounted device, and a storage medium. The present application obtains a current face image recognized by the camera component of the head-mounted device; when the current face image is detected as a target face image, obtains first target information matching the target face image; and displays the first target information and the target face image in association with each other in the display interface of the head-mounted device. The face is detected and recognized by the camera component of the head-mounted device, the first target information corresponding to the face is determined, and the first target information is displayed in association with the face. This enables the wearer to observe a specific face while wearing the head-mounted device, and the information pre-stored for the face is displayed in correspondence with the face, so that the wearer can obtain information related to the face, which reduces the wearer's memory in social, work, and other scenarios, allowing the wearer to focus on the conversation occurring in the current environment, thereby improving the intelligence of the information display of the head-mounted device. BRIEF DESCRIPTION OF THE DRAWINGS
[0029] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.
[0030] Figure 1 A flowchart of an information display method provided in one embodiment of the present application;
[0031] Figure 2 A reference schematic diagram for displaying first target information provided by an embodiment of the present application;
[0032] Figure 3 Another reference schematic diagram for displaying first target information provided by an embodiment of the present application;
[0033] Figure 4 is a schematic diagram of an information display device provided by an embodiment of the present application;
[0034] Figure 5 This is a schematic block diagram of the structure of a wearable device involved in one embodiment of the present application. DETAILED DESCRIPTION
[0035] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0036] The flowcharts shown in the accompanying drawings are only examples and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps may also be decomposed, combined or partially merged, so the actual execution order may change according to actual conditions.
[0037] Embodiments of the present application provide an information display method, a head-mounted device, and a computer-readable storage medium.
[0038] In conjunction with the accompanying drawings, some embodiments of the present application are described in detail below. In the absence of conflict, the following embodiments and features in the embodiments can be combined with each other.
[0039] Please refer to Figure 1 , Figure 1 A flowchart of an information display method provided for an embodiment of the present application. The information display method can be used in a head-mounted device to detect and recognize a human face through a camera component of the head-mounted device, determine first target information corresponding to the human face, and associate the first target information with the human face for display. The head-mounted device can be smart glasses, smart helmets, etc., such as AR glasses, AR helmets, etc.
[0040] like Figure 1 As shown, the information display method includes steps S101 to S103.
[0041] Step S101: Acquire a current face image recognized by the camera assembly of the head mounted device.
[0042] Exemplarily, the head-mounted device may be a smart device that implements a display function through a near-eye display component. In the head-mounted device, a camera component is provided. When a user wears the head-mounted device, the head-mounted device can obtain images of the environment around the user through the camera component. For example, smart glasses can use a camera to capture the real environment observed by the wearer through the lenses. The camera component may be a camera and / or other sensors that can detect human faces. The near-eye display component is a component that allows the user to display relevant information in front of the user's eyes when wearing the head-mounted device. The composition of the near-eye display component can be described in the relevant technology and will not be described in detail in this embodiment.
[0043] Exemplarily, the information display method provided in the embodiment of the present application is used to display information related to a specific face. To achieve this, the head-mounted device first needs to determine whether there is a face image in the wearer's field of view. Therefore, the head-mounted device recognizes the current face image through the camera component. Specifically, the face detection can be performed on the image recognized by the camera component through a face recognition algorithm. The face recognition algorithm can be, for example, a face recognition classifier in OpenCV. It can be understood that the camera component may or may not perform a shooting operation during the process of recognizing a face image, similar to the process of taking a photo, before the shooting command is triggered, the camera component can locate the face within the shooting range, that is, the face image recognized by the camera component in the embodiment of the present application can be a face recognized by the camera component, or a face image captured by the camera component.
[0044] In some implementations, obtaining the current face image recognized by the camera assembly of the head mounted device includes:
[0045] When the camera assembly recognizes a plurality of candidate facial images, obtaining distance information corresponding to each of the candidate facial images, wherein the distance information is used to represent the distance between the location of the candidate facial image and a preset reference location;
[0046] A current face image is determined from each of the candidate face images according to the distance information, wherein the distance between the position of the current face image and the preset reference position is less than a first preset distance threshold.
[0047] For example, in some special scenarios, such as crowded places, the camera component may recognize multiple candidate facial images at the same time. The amount of calculation required to determine whether these candidate facial images have matching first target information is large, which may easily cause a waste of computing resources of the head-mounted device. To avoid this situation, the head-mounted device can filter out the current facial image based on the distance between the location of the candidate facial image and a preset reference location, where the preset reference location can be the location of the camera component or the location of the center point of the head-mounted device display interface.
[0048] Exemplarily, if the preset reference position is the position of the camera assembly, and the camera assembly is taken as an example, since when an object is imaged through the camera lens, there is a proportional relationship between the actual size of the object and the size of its projection on the camera, and this proportional relationship is determined by the focal length of the camera, the distance between the face and the camera can be estimated based on the actual size of the face, the size of the face image in the camera, and the focal length of the imaging as the distance information corresponding to the candidate face image. If the face is far from the camera, there is no need to match the candidate face image with the first target information. Only when the face is close to the camera, it indicates that the user may need to pay attention to the first target information corresponding to this face. At this time, the head-mounted device determines the candidate face image corresponding to the face as the current face image recognized by its camera assembly.
[0049] For example, if the preset reference position is the position of the center point of the head-mounted device display interface, the wearer can move the head to make the candidate face image close to the center point of the display interface. When the candidate face image is close to the center point of the display interface, the head-mounted device uses the candidate face image as the current face image, avoiding the head-mounted device from performing information matching operations on a large number of faces in the field of view, thereby reducing the power consumption of the head-mounted device.
[0050] Step S102: when it is detected that the current facial image is a target facial image, first target information matching the target facial image is obtained.
[0051] Exemplarily, after the head mounted device determines that the current face image exists in the wearer's field of view through step S101, it can perform information matching on the current face image to determine whether there is corresponding first target information for the current face image. Specifically, the facial feature information of the current face image can be matched in a preset database. If there is a preset face matching the facial feature information in the database, the current face image is determined as the target face image, and the information associated with the target face image is obtained as the first target information corresponding to the target face image.
[0052] The information corresponding to the target facial image is stored in the head-mounted device in advance in association with the facial information, and is the relevant information output by the user corresponding to the target facial image collected when the head-mounted device recognizes the target facial image through the camera component during the historical period. Exemplarily, if the wearer of the head-mounted device is user A, and if user A talks with user B while wearing the head-mounted device during a certain historical period, the head-mounted device can extract the chat information during the conversation between user A and user B, and store the relevant information of the chat information in association with the facial image of user B in the head-mounted device, and the relevant information of the chat information is the first target information corresponding to the facial image of user B.
[0053] In some implementations, the acquiring first target information matching the target facial image includes:
[0054] Acquire second target information stored corresponding to the target face image;
[0055] The first target information is determined according to the second target information, wherein an amount of information of the first target information is less than or equal to an amount of information of the second target information.
[0056] In one embodiment, the method for generating the second target information can refer to the following embodiments and will not be repeated here. After the head mounted device obtains the second target information, the head mounted device can directly store the second target information, or extract key information from the second target information and store the key information in the second target information as the first target information, wherein the key information is keywords such as person, time, and location in the second target information. In one embodiment, the head mounted device can also directly store the first target information and the second target information.
[0057] When the head-mounted device needs to display the first target information that matches the target facial image, that is, when the head-mounted device needs to display the first target information associated with the target facial image, the head-mounted device can obtain the second target information, and use the key information in the second target information as the first target information. At this time, the amount of information of the first target information is less than the amount of information of the second target information; the head-mounted device can also directly display the second target information as the first target information. At this time, the amount of information of the first target information is equal to the amount of information of the second target information.
[0058] It can be understood that when the amount of information of the first target information is less than the amount of information of the second target information, the amount of information that the head-mounted device needs to display is reduced, thereby reducing the occlusion of the wearer's field of view by the first target information, and also reducing the amount of information that the wearer needs to receive, thereby improving the efficiency of information reception.
[0059] Exemplarily, the second target information and the first target information may be in different formats. For example, the second target information may be an audio file obtained by recording the conversation between the wearer and the user corresponding to the target face image. When the first target information needs to be displayed, the audio file is subjected to text recognition and text extraction to obtain key information corresponding to the second target information as the first target information. Of course, it is not limited to this. The first target information may also include the storage time and storage location of the second target information to prompt the wearer the time and location of the conversation.
[0060] In some implementations, step S102 includes:
[0061] When detecting that the current facial image is a target facial image, determining the number of the target facial images;
[0062] If there are at least two target face images, first target information matching the target face image corresponding to the minimum target distance is obtained, wherein the target distance is the distance between the position of the target face image and the preset target position.
[0063] For example, in some special scenarios, such as crowded places, the camera component of the head-mounted device may recognize multiple facial images at the same time, that is, the head-mounted device detects multiple current facial images, and there may be multiple target facial images at this time. If the first target information corresponding to all target facial images is displayed, it may cause the display interface to be unable to display all the first target information, and may also affect the display of other content in the display interface. And when the head-mounted device is a device with AR display function, displaying too much first target information will block the line of sight of the wearer wearing the head-mounted device. Therefore, in order to solve the above problem, the head-mounted device in the embodiment of the present disclosure determines the number of target facial images when detecting that the current facial image is a target facial image; if there are at least two target facial images, the first target information matching the target facial image corresponding to the minimum target distance is obtained, wherein the target distance is the distance between the position of the target facial image and the preset target position, and the preset target position may be the same as the preset reference position or different from the preset reference position. For example, when the preset target position is the center point of the display interface, the first target information is the information corresponding to the target face image closest to the center point of the display interface.
[0064] In some embodiments, the method further comprises:
[0065] When the duration for which the camera component fails to recognize a facial image is greater than a preset duration, the camera component is turned off.
[0066] For example, the wearer can activate the camera component in the head-mounted device through an icon, button or sensor (such as an infrared sensor, an inertial measurement unit, a Bluetooth module, etc.) to recognize the face through the camera component.
[0067] For example, if the camera component of the head-mounted device is started and no face image is detected within the preset time, that is, the time for which the camera component does not recognize the face image is longer than the preset time, it means that the wearer may have triggered the function by mistake, or the user no longer needs the function due to changes in circumstances. In order to avoid heating and power consumption caused by long-term operation of the camera component, the head-mounted device actively triggers the shutdown command, and the camera component is shut down through the shutdown command. The preset time can be set according to the actual situation, for example, it can be 30 seconds, of course, it is not limited to this, and is not limited here.
[0068] This embodiment turns off the camera component of the head-mounted device when the camera component of the head-mounted device fails to recognize a facial image for longer than a preset time, thereby avoiding the camera component from being in operation when not needed, thereby reducing the power consumption of the head-mounted device and improving the battery life of the head-mounted device.
[0069] In some embodiments, the method further comprises:
[0070] In the case where it is identified that the current facial image does not belong to the target facial image, second target information corresponding to the current facial image is obtained and the second target information is stored.
[0071] Exemplarily, if the current facial image does not belong to the target facial image, it indicates that the camera component of the head-mounted device has not recognized the current facial image before, or that the current facial image has been recognized before, but the head-mounted device does not store information associated with the face. At this time, the head-mounted device obtains the second target information corresponding to the current facial image, and stores the second target information in association with the current facial image.
[0072] Exemplarily, for the current face image belonging to the target face image, the user may also update the corresponding second target information through a specific operation, thereby improving the real-time performance of the second target information.
[0073] In some implementations, the step of acquiring second target information corresponding to the current facial image when it is recognized that the current facial image does not belong to the target facial image includes at least one of the following:
[0074] Acquire voice information input for the current face image, and store the voice information as second target information corresponding to the current face image; or
[0075] Acquire text information input for the current face image, and store the text information as second target information corresponding to the current face image.
[0076] Exemplarily, the second target information may be an audio file corresponding to the voice information, such as the head mounted device recording the voice information of the conversation between the wearer and the user corresponding to the current face image, and storing the voice information as the second target information in association with the current face image, thereby improving the convenience of inputting the second target information. At this time, the second target information includes at least the voice information of the user corresponding to the current face image, and may also include the voice information of the wearer. In another embodiment, after the head mounted device obtains the voice information, the head mounted device converts the voice information into text information, and stores the text information as the second target information in association with the current face image.
[0077] Exemplarily, the second target information can also be input via text. The wearer can input the conversation content with the user corresponding to the current facial image into the head-mounted device in the form of text. When the head-mounted device receives the text information input by the wearer, it uses the text information as the second target information corresponding to the current facial image, and stores the second target information in association with the current facial image.
[0078] This embodiment obtains voice information or text information corresponding to the current face image as the second target information and stores it in association with the current face image, thereby providing multiple ways to obtain the second target information and improving the convenience of obtaining the second target information.
[0079] Step S103: associate the first target information with the target face image and display them on a display interface of the head mounted device.
[0080] After the head mounted device acquires the first target information, the head mounted device associates the first target information with the target face image for display.
[0081] This application obtains the current face image recognized by the camera component of the head-mounted device; when the current face image is detected as a target face image, obtains the first target information that matches the target face image; and displays the first target information and the target face image in association with each other in the display interface of the head-mounted device. The face is detected and recognized by the camera component of the head-mounted device, the first target information corresponding to the face is determined, and the first target information is displayed in association with the face. This enables the wearer to observe a specific face while wearing the head-mounted device, and the information pre-stored for the face is displayed in correspondence with the face, so that the wearer can obtain information related to the face, which reduces the wearer's memory in social, work and other scenarios, allowing the wearer to focus on the conversation occurring in the current environment, thereby improving the intelligence of the information display of the head-mounted device.
[0082] In some implementations, displaying the first target information and the target face image in association with each other on a display interface of the head mounted device includes:
[0083] Displaying the first target information at a position where the distance between the display interface and the target face image is less than a preset distance threshold;
[0084] Alternatively, the first target information is displayed in a first preset area of the display interface, and the first target information is associated with the target facial image through a guide mark.
[0085] When displaying the first target information, the head-mounted device may display the first target information at a position that is less than a preset distance threshold from the position of the target facial image. Exemplarily, any position of a facial image may be used as the position of the target facial image. This embodiment does not limit the position of the target facial image, and the user may set it according to specific needs. During the movement of the target facial image, the text box used to display the first target information also moves accordingly. That is, during the movement of the user corresponding to the target facial image, the display position of the first target information in the display interface of the head-mounted device will also move with the movement of the user corresponding to the target facial image, thereby allowing the wearer to observe the first target information at a position close to the target facial image, and the relationship between the first target information and the target facial image is more intuitive. Figure 2 As shown, the first target information is displayed above the target face image and is relatively close to the target face image. This embodiment does not impose any restrictions on the size of the preset distance threshold.
[0086] In one embodiment, the first target information may also be displayed in a first preset area of the display interface corresponding to the near-eye display component. The first preset area is an area pre-set in the display interface of the head-mounted device. For example, the first preset area may be a specific area in the display interface, such as Figure 3 As shown, the first preset area can be the lower right corner area of the display interface. After the head mounted device determines the first target information, the head mounted device displays the first target information in the first preset area of the display interface, and associates the first target information with the target face image through a guide mark, wherein the guide mark can include an arrow or a guide line. It can be understood that Figure 2 , 3 The current face image in includes face A and face B, wherein face A does not belong to the target face image, and face B belongs to the target face image.
[0087] This embodiment provides a display method for associating multiple first target information with target facial images, so that when there are multiple faces in the display interface of the head-mounted device, it is convenient for the wearer to quickly identify which face the first target information belongs to, thereby improving the recognizability of the first target information.
[0088] In some implementations, displaying the first target information and the target face image in association with each other on a display interface of the head mounted device includes:
[0089] When the target facial image is located in a second preset area of the display interface, the first target information and the target facial image are associated and displayed in the display interface.
[0090] The camera component of the head-mounted device may recognize multiple current facial images, and there may be multiple target facial images in the multiple current facial images. However, if the first target information corresponding to the multiple target facial images is displayed in the display interface of the head-mounted device, it will block the field of view of the wearer of the head-mounted device, and may also block other content displayed on the display interface of the head-mounted device. In order to solve the above problems, the head-mounted device in this embodiment will only associate the first target information with the target facial image and display it in the display interface when the target facial image is located in the second preset area of its display interface. Among them, the second preset area can be the central area of the display interface. Exemplarily, the center point of the display interface can be used as a reference, and the area within the preset range of the center point is the second preset area of the display interface. This embodiment does not limit the shape and size of the second preset area. For example, the second preset area can be a rectangle or a circle.
[0091] This embodiment displays the first target information corresponding to the target facial image only when the target facial image falls within the second preset area of the head-mounted device display interface, thereby avoiding displaying the first target information corresponding to each target facial image and avoiding blocking the line of sight of the wearer of the head-mounted device due to the display of the first target information.
[0092] See also Figure 4 , Figure 4 It is a schematic diagram of an information display device provided in one embodiment of the present application. The information display device can be configured in a head-mounted device to execute the aforementioned information display method.
[0093] like Figure 3 As shown, the information display device includes: a face recognition module 110, an information acquisition module 120, and an information display module 130.
[0094] A face recognition module 110 is configured to obtain a current face image recognized by a camera assembly of the head mounted device;
[0095] The information acquisition module 120 acquires first target information matching the target face image when detecting that the current face image is a target face image;
[0096] The information display module 130 associates the first target information with the target face image and displays it in a display interface of the head mounted device.
[0097] Exemplarily, the above method can be implemented in the form of a computer program. Figure 5 Running on the headset shown.
[0098] See also Figure 5 , Figure 5This is a schematic block diagram of the structure of a head-mounted device provided in an embodiment of the present application. The head-mounted device may be a smart helmet or smart glasses, etc.
[0099] like Figure 5 As shown, the head mounted device includes a processor, a memory and a network interface connected via a system bus, wherein the memory may include a storage medium and an internal memory.
[0100] The storage medium can store an operating system and a computer program. The computer program includes program instructions, and when the program instructions are executed, the processor can execute any information display method.
[0101] The processor is used to provide computing and control capabilities to support the operation of the entire head-mounted device.
[0102] The internal memory provides an environment for the operation of the computer program in the storage medium. When the computer program is executed by the processor, the processor can execute any information display method.
[0103] The network interface is used for network communication, such as sending assigned tasks, etc. Those skilled in the art will understand that Figure 5 The structure shown in the figure is merely a block diagram of a portion of the structure related to the scheme of the present application, and does not constitute a limitation on the head-mounted device to which the scheme of the present application is applied. The specific head-mounted device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.
[0104] It should be understood that the processor may be a central processing unit (CPU), and the processor may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.
[0105] In one embodiment, the processor is used to run a computer program stored in the memory to implement the following steps:
[0106] Obtaining a current face image recognized by the camera assembly of the head mounted device;
[0107] When detecting that the current facial image is a target facial image, acquiring first target information matching the target facial image;
[0108] The first target information and the target facial image are associated and displayed on a display interface of the head mounted device.
[0109] In one embodiment, the processor, in the process of acquiring first target information matching the target face image when detecting that the current face image is a target face image, is used to implement:
[0110] When detecting that the current facial image is a target facial image, determining the number of the target facial images;
[0111] If there are at least two target face images, first target information matching the target face image corresponding to the minimum target distance is obtained, wherein the target distance is the distance between the position of the target face image and the preset target position.
[0112] In one embodiment, the processor, in the process of displaying the first target information and the target face image in association with each other on the display interface of the head mounted device, is configured to implement:
[0113] Displaying the first target information at a position where the distance between the display interface and the target face image is less than a preset distance threshold;
[0114] Alternatively, the first target information is displayed in a first preset area of the display interface, and the first target information is associated with the target facial image through a guide mark.
[0115] In one embodiment, the processor, in the process of displaying the first target information and the target face image in association with each other on the display interface of the head mounted device, is configured to implement:
[0116] When the target facial image is located in a second preset area of the display interface, the first target information and the target facial image are associated and displayed in the display interface.
[0117] In one embodiment, the processor, in the process of implementing the information display method, is used to implement:
[0118] In the case where it is identified that the current facial image does not belong to the target facial image, second target information corresponding to the current facial image is obtained and the second target information is stored.
[0119] In one embodiment, the processor, in the process of acquiring the second target information corresponding to the current face image when recognizing that the current face image does not belong to the target face image, is used to implement at least one of the following:
[0120] Acquire voice information input for the current face image, and store the voice information as second target information corresponding to the current face image; or
[0121] Acquire text information input for the current face image, and store the text information as second target information corresponding to the current face image.
[0122] In one embodiment, the processor, in the process of acquiring the first target information matching the target face image, is used to implement:
[0123] Acquire second target information stored corresponding to the target face image;
[0124] The first target information is determined according to the second target information, wherein an amount of information of the first target information is less than or equal to an amount of information of the second target information.
[0125] In one embodiment, the processor, in the process of obtaining the current face image recognized by the camera assembly of the head mounted device, is used to implement:
[0126] When the duration for which the camera component fails to recognize a facial image is greater than a preset duration, the camera component is turned off.
[0127] An embodiment of the present application also provides a computer-readable storage medium, on which a computer program is stored. The computer program includes program instructions. The method implemented when the program instructions are executed can refer to the various embodiments of the information display method of the present application.
[0128] The computer-readable storage medium may be an internal storage unit of the head-mounted device described in the foregoing embodiment, such as a hard disk or memory of the head-mounted device. The computer-readable storage medium may also be an external storage device of the head-mounted device, such as a plug-in hard disk, a smart memory card (SmartMedia Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc., provided on the head-mounted device.
[0129] It should be understood that the terms used in this application specification are only for the purpose of describing specific embodiments and are not intended to limit the application. As used in this application specification and the appended claims, unless the context clearly indicates otherwise, the singular forms "a", "an" and "the" are intended to include plural forms.
[0130] It should also be understood that the term "and / or" used in the specification of this application and the appended claims refers to any combination of one or more of the associated listed items and all possible combinations, including these combinations. It should be noted that, in this article, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "including a..." does not exclude the presence of other identical elements in the process, method, article or system including the element.
[0131] The serial numbers of the embodiments of the present application are for description only and do not represent the advantages and disadvantages of the embodiments. The above description is only a specific implementation mode of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed in the present application, and these modifications or replacements should be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be based on the protection scope of the claims.
Claims
1. An information display method, applied to a head mounted device, characterized in that: The method comprises: Obtaining a current face image recognized by the camera assembly of the head mounted device; When detecting that the current facial image is a target facial image, acquiring first target information matching the target facial image; The first target information and the target facial image are associated and displayed on a display interface of the head mounted device.
2. The information display method according to claim 1, characterized in that: The step of acquiring first target information matching the target face image when the current face image is detected to be a target face image includes: When detecting that the current facial image is a target facial image, determining the number of the target facial images; If there are at least two target face images, first target information matching the target face image corresponding to the minimum target distance is obtained, wherein the target distance is the distance between the position of the target face image and the preset target position.
3. The information display method according to claim 1, characterized in that: The associating and displaying the first target information and the target face image on a display interface of the head mounted device includes: Displaying the first target information at a position where the distance between the display interface and the target face image is less than a preset distance threshold; Alternatively, the first target information is displayed in a first preset area of the display interface, and the first target information is associated with the target facial image through a guide mark.
4. The information display method according to claim 1, characterized in that: The associating and displaying the first target information and the target face image on a display interface of the head mounted device includes: When the target facial image is located in a second preset area of the display interface, the first target information and the target facial image are associated and displayed in the display interface.
5. The information display method according to claim 1, characterized in that: The method further comprises: In the case where it is identified that the current facial image does not belong to the target facial image, second target information corresponding to the current facial image is obtained and the second target information is stored.
6. The information display method according to claim 5, characterized in that: The step of acquiring second target information corresponding to the current face image when it is recognized that the current face image does not belong to the target face image comprises at least one of the following: Acquire voice information input for the current face image, and store the voice information as second target information corresponding to the current face image; or Acquire text information input for the current face image, and store the text information as second target information corresponding to the current face image.
7. The information display method according to claim 1, characterized in that: The obtaining of first target information matching the target face image includes: Acquire second target information stored corresponding to the target face image; The first target information is determined according to the second target information, wherein an amount of information of the first target information is less than or equal to an amount of information of the second target information.
8. The information display method according to claim 1, characterized in that: The method further comprises: When the duration for which the camera component fails to recognize a facial image is greater than a preset duration, the camera component is turned off.
9. A head mounted device, characterized in that: The head mounted device comprises a processor, a memory, and a computer program stored in the memory and executable by the processor, wherein when the computer program is executed by the processor, the steps of the information display method according to any one of claims 1 to 8 are implemented.
10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, wherein when the computer program is executed by a processor, the steps of the information display method according to any one of claims 1 to 8 are implemented.
Citation Information
Cited By
Information display method, head-mounted device, and storage medium
WO2026144026A1