Information display method and device, electronic equipment and readable storage medium

Abstract

The invention discloses an information display method and device, electronic equipment and a readable storage medium, and belongs to the technical field of electronic equipment. The method comprises the steps that under the condition that a first interface is displayed and a first air gesture is detected, in response to the first air gesture, a first object in the first interface is determined; under the condition that the second air gesture is detected, responding to the second air gesture, and magnifying and displaying the first object.

Description

Technical Field

[0001] The present application belongs to the technical field of electronic devices, and specifically relates to an information display method, device, electronic device and readable storage medium. Background Art

[0002] With the advancement of sensor technology and artificial intelligence algorithms, air gesture control of mobile phones has gradually become a reality. When there is a certain distance between the user and the electronic device, the user does not need to touch the screen, but only needs to capture gestures through the front camera to perform basic operations such as waking up the phone, sliding up and down pages, and clicking the screen.

[0003] However, there are some limitations to gesture control. When the user is far away from the phone screen, the text and pictures on the screen will become too small and difficult to read. Users have to frequently adjust the distance from the phone to barely see the content, which not only reduces the efficiency of use, but also easily causes visual fatigue.

[0004] Currently, when there is a certain distance between the user and the electronic device, the user cannot clearly view the displayed content in the electronic device. Summary of the invention

[0005] The purpose of the embodiments of the present application is to provide an information display method, device, electronic device and readable storage medium, which can solve the problem that a user cannot clearly view the displayed content in an electronic device when there is a certain distance between the user and the electronic device.

[0006] In a first aspect, an embodiment of the present application provides an information display method, the method comprising:

[0007] When a first interface is displayed and a first air gesture is detected, determining a first object in the first interface in response to the first air gesture;

[0008] When a second air gesture is detected, the first object is displayed in an enlarged manner in response to the second air gesture.

[0009] In a second aspect, an embodiment of the present application provides an information display device, the device comprising:

[0010] a determination module, configured to, when a first interface is displayed and a first air gesture is detected, determine a first object in the first interface in response to the first air gesture;

[0011] The display module is used to, when a second air gesture is detected, enlarge and display the first object in response to the second air gesture.

[0012] In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the program or instructions are executed by the processor, the steps of the method described in the first aspect are implemented.

[0013] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.

[0014] In a fifth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect.

[0015] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method described in the first aspect.

[0016] In an embodiment of the present application, when a first interface is displayed and a first air gesture is detected, a first object in the first interface is determined in response to the first air gesture, and the first object that the user wants to operate can be accurately located by capturing the user's first air gesture. When a second air gesture is detected, the first object is magnified and displayed in response to the second air gesture, and the user can achieve magnified display of the first object through a simple air gesture operation, so that when there is a certain distance between the user and the electronic device, the user can clearly view the display content in the electronic device. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 is a flow chart of an information display method provided by an embodiment of the present application;

[0018] Figure 2 is a schematic diagram of a first object provided in an embodiment of the present application;

[0019] Figure 3 is a schematic diagram of a first sub-gesture provided in an embodiment of the present application;

[0020] Figure 4 is a schematic diagram of a second sub-gesture provided in an embodiment of the present application;

[0021] Figure 5 is a schematic diagram of a sliding first interface provided in an embodiment of the present application;

[0022] Figure 6 is a schematic diagram of an enlarged display message control provided by an embodiment of the present application;

[0023] Figure 7 is a schematic diagram of a message page provided in an embodiment of the present application;

[0024] Figure 8 It is a schematic diagram of message identification information provided by an embodiment of the present application;

[0025] Fig. 9 It is a schematic diagram of a display position of a mobile message page provided in an embodiment of the present application;

[0026] Fig.10 It is a schematic diagram of closing a message page provided in an embodiment of the present application;

[0027] Fig.11 is a structural diagram of an information display device provided in an embodiment of the present application;

[0028] Fig.12 It is one of the hardware structure diagrams of the electronic device according to the embodiment of the present application;

[0029] Fig.13 This is the second schematic diagram of the hardware structure of the electronic device according to the embodiment of the present application. DETAILED DESCRIPTION

[0030] The following will be combined with the drawings of the embodiments of the present application to clearly describe the technical solutions of the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all of the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present application belong to the scope of protection of this application.

[0031] The terms "first", "second", etc. in the specification and claims of this application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0032] In response to the problems arising in the related art, the embodiments of the present application provide an information display method, device, electronic device and readable storage medium, which can solve the problem in the related art that when there is a certain distance between the user and the electronic device, the user cannot clearly view the displayed content in the electronic device.

[0033] The information display method provided by the embodiment of the present application is described in detail below through specific embodiments and their application scenarios in conjunction with the accompanying drawings.

[0034] Figure 1 A flowchart of an information display method provided in an embodiment of the present application.

[0035] like Figure 1 As shown, the information display method may include steps 110 to 120, and the method is applied to an information display device, as shown below:

[0036] Step 110: When a first interface is displayed and a first air gesture is detected, determine a first object in the first interface in response to the first air gesture.

[0037] The first interface refers to the screen content currently displayed by the electronic device. The first interface may include multiple objects, such as buttons, icons, texts, etc.

[0038] The first air gesture refers to non-contact operations performed by users in front of the device through hand movements, such as waving, pinching, or sliding. Electronic devices detect these gestures through sensors, such as cameras, infrared sensors, depth sensors, etc. The camera can capture images of gestures, the infrared sensor can detect the position and movement of the hand, and the depth sensor can provide three-dimensional information of the gesture.

[0039] The sensors in the electronic device capture the user's hand movements, and the captured data is sent to the device's processor for analysis. The specific gesture pattern is identified through an algorithm to confirm whether it is a predefined first air gesture.

[0040] When the first air gesture is detected, in response to the first air gesture, the electronic device analyzes the currently displayed first interface and identifies the objects therein. Based on the position and direction of the first air gesture, the electronic device determines the object that the user intends to select or operate. The electronic device finally determines the first object in the first interface so as to perform a corresponding operation, such as selecting, enlarging, or moving.

[0041] Gesture recognition algorithms, including machine learning and deep learning. These algorithms can be trained to recognize various gesture patterns. By pre-defining the operations corresponding to various gestures, users can be ensured to intuitively control the interface through gestures.

[0042] First object: In the user interface (UI), a display object refers to any interactive element displayed on the screen, such as buttons, icons, text boxes, etc.

[0043] Specifically, when a first interface is displayed and a first air gesture is detected, the first air gesture is identified to obtain first air gesture information; and, based on the first air gesture information, a first object in the first interface is determined.

[0044] According to the first recognized air gesture information, the direction or action type of the gesture is analyzed to determine the displayed object that the user wants to operate. For example, if the user points to an icon on the screen, the icon will be recognized as the first object. The first object that the user wants to operate can be accurately located to prepare for subsequent operations on the first object.

[0045] Sensors on electronic devices, such as cameras or depth sensors, capture the user's hand movements and identify the type and location of gestures through image processing and machine learning algorithms. The recognition results are converted into machine-understandable information, namely the first air gesture information. This allows the electronic device to understand the user's gesture intentions and provide basic data for subsequent operations.

[0046] like Figure 2 As shown in a, a first interface is displayed. When a first air gesture is received, the first air gesture includes a fist gesture 212 and an open fist gesture 212. The first air gesture information includes the type of the first air gesture. According to the first air gesture information, the type, position and action of the gesture are analyzed to determine the display object that the user wants to operate, such as Figure 2 As shown in b, the first object 214 is determined according to the first air gesture information.

[0047] In a possible embodiment, step 110 may specifically include the following steps:

[0048] When a first interface is displayed and a first air gesture is detected, first air gesture information is obtained in response to the first air gesture; and based on the first air gesture information, a first object in the first interface is determined, and a first air gesture identifier is displayed in a display area associated with the first object.

[0049] First air gesture indicator: refers to the visual prompt displayed after the user performs the first air gesture to indicate the operation result. This indicator usually appears in the form of a graphic or cursor to help the user confirm the exact location of the gesture. After the user completes the gesture operation, the first air gesture indicator can provide feedback on the success of the operation to help the user confirm the validity of the operation.

[0050] According to the first air gesture information, the type, position and action of the gesture are analyzed to determine the display object that the user wants to operate. For example, if the user points to an icon on the screen, the icon will be identified as the first object. According to the gesture information, the position of the first object on the screen is located, and its associated display area is determined. The UI element that the user wants to operate can be accurately located to prepare for subsequent operations.

[0051] According to the position of the first object, its associated display area is determined, which is usually the area around the display object. The first air gesture identifier is displayed in the display area associated with the first object to indicate the completion of the operation. The identifier usually appears in the form of a graphic or cursor to help the user confirm the exact location of the gesture. The user can confirm the validity of the operation through the first air gesture identifier, thereby improving the user experience and operation accuracy.

[0052] Through the first air gesture identifier, the user can confirm the exact position of the gesture in real time, improving the accuracy of the operation. The display of the first air gesture identifier can provide clear visual feedback to help the user confirm the completion status of the operation and enhance the user experience. Through the recognition and processing of gesture information, complex air gesture operations can be implemented, simplifying the user's operation process.

[0053] Electronic devices can intelligently recognize and respond to users' first air gestures, providing a more humane and efficient interactive experience. Users can operate specific UI elements through simple hand movements and obtain clear visual feedback, improving the overall user experience.

[0054] In a possible embodiment, the first air gesture includes a first sub-air gesture and a second sub-air gesture, and step 110 includes:

[0055] When the first sub-air gesture is detected, a first air gesture identifier is displayed; the first air gesture identifier is used to indicate an interface position corresponding to the first sub-air gesture;

[0056] When the second sub-air gesture is detected, determining the first object;

[0057] The method further comprises:

[0058] A second air gesture identifier is displayed in an associated area of ​​the first object; display parameters of the first air gesture identifier are different from display parameters of the second air gesture identifier.

[0059] Sub-gestures: refers to the multiple parts or stages that make up a complete gesture. For example, a complete gesture may include multiple consecutive hand movements or position changes. In complex gesture operations, multiple sub-gestures need to be recognized and processed to complete a complete operation.

[0060] The first air gesture indicator refers to the visual cue displayed when the user performs the first sub-air gesture to indicate the gesture position. The first air gesture indicator appears in the form of a graphic or cursor to help the user confirm the exact position of the gesture. When the user performs a gesture operation, the first air gesture indicator can provide real-time feedback to help the user adjust the gesture position and improve the accuracy of the operation.

[0061] Second air gesture indicator: refers to the visual prompt displayed after the user completes the first air gesture to indicate the result of the operation. The second air gesture indicator is different from the first air gesture indicator and is used to confirm the completion of the operation. After the user completes the gesture operation, the second air gesture indicator can provide feedback on the success of the operation to help the user confirm the validity of the operation.

[0062] The sensor on the electronic device captures the user's first sub-air gesture and identifies the type and location of the gesture through image processing and machine learning algorithms. Based on the identified first sub-air gesture information, the first air gesture identifier is displayed on the screen to indicate the location of the gesture. When the user performs the second sub-air gesture, the sensor captures and identifies the gesture again. Based on the second sub-air gesture information, the direction or action type of the gesture is analyzed to determine the first object that the user wants to operate.

[0063] Display the first air gesture identifier: Display the first air gesture identifier in the display area associated with the first object to indicate the completion of the operation. The display parameters of the first air gesture identifier are different from those of the preview air gesture identifier to distinguish between the preview and completion states. Display parameters such as color, size, shape, etc. Through the recognition and processing of multiple sub-gestures, the first object that the user wants to operate is accurately located, and clear visual feedback is provided to help the user confirm the validity of the operation.

[0064] like Figure 3 As shown in a, the first air gesture includes a first sub-air gesture 312. When the first sub-air gesture 312 is detected, the first air gesture identifier 311 is displayed. Figure 3 As shown in b, the display position of the first air gesture identifier 311 is updated along with the position of the first sub-air gesture 312.

[0065] like Figure 4 As shown in a, the first air gesture includes a second sub-air gesture 314. When the second sub-air gesture 314 is detected, the second air gesture identifier 315 is displayed in the display area associated with the first object, and the display parameters of the second air gesture identifier 315 are different from the display parameters of the first air gesture identifier 311.

[0066] Therefore, through the first air gesture identifier, the user can adjust the gesture position in real time to improve the accuracy of the operation. The display parameters of the second air gesture identifier are different from those of the first air gesture identifier, which can provide clear visual feedback to help users confirm the completion status of the operation. Through the recognition and processing of multiple sub-gestures, complex air gesture operations can be achieved, simplifying the user's operation process. It can intelligently recognize and respond to the user's air gestures, providing a more humane and efficient interactive experience.

[0067] In a possible embodiment, after step 120, the method further includes:

[0068] When a third air gesture is detected, in response to the third air gesture, the first interface is updated and displayed according to a moving direction corresponding to the third air gesture.

[0069] The third air gesture refers to the third hand movement performed by the user after completing the first and second air gestures. This gesture is usually used to indicate the direction of page sliding or perform other operations. In complex air gesture operations, the third air gesture can be used to implement page sliding, page turning and other operations.

[0070] The electronic device analyzes the moving direction of the third air gesture, such as up, down, left, right, etc. The electronic device maps the moving direction of the third air gesture to the operation of the interface. For example, swiping up may correspond to scrolling the interface up, and swiping left may correspond to switching pages to the left.

[0071] According to the moving direction of the third air gesture, the currently displayed first interface is adjusted. For example, if the third air gesture is a downward slide, the electronic device may scroll down the interface content; if it is a right slide, the electronic device may switch to the next page to the right. The electronic device responds to the third air gesture and updates the interface in real time to ensure that the user can see the result of the gesture operation.

[0072] Specifically, when a third air gesture is detected, the third air gesture is identified to obtain third air gesture information, wherein the third air gesture information is used to indicate a moving direction of the third air gesture; and according to the third air gesture information, the first interface is slid.

[0073] Third air gesture information: The third air gesture information refers to the relevant data of the third air gesture captured and recognized by the sensor, including the type, position, movement direction, etc. of the gesture. The third air gesture information is used to guide the execution of corresponding operations, such as page sliding.

[0074] When the user performs the third air gesture, the sensor on the electronic device captures the user's hand movement and identifies the type, position and movement direction of the gesture through image processing and machine learning algorithms. Based on the captured gesture data, the third air gesture information is generated to indicate the movement direction of the gesture. The user's gesture intention can be identified to provide basic data for subsequent page sliding operations.

[0075] According to the third air gesture information, the movement direction of the gesture is analyzed to determine the sliding direction of the page, such as up, down, left, and right. According to the analysis results, the display content of the first interface is adjusted to achieve the sliding effect of the page. For example, if the gesture indicates moving upward, the page will slide up to display the content of the next page. Users can slide pages through simple gesture operations, improving the convenience of operation and user experience.

[0076] Users can use continuous gestures to perform complex page sliding operations without complex clicks or sliding operations. Through air gestures, users can interact with electronic devices more naturally and intuitively, reducing their reliance on physical buttons or touch screens. Air gesture technology can be applied to a variety of electronic devices and scenarios, such as smart TVs, smart homes, AR / VR electronic devices, etc., to provide users with more diverse interaction methods. Through the recognition and processing of multiple sub-gestures, complex air gesture operations can be achieved, simplifying the user's operation process.

[0077] like Figure 5 As shown, when a third air gesture is detected, the third air gesture is identified and third air gesture information is obtained, wherein the third air gesture information is used to indicate a moving direction of the third air gesture; when the third air gesture is a left swipe, the first interface is slid to the left.

[0078] As a result, electronic devices can intelligently recognize and respond to users' air gestures, providing a more humane and efficient interactive experience. Users can slide pages and perform other complex operations with simple hand movements, improving the overall user experience.

[0079] Step 120: When a second air gesture is detected, the first object is displayed by enlarging the size of the first object in response to the second air gesture.

[0080] The electronic device uses a zoom algorithm to magnify and display the first object, and the zoom algorithm involves image processing technology, such as interpolation processing, resampling processing, etc. In response to the second air gesture, the electronic device adjusts the interface layout to ensure that the enlarged first object can be fully displayed on the screen.

[0081] Wherein, step 120 may specifically include the following steps:

[0082] When a second air gesture is detected, the second air gesture is identified to obtain second air gesture information; and according to the second air gesture information, the first object in the first interface is enlarged and displayed.

[0083] When the user performs the second gesture, the sensor captures and recognizes the gesture again, generating second air gesture information. The user's gestures can be continuously recognized to implement a multi-step operation process.

[0084] According to the second air gesture information, it is determined that the user wants to zoom in on the first object. The zoom effect is achieved by adjusting the display ratio of the UI element. The user can zoom in on a specific UI element through simple gesture operations, thereby improving user experience and ease of operation.

[0085] Through air gestures, users can interact with electronic devices more naturally and intuitively, reducing reliance on physical buttons or touch screens. Users can use simple gestures to perform complex operations, such as zooming in on specific content, without the need for complex clicks or slides. Air gesture technology can be applied to a variety of electronic devices and scenarios, such as smart homes, smart TVs, AR / VR electronic devices, etc., to provide users with more diverse ways of interaction. Electronic devices can intelligently recognize and respond to user gestures, achieving a more humane and efficient interactive experience.

[0086] In a possible embodiment, the following steps may also be included:

[0087] Step 210, when a notification message is received, determining a first display size according to a distance between the user and the electronic device;

[0088] Step 220: Display a notification message control according to the first display size, wherein the notification message control includes the notification message.

[0089] Receiving a notification message refers to new information or reminders received by an electronic device, such as text messages, emails, social media updates, etc. Electronic devices use sensors to detect the distance between the user and the device, such as infrared sensors, ultrasonic sensors, or lidar. The sensor captures the user's location information and calculates the distance between the user and the device through an algorithm.

[0090] According to predefined rules, the distance between the user and the device is mapped to a corresponding display size. For example, the closer the distance, the larger the display size; the farther the distance, the smaller the display size. The first display size is calculated.

[0091] The notification message control refers to an interface element for displaying a notification message, which generally includes message content, an icon, a timestamp, etc. The size of the notification message control is adjusted according to the first display size determined in step 210. The electronic device updates the interface in real time to ensure that the notification message control is displayed on the screen according to the calculated size.

[0092] The notification message control includes the specific content of the notification message, such as text, pictures, links, etc. The electronic device can also automatically adjust the layout of the notification message according to the content of the notification message and the size of the control to ensure that the notification message is clearly visible.

[0093] By dynamically adjusting the display size of the notification message control according to the distance between the user and the electronic device, the best visual experience is provided, so that users can clearly view the notification message at different distances.

[0094] Wherein, step 220 may specifically include the following steps:

[0095] When the distance between the user and the electronic device is greater than a preset distance, determining a first display size according to the distance between the user and the electronic device;

[0096] The notification message control is enlarged and displayed according to the first display size.

[0097] Notification message control: refers to the elements used to display notification messages in the user interface, usually including notification icons, notification content, close buttons, etc. Commonly used in electronic devices such as smartphones, tablets, and smart TVs, it is used to push notification messages to users, such as text messages, emails, and application updates.

[0098] Preset distance: refers to the preset distance threshold between the user and the electronic device. When the distance between the user and the electronic device exceeds this threshold, the corresponding operation will be triggered. It is used to adjust the display effect according to the distance between the user and the electronic device, such as enlarging the notification message control to improve the user's visibility and operation convenience.

[0099] The distance between the user and the electronic device is detected by the sensor on the electronic device. Sensors such as infrared sensors, ultrasonic sensors or cameras can capture the user's location information in real time and calculate the distance between the user and the electronic device. Based on the data captured by the sensor, the actual distance between the user and the electronic device is calculated and compared with the preset distance. It can detect the distance between the user and the electronic device in real time and provide basic data for subsequent operations.

[0100] Based on the detected distance between the user and the electronic device, determine whether it is greater than the preset distance. If the distance is greater than the preset distance, the zoom display operation will be triggered. The zoom effect is achieved by adjusting the display ratio of the notification message control. For example, increase the font size or icon size of the control, or adjust the display area of ​​the control to make it more conspicuous on the screen. When the user is far away from the electronic device, enlarging the display of the notification message control can improve the user's visibility and help the user view and operate the notification message more easily.

[0101] like Figure 6 As shown in a, when the notification message control 611 is displayed, the distance between the user and the electronic device is detected; Figure 6 As shown in b, when the distance is greater than the preset distance, the notification message control 611 is enlarged and displayed.

[0102] By adjusting the display effect according to the distance between the user and the electronic device, a more user-friendly user experience can be provided. When the user is at a long distance, the notification message can still be clearly seen, reducing the complexity of operation. Enlarging the display of the notification message control can reduce the user's misoperation when operating at a long distance, and improve the accuracy and convenience of operation.

[0103] The embodiment shown in steps 210-220 can be applied to a variety of electronic devices and scenarios, such as smart TVs, smart home electronic devices, public information display screens, etc., to provide users with a more flexible and convenient interaction method. When the user is far away from the electronic device, enlarging the display notification message control can significantly improve the visibility of the notification message, ensuring that the user will not miss important information.

[0104] As a result, the electronic device can intelligently adjust the display effect according to the distance between the user and the electronic device, providing a more humane and efficient interactive experience. The user can still easily view and operate the notification message at different distances, improving the overall user experience.

[0105] In a possible embodiment, the following steps may also be included:

[0106] When a fourth air gesture directed to the notification message control is detected, a message content page of the notification message is displayed in response to the fourth air gesture.

[0107] Fourth air gesture: refers to the fourth hand movement performed by the user when viewing the notification message control. This gesture is usually used to further operate the notification message control, such as opening the notification message page or updating the displayed content. In complex air gesture operations, the fourth air gesture can be used to implement further operations of the notification message control.

[0108] The message content page refers to the interface used to display the notification message content in detail, usually including all the text, pictures, links, attachments, etc. of the message.

[0109] When the fourth air gesture directed to the notification message control is detected, in response to the fourth air gesture, the message content page is switched to be displayed, and the electronic device loads the detailed content of the notification message and displays it on the message content page.

[0110] Through air gesture technology, users can interact with electronic devices more naturally and conveniently. Gestures are captured by sensors, recognized by algorithms, and responded to according to predefined rules, ultimately displaying the detailed content page of the notification message. This allows users to achieve complex interface control through simple gesture operations.

[0111] Specifically, when a fourth air gesture directed to the notification message control is detected, the fourth air gesture is identified to obtain fourth air gesture information;

[0112] When the fourth air gesture information matches the first type of gesture information, displaying the notification message page indicated by the notification message control;

[0113] When the fourth air gesture information matches the second type of gesture information, the notification message control is updated and displayed as the second air gesture identification information.

[0114] Fourth air gesture information: refers to the relevant data of the fourth air gesture captured and recognized by the sensor, including the type, position, action, etc. of the gesture. The fourth air gesture information is used to guide the execution of corresponding operations, such as displaying a notification message page or updating the displayed content.

[0115] The first type of gesture information: refers to a predefined type of gesture information, which is usually used to trigger a specific operation, such as opening a notification message page. When the user performs the fourth air gesture, the recognized gesture information will be matched with the first type of gesture information to determine whether to perform the corresponding operation.

[0116] The second type of gesture information refers to another type of predefined gesture information, which is usually used to trigger other operations, such as updating the displayed content. When the user performs the fourth air gesture, the recognized gesture information will be matched with the second type of gesture information to determine whether to perform the corresponding operation.

[0117] Second air gesture identification information: refers to the visual prompt displayed when the user performs the second type of gesture to indicate the result of the operation. This identification information is usually different from the first air gesture identification information and is used to confirm the completion of the operation. After the user completes the gesture operation, the second air gesture identification information can provide feedback on the success of the operation to help the user confirm the validity of the operation.

[0118] When the user performs the fourth air gesture, the sensor on the electronic device captures the user's hand movement and identifies the type, position and action of the gesture through image processing and machine learning algorithms. Based on the captured gesture data, the fourth air gesture information is generated to indicate the type and action of the gesture. The user's gesture intention can be identified to provide basic data for subsequent operations.

[0119] The recognized fourth air gesture information is matched with the predefined first type of gesture information. If the match is successful, the corresponding operation is performed, such as displaying the notification message page. According to the matching result, the notification message page indicated by the notification message control is opened and displayed, and the user can view the detailed notification content. The user can quickly open the notification message page and view detailed information through specific gesture operations.

[0120] like Figure 7 As shown in a, the notification message control 611 is displayed, and when a fourth air gesture for the notification message control is detected, the fourth air gesture 612 is identified to obtain fourth air gesture information; Figure 7 As shown in b, when the fourth air gesture information matches the first type of gesture information, the notification message page 613 indicated by the notification message control 611 is displayed.

[0121] The recognized fourth air gesture information is matched with the predefined second type of gesture information. If the match is successful, the corresponding operation will be performed, such as updating the displayed content. According to the matching result, the notification message control is updated to display the second air gesture identification information, indicating the completion of the operation. The user can update the display content of the notification message control through specific gesture operations and provide feedback on the success of the operation.

[0122] like Figure 8 As shown in a, the notification message control 611 is displayed, and when a fourth air gesture for the notification message control is detected, the fourth air gesture 612 is identified to obtain fourth air gesture information; Figure 8 As shown in b, when the fourth air gesture information and the second type of gesture information match, the notification message control is updated and displayed as the second air gesture identification information 615.

[0123] Users can use continuous gestures to operate complex notification message controls without complex clicks or slides. Through air gestures, users can interact with electronic devices more naturally and intuitively, reducing dependence on physical buttons or touch screens. Air gesture technology can be applied to a variety of electronic devices and scenarios, such as smart TVs, smart homes, AR / VR electronic devices, etc., providing users with more diverse interaction methods.

[0124] The display of the second air gesture identification information can provide clear visual feedback to help users confirm the validity of the operation and enhance the user experience.

[0125] As a result, electronic devices can intelligently recognize and respond to users' air gestures, providing a more humane and efficient interactive experience. Users can further operate notification message controls through simple hand movements, improving the overall user experience.

[0126] In a possible embodiment, the following steps may also be included:

[0127] When a voice message is detected and the voice message includes first voice identification information, recording voice input information;

[0128] When the second voice identification information is detected in the recorded voice input information, generating voice output information according to the recorded voice input information;

[0129] The voice output information is sent to a contact associated with the notification message.

[0130] Voice message: refers to the voice data input by the user through the microphone, usually including the user's voice commands, conversation content, etc. It is commonly used in applications such as voice assistants, voice input methods, and voice calls to achieve voice interaction.

[0131] The first voice identification information refers to a specific voice instruction or keyword used by the user to indicate the start of voice recording during the voice input process. During the voice input process, the user can trigger the start of recording the voice input information by saying the first voice identification information.

[0132] Voice input information: refers to the voice data input by the user through the microphone during the recording process, usually including the user's voice commands, conversation content, etc. It is used to generate voice output information, such as voice messages, voice commands, etc.

[0133] Second voice identification information: refers to a specific voice command or keyword used by the user to indicate the end of recording and sending the voice during the voice input process. During the voice input process, the user can trigger the end of recording and sending the voice input information by saying the second voice identification information.

[0134] Voice output information: refers to the voice data generated based on the recorded voice input information, usually including voice messages, voice commands, etc. It is used to send to the contacts associated with the notification message control to achieve voice interaction.

[0135] The microphone on the electronic device captures the user's voice input in real time and converts the voice data into text or instructions through voice recognition technology. Based on the captured voice data, the user's voice instructions or conversation content are recognized. It can detect the user's voice input in real time and provide basic data for subsequent operations.

[0136] The first voice identification information is identified in the detected voice message, such as "start recording" or a specific keyword. Once the first voice identification information is detected, the user's voice input information is recorded and the voice data is stored in a buffer. The user can trigger the start of recording the voice input information through a specific voice command, thereby realizing the convenience of voice input.

[0137] During the process of recording the voice input information, the voice message is detected in real time, and the second voice identification information, such as "send" or a specific keyword, is identified. Once the second voice identification information is detected, the recording is terminated, and the recorded voice input information is converted into voice output information.

[0138] Users can use specific voice commands to trigger the end of recording and generate voice output information, realizing the convenience of voice input. Determine the recipient of the voice output information based on the contact information associated with the notification message control. Send the generated voice output information to the contact associated with the notification message control to realize voice interaction. Users can quickly interact with contacts through voice input and sending, improving the convenience of operation and user experience.

[0139] Users can quickly interact with contacts by voice input and sending, without complicated clicks or slides. Through voice interaction, users can interact with electronic devices more naturally and intuitively, reducing dependence on physical buttons or touch screens. Voice interaction technology can be applied to a variety of electronic devices and scenarios, such as smartphones, smart speakers, smart home electronic devices, etc., to provide users with more diverse interaction methods. Through the recognition and processing of voice commands, complex voice interaction operations can be realized, simplifying the user's operation process. Users can quickly interact with contacts by voice input and sending, improving interaction efficiency and convenience.

[0140] As a result, electronic devices can intelligently recognize and respond to user voice input, providing a more humane and efficient interactive experience. Users can input and send voice through simple voice commands, improving the overall user experience.

[0141] In a possible embodiment, the following steps may also be included:

[0142] When the fifth air gesture is detected, in response to the fifth air gesture information, the display position of the notification message page is updated according to the moving direction corresponding to the fifth air gesture information.

[0143] The fifth air gesture refers to the fifth hand movement performed by the user when viewing the notification message page. This gesture is usually used to indicate the direction of the page movement on the screen. In complex air gesture operations, the fifth air gesture can be used to realize the movement of the notification message page on the screen.

[0144] Analyze the moving direction of the fifth air gesture, such as up, down, left, right, etc. Map the moving direction of the gesture to the operation of the interface. For example, swiping up may correspond to moving the notification message page up, and swiping left may correspond to moving the notification message page left.

[0145] Specifically, when the fifth air gesture is detected, identifying the fifth air gesture information; the fifth air gesture information is used to indicate the moving direction of the fifth air gesture;

[0146] According to the fifth air gesture information, the display position of the notification message page in the screen display area is moved.

[0147] The fifth air gesture information refers to the relevant data of the fifth air gesture captured and recognized by the sensor, including the type, position, movement direction, etc. of the gesture. The fifth air gesture information is used to guide the execution of corresponding operations, such as moving the display position of the notification message page on the screen.

[0148] When the user performs the fifth air gesture, the sensor on the electronic device captures the user's hand movement and identifies the type, position and movement direction of the gesture through image processing and machine learning algorithms. Based on the captured gesture data, the fifth air gesture information is generated to indicate the movement direction of the gesture. The user's gesture intention can be identified to provide basic data for subsequent page movement operations.

[0149] According to the fifth air gesture information, the direction of movement of the gesture is analyzed to determine the direction of movement of the page, such as up, down, left, and right. According to the analysis results, the display position of the notification message page in the screen display area is adjusted. For example, if the gesture indicates to move upward, the page will be moved upward so that it is displayed in a new position on the screen. Users can use simple gesture operations to move the notification message page on the screen, improving the convenience of operation and user experience.

[0150] like Fig. 9As shown in a, a message page 613 is displayed, and when the fifth air gesture 616 is detected, the fifth air gesture information is identified; the fifth air gesture information is used to indicate that the moving direction of the fifth air gesture 616 is downward; according to the fifth air gesture information, the display position of the notification message page 613 in the screen display area is moved downward.

[0151] Users can use continuous gestures to move notification message pages on the screen without complicated clicks or slides. Through air gestures, users can interact with electronic devices more naturally and intuitively, reducing their reliance on physical buttons or touch screens. Air gesture technology can be applied to a variety of electronic devices and scenarios, such as smart TVs, smart homes, AR / VR electronic devices, etc., to provide users with more diverse interaction methods. Through the recognition and processing of multiple sub-gestures, complex air gesture operations can be implemented, simplifying the user's operation process. Users can quickly adjust the display position of the notification message page on the screen through simple gestures, improving interaction efficiency and convenience.

[0152] In addition, if Fig.10 As shown in a, a message page 613 is displayed. When the sixth air gesture 617 is detected, the fifth air gesture information is recognized; and the message page is closed according to the fifth air gesture information.

[0153] As a result, electronic devices can intelligently recognize and respond to users' air gestures, providing a more user-friendly and efficient interactive experience. Users can move notification message pages on the screen with simple hand movements, improving the overall user experience.

[0154] In an embodiment of the present application, when a first interface is displayed and a first air gesture is detected, a first object in the first interface is determined in response to the first air gesture, and the first object that the user wants to operate can be accurately located by capturing the user's first air gesture. When a second air gesture is detected, the first object is magnified and displayed in response to the second air gesture, and the user can achieve magnified display of the first object through a simple air gesture operation, so that when there is a certain distance between the user and the electronic device, the user can clearly view the display content in the electronic device.

[0155] The information display method provided in the embodiment of the present application can be executed by an information display device. In the embodiment of the present application, an information display device executing the information display method is taken as an example to illustrate the information display device provided in the embodiment of the present application.

[0156] Fig.11 1100 is a block diagram of an information display device provided in an embodiment of the present application. The device 1100 includes:

[0157] A determination module 1110, configured to determine a first object in the first interface in response to a first air gesture when a first interface is displayed and a first air gesture is detected;

[0158] The display module 1120 is configured to, when a second air gesture is detected, enlarge and display the first object in response to the second air gesture.

[0159] In a possible embodiment, the first air gesture includes a first sub-air gesture and a second sub-air gesture, and the determining module 1110 is specifically configured to:

[0160] When the first sub-air gesture is detected, a first air gesture identifier is displayed; the first air gesture identifier is used to indicate an interface position corresponding to the first sub-air gesture;

[0161] When the second sub-air gesture is detected, determining the first object;

[0162] The display module 1120 is further used to display a second air gesture identifier in the associated area of ​​the first object; the display parameters of the first air gesture identifier are different from the display parameters of the second air gesture identifier.

[0163] In a possible embodiment, the display module 1120 is further used to update and display the first interface in response to a third air gesture when a third air gesture is detected, according to a moving direction corresponding to the third air gesture.

[0164] In a possible embodiment, the determination module 1110 is further configured to determine the first display size according to the distance between the user and the electronic device when the notification message is received;

[0165] The display module 1120 is further configured to display a notification message control according to the first display size, wherein the notification message control includes the notification message.

[0166] In a possible embodiment, the display module 1120 is further used to display the message content page of the notification message in response to the fourth air gesture when a fourth air gesture directed to the notification message control is detected.

[0167] In a possible embodiment, the device 1100 further includes:

[0168] A recording module, configured to record voice input information when a voice message is detected and the voice message includes first voice identification information;

[0169] A generating module, configured to generate voice output information according to the recorded voice input information when second voice identification information is detected in the recorded voice input information;

[0170] A sending module is used to send the voice output information to a contact person associated with the notification message.

[0171] In a possible embodiment, the device 1100 further includes:

[0172] An updating module is used to update the display position of the notification message page according to the moving direction corresponding to the fifth air gesture information in response to the fifth air gesture information when the fifth air gesture is detected.

[0173] In an embodiment of the present application, when a first interface is displayed and a first air gesture is detected, a first object in the first interface is determined in response to the first air gesture, and the first object that the user wants to operate can be accurately located by capturing the user's first air gesture. When a second air gesture is detected, the first object is magnified and displayed in response to the second air gesture, and the user can achieve magnified display of the first object through a simple air gesture operation, so that when there is a certain distance between the user and the electronic device, the user can clearly view the display content in the electronic device.

[0174] The information display device in the embodiment of the present application can be an electronic device, or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or it can be other devices other than a terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc., and can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0175] The information display device of the embodiment of the present application may be a device having an action system. The action system may be an Android action system, an iOS action system, or other possible action systems, which are not specifically limited in the embodiment of the present application.

[0176] The information display device provided in the embodiment of the present application can implement each process implemented in the above method embodiment, and will not be described again here to avoid repetition.

[0177] Alternatively, if Fig.12 As shown, an embodiment of the present application also provides an electronic device 1210, including a processor 1211, a memory 1212, and a program or instruction stored in the memory 1212 and executable on the processor 1211. When the program or instruction is executed by the processor 1211, each step of any of the above-mentioned information display method embodiments is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0178] It should be noted that the electronic devices in the embodiments of the present application include the above-mentioned mobile electronic devices and non-mobile electronic devices.

[0179] Fig.13 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.

[0180] The electronic device 1300 includes but is not limited to: a radio frequency unit 1301, a network module 1302, an audio output unit 1303, an input unit 1304, a sensor 1305, a display unit 1306, a user input unit 1307, an interface unit 1308, a memory 1309, and a processor 1310 and other components.

[0181] Those skilled in the art will appreciate that the electronic device 1300 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 1310 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig.13 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0182] The processor 1310 is configured to, when a first interface is displayed and a first air gesture is detected, determine a first object in the first interface in response to the first air gesture;

[0183] The display unit 1306 is used to, when a second air gesture is detected, enlarge and display the first object in response to the second air gesture.

[0184] Optionally, the first air gesture includes a first sub-air gesture and a second sub-air gesture, and the display unit 1306 is further used to display a first air gesture identifier when the first sub-air gesture is detected; the first air gesture identifier is used to indicate an interface position corresponding to the first sub-air gesture;

[0185] The processor 1310 is further configured to determine the first object when the second sub-air gesture is detected;

[0186] The display unit 1306 is further used to display a second air gesture identifier in an associated area of ​​the first object; display parameters of the first air gesture identifier are different from display parameters of the second air gesture identifier.

[0187] Optionally, the display unit 1306 is further used to, when a third air gesture is detected, respond to the third air gesture and update the display of the first interface according to a moving direction corresponding to the third air gesture.

[0188] Optionally, the processor 1310 is further configured to determine the first display size according to the distance between the user and the electronic device when receiving the notification message;

[0189] The display unit 1306 is further configured to display a notification message control according to the first display size, where the notification message control includes the notification message.

[0190] Optionally, the display unit 1306 is further configured to, when a fourth air gesture directed to the notification message control is detected, display a message content page of the notification message in response to the fourth air gesture.

[0191] Optionally, the processor 1310 is further configured to record voice input information when a voice message is detected and the voice message includes first voice identification information;

[0192] The processor 1310 is further configured to generate voice output information according to the recorded voice input information when second voice identification information is detected in the recorded voice input information;

[0193] The processor 1310 is further configured to send the voice output information to a contact associated with the notification message.

[0194] Optionally, the processor 1310 is further used to, when a fifth air gesture is detected, respond to the fifth air gesture information and update the display position of the notification message page according to a moving direction corresponding to the fifth air gesture information.

[0195] In an embodiment of the present application, when a first interface is displayed and a first air gesture is detected, a first object in the first interface is determined in response to the first air gesture, and the first object that the user wants to operate can be accurately located by capturing the user's first air gesture. When a second air gesture is detected, the first object is magnified and displayed in response to the second air gesture, and the user can achieve magnified display of the first object through a simple air gesture operation, so that when there is a certain distance between the user and the electronic device, the user can clearly view the display content in the electronic device.

[0196] It should be understood that in the embodiment of the present application, the input unit 1304 may include a graphics processor (Graphics Processing Unit, GPU) 13041 and a microphone 13042, and the graphics processor 13041 processes the image data of the static picture or video image obtained by the image capture device (such as a camera) in the video image capture mode or the image capture mode. The display unit 1306 may include a display panel 13061, and the display panel 13061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 1307 includes at least one of a touch panel 13071 and other input devices 13072. The touch panel 13071 is also called a touch screen. The touch panel 13071 may include two parts: a touch detection device and a touch controller. Other input devices 13072 may include, but are not limited to, a physical keyboard, a function key (such as a volume control button, a switch button, etc.), a trackball, a mouse, and an action rod, which will not be repeated here. The memory 1309 can be used to store software programs and various data, including but not limited to applications and action systems. The processor 1310 may integrate an application processor and a modem processor, wherein the application processor mainly processes the action system, user pages and application programs, and the modem processor mainly processes wireless communications. It is understandable that the modem processor may not be integrated into the processor 1310.

[0197] The memory 1309 can be used to store software programs and various data. The memory 1309 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 1309 may include a volatile memory or a non-volatile memory, or the memory x09 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 1309 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0198] The processor 1310 may include one or more processing units; optionally, the processor 1310 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 1310.

[0199] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned information display method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0200] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0201] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned information display method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0202] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0203] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned information display method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0204] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0205] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0206] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. An information display method, characterized in that: The method comprises: When a first interface is displayed and a first air gesture is detected, determining a first object in the first interface in response to the first air gesture; When a second air gesture is detected, the first object is displayed in an enlarged manner in response to the second air gesture.

2. The method according to claim 1, characterized in that The first air gesture includes a first sub-air gesture and a second sub-air gesture, and determining a first object in the first interface in response to the first air gesture includes: When the first sub-air gesture is detected, a first air gesture identifier is displayed; the first air gesture identifier is used to indicate an interface position corresponding to the first sub-air gesture; When the second sub-air gesture is detected, determining the first object; The method further comprises: A second air gesture identifier is displayed in an associated area of ​​the first object; display parameters of the first air gesture identifier are different from display parameters of the second air gesture identifier.

3. The method according to claim 2, characterized in that When the first interface is displayed and the first air gesture is detected, after determining the first object in the first interface in response to the first air gesture, the method further includes: When a third air gesture is detected, in response to the third air gesture, the first interface is updated and displayed according to a moving direction corresponding to the third air gesture.

4. The method according to claim 1, characterized in that The method further comprises: When receiving the notification message, determining the first display size according to the distance between the user and the electronic device; A notification message control is displayed according to the first display size, wherein the notification message control includes the notification message.

5. The method according to claim 4, characterized in that The method further comprises: When a fourth air gesture directed to the notification message control is detected, a message content page of the notification message is displayed in response to the fourth air gesture.

6. The method according to claim 4, characterized in that The method further comprises: When a voice message is detected and the voice message includes first voice identification information, recording voice input information; When the second voice identification information is detected in the recorded voice input information, generating voice output information according to the recorded voice input information; The voice output information is sent to a contact associated with the notification message.

7. The method according to claim 5, characterized in that The method further comprises: When the fifth air gesture is detected, in response to the fifth air gesture information, the display position of the notification message page is updated according to the moving direction corresponding to the fifth air gesture information.

8. An information display device, characterized in that: The device comprises: a determination module, configured to, when a first interface is displayed and a first air gesture is detected, determine a first object in the first interface in response to the first air gesture; The display module is used to, when a second air gesture is detected, enlarge and display the first object in response to the second air gesture.

9. An electronic device, characterized in that: The method comprises a processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the method according to any one of claims 1 to 7 are implemented.

10. A readable storage medium, characterized in that: The readable storage medium stores a program or instruction, and when the program or instruction is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Images