Notification message output method and device, equipment and storage medium

Abstract

The invention provides a notification message output method and device, equipment and a storage medium, and belongs to the field of information notification, and the method comprises the steps: obtaining a to-be-output first notification message and a current operation scene of head-mounted display equipment; according to the first notification message and the operation scene, determining a target output mode of the first notification message; and controlling the head-mounted display device to output the first notification message according to the target output mode. According to the method, the output mode of the first notification message is adjusted according to the operation scene, so that the notification message output mode can adapt to user preferences and scene requirements, the reasonability and accuracy of notification message output are greatly improved, a user can know important information more timely, and then the use experience of the user is improved.

Description

Technical Field

[0001] The present application relates to data display technology, and in particular to a notification message output method, device, equipment and storage medium. Background Art

[0002] With the continuous development of science and technology, augmented reality (AR) glasses are becoming more and more popular. When AR glasses receive notification messages, they usually display the notification messages directly in front of the user. However, as the number of notification messages that AR glasses need to output increases, AR glasses fail to effectively select the appropriate notification method when selecting the output method and there is a problem of continuously notifying unimportant information, which seriously interferes with user use. Summary of the invention

[0003] The main purpose of the present application is to provide a notification message output method, device, equipment and storage medium, aiming to select a suitable output mode to output the notification message.

[0004] In a first aspect, the present application provides a notification message output method, the notification message output method comprising the following steps:

[0005] Obtaining a first notification message to be output and a current operating scenario of the head mounted display device;

[0006] Determining a target output mode of the first notification message according to the first notification message and the running scenario;

[0007] According to the target output mode, the head mounted display device is controlled to output the first notification message.

[0008] In a second aspect, the present application further provides a notification message output device, the notification message output device comprising an acquisition module, a determination module and an output module, wherein:

[0009] The acquisition module is used to acquire the first notification message to be output and the current operating scene of the head mounted display device;

[0010] The determining module is used to determine a target output mode of the first notification message according to the first notification message and the operation scenario;

[0011] The output module is used to control the head mounted display device to output the first notification message according to the target output mode.

[0012] In a third aspect, the present application also provides a head-mounted display device, comprising a processor, a memory, and a computer program stored in the memory and executable by the processor, wherein when the computer program is executed by the processor, the steps of the notification message output method as described above are implemented.

[0013] In a fourth aspect, the present application further provides a computer-readable storage medium, on which a computer program is stored, wherein when the computer program is executed by a processor, the steps of the notification message output method as described above are implemented.

[0014] The present application provides a notification message output method, apparatus, device and storage medium. The present application obtains a first notification message to be output and the current operating scenario of the head-mounted display device; determines the target output mode of the first notification message according to the first notification message and the operating scenario; and controls the head-mounted display device to output the first notification message according to the target output mode. The present application adjusts the output mode of the first notification message according to the operating scenario, so that the output mode of the notification message can adapt to the user's preferences and scenario requirements, greatly improving the rationality and accuracy of the notification message output, so that the user can understand important information more timely, thereby improving the user's experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0016] Figure 1 A flowchart of a notification message output method provided in an embodiment of the present application;

[0017] Figure 2 for Figure 1 A flowchart of sub-steps of the notification message output method in FIG.

[0018] Figure 3 A schematic diagram of a pop-up notification output method provided in an embodiment of the present application;

[0019] Figure 4 A schematic diagram of a scenario of a banner notification output method provided in an embodiment of the present application;

[0020] Figure 5 A schematic diagram of a scenario of a toast prompt output method provided in an embodiment of the present application;

[0021] Figure 6A schematic diagram of a scenario for outputting a task status notification provided in an embodiment of the present application;

[0022] Figure 7 A schematic block diagram of a notification message output device provided in an embodiment of the present application;

[0023] Figure 8 for Figure 7 A schematic block diagram of a submodule of a notification message output device in;

[0024] Fig. 9 A schematic block diagram of the structure of a head mounted display device provided in an embodiment of the present application.

[0025] The realization of the purpose, functional features and advantages of this application will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0026] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0027] The flowcharts shown in the accompanying drawings are only examples and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps may also be decomposed, combined or partially merged, so the actual execution order may change according to actual conditions.

[0028] With the continuous development of science and technology, augmented reality (AR) glasses are becoming more and more popular. When AR glasses receive notification messages, they usually display the notification messages directly in front of the user. However, as AR glasses require more and more notifications and prompts, such as banner notifications, toast prompts, pop-ups, vibrations, and voice, AR glasses need to process multiple notifications at the same time. When functions run concurrently, resource occupation conflicts may occur, resulting in important notifications failing to notify users in a timely manner, and continuous notifications of unimportant information, which seriously interferes with user use and leads to a poor user experience.

[0029] To solve the above problems, the embodiments of the present application provide a notification message output method, apparatus, device and storage medium. The notification message output method includes: obtaining a first notification message to be output and the current operating scenario of the head-mounted display device; determining a target output mode of the first notification message according to the first notification message and the operating scenario; and controlling the head-mounted display device to output the first notification message according to the target output mode.

[0030] Among them, the notification message output method can be applied to a head-mounted display device, which can be an augmented reality (AR) glasses, an AR helmet, a mixed reality (MR) glasses, a MR helmet and other devices.

[0031] In conjunction with the accompanying drawings, some embodiments of the present application are described in detail below. In the absence of conflict, the following embodiments and features in the embodiments can be combined with each other.

[0032] Please refer to Figure 1 , Figure 1 A flowchart of a notification message output method provided in an embodiment of the present application.

[0033] like Figure 1 As shown, the notification message output method includes steps S101 to S103.

[0034] Step S101: Obtain a first notification message to be output and a current operating scenario of the head mounted display device.

[0035] Among them, the notification message is a message that the head-mounted display device notifies the user, and the notification message includes but is not limited to system notification messages, application notification messages and short message notification messages, for example, the system notification message is a battery notification, an alarm notification and a network signal notification, etc.; the application notification message can be an application push notification, an application verification code notification and an application data notification, etc.; the short message notification message is an SMS notification.

[0036] Among them, the running scene is the scene that the head-mounted display device is currently in, and the running scene includes but is not limited to a regular running scene, a conference running scene, a sports running scene, etc. In one embodiment, the running scene can also be a global desktop, outputting notification messages in the application, and outputting notification messages on the lock screen interface. Among them, the global desktop can be the initial interface displayed after the head-mounted display device is turned on, or it can be a specific interface set by the user. The notification message output in the application and the lock screen interface can be a first notification message or a second notification message.

[0037] In some embodiments, a first notification message to be output by a head mounted display device and a current operating scenario of the head mounted display device are obtained to obtain the first notification message and the operating scenario.

[0038] In some embodiments, Figure 2 As shown, step S101 includes sub-steps S1011 to S1014.

[0039] Sub-step S1011: determine the initial output priority of the first notification message.

[0040] The initial output priority is used to represent the importance of the first notification message. The greater the initial output priority, the more important the first notification message.

[0041] In some embodiments, the source information level, urgency level and importance level of the first notification message are obtained; and the initial output priority of the first notification message is determined based on the source information level, urgency level and importance level.

[0042] In some embodiments, the method for obtaining the source information level of the first notification message may be: obtaining the source information of the first notification message, obtaining a first mapping relationship table between the preset source information and the source information level; matching the source information level of the source information from the first mapping relationship table. The first mapping relationship table may be set according to actual conditions, and the embodiment of the present invention does not specifically limit this. The source information level may be accurately and efficiently determined through the first mapping relationship table.

[0043] Exemplarily, the first notification message comes from a government notification source (for example, an earthquake reminder notification); the source information level of the government notification source is matched from the first mapping relationship table, and the source information level of the first notification message is high priority. For another example, the first notification message comes from an application notification source (for example, WeChat message notification, SMS notification, and operator notification, etc.), and the source information level of the application notification source is matched from the first mapping relationship table, and the source information level of the first notification message is medium priority. For another example, the first notification message comes from an application developer push source, and the source information level of the application developer push source is matched from the first mapping relationship table, and the source information level of the first notification message is low priority.

[0044] In some embodiments, the method for obtaining the urgency level of the first notification message may be: determining the keywords in the first notification message, obtaining a second mapping relationship table between preset keywords and urgency levels; querying the urgency level matched by the keywords from the second mapping relationship table, and obtaining the urgency level of the first notification message. The second mapping relationship table may be set according to actual conditions, and the implementation of the present invention does not specifically limit this.

[0045] Exemplarily, the first notification message is a notification message with a meeting time, and the keyword in the first notification message is a time point. The urgency level matching the keyword time point is searched from the second mapping relationship table, and the urgency level is obtained as a high priority.

[0046] In some embodiments, the method for obtaining the importance level of the first notification message may be: determining the keywords in the first notification message, obtaining a third mapping relationship table between preset keywords and importance levels; querying the importance level of the keyword matching from the third mapping relationship table to obtain the importance level of the first notification message. The third mapping relationship table may be set according to actual conditions, and the implementation of the present invention does not specifically limit this.

[0047] Exemplarily, the first notification message is a typhoon warning notification message, the keywords in the first notification message are time, typhoon and wind force level, and the importance level of the keywords time, typhoon and wind force level matching queried from the third mapping relationship table is high priority.

[0048] In some embodiments, the source information level, urgency level, and importance level of the first notification message may be obtained by: obtaining a preset level recognition model, which is a pre-trained neural network model; inputting the first notification message into the preset level recognition model for recognition, and obtaining the source information level, urgency level, and importance level of the first notification message. By recognizing the notification message through the preset level recognition model, the source information level, urgency level, and importance level can be accurately obtained.

[0049] In some embodiments, a sample data set is obtained, the sample data set includes multiple sample data, the sample data includes sample notification messages, and marked source information levels, marked urgency levels, and marked importance levels; a sample data is selected from the sample data set as target sample data, and the sample notification message in the target sample data is input into a preset neural network model for identification to obtain a predicted source information level, a predicted urgency level, and a predicted importance level; according to the predicted source information level, the predicted urgency level, the predicted importance level, the marked source information level, the marked urgency level, and the marked importance level, it is determined whether the preset neural network model has converged, and if the preset neural network model has not converged, it continues to return to the step of selecting a sample data from the sample data set as the target sample data until the preset neural network model converges to obtain a level recognition model. Wherein, the preset neural network model includes but is not limited to a convolutional neural network model, a recurrent neural network model, and a recurrent convolutional neural network model.

[0050] In some embodiments, the method for determining whether the preset neural network model has converged based on the predicted source information level, the predicted urgency level, the predicted importance level, the marked source information level, the marked urgency level, and the marked importance level can be: determining the target loss value based on the predicted source information level, the predicted urgency level, the predicted importance level, the marked source information level, the marked urgency level, and the marked importance level; if the target loss value is less than or equal to the preset loss value, determining that the preset neural network model has converged; if the target loss value is greater than the preset loss value, determining that the preset neural network model has not converged. Among them, the preset loss value can be set according to actual conditions, and the embodiments of the present invention do not specifically limit this. For example, the preset loss value can be set to 0.02.

[0051] In some embodiments, according to the predicted source information level, the predicted urgency level, the predicted importance level, the marked source information level, the marked urgency level and the marked importance level, the method for determining the target loss value can be: performing similarity calculation on the predicted source information level and the marked source information level to obtain a first similarity value; performing similarity calculation on the predicted urgency level and the marked urgency level to obtain a second similarity value; performing similarity calculation on the predicted importance level and the marked importance level to obtain a third similarity value; taking the average of the first similarity value, the second similarity value and the third similarity value to obtain a similarity value; removing the unit from the similarity value, and determining the obtained value as the target loss value. Among them, the method for calculating the similarity value can be selected according to the actual situation, and the embodiment of the present invention does not specifically limit this. For example, the method for calculating the similarity can be cosine similarity.

[0052] In some embodiments, the third output priority is determined according to the source information level, the fourth output priority is determined according to the urgency level, and the fifth output priority is determined according to the importance level; the third output priority, the fourth output priority, and the fifth output priority are weighted and summed to obtain the initial output priority. The initial output priority can be accurately determined by the source information level, the urgency level, and the importance level.

[0053] It should be noted that the output priority is expressed in the form of a priority score. The specific relationship between the output priority and the priority score can be set according to actual conditions. For example, a high output priority corresponds to a priority score greater than 80, a medium output priority corresponds to a priority score greater than 60 and less than 80, and a low output priority corresponds to a priority score less than 60.

[0054] In some embodiments, the method of determining the third output priority according to the source information level can be: obtaining a mapping relationship table between a preset source information level and the third output priority, querying the priority of the source information level pair from the mapping relationship table, and obtaining the third output priority. The mapping relationship table can be set according to actual conditions, and the embodiment of the present invention does not specifically limit this.

[0055] In some embodiments, the fourth output priority level can be determined according to the urgency level by obtaining a mapping relationship table between a preset urgency level and a fourth output priority level, querying the priority of the urgency level pair from the mapping relationship table, and obtaining the fourth output priority level. The mapping relationship table can be set according to actual conditions, and the embodiment of the present invention does not specifically limit this.

[0056] In some embodiments, the fifth output priority can be determined according to the importance level by obtaining a mapping relationship table between a preset importance level and the fifth output priority, and querying the priority of the importance level pair from the mapping relationship table to obtain the fifth output priority. The mapping relationship table can be set according to actual conditions, and the embodiment of the present invention does not specifically limit this.

[0057] In some embodiments, the weighted sum of the third output priority, the fourth output priority and the fifth output priority can be performed to obtain the initial output priority by: obtaining a preset first weight parameter, a preset second weight parameter and a preset third weight parameter; multiplying the third output priority and the preset first weight parameter to obtain the sixth output priority; multiplying the fourth output priority and the preset second weight parameter to obtain the seventh output priority; multiplying the fifth output priority and the preset third weight parameter to obtain the eighth output priority; and calculating the average of the sixth output priority, the seventh output priority and the eighth output priority to obtain the initial output priority.

[0058] Sub-step S1012: obtaining a priority adjustment coefficient according to the operation scenario.

[0059] The priority adjustment coefficient is used to adjust the initial output priority of the first notification message.

[0060] Obtain a mapping relationship table between preset operation scenarios and priority adjustment coefficients, and query the priority adjustment coefficient matching the current operation scenario from the mapping relationship table. The priority adjustment coefficient is used to adjust the initial output priority. The mapping relationship table can be set according to actual conditions, and the embodiment of the present invention does not specifically limit this.

[0061] Exemplarily, the current operating scenario of the head mounted display device is running, and from the mapping relationship table, the priority adjustment coefficient matching the current operating scenario is 2.

[0062] Sub-step S1013: determining the output priority according to the initial output priority and the priority adjustment coefficient.

[0063] The initial output priority and the priority adjustment coefficient are multiplied to obtain the output priority.

[0064] Exemplarily, the initial output priority of the first notification message is 20, and the priority adjustment coefficient is 2. The initial output priority 20 and the priority adjustment coefficient 2 are multiplied to obtain an output priority of 40.

[0065] Sub-step S1014: determining a target output mode of the first notification message according to the output priority.

[0066] Among them, the target output mode includes at least one of the following: a pop-up notification output mode, a banner notification output mode, a toast prompt output mode and a task status notification output mode.

[0067] In some embodiments, the pop-up notification output method is a window displayed independently on the display interface of the head-mounted display device, the pop-up notification is located at the top of all display layers and displayed in the middle area of ​​the display interface; the banner notification output method is displayed in the form of a banner on the display interface of the head-mounted display device, and the banner notification blocks part of the display content of the current display interface, and when a touch operation on the banner notification is received, the touch operation is responded to; the toast prompt output method is displayed in the form of a floating message box on the display interface of the head-mounted display device; the toast prompt and the banner notification are displayed in different areas of the display interface respectively; the task status notification output method is displayed in the form of a task logo on the display interface of the head-mounted display device.

[0068] In some embodiments, the pop-up notification output mode is a window displayed independently on the display interface. The pop-up notification is located at the top of all display layers and displayed in the middle area of ​​the display interface. The pop-up notification is used to convey important information, notifications or warnings to the wearer, and may require the wearer to perform operations or decisions. The scenarios in which the pop-up notification is used include the global desktop, outputting notification messages in applications, and outputting notification messages on the lock screen interface.

[0069] For example, Figure 3As shown, when the language setting is output in a pop-up notification output mode, a pop-up notification 11 of the language setting is displayed on the display interface 10 of the head mounted display device, and the pop-up notification 11 of the language setting is located at the top of all display layers and displayed in the middle area of ​​the display interface. The wearer can choose whether to switch the language setting in the pop-up notification.

[0070] In some embodiments, the banner notification output mode is to display it in the form of a banner on the display interface of the head mounted display device, and the banner notification covers part of the content displayed on the current display interface screen. The banner notification is used to deliver important message reminders and event reminders to the wearer. The wearer can perform touch operations on the banner notification, for example, clear the notification, open the application or related page corresponding to the notification. The use scenarios of the banner notification include global desktop, outputting notification messages in applications, and outputting notification messages on the lock screen interface.

[0071] For example, Figure 4 As shown, when a new message reminder is output in the form of a banner notification output, a banner notification 12 of the new message reminder is displayed on the display interface 10 of the head-mounted display device. The banner notification 12 can also be touched. If the wearer touches and clicks on the banner notification of the new message reminder, the display interface opens to the application where the new message is located, and displays the new message interface so that the wearer can reply to the message.

[0072] In some embodiments, the toast prompt output mode is displayed in the form of a floating message box on the display interface of the head-mounted display device. The toast prompt application is used in scenarios such as operation feedback in application settings and prompt feedback on the current application / device running status. For example, when the wearer reports a setting data item in the application, the display interface will pop up a "Save Successfully" prompt to let the wearer know that the operation has been completed. Among them, the toast prompt application scenarios include the global desktop and outputting notification messages in the application.

[0073] For example, Figure 5 As shown, when the network abnormality prompt information is output in a toast prompt output mode, a toast prompt 13 of the network abnormality prompt information is displayed on the display interface 10 of the head mounted display device, which can effectively prompt the wearer of the network abnormality.

[0074] In some embodiments, the task status notification is displayed in the form of a task identifier on the display interface of the head-mounted display device. The task status notification application outputs notification messages on the global desktop and in the application program. The task status notification includes a multi-task status notification, that is, multiple task status notifications are processed simultaneously, and the task status notification is performed according to the output priority, without waiting for one task status notification to be completed before starting another task status notification. For example, the task status notification includes a call duration status and a recording status, and the priority of the call duration status is greater than the recording status. When the head-mounted display device first performs recording and outputs the task status notification of the recording status on the display interface, when a voice call is connected, the task status notification of the recording status is ended, and the task status notification of the call duration status is output. When the voice call ends, the task status notification of the recording status continues to be output. When the head-mounted display device first performs a voice call and outputs the task status notification of the call duration status on the display interface, when recording is turned on, since the priority of the recording is lower than the priority of the voice call, the task status notification of the call duration status continues to be output.

[0075] For example, Figure 6 As shown, when the call duration status is output in the task status notification output mode, the task status notification 14 of the call duration status is displayed on the display interface 10 of the head mounted display device, which can effectively display the call duration information.

[0076] In one embodiment, the notification message output window area corresponding to the pop-up notification output mode is larger than the notification message output window area corresponding to the banner notification output mode, the toast prompt output mode, and the multi-tasking status notification output mode.

[0077] In one embodiment, the position of the first output window of the notification message in the banner notification output mode and the position of the second output window of the notification message in the toast prompt output mode can be swapped. In one embodiment, the first output window is in the lower area of ​​the head-mounted display device display interface, and the second output window is in the upper area of ​​the head-mounted display device display interface. In another embodiment, the first output window is in the upper area of ​​the head-mounted display device display interface, and the second output window is in the lower area of ​​the head-mounted display device display interface.

[0078] In one embodiment, the output rules of the notification messages in the banner notification output mode and the toast prompt output mode are: each notification message is displayed for a set time, and after the set time, if there is a new notification message to be displayed, then the new notification message is displayed, and if there is no new notification message to be displayed, then the first output window and the second output window will not be displayed in the display interface of the head-mounted display device. The set time can be set according to specific needs, and this embodiment does not limit this.

[0079] It should be noted that the duration of the banner notification and toast prompt being displayed on the display interface can be set according to actual conditions, and the embodiment of the present invention does not specifically limit this. For example, the banner notification is displayed for 2 seconds, and the toast prompt is displayed for 1 second. When there is a new banner notification and toast prompt output, it is necessary to wait until the banner notification and toast prompt being displayed are completed before displaying them. The banner notification can be displayed in the upper half of the display interface, and the toast prompt can be displayed in the lower half of the display interface; or the banner notification can be displayed in the lower half of the display interface, and the toast prompt can be displayed in the upper half of the display interface.

[0080] In some embodiments, if the output priority is greater than or equal to the first preset priority, the target output mode is determined to be a pop-up notification output mode; if the output priority is less than the first preset priority and greater than or equal to the second preset priority, the target output mode is determined to be the banner notification output mode; if the output priority is less than the second preset priority and greater than or equal to the third preset priority, the target output mode is determined to be the toast prompt output mode; if the output priority is less than the third preset priority and greater than or equal to the fourth preset priority, the target output mode is determined to be a task status notification output mode. Among them, the first preset priority, the second preset priority, the third preset priority and the fourth preset priority can be set according to actual conditions, and the embodiments of the present invention do not specifically limit this. For example, the priority can be expressed in the form of a priority score, the first preset priority can be set to a priority score of 80, the second preset priority can be set to a priority score of 60, the third preset priority can be set to a priority score of 40, and the fourth preset priority can be set to a priority score of 20.

[0081] Exemplarily, the first notification message is to display heart rate information, the initial output priority of displaying heart rate information is priority score 35, the current operating scene of the head mounted display device is running, and the priority adjustment coefficient matching the current operating scene is queried from the mapping relationship table as 2, and the priority score 35 of the initial output priority and the priority adjustment coefficient 2 are multiplied to obtain an output priority of priority score 70, wherein the first preset priority can be set to priority score 80, the second preset priority can be set to priority score 60, the third preset priority can be set to priority score 40, and the fourth preset priority can be set to priority score 20. The priority score 70 of the output priority is less than the first preset priority and greater than or equal to the second preset priority, and it is determined that the target output mode of the first notification message displaying heart rate information is the banner notification output mode.

[0082] Step S103: Control the head mounted display device to output the first notification message according to the target output mode.

[0083] After obtaining the target output mode, the head mounted display device is controlled to output the first notification message in the target output mode, so as to accurately output a more important target notification message.

[0084] In some embodiments, it is determined whether there is a second notification message whose output mode has been confirmed and not output; if there is no second notification message whose output mode has been confirmed and not output, the step of: controlling the head mounted display device to output the first notification message according to the target output mode. If there is no other second notification message that has not been output, directly output the first notification message in the target output mode, so as to accurately output the more important target notification message.

[0085] In some embodiments, if there is a second notification message whose output mode has been confirmed but not output, the second output priority of each second notification message is obtained; the output order of the first notification message is determined according to the output priority of the first notification message and each second output priority; the head mounted display device is controlled to output the first notification message in the target output mode according to the output order. The output priority of the first notification message is compared with the second output priority of the second notification message, so as to output a notification message with a higher priority, so that the user can understand important information more timely, thereby improving the user's experience.

[0086] Exemplarily, there is a second notification message a and a second notification message b whose output mode has been confirmed but not output, wherein the second output priority of the second notification message a is a priority score of 40, the second output priority of the second notification message b is a priority score of 15, and the output priority of the first notification message is a priority score of 30, then the second notification message a is output first, then the first notification message is output, and finally the second notification message b is output.

[0087] In some embodiments, the available system resources of the head mounted display device are obtained; if the available system resources are greater than or equal to the preset available system resources, the step of: controlling the head mounted display device to output the first notification message according to the target output mode. The preset available system resources can be set according to actual conditions, and the embodiment of the present invention does not specifically limit this. For example, the available system resources can be the executable memory of the head mounted display device, and the preset available system resources are 80% of the executable memory.

[0088] In some embodiments, if the available system resources are less than the preset available system resources, the first notification message is stored in a cache queue corresponding to the output priority among multiple cache queues according to the output priority; and the target output mode of the first notification message is updated according to the cache queue where the first notification message is located.

[0089] Among them, different output priorities correspond to different cache queues. For example, notification messages with an output priority greater than or equal to the first preset priority are stored in the first cache queue, notification messages with an output priority less than the first preset priority and greater than or equal to the second preset priority are stored in the second cache queue, notification messages with an output priority less than the second preset priority and greater than or equal to the third preset priority are stored in the third cache queue, and notification messages with an output priority less than the third preset priority and greater than or equal to the fourth preset priority are stored in the fourth cache queue.

[0090] In some embodiments, the output priority of the first notification message is obtained, and the first notification message is cached in a corresponding cache queue according to the output priority. By caching the first notification message in the cache queue, when system resources are limited, notification messages in the high-priority cache queue are processed first, thereby giving priority to important notification messages, which greatly improves the user experience.

[0091] In some embodiments, in response to the available system resources of the head-mounted display device being less than or equal to a preset threshold, each notification message is stored in a cache queue corresponding to an output priority in a plurality of cache queues. The preset threshold can be set according to actual conditions, and the embodiment of the present invention does not specifically limit this. When the system resources of the head-mounted display device are insufficient, each notification message is stored in a cache queue corresponding to an output priority in a plurality of cache queues, so that the device prioritizes processing notification messages in a high-priority cache queue, and then prioritizes processing important notification messages, thereby greatly improving the user experience.

[0092] The notification message output method provided in the above embodiment obtains the first notification message to be output and the current operating scenario of the head-mounted display device; determines the target output mode of the first notification message according to the first notification message and the operating scenario; and controls the head-mounted display device to output the first notification message according to the target output mode. The present application adjusts the output mode of the first notification message according to the operating scenario, so that the output mode of the notification message can adapt to the user's preferences and scenario requirements, greatly improving the rationality and accuracy of the notification message output, so that the user can understand important information more timely, thereby improving the user's experience.

[0093] See also Figure 7 , Figure 7 A schematic block diagram of a notification message output device provided in an embodiment of the present application.

[0094] like Figure 7 As shown, the notification message output device 200 includes an acquisition module 210, a determination module 220 and an output module 230, wherein:

[0095] The acquisition module 210 is used to acquire the first notification message to be output and the current operating scene of the head mounted display device;

[0096] The determination module 220 is used to determine a target output mode of the first notification message according to the first notification message and the operation scenario;

[0097] The output module 230 is used to control the head mounted display device to output the first notification message according to the target output mode.

[0098] In some embodiments, Figure 8 As shown, the determination module 220 includes a determination submodule 221 and an acquisition submodule 222, wherein:

[0099] The determining submodule 221 is used to determine an initial output priority of the first notification message, where the greater the initial output priority, the more important the first notification message;

[0100] The acquisition submodule 222 is used to acquire a priority adjustment coefficient according to the operation scenario, and the priority adjustment coefficient is used to adjust the initial output priority of the first notification message;

[0101] The determination submodule 221 is further configured to determine the output priority according to the initial output priority and the priority adjustment coefficient;

[0102] The determining submodule 221 is further configured to determine a target output mode of the first notification message according to the output priority.

[0103] In some embodiments, the notification message output device 200 is further used to:

[0104] The target output mode includes at least one of the following: a pop-up notification output mode, a banner notification output mode, a toast prompt output mode, and a task status notification output mode.

[0105] In some embodiments, the notification message output device 200 is further used to:

[0106] The pop-up notification output mode is a window independently displayed on the display interface of the head mounted display device, and the pop-up notification is located at the topmost layer of all display layers and displayed in the middle area of ​​the display interface;

[0107] and / or,

[0108] The banner notification output mode is to display the banner notification on the display interface of the head mounted display device in the form of a banner, and the banner notification covers part of the displayed content of the current display interface, and when a touch operation on the banner notification is received, respond to the touch operation;

[0109] and / or,

[0110] The toast prompt output mode is to display it in the form of a floating message box on the display interface of the head mounted display device; the toast prompt and the banner notification are respectively displayed in different areas of the display interface;

[0111] and / or,

[0112] The task status notification output method is to display it in the form of a task logo on the display interface of the head mounted display device.

[0113] In some embodiments, the determining submodule 221 is further used to:

[0114] If the output priority is greater than or equal to the first preset priority, determining the target output mode to be the pop-up notification output mode;

[0115] If the output priority is less than the first preset priority and greater than or equal to the second preset priority, determining that the target output mode is the pop-up output mode and the banner notification output mode;

[0116] If the output priority is less than the second preset priority and greater than or equal to the third preset priority, determining that the target output mode is the pop-up window output mode and the toast prompt output mode;

[0117] If the output priority is less than the third preset priority and greater than or equal to the fourth preset priority, it is determined that the target output mode is the pop-up window output mode and the task status notification output mode.

[0118] In some embodiments, the notification message output device 200 is further used to:

[0119] Determine whether there is a second notification message whose output mode has been confirmed and not output;

[0120] If there is no second notification message whose output mode has been confirmed and has not been output, the step of controlling the head mounted display device to output the first notification message according to the target output mode is performed.

[0121] In some embodiments, the notification message output device 200 is further used to:

[0122] If there are second notification messages whose output mode has been confirmed but not output, obtaining the second output priority of each second notification message;

[0123] determining an output order of the first notification messages according to the output priority of the first notification messages and each of the second output priorities;

[0124] The head mounted display device is controlled to output the first notification message in the target output mode according to the output order.

[0125] In some embodiments, the notification message output device 200 is further used to:

[0126] Obtaining available system resources of the head mounted display device;

[0127] If the available system resources are less than the preset available system resources, storing the first notification message in a cache queue corresponding to the output priority among a plurality of cache queues according to the output priority;

[0128] A target output mode of the first notification message is updated according to the cache queue where the first notification message is located.

[0129] It should be noted that those skilled in the art can clearly understand that for the convenience and brevity of description, the specific working process of the above-mentioned notification message output device can refer to the corresponding process in the aforementioned notification message output method embodiment, and will not be repeated here.

[0130] See also Fig. 9 , Fig. 9 A schematic block diagram of the structure of a head mounted display device provided in an embodiment of the present application.

[0131] like Fig. 9 As shown, the head mounted display device 300 includes a processor 302 and a memory 303 connected via a system bus 301, wherein the memory may include a storage medium and an internal memory.

[0132] The storage medium can store a computer program. The computer program includes program instructions, and when the program instructions are executed, the processor can execute any notification message output method.

[0133] The processor 301 is used to provide computing and control capabilities to support the operation of the entire head-mounted display device.

[0134] The internal memory provides an environment for the operation of the computer program in the storage medium. When the computer program is executed by the processor, the processor can execute any notification message output method.

[0135] Those skilled in the art will understand that Fig. 9 The structure shown in the figure is only a block diagram of a part of the structure related to the scheme of the present application, and does not constitute a limitation on the head-mounted display device to which the scheme of the present application is applied. The specific head-mounted display device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0136] It should be understood that the processor 302 may be a central processing unit (CPU), and the processor may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0137] In one embodiment, the processor 302 is used to run a computer program stored in the memory to implement the following steps:

[0138] Obtaining a first notification message to be output and a current operating scenario of the head mounted display device;

[0139] Determining a target output mode of the first notification message according to the first notification message and the running scenario;

[0140] According to the target output mode, the head mounted display device is controlled to output the first notification message.

[0141] In one embodiment, when the processor 302 implements the step of determining the target output mode of the first notification message according to the first notification message and the operating scenario, it is configured to implement:

[0142] Determine an initial output priority of the first notification message, where the initial output priority is used to characterize the importance of the first notification message, and a greater initial output priority indicates more important the first notification message;

[0143] Acquire a priority adjustment coefficient according to the operation scenario, where the priority adjustment coefficient is used to adjust an initial output priority of the first notification message;

[0144] Determining an output priority according to the initial output priority and the priority adjustment coefficient;

[0145] A target output mode of the first notification message is determined according to the output priority.

[0146] In one embodiment, the processor 302 is configured to implement:

[0147] The target output mode includes at least one of the following: a pop-up notification output mode, a banner notification output mode, a toast prompt output mode, and a task status notification output mode.

[0148] In one embodiment, the processor 302 is configured to implement:

[0149] The pop-up notification output mode is a window independently displayed on the display interface of the head mounted display device, and the pop-up notification is located at the topmost layer of all display layers and displayed in the middle area of ​​the display interface;

[0150] and / or,

[0151] The banner notification output mode is to display the banner notification on the display interface of the head mounted display device in the form of a banner, and the banner notification covers part of the displayed content of the current display interface, and when a touch operation on the banner notification is received, respond to the touch operation;

[0152] and / or,

[0153] The toast prompt output mode is to display it in the form of a floating message box on the display interface of the head mounted display device; the toast prompt and the banner notification are respectively displayed in different areas of the display interface;

[0154] and / or,

[0155] The task status notification output method is to display it in the form of a task logo on the display interface of the head mounted display device.

[0156] In one embodiment, when implementing the step of determining the target output mode of the first notification message according to the output priority, the processor 302 is configured to implement:

[0157] If the output priority is greater than or equal to the first preset priority, determining the target output mode to be the pop-up notification output mode;

[0158] If the output priority is less than the first preset priority and greater than or equal to the second preset priority, determining that the target output mode is the pop-up output mode and the banner notification output mode;

[0159] If the output priority is less than the second preset priority and greater than or equal to the third preset priority, determining that the target output mode is the pop-up window output mode and the toast prompt output mode;

[0160] If the output priority is less than the third preset priority and greater than or equal to the fourth preset priority, it is determined that the target output mode is the pop-up window output mode and the task status notification output mode.

[0161] In one embodiment, before implementing the step of controlling the head mounted display device to output the first notification message according to the target output mode, the processor 302 is further configured to implement:

[0162] Determine whether there is a second notification message whose output mode has been confirmed and not output;

[0163] If there is no second notification message whose output mode has been confirmed and has not been output, the step of controlling the head mounted display device to output the first notification message according to the target output mode is performed.

[0164] In one embodiment, after implementing the determining whether there is a second notification message whose output mode has been confirmed and not output, the processor 302 is further configured to implement:

[0165] If there are second notification messages whose output mode has been confirmed but not output, obtaining the second output priority of each second notification message;

[0166] determining an output order of the first notification messages according to the output priority of the first notification messages and each of the second output priorities;

[0167] The head mounted display device is controlled to output the first notification message in the target output mode according to the output order.

[0168] In one embodiment, after obtaining the available system resources of the head mounted display device, the processor 302 is further configured to:

[0169] Obtaining available system resources of the head mounted display device;

[0170] If the available system resources are less than the preset available system resources, storing the first notification message in a cache queue corresponding to the output priority among a plurality of cache queues according to the output priority;

[0171] A target output mode of the first notification message is updated according to the cache queue where the first notification message is located.

[0172] It should be noted that technicians in the relevant field can clearly understand that for the convenience and conciseness of description, the above description of the specific working process of the head-mounted display device can refer to the corresponding process in the aforementioned notification message output method embodiment, and will not be repeated here.

[0173] An embodiment of the present application also provides a computer-readable storage medium, on which a computer program is stored. The computer program includes program instructions. The method implemented when the program instructions are executed can refer to the various embodiments of the notification message output method of the present application.

[0174] The computer-readable storage medium may be an internal storage unit of the head-mounted display device described in the foregoing embodiment, such as a hard disk or memory of the head-mounted display device. The computer-readable storage medium may be non-volatile or volatile. The computer-readable storage medium may also be an external storage device of the head-mounted display device, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc., equipped on the head-mounted display device.

[0175] It should be understood that the terms used in this application specification are only for the purpose of describing specific embodiments and are not intended to limit the application. As used in this application specification, unless the context clearly indicates otherwise, the singular forms "a", "an" and "the" are intended to include plural forms.

[0176] It should also be understood that the term "and / or" used in the present specification refers to any combination of one or more of the associated listed items and all possible combinations, including these combinations. It should be noted that, in this article, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "including a..." does not exclude the presence of other identical elements in the process, method, article or system including the element.

[0177] The serial numbers of the embodiments of the present application are for description only and do not represent the advantages and disadvantages of the embodiments. The above description is only a specific implementation mode of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed in the present application, and these modifications or replacements should be included in the protection scope of the present application.

Claims

1. A notification message output method, characterized in that: Applied to a head mounted display device, the method comprises: Obtaining a first notification message to be output and a current operating scenario of the head mounted display device; Determining a target output mode of the first notification message according to the first notification message and the running scenario; According to the target output mode, the head mounted display device is controlled to output the first notification message.

2. The notification message output method according to claim 1, characterized in that: The determining, according to the first notification message and the running scenario, a target output mode of the first notification message includes: Determine an initial output priority of the first notification message, wherein a greater initial output priority indicates more important the first notification message; Acquire a priority adjustment coefficient according to the operation scenario, where the priority adjustment coefficient is used to adjust an initial output priority of the first notification message; Determining an output priority according to the initial output priority and the priority adjustment coefficient; A target output mode of the first notification message is determined according to the output priority.

3. The notification message output method according to claim 1, characterized in that: The target output mode includes at least one of the following: a pop-up notification output mode, a banner notification output mode, a toast prompt output mode, and a task status notification output mode.

4. The notification message output method according to claim 3, characterized in that: The method further comprises: The pop-up notification output mode is a window independently displayed on the display interface of the head mounted display device, and the pop-up notification is located at the topmost layer of all display layers and displayed in the middle area of ​​the display interface; and / or, The banner notification output mode is to display the banner notification on the display interface of the head mounted display device in the form of a banner, and the banner notification covers part of the displayed content of the current display interface, and when a touch operation on the banner notification is received, respond to the touch operation; and / or, The toast prompt output mode is to display it in the form of a floating message box on the display interface of the head mounted display device; the toast prompt and the banner notification are respectively displayed in different areas of the display interface; and / or, The task status notification output method is to display it in the form of a task logo on the display interface of the head mounted display device.

5. The notification message output method according to claim 2, characterized in that: The determining a target output mode of the first notification message according to the output priority includes: If the output priority is greater than or equal to the first preset priority, determining that the target output mode is a pop-up notification output mode; If the output priority is less than the first preset priority and greater than or equal to the second preset priority, determining that the target output mode is a banner notification output mode; If the output priority is less than the second preset priority and greater than or equal to the third preset priority, determining that the target output mode is a toast prompt output mode; If the output priority is less than the third preset priority and greater than or equal to the fourth preset priority, the target output mode is determined to be the task status notification output mode.

6. The notification message output method according to claim 1, characterized in that: Before controlling the head mounted display device to output the first notification message according to the target output mode, the method further includes: Determine whether there is a second notification message whose output mode has been confirmed and not output; If there is no second notification message whose output mode has been confirmed and has not been output, the step of controlling the head mounted display device to output the first notification message according to the target output mode is performed.

7. The notification message output method according to claim 6, characterized in that: After determining whether there is a second notification message whose output mode has been confirmed and not output, the method further includes: If there are second notification messages whose output mode has been confirmed but not output, obtaining the second output priority of each second notification message; determining an output order of the first notification messages according to the output priority of the first notification messages and each of the second output priorities; The head mounted display device is controlled to output the first notification message in the target output mode according to the output order.

8. The notification message output method according to claim 1, characterized in that: The method further comprises: Obtaining available system resources of the head mounted display device; If the available system resources are less than the preset available system resources, storing the first notification message in a cache queue corresponding to the output priority among a plurality of cache queues according to the output priority; A target output mode of the first notification message is updated according to the cache queue where the first notification message is located.

9. A notification message output device, characterized in that: The notification message output device includes an acquisition module, a determination module and an output module, wherein: The acquisition module is used to acquire the first notification message to be output and the current operating scene of the head mounted display device; The determining module is used to determine a target output mode of the first notification message according to the first notification message and the operation scenario; The output module is used to control the head mounted display device to output the first notification message according to the target output mode.

10. A head mounted display device, characterized in that: The head mounted display device comprises a processor, a memory, and a computer program stored in the memory and executable by the processor, wherein when the computer program is executed by the processor, the steps of the notification message output method as described in any one of claims 1 to 8 are implemented.

11. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, wherein when the computer program is executed by a processor, the steps of the notification message output method according to any one of claims 1 to 8 are implemented.

Images