State reminding processing method and device, head-mounted equipment and storage medium

Abstract

The invention provides a state reminding processing method and device, head-mounted equipment and a computer readable storage medium. The state reminding processing method comprises the following steps: acquiring first physiological state information of a wearer of the head-mounted equipment; determining whether the head-mounted device triggers a state reminding mode or not based on the first physiological state information; when the head-mounted device triggers a state reminding mode, visual perceptibility reduction processing is carried out on a visual field picture of the head-mounted device, and the visual perceptibility comprises at least one of color saturation and picture brightness. According to the invention, the problem that the reminding function (such as sound, vibration and pop-up) is easy to ignore or close can be solved to a certain extent, and the effectiveness of state reminding is improved.

Description

Technical Field

[0001] This application relates to the field of information processing technology, specifically to a status reminder processing method, apparatus, head-mounted device, and computer-readable storage medium. Background Technology

[0002] Today, prolonged screen time and sedentary lifestyles pose hidden health risks. With the rise of digital technology, electronic devices such as smart glasses and smart helmets have become deeply integrated into every aspect of life, serving as indispensable partners in daily work, study, and entertainment. The status reminder functions of these devices also play a crucial role, acting as an important line of defense for people's physical and mental health. These status reminder functions of electronic devices aim to promptly detect and intervene in problems such as prolonged screen time and sedentary behavior. By reminding users of eye fatigue and other unhealthy states, they guide people to develop good lifestyle habits, thereby preventing potential health risks.

[0003] However, current status reminders, such as sound reminders, vibration reminders, and pop-up reminders, are external and easily ignored or actively turned off, making it easy for users to overlook status reminders and thus preventing them from playing their due role. Summary of the Invention

[0004] This application provides a status reminder processing method, device, head-mounted device, and computer-readable storage medium, which can solve the problem to some extent that reminder functions (such as sound, vibration, pop-up windows, etc.) are easily ignored or turned off, thereby improving the effectiveness of status reminders.

[0005] Firstly, this application provides a status reminder processing method, the method comprising: Obtain the initial physiological state information of the wearer of the head-mounted device; Based on the first physiological state information, determine whether the head-mounted device triggers the status reminder mode; When the head-mounted device triggers the status reminder mode, the visual perception of the field of view of the head-mounted device is reduced, wherein the visual perception includes at least one of color saturation and screen brightness.

[0006] Secondly, this application provides a status reminder processing device, the status reminder processing device comprising: The acquisition unit is used to acquire the first physiological state information of the wearer of the head-mounted device; The determining unit is configured to determine, based on the first physiological state information, whether the head-mounted device has triggered a status reminder mode; The processing unit is configured to reduce the visual perception of the field of view of the head-mounted device when the head-mounted device triggers the status reminder mode, wherein the visual perception includes at least one of color saturation and screen brightness.

[0007] Thirdly, this application also provides a head-mounted device, which includes a processor and a memory, wherein the memory stores a computer program, and the processor executes any of the status reminder processing methods provided in this application when it calls the computer program in the memory.

[0008] Fourthly, this application also provides a computer-readable storage medium having a computer program stored thereon, the computer program being loaded by a processor to execute the status reminder processing method described above.

[0009] This application obtains the first physiological state information of the wearer of the head-mounted device; based on the first physiological state information, it determines whether the head-mounted device has triggered a status reminder mode; when the head-mounted device triggers the status reminder mode, it reduces the visual perceptibility of the head-mounted device's field of view, so that the first physiological state information can drive changes in the visual perceptibility of the entire field of view (such as global color saturation and screen brightness), thereby allowing the user to immerse themselves in the reminder through the visual perceptibility of the field of view. Since the reduced visual perceptibility of the field of view is not easily ignored or turned off, it can solve the problem of reminder functions (such as sound, vibration, pop-ups, etc.) being easily ignored or turned off to a certain extent, thus improving the effectiveness of status reminders. Attached Figure Description

[0010] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0011] Figure 1 This is a schematic block diagram of the structure of a head-mounted device provided in an embodiment of this application; Figure 2 This is a schematic diagram of an embodiment of the status reminder processing method provided in this application; Figure 3 This is a schematic flowchart of an embodiment of step 203 provided in this application; Figure 4 This is a schematic flowchart of another embodiment of step 203 provided in this application; Figure 5 This is a schematic diagram of another embodiment of the status reminder processing method provided in this application; Figure 6 This is a schematic diagram of an embodiment of the status reminder processing device provided in this application. Detailed Implementation

[0012] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0013] The flowchart shown in the attached diagram is for illustrative purposes only and does not necessarily include all content and operations / steps, nor does it necessarily have to be performed in the described order. For example, some operations / steps can be broken down, combined, or partially merged, so the actual execution order may change depending on the actual situation.

[0014] In the description of the embodiments of this application, it should be understood that the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Therefore, features defined with "first" and "second" may explicitly or implicitly include one or more of the stated features. In the description of the embodiments of this application, "multiple" means two or more, unless otherwise explicitly specified.

[0015] To enable any person skilled in the art to implement and use this application, the following description is provided. In this description, details are set forth for purposes of explanation. It should be understood that those skilled in the art will recognize that this application can be implemented without using these specific details. In other instances, well-known processes will not be described in detail to avoid obscuring the description of the embodiments of this application with unnecessary detail. Therefore, this application is not intended to be limited to the embodiments shown, but is consistent with the broadest scope of the principles and features disclosed in the embodiments of this application.

[0016] This application provides a status reminder processing method, apparatus, head-mounted device, and computer-readable storage medium. The status reminder processing apparatus can be integrated into the head-mounted device. The head-mounted device can be smart glasses, a smart helmet, etc. The smart glasses can be AR (augmented reality) glasses, VR (virtual reality) glasses, MR (mixed reality) glasses, XR (eXtended Reality) glasses, etc., and the smart helmet can be an AR helmet, etc.

[0017] The execution subject of the status reminder processing method in this application embodiment can be the status reminder processing device provided in this application embodiment, or a head-mounted device that integrates the status reminder processing device. The status reminder processing device can be implemented in hardware or software.

[0018] The following detailed description of some embodiments of this application is provided in conjunction with the accompanying drawings. Unless otherwise specified, the following embodiments and features can be combined with each other.

[0019] Figure 1 This is a schematic block diagram of the structure of a head-mounted device provided in an embodiment of this application.

[0020] like Figure 1 As shown, the head-mounted device 100 includes a processor 101 and a memory 102, which are connected via a bus 103, such as an I2C (Inter-integrated Circuit) bus.

[0021] Specifically, processor 101 provides computing and control capabilities to support the operation of the entire head-mounted device 100. Processor 101 can be a Central Processing Unit (CPU), but it can also be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor.

[0022] Specifically, the memory 102 can be a Flash chip, a read-only memory (ROM) disk, an optical disk, a USB flash drive, or a portable hard drive, etc.

[0023] Those skilled in the art will understand that Figure 1 The structures shown are merely block diagrams of some structures related to the embodiments of this application and do not constitute a limitation on the head-mounted device to which the embodiments of this application are applied. Specific head-mounted devices may include more or fewer components than those shown in the figures, or combine certain components, or have different component arrangements.

[0024] The processor 101 is configured to run a computer program stored in the memory 102, and implement any of the status reminder processing methods provided in this application embodiment when executing the computer program. For example, the processor 101 is configured to run a computer program stored in the memory 102, and can implement the following steps when executing the computer program: The system acquires the first physiological state information of the wearer of the head-mounted device; based on the first physiological state information, it determines whether the head-mounted device has triggered a status reminder mode; when the head-mounted device triggers the status reminder mode, it performs visual perception reduction processing on the field of view of the head-mounted device, wherein the visual perception includes at least one of color saturation and screen brightness.

[0025] It should be noted that those skilled in the art will understand that, for the sake of convenience and brevity, the specific working process of the head-mounted device described above can be referred to the corresponding process in the following embodiments of the status reminder processing method, and will not be repeated here.

[0026] The following will be based on Figure 1 Taking the head-mounted device shown as the execution subject of the status reminder processing method as an example, the status reminder processing method provided in this application embodiment will be described in detail. For the sake of simplification and ease of description, the execution subject will be omitted in the subsequent method embodiments.

[0027] Please see Figure 2 , Figure 2 This is a flowchart illustrating a status alert processing method provided in an embodiment of this application. The status alert processing method includes steps 201-203, wherein: 201. Obtain the first physiological state information of the wearer of the head-mounted device.

[0028] Physiological state information includes at least one of visual indication information and body posture indication information.

[0029] The visual indication information includes, but is not limited to, the wearer's gaze distance, gaze duration (gaze duration may include, but is not limited to, cumulative gaze duration and continuous gaze duration), and eye health index (eye health index may be determined based on information such as pupil state, blink frequency, and eye movement amplitude).

[0030] Among them, posture indication information may include, but is not limited to, the duration of maintaining a certain sitting posture, the duration of looking down, etc.

[0031] The first physiological state information is the physiological state information detected in the normal display mode.

[0032] In this embodiment, to alert the user to fatigue, the head-mounted device has at least two viewing modes: a normal display mode and a status alert mode. The visual perception of the normal display mode and the status alert mode is set differently, with the visual perception in the normal display mode being greater than that in the status alert mode. This is to ensure that the user experiences a clear visual difference between the two modes. For example, the color saturation in the status alert mode is lower than that in the normal display mode, and the screen brightness in the status alert mode is lower than that in the normal display mode.

[0033] Depending on the settings of the physiological state information, step 201 can be implemented in various ways, including, for example: (1) In some embodiments, the physiological state information includes visual indication information. For example, the visual indication information includes gaze distance and gaze duration. In this case, the first physiological state information includes the first gaze distance and the first gaze duration. Step 201 may specifically include: obtaining the first gaze distance and the first gaze duration of the wearer of the head-mounted device. For example, the head-mounted device can use eye-tracking technology to detect the wearer's gaze point and pupil state, and combine it with a depth camera / ToF depth camera (Time of Flight, depth sensing technology measures the round-trip time of the light signal from the device to the target object by emitting an adjusted light signal, and calculates the actual physical distance between the target object and the device. Thus, the ToF depth camera can measure the distance between the wearer's gaze object and the head-mounted device by using depth sensor technology, thereby determining the wearer's gaze distance) to determine the wearer's gaze distance, thereby obtaining the first gaze distance; and the duration of the wearer's gaze state can be counted as the gaze duration, thereby obtaining the first gaze duration.

[0034] The first gaze distance refers to the gaze distance detected in normal display mode.

[0035] The first fixation duration refers to the fixation duration detected in normal display mode.

[0036] (2) In some embodiments, the physiological state information includes body posture indication information. For example, if the body posture indication information includes sitting duration and head-down duration, then the first physiological state information includes the first sitting duration and the first head-down duration. Step 201 may specifically include: obtaining the first sitting duration and the first head-down duration of the wearer of the head-mounted device. For example, the wearer's motion state, such as motion acceleration, motion angular velocity, and posture data, can be detected in real time by the IMU (Inertial Measurement Unit) built into the head-mounted device. If the motion acceleration and motion angular velocity are lower than the preset value for a long time, it is considered that the wearer is in a prolonged sitting state. The duration of motion acceleration and motion angular velocity being lower than the preset value can be counted as the sitting duration, thereby obtaining the first sitting duration. If the posture data reflects that the wearer is in a head-down state, the duration of the wearer being in a head-down state can be counted based on the posture data as the head-down duration, thereby obtaining the first head-down duration.

[0037] The first sitting posture duration refers to the sitting posture duration detected in normal display mode.

[0038] The first head-down duration refers to the head-down duration detected in normal display mode.

[0039] (3) In some embodiments, physiological state information includes visual indication information and body posture indication information. For example, visual indication information includes gaze distance and gaze duration, and body posture indication information includes sitting posture duration. In this case, the first physiological state information includes the first gaze distance, the first gaze duration, the first sitting posture duration, and the first head-down duration. Step 201 may specifically include: obtaining the first gaze distance, the first gaze duration, the first sitting posture duration, and the first head-down duration of the wearer of the head-mounted device.

[0040] 202. Based on the first physiological state information, determine whether the head-mounted device has triggered a status reminder mode.

[0041] There are several ways to implement step 202, including, for example: (1) In some embodiments, a status reminder mode is triggered when the wearer is considered to be in a state of visual fatigue. In this case, step 202 may specifically include: determining whether the wearer is in a state of visual fatigue based on the first visual indication information; if the wearer is in a state of visual fatigue, determining that the head-mounted device triggers a status reminder mode; if the wearer is in a state of visual fatigue, determining that the head-mounted device does not trigger a status reminder mode. For example, the first visual indication information includes a first gaze distance and a first gaze duration. If the duration of the first gaze distance being less than a preset distance threshold is greater than a first preset duration, or if the first gaze duration is greater than a second preset duration, then it is determined that the wearer is in a state of visual fatigue, and the head-mounted device is determined to trigger a status reminder mode. If the duration of the first gaze distance being less than the preset distance threshold is less than or equal to the first preset duration, and the first gaze duration is less than or equal to the second preset duration, then it is determined that the wearer is not in a state of visual fatigue, and the head-mounted device is determined not to trigger a status reminder mode.

[0042] (2) In some embodiments, a status reminder mode is triggered when the wearer is considered to be in a state of physical fatigue. In this case, step 202 may specifically include: determining whether the wearer is in a state of physical fatigue based on the first posture indication information; determining that the head-mounted device triggers a status reminder mode when the wearer is in a state of physical fatigue; and determining that the head-mounted device does not trigger a status reminder mode when the wearer is in a state of physical fatigue. For example, the first posture indication information includes a first sitting posture duration and a first head-down duration. If the first sitting posture duration is greater than a third preset duration, or if the first head-down duration is greater than a fourth preset duration, then it is determined that the wearer is in a state of physical fatigue, and the head-mounted device is determined to trigger a status reminder mode. If the first sitting posture duration is less than or equal to the third preset duration, and the first head-down duration is less than or equal to the fourth preset duration, then it is determined that the wearer is not in a state of physical fatigue, and the head-mounted device is determined not to trigger a status reminder mode.

[0043] (3) In some embodiments, the field of view includes a status prompt element, which is used to display the wearer's energy prompt value. When the energy prompt value displayed by the status prompt element is outside the preset prompt value range, a status reminder mode is triggered.

[0044] Taking the first physiological state information, including first visual indication information, as an example, the wearer's current energy prompt value is determined based on the first visual indication information. When the energy prompt value is outside a preset prompt value range (e.g., the energy prompt value is less than or equal to a preset energy value threshold), the head-mounted device is determined to trigger a status reminder mode. When the energy prompt value is within a preset prompt value range (e.g., the energy prompt value is greater than a preset energy value threshold), the head-mounted device is determined not to trigger a status reminder mode. In some embodiments, the higher the fatigue level indicated by the first visual indication information, the lower the energy prompt value. For example, the first visual indication information includes a first gaze distance and a first gaze duration. A larger gaze distance indicates greater fatigue, and a longer gaze duration also indicates greater fatigue. In this case, the energy prompt value can be set to be lower if the first gaze distance is larger, and lower if the first gaze duration is longer. And so on. Thus, the energy prompt value can be determined based on the first gaze distance and / or the first gaze duration.

[0045] Taking the first physiological state information, including first posture indication information, as an example, the wearer's current energy prompt value is determined based on the first posture indication information. When the energy prompt value is outside a preset prompt value range (e.g., the energy prompt value is less than or equal to a preset energy value threshold), the head-mounted device is determined to trigger a status reminder mode. When the energy prompt value is within a preset prompt value range (e.g., the energy prompt value is greater than a preset energy value threshold), the head-mounted device is determined not to trigger a status reminder mode. In some embodiments, the higher the fatigue level indicated by the first posture indication information, the lower the energy prompt value. For example, the first posture indication information includes a first sitting posture duration and a first head-down posture duration. A longer sitting posture duration indicates greater fatigue, and a longer head-down posture duration also indicates greater fatigue. In this case, the energy prompt value can be set to be lower for a longer first sitting posture duration and lower for a longer first head-down posture duration, and so on. Thus, the energy prompt value can be determined based on the first sitting posture duration and / or the first head-down posture duration.

[0046] Taking the first physiological state information, which includes first posture indication information and first posture indication information, as an example, the wearer's current energy prompt value is determined based on the first visual indication information and the first posture indication information. When the energy prompt value is outside the preset prompt value range (e.g., the energy prompt value is less than or equal to a preset energy value threshold), the head-mounted device is determined to trigger a status reminder mode. When the energy prompt value is within the preset prompt value range (e.g., the energy prompt value is greater than a preset energy value threshold), the head-mounted device is determined not to trigger a status reminder mode. In some embodiments, the higher the fatigue level indicated by the first visual indication information and the higher the fatigue level indicated by the first posture indication information, the lower the energy prompt value. For example, if the first visual indication information includes a first gaze distance and a first gaze duration, and the first posture indication information includes a first sitting posture duration and a first head-down posture duration, then the energy prompt value can be set to be lower if the first gaze distance is larger and the first gaze duration is longer. Similarly, the energy prompt value can be set to be lower if the first sitting posture duration is longer and the first head-down posture duration is longer. And so on. In this way, the energy cue value can be determined based on the first gaze distance, the first gaze duration, the first sitting posture duration, and the first head-down posture duration.

[0047] 203. When the head-mounted device triggers the status reminder mode, the visual perception of the field of view of the head-mounted device is reduced.

[0048] Visual perception includes at least one of color saturation and screen brightness.

[0049] There are several ways to implement step 203, including, for example: (1) In some embodiments, visual perception includes the brightness of the field of view, and visual perception is reduced by decreasing the brightness of the field of view. In this case, such as Figure 3 As shown, step 203 may specifically include 2031A~2032A: 2031A. When the head-mounted device triggers the status reminder mode, a first brightness value matching the first physiological state information is determined.

[0050] 2032A. Based on the first brightness value, the brightness of the view image is reduced.

[0051] In some embodiments, the brightness of the viewpoint can be directly reduced to a first brightness value. For example, the brightness of the viewpoint can be directly switched from the current brightness value to the first brightness value.

[0052] In some embodiments, the brightness of the field of view can be smoothly reduced from the current brightness value to a first brightness value. For example, the brightness of the field of view can be smoothly reduced from the current brightness value to the first brightness value over 3-5 seconds.

[0053] (2) In some embodiments, visual perception includes the color saturation of the field of view. Visual perception is reduced by decreasing the color saturation of the field of view. In this case, such as... Figure 4 As shown, step 203 may specifically include steps 2031B to 2033B: 2031B. When the head-mounted device triggers the status reminder mode, a first global color mapping matrix matching the first physiological state information is determined.

[0054] The global color mapping matrix can be used to adjust the color saturation of the displayed image. Each saturation value corresponds to a global color mapping matrix. For example, as shown in Formula 1, taking the RGB color space, a global color mapping matrix can include RGB channels (the first 3x3 rows) and an opacity channel (the 4th row). When the matrix is ​​an identity matrix (i.e., diagonal elements Rr=Gg=Bb=1, other off-diagonal elements=0), the pixel RGB values ​​remain unchanged, and the image color saturation is normal. When the saturation is reduced, the diagonal elements of the matrix Rr=Gg=Bb=k (k<1), and other off-diagonal elements=0, thus causing the RGB channels to decay proportionally, and the color gradually approaches grayscale. When the saturation is increased, the diagonal elements of the matrix Rr=Gg=Bb=k (k>1), and other off-diagonal elements=0, thus causing the RGB channels to increase proportionally, and the color is enhanced.

[0055] Formula 1 In Formula 1, the elements in the first 3 rows and 3 columns correspond to the gain coefficients and mixing coefficients of the three RGB color channels, respectively. For example, Rr refers to the self-gain coefficient of the red (R) channel, Gg refers to the self-gain coefficient of the green (G) channel, Bb refers to the self-gain coefficient of the blue (B) channel, Gr is the cross-mixing coefficient of the green channel to the red channel (controlling the contribution intensity of the original green signal to the final red signal), Br is the cross-mixing coefficient of the blue (B) channel to the red (R) channel, Rg is the cross-mixing coefficient of the red channel (R) to the green (G) channel, Bg is the cross-mixing coefficient of the blue (B) channel to the green (G) channel, Rb is the cross-mixing coefficient of the red (R) channel to the blue (B) channel, and Gb is the cross-mixing coefficient of the green (G) channel to the blue (B) channel.

[0056] The first global color mapping matrix is ​​used to adjust the color saturation of the view frame to a first saturation value. For example, it can reduce the color saturation of virtual sub-images in the view frame or reduce the color saturation of real sub-images in the view frame. In this embodiment, the first global color mapping matrix is ​​used to reduce the color saturation of the view frame.

[0057] The first saturation value is the color saturation value corresponding to the first global color mapping matrix.

[0058] In some embodiments, as long as the conditions for triggering the status reminder mode of the head-mounted device are met, regardless of the first physiological state information, the color saturation is reduced to the same saturation value, that is, a global color mapping matrix with the same value is used as the first global color mapping matrix. Step 2031B may specifically include: using the global mapping matrix used to reduce the color saturation to the first saturation value as the first global color mapping matrix for matching the first physiological state information.

[0059] In some embodiments, a first global color mapping matrix is ​​determined in conjunction with the energy prompt value. The larger the energy prompt value, the larger the range of the first global color mapping matrix used to adjust color saturation. At this time, the wearer's current energy prompt value can be determined based on the first physiological state information (such as the first visual indication information and / or the first posture indication information). (For details on how to determine the energy prompt value, please refer to the relevant description above, which will not be repeated here.) Step 2031B may specifically include: when the head-mounted device triggers the status reminder mode, based on the wearer's current energy prompt value and the preset mapping relationship table between the prompt value and the saturation value, determining the saturation value that has a mapping relationship with the energy prompt value as the first saturation value; then, based on the first saturation value, determining a global mapping matrix for adjusting the color saturation to the first saturation value, as the first global color mapping matrix for matching the first physiological state information.

[0060] 2032B. Based on the first global color mapping matrix, process the basic rendering data of each frame of the field of view to obtain the adjusted rendering data for each frame of the field of view.

[0061] Rendering data refers to data used to indicate the attribute information (such as color and texture) of pixels in the image.

[0062] The base rendering data refers to the rendering data before saturation adjustment.

[0063] Among them, virtual sub-screens are virtual screens used to present virtual elements in the field of view (such as map UI elements to be displayed by head-mounted devices).

[0064] Among them, the reality sub-picture is used to present the reality elements in the field of view (such as roads, buildings, etc. in the real environment).

[0065] The first virtual sub-screen refers to the virtual sub-screen when visual perception is reduced.

[0066] The first reality sub-picture refers to the reality sub-picture when visual perception is reduced.

[0067] The first global color mapping matrix refers to the global color mapping matrix used when performing visual perception reduction processing.

[0068] To better understand the embodiments of this application, the following example illustrates how to implement the image rendering process using the GPU (Graphics Processing Unit) of a head-mounted device. The details are as follows: 1. Application Stage (Main Processor Processing): The application provides the virtual sub-screen's attribute information (such as the position, size, texture (such as button images, text fonts, etc.), transparency, etc. of the virtual sub-screen elements), the attribute information of the real sub-screen, and the global color mapping matrix to the graphics processor (such as the GPU).

[0069] 2. Geometry Stage (GPU Processing): Based on the attribute information of the virtual sub-screen, the vertex data of the contained elements (i.e., virtual sub-screen elements) are converted into screen coordinates to determine the display position of the elements in the view, thereby obtaining data such as vertex coordinates and vertex colors of the virtual sub-screen elements. Similarly, based on the attribute information of the real-world sub-screen, the vertex coordinates and vertex colors of the real-world sub-screen elements can be obtained.

[0070] 3. Rasterization Stage (GPU Processing): Based on the vertex coordinates and other data of the virtual sub-screen elements, the geometric shape formed by the vertices of the elements is converted into a set of pixels on the screen (i.e., fragments, each fragment representing one pixel), thus obtaining the fragment set of the virtual sub-screen. Similarly, the fragment set of the real sub-screen is obtained through this process.

[0071] 4. Texture Sampling Stage (GPU Processing): Based on the fragment set of the virtual sub-image and the vertex colors of the virtual sub-image elements, the original color value of each fragment is read (taking the RGB color system as an example, that is, reading the original RGB value of each fragment), thus obtaining the original RGB value of each fragment in the fragment set of the virtual sub-image. Similarly, the original RGB value of each fragment in the fragment set of the real sub-image is obtained.

[0072] 5. Pixel Shader Stage (GPU Processing): Post-processing is performed on the raw RGB values ​​of fragments, including global color mapping matrix operations and opacity blending. For example, the raw RGB value of each fragment in the virtual sub-image fragment set is multiplied by the global color mapping matrix to obtain the adjusted color value (i.e., the adjusted RGB value) of that fragment. Another example is when a virtual sub-image element needs to be perspective-driven by a real-world sub-image element; the raw RGB value of the fragment is then multiplied by the global color mapping matrix and opacity blending is performed. The final output is the final color value (i.e., the final RGB value, at which point saturation adjustment has been completed due to the calculation) of each fragment in the virtual sub-image fragment set and the final RGB value (at which point color saturation adjustment has been completed due to the calculation) of each fragment in the real-world sub-image fragment set, thus achieving the effect of adjusting the color saturation of both virtual and real-world sub-image elements.

[0073] 6. Frame Buffer Fusion Stage (GPU Processing): Based on the final RGB value of each fragment in the virtual sub-picture fragment set and the final RGB value of each fragment in the real sub-picture fragment set, the color value of the corresponding fragment position is superimposed as the pixel value at that position, so as to fuse the virtual sub-picture and the real sub-picture into the final screen image (i.e. the field of view image displayed on the head-mounted device) and send it to the display screen of the head-mounted device.

[0074] In some embodiments, the color saturation of the view image can be directly reduced from the current saturation value to a first saturation value. In this case, the specific processing of step 2032B can be as follows: perform a dot product between the first global color mapping matrix and the basic rendering data of each frame of the view image, and use the dot product result as the adjusted rendering data of each frame of the view image, thereby realizing the saturation adjustment of the view image.

[0075] In some embodiments, the color saturation of the view image can be smoothly reduced from the current saturation value to a first saturation value. In this case, step 2032B can be processed as follows: Based on a preset smooth transition duration, interpolation is performed between the initial global color mapping matrix and the first global color mapping matrix of the view image to obtain at least two sets of transition global color mapping matrices; based on the at least two sets of transition global color mapping matrices, the basic rendering data of each frame of the view image is processed to obtain adjusted rendering data for each frame of the view image.

[0076] The initial global color mapping matrix refers to the global color mapping matrix used by the head-mounted device for the current output field of view.

[0077] The transition global color mapping matrix refers to the global color mapping matrix obtained by interpolating the initial global color mapping matrix and the first global color mapping matrix.

[0078] The specific value of the preset smooth transition duration can be set according to the actual business scenario requirements, such as 3 seconds, 5 seconds, etc.

[0079] For example, taking the global color mapping matrix format of Formula 1 as an example, assuming the diagonal coefficient k=1 of the initial global color mapping matrix (i.e., Rr=Gg=Bb=1) and Rr=Gg=Bb=0.4 of the first global color mapping matrix, firstly, based on the preset smooth transition (e.g., 3 seconds) and the display frame rate of the viewpoint pair (e.g., 10 frames per second), calculate the number of frames between the initial global color mapping matrix and the first global color mapping matrix (e.g., 3 seconds * 10 frames / second = 30 frames); and calculate the difference in diagonal coefficients between the initial global color mapping matrix and the first global color mapping matrix; then, based on the interval... The frame rate and diagonal coefficient difference are used to determine the leading frame coefficient difference (k1-k2=(1-0.4) / 3*10=0.02). Finally, according to the leading frame coefficient difference, interpolation is performed between the initial global color mapping matrix and the first global color mapping matrix (e.g., keeping the values ​​of other diagonal elements unchanged, starting from diagonal coefficient k=1) to obtain n sets of transition global color mapping matrices, namely: global color mapping matrix with diagonal coefficient k=1-0.02, global color mapping matrix with diagonal coefficient k=1-0.02*2, ..., global color mapping matrix with diagonal coefficient k=1-0.02*30. The value of n is equal to the interval frame number.

[0080] Depending on the object being adjusted for color saturation, step 2032B can be implemented in various ways. For example, it includes the following methods: <1> to <3> : <1> In some embodiments, the field of view includes virtual sub-screen elements. "Reducing the color saturation of the field of view" includes reducing the color saturation of the virtual sub-screen elements in the field of view. In this case, step 2032B may specifically include the following steps A1 to A2: A1. Based on the first global color mapping matrix, adjust the saturation of the basic rendering data of each frame of the first virtual sub-screen in the field of view to obtain the adjusted rendering data of each frame of the first virtual sub-screen.

[0081] Specifically, the first global color mapping matrix can be multiplied by the basic rendering data of each frame of the first virtual sub-image, and the result of the multiplication can be used as the adjusted rendering data of each frame of the first virtual sub-image. Thus, by multiplying the first global color mapping matrix by the basic rendering data of each frame of the first virtual sub-image, since the basic rendering data of each frame of the first virtual sub-image contains the original color values ​​(such as original RGB values) of each fragment (i.e., each pixel) of the first virtual sub-image, the diagonal coefficient of the first global color mapping matrix is ​​reduced relative to the diagonal coefficient of the initial color mapping matrix. The result of the multiplication will reduce the original color values ​​(such as original RGB values) of each pixel in the first virtual sub-image, thereby achieving a reduction in saturation. Subsequently, using the adjusted rendering data of each frame of the first virtual sub-image to output the view can reduce the color saturation of the virtual sub-image elements in the view.

[0082] In some embodiments, the color saturation of virtual sub-screen elements can be smoothly reduced from the current saturation value to a first saturation value. In this case, in step A1, the initial global color mapping matrix of the viewpoint and the first global color mapping matrix can be interpolated according to a preset smooth transition duration to obtain at least two sets of transition global color mapping matrices; the basic rendering data of each frame of the first virtual sub-screen is then processed according to the at least two sets of transition global color mapping matrices to obtain adjusted rendering data for each frame of the first virtual sub-screen. The detailed implementation process of the smoothing process has been described previously; please refer to the previous explanation for details, which will not be repeated here.

[0083] A2. The adjusted rendering data of each frame of the first virtual sub-screen and the basic rendering data of each frame of the first real sub-screen in the field of view are superimposed to obtain the adjusted rendering data of each frame of the field of view.

[0084] Specifically, referring to the processing method in the "frame buffer fusion stage" mentioned above, the adjusted rendering data of each frame of the first virtual sub-screen and the basic rendering data of each frame of the first real sub-screen in the field of view are superimposed to obtain the adjusted rendering data of each frame of the field of view. The obtained adjusted rendering data of each frame of the field of view is output to the screen, so that the first virtual sub-screen and the first real sub-screen can be merged into the final screen image. At this time, the image effect corresponding to the field of view is output based on the adjusted rendering data of each frame of the field of view, which can reduce the color saturation of the virtual sub-screen elements in the field of view.

[0085] <2> In some embodiments, the field of view includes real sub-screen elements, and "reducing the color saturation of the field of view" includes reducing the color saturation of the real sub-screen elements. In this case, step 2032B may specifically include the following steps B1~B2: B1. Based on the first global color mapping matrix, adjust the saturation of the basic rendering data of each frame of the first real sub-screen in the field of view to obtain the adjusted rendering data of each frame of the first real sub-screen.

[0086] Specifically, the first global color mapping matrix can be multiplied by the basic rendering data of each frame of the first real sub-image, and the result of the multiplication can be used as the adjusted rendering data of each frame of the first real sub-image. Thus, by multiplying the first global color mapping matrix by the basic rendering data of each frame of the first real sub-image, since the basic rendering data of each frame of the first real sub-image contains the original color values ​​(such as original RGB values) of each fragment (i.e., each pixel) of the first real sub-image, the diagonal coefficient of the first global color mapping matrix is ​​reduced relative to the diagonal coefficient of the initial color mapping matrix. The result of the multiplication will reduce the original color values ​​(such as original RGB values) of each pixel in the first real sub-image, thereby achieving a reduction in saturation. Subsequently, using the adjusted rendering data of each frame of the first real sub-image to output the view can reduce the color saturation of the real sub-image elements in the view.

[0087] In some embodiments, the color saturation of elements in the real-world sub-screen can be smoothly reduced from the current saturation value to a first saturation value. In this case, in step B1, the initial global color mapping matrix of the visual field and the first global color mapping matrix can be interpolated according to a preset smooth transition duration to obtain at least two sets of transition global color mapping matrices. The basic rendering data of each frame of the first real-world sub-screen is then processed based on the at least two sets of transition global color mapping matrices to obtain adjusted rendering data for each frame of the first real-world sub-screen. The detailed implementation process of the smoothing process has been described previously; please refer to the previous explanation for details, which will not be repeated here.

[0088] B2. The basic rendering data of each frame of the first virtual sub-screen and the adjusted rendering data of each frame of the first real sub-screen in the field of view are superimposed to obtain the adjusted rendering data of each frame of the field of view.

[0089] Specifically, referring to the processing method in the "frame buffer fusion stage" mentioned above, the basic rendering data of each frame of the first virtual sub-screen and the adjusted rendering data of each frame of the first real sub-screen in the field of view are superimposed to obtain the adjusted rendering data of each frame of the field of view. The obtained adjusted rendering data of each frame of the field of view is output to the screen, so that the first virtual sub-screen and the first real sub-screen can be merged into the final screen image. At this time, the image effect corresponding to the field of view is output based on the adjusted rendering data of each frame of the field of view, which can reduce the color saturation of the elements of the real sub-screen in the field of view.

[0090] <3> In some embodiments, the field of view includes virtual sub-screen elements and real sub-screen elements. "Reducing the color saturation of the field of view" includes reducing the color saturation of both the virtual and real sub-screen elements. In this case, step 2032B may specifically include the following steps C1 to C3: C1. Based on the first global color mapping matrix, adjust the saturation of the basic rendering data of each frame of the first virtual sub-screen in the field of view to obtain the adjusted rendering data of each frame of the first virtual sub-screen.

[0091] C2. Based on the first global color mapping matrix, adjust the saturation of the basic rendering data of each frame of the first real sub-screen in the field of view to obtain the adjusted rendering data of each frame of the first real sub-screen.

[0092] The implementation of steps C1 to C2 is similar to steps A1 and B1. For details, please refer to the relevant explanations above. They will not be repeated here.

[0093] C3. The adjusted rendering data of each frame of the first virtual sub-screen and the adjusted rendering data of each frame of the first real sub-screen are superimposed to obtain the adjusted rendering data of each frame of the field of view.

[0094] Specifically, referring to the processing method in the "frame buffer fusion stage" mentioned above, the adjusted rendering data of each frame of the first virtual sub-screen and the adjusted rendering data of each frame of the first real sub-screen in the field of view are superimposed to obtain the adjusted rendering data of each frame of the field of view. The obtained adjusted rendering data of each frame of the field of view is output to the screen, so that the first virtual sub-screen and the first real sub-screen can be merged into the final screen image. At this time, the corresponding image effect of the field of view is output based on the adjusted rendering data of each frame of the field of view. This can reduce the color saturation of the virtual sub-screen elements in the field of view and reduce the color saturation of the real sub-screen elements in the field of view, making the overall field of view darker.

[0095] 2033B. Based on the adjusted rendering data of each frame of the field of view, output the corresponding image effect of the field of view to reduce the color saturation of the field of view.

[0096] Furthermore, the visual field includes status indicator elements (such as floating colored crystals or energy bars) to display the wearer's energy level. These energy levels can be expressed as numerical values, percentages, or levels (such as medium, high, and low), and can be customized according to specific business needs; this embodiment does not impose any limitations. In this way, users can see in real-time how the energy level decreases due to real-world activities (such as prolonged sitting), and when the energy level falls below a threshold, it drives changes in the overall visual perception of the visual field (such as global color saturation and screen brightness), thus highlighting the impact of the virtual state on real-world perception. This addresses the problem of traditional reminder functions (such as sound and pop-ups) being easily ignored or turned off, allowing users to experience reminders in an immersive way.

[0097] Furthermore, the method may also include: when the head-mounted device triggers a status reminder mode, displaying visual prompts on the field of view, wherein the prompts include at least one of the cause of reduced visual perception and a suggested task for restoring visual perception.

[0098] Furthermore, such as Figure 5 As shown, the method may further include steps 204-206 to restore the visual perception of the field of view: 204. After the visual perception of the field of view of the head-mounted device is reduced, the second physiological state information of the wearer is obtained.

[0099] In some embodiments, the second physiological state information includes a second gaze distance and a second gaze duration. Step 204 may specifically include: obtaining the second gaze distance and the second gaze duration of the wearer of the head-mounted device.

[0100] In some embodiments, the physiological state information includes body posture indication information. For example, the body posture indication information includes sitting duration and head-down duration. In this case, the second physiological state information includes second sitting duration and second head-down duration. Step 204 may specifically include: obtaining the second sitting duration and second head-down duration of the wearer of the head-mounted device.

[0101] 205. Based on the second physiological state information, determine whether the head-mounted device has triggered the normal display mode.

[0102] 206. When the head-mounted device triggers the normal display mode, visual perception restoration processing is performed on the field of view of the head-mounted device.

[0103] Thus, steps 201-203 can trigger a status reminder mode to reduce the visual perception of the field of view, thereby reminding the user of unhealthy states such as visual fatigue and physical fatigue (e.g., prolonged sitting, looking down). After the user performs an action to restore a healthy state (e.g., standing, looking into the distance), steps 204-206 can trigger a normal display mode on the wearable device to restore the visual perception of the field of view, making the field of view bright again. This creates a virtual-real interaction that combines the impact of real-world conditions on visual perception with the restoration of visual perception by real-world actions, thus reducing the problem of reminder functions (e.g., sound, pop-ups) being easily ignored or turned off.

[0104] There are several ways to implement step 206, including, for example: (1) In some embodiments, visual perception includes the brightness of the field of view. Visual perception is restored by restoring the brightness of the field of view. In this case, step 206 may specifically include 2061A~2062A: 2061A. When the head-mounted device triggers the status reminder mode, a second brightness value matching the second physiological state information is determined.

[0105] 2062A. Based on the second brightness value, perform image brightness restoration processing on the field of view.

[0106] (2) In some embodiments, visual perception includes the color saturation of the field of view. Visual perception is restored by restoring the color saturation of the field of view. In this case, step 206 may specifically include 2061B~2063B: 2061B. When the head-mounted device triggers the status reminder mode, a second global color mapping matrix that matches the second physiological state information is determined.

[0107] 2062B. Based on the second global color mapping matrix, the basic rendering data of each frame of the field of view is processed to obtain the adjusted rendering data for each frame of the field of view.

[0108] Depending on the object being adjusted for color saturation, step 2062B can be implemented in various ways. For example, it includes the following methods: <1> to <3> : <1> In some embodiments, the field of view includes virtual sub-screen elements. "Restoring the color saturation of the field of view" includes restoring the color saturation of the virtual sub-screen elements in the field of view. In this case, step 2062B may specifically include the following steps D1~D2: D1. Based on the second global color mapping matrix, adjust the saturation of the basic rendering data of each frame of the second virtual sub-screen in the field of view to obtain the adjusted rendering data of each frame of the second virtual sub-screen.

[0109] D2. The adjusted rendering data of each frame of the second virtual sub-screen and the basic rendering data of each frame of the second real sub-screen in the field of view are superimposed to obtain the adjusted rendering data of each frame of the field of view.

[0110] <2> In some embodiments, the field of view includes real sub-screen elements, and "restoring the color saturation of the field of view" includes restoring the color saturation of the real sub-screen elements. In this case, step 2062B may specifically include the following steps E1~E2: E1. Based on the second global color mapping matrix, adjust the saturation of the basic rendering data of each frame of the second reality sub-screen in the field of view to obtain the adjusted rendering data of each frame of the second reality sub-screen.

[0111] E2. The basic rendering data of each frame of the second virtual sub-screen and the adjusted rendering data of each frame of the second real sub-screen in the field of view are superimposed to obtain the adjusted rendering data of each frame of the field of view.

[0112] <3> In some embodiments, the field of view includes virtual sub-screen elements and real sub-screen elements. "Restoring the color saturation of the field of view" includes restoring the color saturation of the virtual sub-screen elements and the real sub-screen elements. In this case, step 2062B may specifically include the following steps F1 to F3: F1. Based on the second global color mapping matrix, adjust the saturation of the basic rendering data of each frame of the second virtual sub-screen in the field of view to obtain the adjusted rendering data of each frame of the second virtual sub-screen.

[0113] F2. Based on the second global color mapping matrix, adjust the saturation of the basic rendering data of each frame of the second reality sub-screen in the field of view to obtain the adjusted rendering data of each frame of the second reality sub-screen.

[0114] F3. Overlay the adjusted rendering data of each frame of the second virtual sub-screen and the adjusted rendering data of each frame of the second real sub-screen to obtain the adjusted rendering data of each frame of the field of view.

[0115] 2063B. Based on the adjusted rendering data of each frame of the field of view, output the corresponding image effect of the field of view to restore the color saturation of the field of view.

[0116] The second virtual sub-screen refers to the virtual sub-screen used during visual perception restoration processing.

[0117] The second reality sub-picture refers to the reality sub-picture during visual perception restoration processing.

[0118] The second global color mapping matrix refers to the global color mapping matrix used in visual perception restoration processing. Specifically, the second global color mapping matrix is ​​used to adjust the color saturation of the visual field to a second saturation value.

[0119] The second saturation value is the color saturation value corresponding to the second global color mapping matrix.

[0120] The specific implementation of steps 204 to 206 is similar to steps 201 to 203 above. For details, please refer to the relevant explanations above. They will not be repeated here.

[0121] As can be seen from the above, firstly, by acquiring the wearer's primary physiological state information; based on this information, it is determined whether the wearer has triggered a status reminder mode; when the wearer triggers the status reminder mode, the visual perception of the wearer's field of vision is reduced. This allows the primary physiological state information to drive changes in the visual perception of the entire field of vision (such as global color saturation and screen brightness), thereby allowing the user to experience the reminder in an immersive way. Since the reduced visual perception of the field of vision is not easily ignored or turned off, it can, to some extent, solve the problem that reminder functions (such as sound, vibration, pop-ups, etc.) are easily ignored or turned off, thus improving the effectiveness of status reminders. Secondly, status reminder elements are displayed on the field of vision. These elements show the energy level and determine the wearer's current energy level based on physiological information such as first visual indication information and / or first body posture indication information. Whether the head-mounted device triggers the status reminder mode is determined by whether the energy level is outside the preset range. This maps the wearer's physiological state information to the energy level, and the level of this energy level drives changes in the visual perception of the entire field of vision (such as global color saturation and screen brightness), making the field of vision appear darker and highlighting the impact of the virtual state on real-world perception. This solves the problem of traditional reminder functions (such as sound and pop-ups) being easily ignored or turned off, allowing users to experience the reminders immersively. Thirdly, steps 204-206 trigger the normal display mode on the wearable device to restore the visual perception of the field of vision, making the field of vision vibrant again. This creates a virtual-real interaction where real-world status affects visual perception, and real-world actions restore visual perception, thus reducing the problem of reminder functions (such as sound and pop-ups) being easily ignored or turned off. Fourthly, by using a preset smooth transition duration to smoothly transition the visual perception of the field of view, the visual perception (such as color saturation and screen brightness) can be smoothly reduced or restored to the target value, which to some extent avoids the discomfort caused by abrupt changes in visual perception. Furthermore, by overlaying the rendering data of virtual sub-screens and real sub-screens, the visual perception of virtual sub-screen elements and real sub-screen elements in the entire field of view can be adjusted synchronously, allowing for global, smooth, and immersive adjustment of the visual perception of the field of view.

[0122] Furthermore, to better implement the status reminder processing method in the embodiments of this application, based on the status reminder processing method, the embodiments of this application also provide a status reminder processing device, such as... Figure 6 The diagram shown is a structural schematic of one embodiment of the status reminder processing device provided in this application. The status reminder processing device 600 includes: Acquisition unit 601 is used to acquire the first physiological state information of the wearer of the head-mounted device; The determining unit 602 is used to determine whether the head-mounted device has triggered a status reminder mode based on the first physiological state information; The processing unit 603 is used to reduce the visual perception of the field of view of the head-mounted device when the head-mounted device triggers the status reminder mode, wherein the visual perception includes at least one of color saturation and screen brightness.

[0123] In some embodiments, the visual perception includes color saturation, and the processing unit 603 is specifically used for: When the head-mounted device triggers the status reminder mode, a first global color mapping matrix matching the first physiological state information is determined; Based on the first global color mapping matrix, the basic rendering data of each frame of the field of view is processed to obtain the adjusted rendering data for each frame of the field of view. The rendering data is adjusted based on each frame of the field of view to output the corresponding image effect of the field of view, so as to reduce the color saturation of the field of view.

[0124] In some embodiments, the processing unit 603 is specifically used for: Based on a preset smooth transition duration, the initial global color mapping matrix of the field of view and the first global color mapping matrix are interpolated to obtain at least two sets of transition global color mapping matrices. The basic rendering data of each frame of the view is processed according to the at least two sets of transition global color mapping matrices to obtain the adjusted rendering data of each frame of the view.

[0125] In some embodiments, the basic rendering data of each frame of the view frame includes the basic rendering data of each frame of the virtual sub-frame and the basic rendering data of each frame of the real sub-frame; the processing unit 603 is specifically used for: Based on the first global color mapping matrix, the saturation of each frame of the basic rendering data of the first virtual sub-screen in the field of view is adjusted to obtain the adjusted rendering data of each frame of the first virtual sub-screen. The adjusted rendering data of each frame of the first virtual sub-screen and the basic rendering data of each frame of the first real sub-screen in the field of view are superimposed to obtain the adjusted rendering data of each frame of the field of view.

[0126] In some embodiments, the basic rendering data of each frame of the view frame includes the basic rendering data of each frame of the virtual sub-frame and the basic rendering data of each frame of the real sub-frame; the processing unit 603 is specifically used for: Based on the first global color mapping matrix, the saturation of each frame of the basic rendering data of the first virtual sub-screen in the field of view is adjusted to obtain the adjusted rendering data of each frame of the first virtual sub-screen. Based on the first global color mapping matrix, the saturation of each frame of the basic rendering data of the first real sub-picture in the field of view is adjusted to obtain the adjusted rendering data of each frame of the first real sub-picture. The adjusted rendering data of each frame of the first virtual sub-screen and the adjusted rendering data of each frame of the first real sub-screen are superimposed to obtain the adjusted rendering data of each frame of the field of view.

[0127] In some embodiments, the first physiological state information includes at least one of first visual indication information and first body posture indication information; the determining unit 602 is specifically used for: Based on the first visual indication information and / or the first body posture indication information, determine whether the head-mounted device triggers a status reminder mode.

[0128] In some embodiments, the first physiological state information includes at least one of first visual indication information and first body posture indication information; the determining unit 602 is specifically used for: The wearer's current energy prompt value is determined based on the first visual indication information and / or the first body posture indication information; When the energy indicator value is outside the preset indicator value range, the head-mounted device is determined to trigger a status reminder mode.

[0129] In some embodiments, the first visual indication information includes at least one of a first gaze distance and a first gaze duration, and the first posture indication information includes at least one of a first sitting posture duration and a first head-down posture duration. The determining unit 602 is specifically configured to: determine the wearer's current energy prompt value based on the first visual indication information and / or the first posture indication information. The energy cue value is determined based on the first gaze distance, the first gaze duration, the first sitting posture duration, and / or the first head-down posture duration.

[0130] In some embodiments, the field of view includes a status indicator element, which is used to display the wearer's energy level.

[0131] In some embodiments, the processing unit 603 is specifically used for: When the head-mounted device triggers the status reminder mode, visual prompts are displayed on the field of view, wherein the prompts include at least one of the following: the reason for the reduced visual perception and a suggested task for restoring visual perception.

[0132] In some embodiments, the processing unit 603 is specifically used for: After visual perception reduction processing is applied to the field of view of the head-mounted device, the second physiological state information of the wearer is obtained. Based on the second physiological state information, it is determined whether the head-mounted device has triggered the normal display mode; When the head-mounted device triggers the normal display mode, visual perception restoration processing is performed on the field of view of the head-mounted device.

[0133] In practice, each of the above units can be implemented as an independent entity or can be arbitrarily combined to be implemented as the same or several entities. For the specific implementation of each of the above units, please refer to the previous embodiment of the status reminder processing method, which will not be repeated here.

[0134] Those skilled in the art will understand that all or part of the steps in the above-described status reminder processing method can be completed by instructions, or by controlling related hardware through instructions. These instructions can be stored in a computer-readable storage medium and loaded and executed by a processor.

[0135] Therefore, embodiments of this application provide a computer-readable storage medium storing multiple computer programs that can be loaded by a processor to execute any of the status reminder processing methods provided in embodiments of this application.

[0136] The computer-readable storage medium may include: read-only memory (ROM), random access memory (RAM), disk or optical disk, etc.

[0137] In the above embodiments of the status alert processing device, computer-readable storage medium, and head-mounted device, the descriptions of each embodiment have different focuses. Parts not described in detail in a particular embodiment can be referred to in the relevant descriptions of other embodiments. Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes and beneficial effects of the status alert processing device, computer-readable storage medium, head-mounted device, and their corresponding units described above can be referred to the description of the status alert processing method in the above embodiments, and will not be repeated here.

[0138] The foregoing has provided a detailed description of a status reminder processing method, apparatus, head-mounted device, and computer-readable storage medium provided in the embodiments of this application. Specific examples have been used to illustrate the principles and implementation methods of this application. The descriptions of the above embodiments are only for the purpose of helping to understand the method and core ideas of this application. At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of this application. Therefore, the content of this specification should not be construed as a limitation of this application.

Claims

1. A method for processing status reminders, characterized in that, The method includes: Obtain the initial physiological state information of the wearer of the head-mounted device; Based on the first physiological state information, determine whether the head-mounted device triggers the status reminder mode; When the head-mounted device triggers the status reminder mode, the visual perception of the field of view of the head-mounted device is reduced, wherein the visual perception includes at least one of color saturation and screen brightness.

2. The status reminder processing method according to claim 1, characterized in that, The visual perception includes color saturation. When the head-mounted device triggers a status alert mode, the visual perception of the head-mounted device's field of view is reduced, including: When the head-mounted device triggers the status reminder mode, a first global color mapping matrix matching the first physiological state information is determined; Based on the first global color mapping matrix, the basic rendering data of each frame of the field of view is processed to obtain the adjusted rendering data for each frame of the field of view. The rendering data is adjusted based on each frame of the field of view to output the corresponding image effect of the field of view, so as to reduce the color saturation of the field of view.

3. The status reminder processing method according to claim 2, characterized in that, The step of processing the basic rendering data of each frame of the view frame according to the first global color mapping matrix to obtain adjusted rendering data for each frame of the view frame includes: Based on a preset smooth transition duration, the initial global color mapping matrix of the field of view and the first global color mapping matrix are interpolated to obtain at least two sets of transition global color mapping matrices. The basic rendering data of each frame of the view is processed according to the at least two sets of transition global color mapping matrices to obtain the adjusted rendering data of each frame of the view.

4. The status reminder processing method according to claim 2, characterized in that, The basic rendering data for each frame of the view includes the basic rendering data for each frame of the virtual sub-view and the basic rendering data for each frame of the real sub-view. The step of processing the basic rendering data of each frame of the view frame according to the first global color mapping matrix to obtain adjusted rendering data for each frame of the view frame includes: Based on the first global color mapping matrix, the saturation of each frame of the basic rendering data of the first virtual sub-screen in the field of view is adjusted to obtain the adjusted rendering data of each frame of the first virtual sub-screen. The adjusted rendering data of each frame of the first virtual sub-screen and the basic rendering data of each frame of the first real sub-screen in the field of view are superimposed to obtain the adjusted rendering data of each frame of the field of view. Alternatively, based on the first global color mapping matrix, the saturation of each frame of the basic rendering data of the first virtual sub-screen in the field of view is adjusted to obtain the adjusted rendering data of each frame of the first virtual sub-screen. Based on the first global color mapping matrix, the saturation of each frame of the basic rendering data of the first real sub-picture in the field of view is adjusted to obtain the adjusted rendering data of each frame of the first real sub-picture. The adjusted rendering data of each frame of the first virtual sub-screen and the adjusted rendering data of each frame of the first real sub-screen are superimposed to obtain the adjusted rendering data of each frame of the field of view.

5. The status reminder processing method according to claim 1, characterized in that, The first physiological state information includes at least one of first visual indication information and first body posture indication information; The step of determining whether the head-mounted device triggers a status reminder mode based on the first physiological state information includes: Based on the first visual indication information and / or the first body posture indication information, determine whether the head-mounted device triggers the status reminder mode; Alternatively, the wearer's current energy prompt value can be determined based on the first visual indication information and / or the first body posture indication information; When the energy indicator value is outside the preset indicator value range, the head-mounted device is determined to trigger a status reminder mode.

6. The status reminder processing method according to claim 1, characterized in that, The field of view includes status indicator elements, which are used to display the wearer's energy level.

7. The status reminder processing method according to claim 1, characterized in that, The method further includes: When the head-mounted device triggers the status reminder mode, visual prompts are displayed on the field of view, wherein the prompts include at least one of the following: the reason for the reduced visual perception and a suggested task for restoring visual perception.

8. The status reminder processing method according to claim 1, characterized in that, The method further includes: After visual perception reduction processing is applied to the field of view of the head-mounted device, the second physiological state information of the wearer is obtained. Based on the second physiological state information, it is determined whether the head-mounted device has triggered the normal display mode; When the head-mounted device triggers the normal display mode, visual perception restoration processing is performed on the field of view of the head-mounted device.

9. A status reminder processing device, characterized in that, The status alert processing device includes: The acquisition unit is used to acquire the first physiological state information of the wearer of the head-mounted device; The determining unit is configured to determine, based on the first physiological state information, whether the head-mounted device has triggered a status reminder mode; The processing unit is configured to reduce the visual perception of the field of view of the head-mounted device when the head-mounted device triggers the status reminder mode, wherein the visual perception includes at least one of color saturation and screen brightness.

10. A head-mounted device, characterized in that, It includes a processor and a memory, wherein the memory stores a computer program, and the processor executes the status alert processing method as described in any one of claims 1 to 8 when it invokes the computer program in the memory.

11. A computer-readable storage medium, characterized in that, It stores a computer program, which is loaded by a processor to execute the status reminder processing method according to any one of claims 1 to 8.

Images