Method and device for correcting bad sitting posture in mixed reality office scenario, equipment and medium

Abstract

The application relates to a mixed reality office scene bad sitting posture correction method and device, equipment and medium, which are suitable for a mixed reality head-mounted device. The method continuously acquires current spatial posture information of a user's head and shoulders, calculates head position offset, left shoulder position offset, right shoulder position offset and head angle offset based on the current spatial posture information and a reference posture model, and judges whether the user is in an abnormal posture state according to each offset and a corresponding threshold value. When the abnormal posture state lasts for more than a preset time length, the mixed reality head-mounted device is controlled to visually modulate display content to prompt the user to adjust the posture. The application can improve the accuracy of bad sitting posture recognition and reduce the interference on the user's office process.

Description

Technical Field

[0001] This application relates to the field of human-computer interaction and intelligent health monitoring, and in particular to a method, device, equipment and medium for correcting poor sitting posture in a mixed reality office setting. Background Technology

[0002] Currently, with the widespread adoption of remote and immersive work environments, users spend extended periods wearing mixed reality devices. Prolonged poor posture, such as forward head tilting, hunching, or tilting to the side, can lead to uneven stress on the cervical spine, spine, and neck and shoulder muscles, causing musculoskeletal disorders and decreased work efficiency. Existing posture correction systems detect poor posture by capturing the posture of individual body parts in real time and provide real-time feedback via text and images. However, current technologies have the following limitations: in the detection phase, there is a lack of joint modeling of the anatomical position and posture of the entire body joints, resulting in incomplete detection of poor posture types and inaccurate identification results; in the intervention phase, reliance on explicit notifications can easily disrupt user workflows and reduce user experience. Summary of the Invention

[0003] This application provides a method, device, equipment, and medium for correcting poor sitting posture in mixed reality office scenarios, aiming to improve the accuracy of user posture recognition during long-term work while wearing mixed reality devices, and to improve the user experience during intervention.

[0004] To achieve the above objectives, this application provides a method for correcting poor posture in a mixed reality office setting, applicable to mixed reality head-mounted devices. The method for correcting poor posture includes: Continuously acquire the current spatial pose information of the user's head and shoulders; Based on the current spatial pose information and the preset reference pose model, the position offset and head angle offset of the user's posture are calculated; wherein, the reference pose model is established based on the user's historical spatial pose information; the historical spatial pose information is obtained by the mixed reality head-mounted device when the user's sitting posture meets the correct sitting posture judgment conditions; the position offset includes: head position offset, left shoulder position offset, and right shoulder position offset; Based on the position offset and head angle offset, determine whether the user is in an abnormal posture state; When the abnormal posture lasts for more than a preset duration, the mixed reality headset is controlled to visually modulate the displayed content to prompt the user to adjust their posture.

[0005] This application establishes a baseline posture model corresponding to the head and shoulders when the user first uses the device, and continuously acquires the current spatial pose information of the head and shoulders during subsequent use. The current spatial pose information is compared with the baseline posture model to obtain positional offset and head angle offset. Based on these positional offset and head angle offset, it is then determined whether the user is in an abnormal posture state. Since the head and shoulders together constitute the representation basis of the user's upper body posture state, compared with detection methods that only collect posture information from a single body part, this method can more comprehensively depict the user's posture deviation and improve the reliability of posture abnormality judgment. Compared with existing technologies that only perform posture detection on a single body part, resulting in incomplete and inaccurate identification of incorrect sitting postures, the poor sitting posture correction method for mixed reality office scenarios provided in this application can improve the accuracy of poor sitting posture detection and enhance the user experience during intervention.

[0006] In a mixed reality office scenario posture correction method provided in this application embodiment, the mixed reality head-mounted device continuously acquires the current spatial pose information of the user's head and shoulders, including: collecting the position parameters of the user's head, the angle parameters of the head, the position parameters of the left shoulder, and the position parameters of the right shoulder.

[0007] Compared to existing technologies that rely on relatively simple posture parameters for posture monitoring, making it difficult to simultaneously consider changes in head orientation and shoulder posture, thus resulting in incomplete identification of poor sitting postures, this application limits the spatial pose information to at least head position, head angle, and left and right shoulder positions. By simultaneously introducing head position and angle parameters, it can characterize the spatial displacement and rotational states of the head, respectively. Since the head and shoulders together constitute key detection information reflecting upper body posture characteristics, this spatial pose information can more comprehensively depict the user's sitting posture, thereby improving the accuracy of identifying various types of poor sitting postures.

[0008] In a mixed reality office scenario posture correction method provided in this application embodiment, based on the current spatial pose information and a preset reference pose model, the method calculates the user's posture position offset and head angle offset, including: Based on the position parameters of the head, left shoulder, and right shoulder, the position offsets of the head, left shoulder, and right shoulder relative to the reference posture model are calculated using Euclidean distance, resulting in the head position offset, left shoulder position offset, and right shoulder position offset. Based on the head angle parameters, the head angle offset relative to the reference posture model is calculated using a rotation matrix to obtain the head angle offset.

[0009] Compared to existing technologies that simply sample and judge posture data and lack the ability to differentiate between positional and angular changes, thus failing to accurately reflect the deviation of the user's head and shoulders from a healthy sitting posture benchmark, this application uses Euclidean distance to calculate the positional offset of the head and shoulders relative to a benchmark posture model, and uses a rotation matrix to calculate the head's angular offset relative to the benchmark posture model. Euclidean distance directly quantifies the displacement deviation of the head and shoulders in three-dimensional space, while the rotation matrix characterizes the rotational changes in the head's posture direction, thereby achieving separate characterization and precise quantification of positional and angular offsets. Therefore, it can more accurately describe the user's deviation from the benchmark sitting posture, thereby improving the accuracy of posture anomaly detection.

[0010] In a mixed reality office scenario posture correction method provided in this application embodiment, determining whether the user is in an abnormal posture state based on the position offset and head angle offset includes: The head position threshold, left shoulder position threshold, right shoulder position threshold, and head angle threshold are obtained, wherein the head position threshold, left shoulder position threshold, right shoulder position threshold, and head angle threshold are determined based on preset parameters or user input parameters; The head position offset, left shoulder position offset, and right shoulder position offset are compared with their corresponding position thresholds. Compare the head angle offset with the corresponding head angle threshold; When the head position offset, left shoulder position offset, right shoulder position offset, or head angle offset exceeds the corresponding threshold, the user is determined to be in an abnormal posture state.

[0011] Compared to existing technologies that lack separate judgment boundaries for different posture parameters, resulting in unclear standards for identifying poor sitting posture, this application compares the positional offset with a preset positional threshold and the head angle offset with a preset head angle threshold. When either the positional offset exceeds its corresponding positional threshold or the head angle offset exceeds its corresponding head angle threshold, it is determined to be an abnormal posture. This allows for the effective identification of abnormal postures such as forward head tilt, head tilt, and shoulder deviation. Furthermore, the positional and head angle thresholds can be determined based on ergonomic parameters or user-defined settings, thus ensuring the clarity of the judgment criteria while also considering individual differences among users, thereby improving the accuracy and applicability of abnormal posture identification.

[0012] In a mixed reality office scenario posture correction method provided in this application embodiment, the mixed reality head-mounted device is controlled to visually modulate the displayed content to prompt the user to adjust their posture, including: When the detected head position offset or head angle offset exceeds the corresponding threshold, visual modulation is applied to the entire display area of ​​the mixed reality head-mounted device to prompt the user to adjust their head posture. When the left shoulder position offset is detected to exceed the left shoulder position threshold, visual modulation is applied to the left local display area to prompt the user to adjust the left shoulder posture; When the right shoulder position offset is detected to exceed the right shoulder position threshold, visual modulation is applied to the right local display area to prompt the user to adjust the right shoulder posture; The left partial display area includes the upper left quarter area and the lower left quarter area, and the right partial display area includes the upper right quarter area and the lower right quarter area.

[0013] Furthermore, visual modulation of the display content of the mixed reality headset includes: reducing the brightness of the displayed content in the display area, reducing the sharpness of the displayed content in the display area, or reducing the transparency of the displayed content in the display area. The method of visual modulation of the entire display area of ​​the mixed reality headset should be the same as the method of visual modulation of the entire display area.

[0014] Furthermore, when the conditions of visual modulation on the entire display area and visual modulation on a partial display area of ​​the mixed reality head-mounted device are met simultaneously, the reduction in brightness, sharpness, or transparency performed on the partial display area is greater than the reduction in brightness, sharpness, or transparency performed on the entire display area.

[0015] Compared to existing technologies that typically use a single prompting method for posture correction, which is difficult to distinguish between postural abnormalities in different parts of the body and can easily disrupt users' normal work due to overly direct prompting, this application improves the intervention method: when an overall postural abnormality is detected, global visual modulation is applied to the display output; when a local postural abnormality is detected, differentiated visual modulation is applied to the local area of ​​the display output, and the visual modulation specifically includes adjusting the visual attributes of the displayed content such as brightness, clarity, and transparency; and when both overall and local postural abnormalities exist simultaneously, the local area is subjected to an enhancement processing intensity higher than that of the global visual modulation. Since overall posture abnormalities and local posture abnormalities correspond to different ranges of display modulation methods, the intervention area can be matched with the abnormal part, thereby improving the targeting of posture reminders. At the same time, by progressively adjusting visual attributes such as brightness, clarity, and transparency, users can be guided to actively adjust their posture in a gentle way, thereby reducing interference with mixed reality office work. Furthermore, when multiple abnormalities exist simultaneously, by increasing the modulation intensity of local areas, the more obvious local parts of the abnormality can be highlighted, allowing users to perceive the body areas that need to be adjusted first, thereby improving the accuracy of posture correction and user experience.

[0016] Based on the above embodiments, another embodiment of this application provides a poor sitting posture correction device for mixed reality office scenarios, including a posture information acquisition module, an offset calculation module, a posture determination module, and a display modulation module.

[0017] The pose information acquisition module is used to continuously acquire the current spatial pose information of the user's head and shoulders; Furthermore, the pose information acquisition module includes: a head parameter acquisition unit and a shoulder parameter acquisition unit; The head parameter acquisition unit is used to acquire the position parameters and angle parameters of the user's head, respectively. The shoulder parameter acquisition unit is used to acquire the position parameters of the user's left shoulder and right shoulder respectively. The offset calculation module is used to calculate the position offset and head angle offset of the user's posture based on the current spatial pose information and the reference pose model. Furthermore, the offset calculation module includes: a position offset calculation unit and an angle offset calculation unit; The position offset calculation unit is used to calculate the position offset of the head, left shoulder and right shoulder relative to the reference posture model using Euclidean distance based on the position parameters of the head, left shoulder and right shoulder, respectively, to obtain the head position offset, left shoulder position offset and right shoulder position offset; The angle offset calculation unit is used to calculate the head angle offset relative to the reference posture model based on the head angle parameters using a rotation matrix, and obtain the head angle offset. The posture determination module is used to compare the position offset and head angle offset with the corresponding preset thresholds to determine whether the user is in an abnormal posture state. The display modulation module is used to control the mixed reality head-mounted device to visually modulate the displayed content when the abnormal posture state is maintained for a preset duration, so as to prompt the user to adjust the posture. Furthermore, the display modulation module includes: a global modulation unit and a local modulation unit; The global modulation unit is used to perform visual modulation on the entire display area of ​​the mixed reality head-mounted device; The local modulation unit is used to perform visual modulation on a local display area of ​​the mixed reality head-mounted device.

[0018] Based on the above embodiments, another embodiment of this application provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that the processor executes the computer program to perform the mixed reality office scene poor posture correction method described in the above application embodiments.

[0019] Based on the above embodiments, another embodiment of this application provides a computer-readable storage medium storing a computer program, characterized in that when the computer program is executed by a processor, it performs the method for correcting poor sitting posture in a mixed reality office scenario as described in the above embodiments. Attached Figure Description

[0020] To more clearly illustrate the technical solution of this application, the drawings used in the embodiments will be briefly introduced below. The drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained from these drawings without creative effort.

[0021] Figure 1 This is a flowchart illustrating a method for correcting poor posture in a mixed reality office setting, provided in one embodiment of this application. Figure 2 This is a flowchart illustrating a poor posture correction system suitable for mixed reality office scenarios, provided in another embodiment of this application. Figure 3 This is a schematic diagram of the structure of a poor sitting posture correction device for a mixed reality office scenario provided in one embodiment of this application. Detailed Implementation

[0022] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0023] It should be understood that the step numbers used in the text are for ease of description only and are not intended to limit the order in which the steps are performed.

[0024] To address the issues of incomplete and inaccurate posture detection in mixed reality office scenarios, and the reliance on explicit notifications for intervention, leading to a poor user experience. For example... Figure 1 As shown in the diagram, this application provides a detailed flowchart of a method for correcting poor posture in a mixed reality office scenario. The method includes steps S101 to S104, which are described in detail below: Step S101: Continuously acquire the current spatial pose information of the user's head and shoulders.

[0025] Furthermore, the mixed reality head-mounted device continuously acquires the current spatial pose information of the user's head and shoulders, including: collecting the position parameters of the user's head, the angle parameters of the head, the position parameters of the left shoulder, and the position parameters of the right shoulder, respectively.

[0026] Preferably, the spatial pose information of the mixed reality head-mounted device can be obtained through a software development interface, namely the OpenXR SDK; the collected spatial pose information is recorded as: head position parameters Head angle parameters Left shoulder position parameters and the position parameters of the right shoulder .

[0027] Step S102: Based on the current spatial pose information and the preset reference pose model, calculate the user's pose position offset and head angle offset; wherein, the reference pose model is established based on the user's historical spatial pose information; the historical spatial pose information is obtained by the mixed reality head-mounted device when the user's sitting posture meets the correct sitting posture judgment conditions; the position offset includes: head position offset, left shoulder position offset, and right shoulder position offset; Preferably, upon first use, the user adjusts to the correct sitting posture according to the system's text instructions. The system reads the position and orientation of the mixed reality headset, as well as the positions of the left and right shoulder sensors, through a software development interface, and records these as the head reference point position and orientation, respectively. , Left shoulder reference point position Right shoulder reference point position And based on this, an individualized baseline posture model is established.

[0028] Furthermore, based on the position parameters of the head, left shoulder, and right shoulder, the position offsets of the head, left shoulder, and right shoulder relative to the reference pose model are calculated using Euclidean distance, respectively, to obtain the head position offset. Left shoulder position offset and right shoulder position offset The specific calculation method is as follows: In the formula, The position parameters of the head in the reference posture model are... The position parameters of the left shoulder of the reference posture model are... The position parameters of the right shoulder of the reference posture model are given. The current head position parameter, The current position parameter of the left shoulder. This refers to the current position parameter of the right shoulder.

[0029] Furthermore, the angular offset of the head relative to the reference pose model is calculated using a rotation matrix. The specific calculation method is as follows: In the formula, The angle parameters of the head of the reference posture model are... This refers to the current head angle parameter.

[0030] Step S103, based on the position offset and head angle offset, determines whether the user is in an abnormal posture state, including: The head position threshold, left shoulder position threshold, right shoulder position threshold, and head angle threshold are obtained, wherein the head position threshold, left shoulder position threshold, right shoulder position threshold, and head angle threshold are determined based on preset parameters or user input parameters; Preferably, the head position threshold is defined as 5cm, the left shoulder position threshold is defined as 5cm, the right shoulder position threshold is defined as 5cm, and the head angle threshold is defined as... The thresholds for each part can be, but are not limited to, set by the user according to different situations.

[0031] The head position offset, left shoulder position offset, and right shoulder position offset are compared with their corresponding position thresholds. Compare the head angle offset with the corresponding head angle threshold; When the head position offset, left shoulder position offset, right shoulder position offset, or head angle offset exceeds the corresponding threshold, the user is determined to be in an abnormal posture state.

[0032] Preferably, when , , or If any condition is met, the user is determined to be in an abnormal posture state, that is, the user is in a poor sitting posture.

[0033] Step S104: When the abnormal posture lasts for more than a preset duration, control the mixed reality head-mounted device to visually modulate the displayed content to prompt the user to adjust their posture.

[0034] Preferably, intervention is triggered after an abnormal posture is detected for a preset duration to prompt the user to adjust their posture; wherein, the preset duration can be set by the user according to different situations, and in this embodiment, the preset duration is 5 seconds.

[0035] Furthermore, when the detected head position offset or head angle offset exceeds the corresponding threshold, visual modulation is applied to the entire display area of ​​the mixed reality headset to prompt the user to adjust their head posture.

[0036] Preferably, in this embodiment, when the head position shifts... or angle deviation At that time, by adjusting the shader parameters in the display rendering program, visual modulation is implemented on the entire display area of ​​the mixed reality head-mounted device; wherein, the display rendering program is Unity.

[0037] When the left shoulder position offset is detected to exceed the left shoulder position threshold, visual modulation is applied to the left local display area to prompt the user to adjust the left shoulder posture.

[0038] Preferably, in this embodiment, when the left shoulder position shifts... At that time, by adjusting the shader parameters in the display rendering program, visual modulation is implemented on the left partial display area of ​​the mixed reality head-mounted device; wherein, the display rendering program is Unity.

[0039] When the right shoulder position offset is detected to exceed the right shoulder position threshold, visual modulation is applied to the right local display area to prompt the user to adjust the right shoulder posture.

[0040] Preferably, in this embodiment, when the right shoulder position shifts... At that time, by adjusting the shader parameters in the display rendering program, visual modulation is implemented on the right partial display area of ​​the mixed reality head-mounted device; wherein, the display rendering program is Unity.

[0041] The left partial display area includes the upper left quarter area and the lower left quarter area, and the right partial display area includes the upper right quarter area and the lower right quarter area.

[0042] Furthermore, the visual modulation of the display area of ​​the mixed reality headset includes: reducing the brightness of the displayed content in the display area, reducing the sharpness of the displayed content in the display area, or reducing the transparency of the displayed content in the display area. The method of visual modulation of the entire display area of ​​the mixed reality headset should be the same as the method of visual modulation of the entire display area.

[0043] Furthermore, when the conditions of visual modulation on the entire display area and visual modulation on a partial display area of ​​the mixed reality head-mounted device are met simultaneously, the modulation amplitude of the partial display area is greater than the modulation amplitude of the entire display area.

[0044] When visual modulation is being applied to the entire display area, visual modulation is required for one or more local display areas. The degree of dimming of the local display area is greater than the degree of dimming of the entire display area, the degree of sharpness change of the local display area is greater than the degree of sharpness change of the entire display area, or the degree of transparency of the local display area is greater than the degree of transparency of the entire display area; wherein, the modulation amplitude of multiple local display areas is the same.

[0045] Preferably, when the conditions for visual modulation of the entire display area of ​​the mixed reality head-mounted device and visual modulation of a local display area are simultaneously met, the degree of dimming, blurring, or transparency of the quarter display area where visual modulation needs to be performed is 50% higher than that of other areas, so as to distinguish it from the overall intervention.

[0046] For a better illustration of this embodiment, see [link to relevant documentation]. Figure 2 , Figure 2This is a flowchart illustrating a posture correction system suitable for mixed reality office scenarios. As shown, the system mainly consists of two parts: a detection module and an intervention module. The detection module monitors the user's head and shoulder posture in real time, outputting head angle offset, head position offset, and shoulder position offset. Based on preset thresholds, it comprehensively determines whether the user is in an abnormal posture state. When an unhealthy posture is determined, the intervention module is activated, and the user adjusts their posture according to changes on the virtual screen. When the posture returns to normal, the display interface gradually returns to a normal state. When a healthy posture is determined, intervention is not activated.

[0047] Implementing the embodiments of this application has the following beneficial effects: By establishing a reference posture model corresponding to the head and shoulders when the user first uses the device, and continuously acquiring the current spatial posture information of the head and shoulders during subsequent use, the current spatial posture information is compared with the reference posture model to obtain the position offset and head angle offset. Based on the position offset and head angle offset, it is then determined whether the user is in an abnormal posture state. Since the head and shoulders together constitute the representation basis of the user's upper body posture state, compared with detection methods that only collect posture information of a single body part, this method can more comprehensively depict the user's posture deviation and improve the reliability of posture abnormality judgment. Compared with existing technologies that only perform posture detection on a single body part, resulting in incomplete and inaccurate identification of incorrect sitting postures, the poor sitting posture correction method for mixed reality office scenarios provided in this application can improve the accuracy of poor sitting posture detection.

[0048] Based on the above method embodiments, this application provides corresponding apparatus embodiments.

[0049] like Figure 3 As shown, one embodiment of this application provides a poor sitting posture correction device for a mixed reality office scenario, including a posture information acquisition module 100, an offset calculation module 200, a posture determination module 300, and a display modulation module 400.

[0050] The pose information acquisition module 100 is used to continuously acquire the current spatial pose information of the user's head and shoulders; Furthermore, the pose information acquisition module 100 includes: a head parameter acquisition unit and a shoulder parameter acquisition unit; The head parameter acquisition unit is used to acquire the position parameters and angle parameters of the user's head, respectively. The shoulder parameter acquisition unit is used to acquire the position parameters of the user's left shoulder and right shoulder respectively. The offset calculation module 200 is used to calculate the position offset and head angle offset of the user posture based on the current spatial pose information and the reference pose model. Furthermore, the offset calculation module 200 includes: a position offset calculation unit and an angle offset calculation unit; The position offset calculation unit is used to calculate the position offset of the head, left shoulder and right shoulder relative to the reference posture model using Euclidean distance based on the position parameters of the head, left shoulder and right shoulder, respectively, to obtain the head position offset, left shoulder position offset and right shoulder position offset; The angle offset calculation unit is used to calculate the head angle offset relative to the reference posture model based on the head angle parameters using a rotation matrix, and obtain the head angle offset. The posture determination module 300 is used to compare the position offset and head angle offset with the corresponding preset thresholds to determine whether the user is in an abnormal posture state. The display modulation module 400 is used to control the mixed reality head-mounted device to visually modulate the displayed content in order to prompt the user to adjust their posture; Furthermore, the display modulation module includes: a global modulation unit and a local modulation unit; The global modulation unit is used to perform visual modulation on the entire display area of ​​the mixed reality head-mounted device; The local modulation unit is used to perform visual modulation on a local display area of ​​the mixed reality head-mounted device.

[0051] Implementing the embodiments of this application has the following beneficial effects: The poor sitting posture correction device for mixed reality office scenarios provided by this application realizes a closed loop of functions, including continuous acquisition of spatial posture information of the user's head and shoulders, offset calculation, abnormal posture judgment, and visual intervention, by setting up a posture information acquisition module, an offset calculation module, a posture judgment module, and a display modulation module. Because the posture information acquisition module can collect head position parameters, head angle parameters, and left and right shoulder position parameters, and calculate position offset and head angle offset by combining them with the baseline posture model, it can perform a relatively complete modeling of the upper body posture based on the three-point information of the head and shoulders. Compared with the method of detecting only a single body part, it improves the completeness and accuracy of poor posture detection. Because the posture determination module compares the position offset and head angle offset with corresponding thresholds, it can more accurately distinguish between head abnormalities and shoulder abnormalities, thus providing a basis for subsequent differentiated intervention. Because the display modulation module includes a global modulation unit and a local modulation unit, it can perform visual modulation on the entire display area and a local display area respectively, and use implicit methods such as changes in brightness, sharpness or transparency to prompt the user to adjust their posture. Therefore, it can achieve flexible correction of poor posture without relying on additional external photography hardware and supporting software, and without interrupting the user's current work tasks as much as possible, taking into account both posture correction effect and interactive experience.

[0052] Based on the above embodiments, another embodiment of this application provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that the processor executes the computer program to perform the mixed reality office scene poor posture correction method described in the above application embodiments.

[0053] Based on the above embodiments, another embodiment of this application provides a computer-readable storage medium storing a computer program, characterized in that when the computer program is executed by a processor, it performs the method for correcting poor sitting posture in a mixed reality office scenario as described in the above embodiments.

[0054] It is understood that the above-described device embodiments correspond to the method embodiments of this application, and can realize the method embodiment of any of the above-described method embodiments of this application that provides a method for correcting poor sitting posture in a mixed reality office scenario.

[0055] It should be noted that the device embodiments described above are merely illustrative, and some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Furthermore, in the accompanying drawings of the device embodiments provided in this application, the connection relationships between modules indicate that they have communication connections, which can specifically be implemented as one or more communication buses or signal lines. Those skilled in the art can understand and implement this without any creative effort.

[0056] Based on the above-described embodiment of the method for correcting poor posture in a mixed reality office scenario, another embodiment of this application provides a terminal device, which includes a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor. When the processor executes the computer program, it implements the method for correcting poor posture in a mixed reality office scenario according to any embodiment of this application.

[0057] For example, in this embodiment, the computer program can be divided into one or more modules, which are stored in the memory and executed by the processor to complete this application. The one or more module units may be a series of computer program instruction segments capable of performing a specific function, which describe the execution process of the computer program in the terminal device.

[0058] The terminal device may be a desktop computer, laptop, handheld computer, or cloud server, etc. The terminal device may include, but is not limited to, a processor and a memory.

[0059] The processor can be a Central Processing Unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor can be a microprocessor or any conventional processor. The processor is the control center of the terminal device, connecting all parts of the terminal device via various interfaces and lines.

[0060] Based on the above-described method embodiments, another embodiment of this application provides a computer-readable storage medium including a stored computer program, wherein, when the computer program is executed, it controls the device where the computer-readable storage medium is located to execute the mixed reality office scenario poor posture correction method described in any of the above-described method embodiments of this application.

[0061] The modules / units integrated in the device / terminal equipment, if implemented as software functional units and sold or used as independent products, can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments can also be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed by a processor, it can implement the steps of the various method embodiments described above. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or certain intermediate forms. The computer-readable medium can include: any entity or device capable of carrying the computer program code, recording media, USB flash drives, portable hard drives, magnetic disks, optical disks, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signals, telecommunication signals, and software distribution media, etc.

[0062] Based on the above-described method embodiments, another embodiment of this application provides a computer program product, including a computer program or instructions, which, when executed by a communication device, implements a method for correcting poor posture in a mixed reality office scenario.

[0063] The specific embodiments described above further illustrate the purpose, technical solution, and beneficial effects of this application. It should be understood that the above descriptions are merely specific embodiments of this application and are not intended to limit the scope of protection of this application. In particular, it should be noted that any modifications, equivalent substitutions, or improvements made by those skilled in the art within the spirit and principles of this application should be included within the scope of protection of this application.

Claims

1. A method for correcting poor posture in a mixed reality office setting, characterized in that, The poor posture correction method, applicable to mixed reality headsets, includes: Continuously acquire the current spatial pose information of the user's head and shoulders; Based on the current spatial pose information and the preset reference pose model, the position offset and head angle offset of the user's posture are calculated; wherein, the reference pose model is established based on the user's historical spatial pose information; the historical spatial pose information is obtained by the mixed reality head-mounted device when the user's sitting posture meets the correct sitting posture judgment conditions; the position offset includes: head position offset, left shoulder position offset, and right shoulder position offset; Based on the position offset and head angle offset, determine whether the user is in an abnormal posture state; When the abnormal posture lasts for more than a preset duration, the mixed reality headset is controlled to visually modulate the displayed content to prompt the user to adjust their posture.

2. The method for correcting poor posture in a mixed reality office setting according to claim 1, characterized in that, The mixed reality head-mounted device continuously acquires the current spatial pose information of the user's head and shoulders, including: collecting the position parameters of the user's head, the angle parameters of the head, the position parameters of the left shoulder, and the position parameters of the right shoulder.

3. The method for correcting poor posture in a mixed reality office setting according to claim 2, characterized in that, Based on the current spatial pose information and the preset reference pose model, the user's pose position offset and head angle offset are calculated, including: Based on the position parameters of the head, left shoulder, and right shoulder, the position offsets of the head, left shoulder, and right shoulder relative to the reference posture model are calculated using Euclidean distance, resulting in the head position offset, left shoulder position offset, and right shoulder position offset. Based on the head angle parameters, the head angle offset relative to the reference posture model is calculated using a rotation matrix to obtain the head angle offset.

4. The method for correcting poor posture in a mixed reality office setting according to claim 3, characterized in that, Based on the positional offset and head angle offset, determine whether the user is in an abnormal posture state, including: The head position threshold, left shoulder position threshold, right shoulder position threshold, and head angle threshold are obtained, wherein the head position threshold, left shoulder position threshold, right shoulder position threshold, and head angle threshold are determined based on preset parameters or user input parameters; The head position offset, left shoulder position offset, and right shoulder position offset are compared with their corresponding position thresholds. Compare the head angle offset with the corresponding head angle threshold; When the head position offset, left shoulder position offset, right shoulder position offset, or head angle offset exceeds the corresponding threshold, the user is determined to be in an abnormal posture state.

5. The method for correcting poor posture in a mixed reality office setting according to claim 3, characterized in that, Controlling the mixed reality headset to visually modulate the displayed content to prompt the user to adjust their posture includes: When the detected head position offset or head angle offset exceeds the corresponding threshold, visual modulation is applied to the display content in the entire display area of ​​the mixed reality headset to prompt the user to adjust their head posture. When the left shoulder position offset is detected to exceed the left shoulder position threshold, visual modulation is applied to the display content in the left local display area to prompt the user to adjust the left shoulder posture; When the right shoulder position offset is detected to exceed the right shoulder position threshold, visual modulation is applied to the display content in the right local display area to prompt the user to adjust the right shoulder posture; The left partial display area includes the upper left quarter area and the lower left quarter area, and the right partial display area includes the upper right quarter area and the lower right quarter area.

6. The method for correcting poor posture in a mixed reality office setting according to claim 5, characterized in that, Visual modulation of the display content of a mixed reality head-mounted device includes: reducing the brightness of the display content in the display area, reducing the sharpness of the display content in the display area, or reducing the transparency of the display content in the display area.

7. The method for correcting poor posture in a mixed reality office setting according to claim 6, characterized in that, When the conditions for visual modulation of the entire display area and visual modulation of a partial display area of ​​a mixed reality head-mounted device are met simultaneously, the modulation amplitude of the partial display area is greater than the modulation amplitude of the entire display area.

8. A device for correcting poor posture in a mixed reality office setting, characterized in that, include: The module includes a pose information acquisition module, an offset calculation module, a pose determination module, and a display modulation module. The pose information acquisition module is used to continuously acquire the current spatial pose information of the user's head and shoulders; The offset calculation module is used to calculate the position offset and head angle offset of the user's posture based on the current spatial pose information and a preset reference pose model. The reference pose model is established based on the user's historical spatial pose information, which is obtained by the mixed reality head-mounted device when the user's sitting posture meets the correct sitting posture judgment conditions. The position offset includes: head position offset, left shoulder position offset, and right shoulder position offset. The posture determination module determines whether the user is in an abnormal posture state based on the position offset and head angle offset. When the abnormal posture lasts for more than a preset duration, the display modulation module controls the mixed reality head-mounted device to visually modulate the displayed content to prompt the user to adjust their posture.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the method for correcting poor posture in a mixed reality office scenario as described in any one of claims 1 to 7.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the method for correcting poor sitting posture in a mixed reality office scenario as described in any one of claims 1 to 7.

Images