A sensing, storage, computing and display integrated hardware control system

Abstract

The present invention belongs to the field of semiconductor chip technology, and specifically is a sensing, storage, computing and display integrated hardware control system. It collects multi-dimensional data in real time based on the multi-integrated sensor array embedded in the chip. On the one hand, it dynamically adjusts the gaze focus and edge area resolution in the virtual interactive graph through user status tracking and external environment perception, simulates human eye vision to enhance experience and reduce computing burden, and automatically matches brightness and color temperature to ensure VR visual continuity and eliminate discomfort caused by sudden environmental changes. On the other hand, it monitors chip operation in real time to evaluate the chip operation risk level to determine the corresponding associated display parameters for step-by-step regulation. It can not only maintain a good visual experience for users, but also achieve effective management of energy consumption and equipment temperature, effectively integrate visual simulation, environmental adaptation and performance optimization, and effectively bring users a smooth and comfortable VR interactive experience through chip hardware control.

Description

Technical Field

[0001] The present invention belongs to the technical field of semiconductor chips, and specifically relates to a sensing, storage, computing and display integrated hardware control system. Background Art

[0002] In today's wave of virtual reality technology development, users' pursuit of depth and breadth of immersive experience has become a key force driving technological innovation. With the sharp increase in immersive demand, the hardware architecture on which traditional VR interactive devices rely has gradually shown its limitations, especially in dealing with core challenges such as high-load real-time rendering, high-definition visual presentation, and high-precision motion tracking. In order to overcome these technical barriers and ensure that users can enjoy a better interactive experience, it is particularly important to innovate the chip control strategy of VR interactive devices.

[0003] In the prior art, there are also some solutions related to chip control of VR interactive devices. For example, the Chinese patent number CN2016100198098 is an invention patent application for a display method of a display device, a display device and a virtual reality VR system. When the display device is turned on, it receives video data sent by a video source device, detects whether the LCD driver chip is in a stable state, and generates a control instruction when the LCD driver chip is in an unstable state. According to the control instruction, the LCD screen of the display device is changed to a black screen, which is used to solve the problem of screen flickering or jitter when the display device is turned on, thereby improving the user experience.

[0004] The above solution faces the limitations common in existing technologies, namely, it focuses on sensing the stable operating status of the chip to perform relevant control measures. On the one hand, it lacks the ability to perceive the user's real environment in real time and adjust display parameters. As a result, in high-brightness or low-light environments, or in specific color temperature environments, the VR display effect may be inconsistent with the actual environment, affecting the user's immersion and comfort.

[0005] On the other hand, the existing technology usually adopts a strategy of significantly reducing display parameters or even stopping display when the chip is not in good operating condition, such as turning the LCD screen of the display device into a black screen as mentioned above. This is an overly simple and crude way to improve the chip operating condition, which may have a significant negative impact on both user experience and system performance, and is contrary to the original intention of chip control technology to maximize user experience and system performance through intelligent regulation. Summary of the invention

[0006] In order to overcome the shortcomings of the background technology, an embodiment of the present invention provides a sensing, storage, computing and display integrated hardware control system, which can effectively solve the problems involved in the above-mentioned background technology.

[0007] The purpose of the present invention can be achieved through the following technical solutions: a sensing, storage, computing and display integrated hardware control system, including: a benchmark display setting module, a real-time data acquisition module, a primary parameter independent correction module, a secondary parameter independent correction module, an optimized parameter output module and a cloud database.

[0008] The benchmark display setting module is connected to the real-time data acquisition module, and the real-time data acquisition module is respectively connected to the primary parameter independent correction module and the secondary parameter independent correction module, and the primary parameter independent correction module and the secondary parameter independent correction module are both connected to the optimization parameter output module, and the cloud database is respectively connected to the real-time data acquisition module, the primary parameter independent correction module, and the secondary parameter independent correction module.

[0009] The benchmark display setting module is used to set the benchmark display parameters of the virtual dynamic interactive graph when the target user conducts VR interactive activities, including the benchmark frame rate, benchmark resolution, benchmark display brightness and benchmark display color temperature.

[0010] The real-time data acquisition module is used to track user status, monitor chip operation and perceive the external environment in real time through the multi-integrated sensor array embedded in the chip, and obtain the current target user status data, chip operation monitoring data and external environment perception data.

[0011] The primary parameter independent correction module is used to independently correct the benchmark display parameters of the current virtual dynamic interaction diagram of the target user according to the current target user state data and external environment perception data.

[0012] The secondary parameter independent correction module is used to perform secondary independent correction on the benchmark display parameters of the current virtual dynamic interaction diagram of the target user according to the current chip operation monitoring data.

[0013] Optimize parameter output module to combine the current virtual dynamic interaction of the target user Figure 1 The benchmark display parameters after the first independent correction and the second independent correction are used to output the optimized display parameters of the current virtual dynamic interactive graph of the target user and provide display feedback.

[0014] The cloud database is used to store the scope of the head deviation planning area and the eye gaze planning area, the power consumption threshold corresponding to the high-energy consumption state and the chip surface temperature threshold corresponding to the overheating operation state provided by the chip manufacturer's technical specifications, the reference color temperature range corresponding to each color tone, and the reference frame rate, reference resolution and reference display brightness corresponding to the minimum experience standard of the virtual dynamic interactive graph.

[0015] Compared with the prior art, the embodiments of the present invention have at least the following advantages or beneficial effects: (1) The present invention performs real-time multi-dimensional data acquisition through a multi-element integrated sensor array embedded in the chip, providing instant and accurate data support for the subsequent correction of the benchmark display parameters of the virtual dynamic interactive graph, ensuring that the system can quickly respond to environmental changes and user status changes.

[0016] (2) The present invention tracks the user status and determines in real time the user's gaze focus area and gaze edge area in the virtual dynamic interactive graph. While maintaining the baseline resolution of the gaze focus area, the resolution of the gaze edge area is relatively lowered, thereby simulating the natural characteristics of human vision. This makes the display of the virtual dynamic interactive graph more in line with human visual habits, which not only helps to improve the user's immersion and satisfaction, but also greatly reduces the computational burden of the graphics processor.

[0017] (3) The present invention perceives the user's external environment and determines in real time the brightness matching and color temperature synchronization between the user's virtual dynamic interaction graph and the real environment, thereby maintaining the continuity of the user's visual experience during the VR interaction process and avoiding the abruptness caused by environmental changes.

[0018] (4) The present invention monitors the chip operation and evaluates the chip operation risk level in real time to determine the corresponding associated display parameters for step-by-step regulation, which can not only maintain a good visual experience for users, but also achieve effective management of energy consumption and device temperature. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] The present invention is further described using the accompanying drawings, but the embodiments in the accompanying drawings do not constitute any limitation to the present invention. A person skilled in the art can obtain other drawings based on the following drawings without creative work.

[0020] Figure 1 It is a schematic diagram of module connection of the present invention. DETAILED DESCRIPTION

[0021] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0022] Reference Figure 1 As shown, the present invention provides a sensing, storage, computing and display integrated hardware control system, including: a benchmark display setting module, a real-time data acquisition module, a primary parameter independent correction module, a secondary parameter independent correction module, an optimized parameter output module and a cloud database.

[0023] The benchmark display setting module is connected to the real-time data acquisition module, and the real-time data acquisition module is respectively connected to the primary parameter independent correction module and the secondary parameter independent correction module, and the primary parameter independent correction module and the secondary parameter independent correction module are both connected to the optimization parameter output module, and the cloud database is respectively connected to the real-time data acquisition module, the primary parameter independent correction module, and the secondary parameter independent correction module.

[0024] The benchmark display setting module is used to set benchmark display parameters of the virtual dynamic interactive graph when the target user conducts VR interactive activities, including a benchmark frame rate, a benchmark resolution, a benchmark display brightness, and a benchmark display color temperature.

[0025] The real-time data acquisition module is used to track user status, monitor chip operation and perceive the external environment in real time through the multi-integrated sensor array embedded in the chip, and obtain the current target user status data, chip operation monitoring data and external environment perception data.

[0026] Specifically, the specific process of user state tracking includes: tracking the user's head movement direction and speed through a chip-integrated inertial measurement unit to lock the user's head fixed position in real time, mapping it to the corresponding position coordinates of a VR virtual dynamic interaction graph, and according to the head deviation planning area scope stored in a cloud database, obtaining the head deviation area corresponding to the user's head fixed position in the VR virtual dynamic interaction graph in real time, and marking it as the user's viewing angle area.

[0027] It should be noted that the above-mentioned integrated inertial measurement unit includes an accelerometer and a gyroscope.

[0028] It should also be noted that the above-mentioned fixed position of the user's head specifically refers to the actual position of the center point of the user wearing the VR glasses relative to the user's head.

[0029] The chip's embedded eye tracking sensor tracks the position and movement of the user's pupil to lock the user's pupil gaze position in real time and map it to the corresponding position coordinates of the VR virtual dynamic interaction diagram. According to the eye gaze planning area scope stored in the cloud database, the eye gaze area corresponding to the user's pupil gaze position in the VR virtual dynamic interaction diagram is obtained in real time and marked as the user's gaze focus area.

[0030] It should also be noted that the above-mentioned head deviation planning area scope and eye gaze planning area scope are both fan-shaped areas with the eye position as the center point and the preset field of view limited distance as the radius, and the corresponding preset field of view fan-shaped center angle is planned. Among them, the head deviation planning area scope corresponds to the preset field of view fan-shaped center angle is greater than the eye gaze planning area scope corresponding to the preset field of view fan-shaped center angle.

[0031] Exemplarily, the preset field of view fan center angles corresponding to the head deflection planning area range and the eye gaze planning area range may be 150 degrees and 120 degrees respectively.

[0032] The other areas of the user's visual field except the user's focus area are marked as the user's gaze edge area.

[0033] Therefore, by tracking the user status, the user's gaze focus area and the user's gaze edge area in the virtual dynamic interaction graph can be obtained in real time.

[0034] Specifically, the specific process of chip operation monitoring and external environment perception includes: real-time monitoring of the operating voltage and operating current flowing through the chip through the integrated circuit embedded in the chip, and taking the product of the two as the power consumption to realize the energy consumption status monitoring of the chip.

[0035] The temperature value of each unit area on the chip surface is monitored in real time through the chip embedded temperature sensor to realize the overheating status monitoring of the chip.

[0036] Energy consumption status monitoring and overheating status monitoring are used together as chip operation monitoring.

[0037] The chip's built-in ambient light sensor can sense the brightness and color temperature of the user's actual ambient light in real time to achieve perception of the external environment.

[0038] The embodiment of the present invention performs real-time multi-dimensional data collection through a multi-element integrated sensor array embedded in the chip, providing instant and accurate data support for the subsequent correction of the benchmark display parameters of the virtual dynamic interactive graph, ensuring that the system can quickly respond to environmental changes and user status changes.

[0039] The primary parameter independent correction module is used to independently correct the benchmark display parameters of the current virtual dynamic interaction graph of the target user according to the current target user state data and external environment perception data.

[0040] Specifically, the independently correcting the reference display parameters of the current virtual dynamic interaction graph of the target user includes: obtaining a gaze focus area and a user gaze edge area in the current virtual dynamic interaction graph of the target user.

[0041] The baseline resolution of the focus area of ​​the target user's current virtual dynamic interaction diagram is maintained, and the baseline resolution of the edge area of ​​the target user's current virtual dynamic interaction diagram is lowered to a preset permitted resolution.

[0042] The embodiments of the present invention track the user status and determine in real time the user's gaze focus area and gaze edge area in the virtual dynamic interaction graph, while maintaining the baseline resolution of the gaze focus area and relatively lowering the resolution of the gaze edge area, thereby simulating the natural characteristics of human vision and making the display of the virtual dynamic interaction graph more in line with human visual habits, which not only helps to improve the user's immersion and satisfaction, but also greatly reduces the computing burden of the graphics processor.

[0043] The brightness and color temperature of the target user's current real ambient light are obtained, and compared with the benchmark display brightness and benchmark display color temperature of the target user's current virtual dynamic interaction graph, and the brightness matching coefficient and color temperature synchronization coefficient of the target user's current virtual dynamic interaction graph are evaluated. If the brightness matching coefficient is greater than or equal to its corresponding preset standard threshold, the benchmark display brightness of the target user's current virtual dynamic interaction graph is maintained. Otherwise, the control direction of the benchmark display brightness is confirmed according to the comparison relationship between the brightness of the target user's current real ambient light and the benchmark display brightness of the target user's current virtual dynamic interaction graph, and further the control value of the benchmark display brightness is confirmed according to the absolute deviation value between the brightness matching coefficient and its corresponding preset standard threshold and the preset control display brightness corresponding to the unit brightness matching coefficient deviation value.

[0044] It should be noted that the confirmation process of the control direction of the above-mentioned benchmark display brightness includes: if the brightness of the target user's current real ambient light is greater than the benchmark display brightness of the target user's current virtual dynamic interaction graph, then confirming that the control direction of the benchmark display brightness is upward; if the brightness of the target user's current real ambient light is less than the benchmark display brightness of the target user's current virtual dynamic interaction graph, then confirming that the control direction of the benchmark display brightness is downward.

[0045] Similarly, if the color temperature synchronization coefficient is greater than or equal to its corresponding preset threshold, the benchmark display color temperature of the user's current virtual dynamic interactive graph is maintained, otherwise the control direction and control value of the benchmark display color temperature are confirmed.

[0046] This achieves an independent correction of the baseline display parameters of the target user's current virtual dynamic interactive graph.

[0047] Specifically, the evaluation process of the brightness matching coefficient of the target user's current virtual dynamic interaction graph includes: calculating the absolute deviation value Δh between the brightness of the target user's current real environment light and the reference display brightness of the target user's current virtual dynamic interaction graph, and calculating the brightness matching coefficient of the target user's current virtual dynamic interaction graph by the calculation model. The brightness matching coefficient of the current virtual dynamic interaction graph of the target user is obtained, where Δh0 is the preset virtual interaction display brightness allowable deviation threshold, and e is a natural constant.

[0048] It should be noted that the calculation process of the absolute deviation value between the brightness of the target user's current real ambient light and the benchmark display brightness of the target user's current virtual dynamic interaction graph is as follows: subtract the brightness of the target user's current real ambient light from the benchmark display brightness of the target user's current virtual dynamic interaction graph, and further convert the obtained difference into an absolute value, thereby obtaining the absolute deviation value between the brightness of the target user's current real ambient light and the benchmark display brightness of the target user's current virtual dynamic interaction graph.

[0049] Specifically, the evaluation process of the color temperature synchronization coefficient of the target user's current virtual dynamic interaction graph includes: obtaining the hue of the target user's current real ambient light and the hue of the target user's current virtual dynamic interaction graph according to the reference color temperature interval corresponding to each hue stored in the cloud database; if the hues are the same, the basic hue synchronization factor α of the target user's current virtual dynamic interaction graph is set to φ1, otherwise it is set to φ2, α=φ1 or φ2 and φ1>φ2.

[0050] Calculate the absolute deviation value Δk between the color temperature of the target user's current real ambient light and the benchmark display color temperature of the target user's current virtual dynamic interaction diagram, using the formula The color temperature synchronization coefficient of the current virtual dynamic interaction graph of the target user is obtained, where k1 is the reference display color temperature of the current virtual dynamic interaction graph of the target user.

[0051] It should be noted that the calculation process of the absolute deviation value between the color temperature of the target user's current real ambient light and the benchmark display color temperature of the target user's current virtual dynamic interaction graph is as follows: subtract the color temperature of the target user's current real ambient light from the benchmark display color temperature of the target user's current virtual dynamic interaction graph, and further convert the obtained difference into an absolute value, thereby obtaining the absolute deviation value between the color temperature of the target user's current real ambient light and the benchmark display color temperature of the target user's current virtual dynamic interaction graph.

[0052] The embodiments of the present invention perceive the user's external environment and determine in real time the brightness matching and color temperature synchronization between the user's virtual dynamic interaction graph and the real environment, thereby maintaining the continuity of the user's visual experience during the VR interaction process and avoiding the abruptness caused by environmental changes.

[0053] The secondary parameter independent correction module is used to perform secondary independent correction on the benchmark display parameters of the current virtual dynamic interaction diagram of the target user according to the current chip operation monitoring data.

[0054] Specifically, the benchmark display parameters of the current virtual dynamic interactive diagram of the target user are modified twice independently, including: by monitoring the chip energy consumption status and overheating status in the current time period, the energy consumption abnormal trend coefficient and overheating abnormal trend coefficient of the chip in the current time period are obtained, and the accumulated value of the two is used as the operation risk coefficient μ of the chip in the current time period, and the operation risk level judgment model is used. Determine the chip operation risk level in the current time period, where μ′ and μ″ are the lower limit and upper limit of the chip operation risk coefficient range corresponding to the preset second-order operation risk level.

[0055] Set the display parameters associated with the first-order operation risk level of the chip to the benchmark frame rate, set the display parameters associated with the second-order operation risk level of the chip to the benchmark frame rate and benchmark resolution, and set the display parameters associated with the third-order operation risk level of the chip to the benchmark frame rate, benchmark resolution and benchmark display brightness, thereby determining the associated display parameters corresponding to the chip's operation risk level in the current time period.

[0056] It should be noted that the above configuration strategy for determining the chip operation risk level and its associated display parameters is based on a careful consideration of the weights of the impact of frame rate, resolution and display brightness on chip energy consumption and overheating risk. Specifically, as the primary adjustment parameter, frame rate has the most significant impact on energy consumption. High frame rate requires the chip GPU to process a large amount of image data in a short period of time, which in turn increases power consumption and computing burden, leading to increased energy consumption and increased overheating risk. Therefore, adjusting the frame rate to control energy consumption and heat dissipation is the most direct and effective means.

[0057] Next is resolution, which also has a significant impact on energy consumption. High resolution means a surge in the number of pixels that need to be rendered, which undoubtedly increases the computing load of the chip GPU and the use of video memory bandwidth, further pushing up energy consumption levels. Especially when processing HD or UHD content, the increase in resolution will significantly increase the complexity of graphics processing, putting greater pressure on energy consumption and cooling systems. Therefore, when the chip operation risk level increases, the resolution is included in the adjustment scope to help mitigate the risk of chip operation.

[0058] Compared with frame rate and resolution, the impact of display brightness on energy consumption is relatively small, but the increase in its value will still directly lead to an increase in the power consumption of each pixel, thereby pushing up the total energy consumption. Maintaining high brightness for a long time will also indirectly increase the thermal load of the device.

[0059] To sum up, from the perspective of energy consumption and heat management, an adjustment priority strategy is established with frame rate as the first, resolution as the second, and brightness as the auxiliary. Corresponding related display parameters are gradually added according to the chip operation risk level, aiming to maintain a good visual experience while achieving effective management of energy consumption and device temperature.

[0060] The reference frame rate, reference resolution and reference display brightness corresponding to the minimum experience standard of the virtual dynamic interactive graph stored in the cloud database are extracted, and half of the absolute difference between their respective corresponding benchmark values ​​is used as the downward adjustment amplitude, thereby obtaining the downward adjustment amplitude of the associated display parameters corresponding to the chip's operating risk level in the current time period.

[0061] Thus, a secondary independent correction of the benchmark display parameters of the target user's current virtual dynamic interactive graph is achieved.

[0062] Specifically, the process of obtaining the abnormal energy consumption trend coefficient of the chip in the current time period includes: obtaining the power consumption p of the chip at each monitoring time point in the current time period. i , i is the number of each monitoring time point in the current time period, i = 1, 2, ..., a, combined with the power consumption threshold p0 corresponding to the high energy consumption state provided by the chip manufacturer's technical specifications stored in the cloud database, calculate the energy consumption abnormal trend coefficient Ec of the chip in the current time period, Where a is the number of monitoring time points in the current time period, p i-1 It is the power consumption of the chip at the i-1th monitoring time point in the current time period.

[0063] Specifically, the process of obtaining the overheating abnormal trend coefficient of the chip in the current time period includes: obtaining the temperature value of each unit area of ​​the chip at each monitoring time point in the current time period, combining the chip surface temperature reaching threshold corresponding to the overheating operation state provided by the chip manufacturer's technical specifications stored in the cloud database, and counting the chip overheating area and its area proportion s at each monitoring time point in the current time period. i , calculate the overheating abnormal trend coefficient Oc of the chip in the current time period, where s i-1 It is the area ratio of the chip overheating area at the i-1th monitoring time point in the current time period.

[0064] The embodiment of the present invention monitors the chip operation and evaluates the chip operation risk level in real time to determine the corresponding associated display parameters for step-by-step regulation, which can not only maintain a good visual experience for users, but also achieve effective management of energy consumption and device temperature.

[0065] The optimization parameter output module is used to combine the current virtual dynamic interaction of the target user Figure 1 The benchmark display parameters after the first independent correction and the second independent correction are used to output the optimized display parameters of the current virtual dynamic interactive graph of the target user and provide display feedback.

[0066] Specifically, the outputting of the optimized display parameters of the current virtual dynamic interaction graph of the target user includes: respectively calculating the average of the reference resolution and reference display brightness after the first independent correction and the second independent correction to obtain the optimized resolution and the optimized display brightness.

[0067] The reference display color temperature after the first independent correction is used as the optimized display color temperature, and the reference frame rate after the second independent correction is used as the optimized frame rate.

[0068] The optimized display parameters of the current virtual dynamic interactive diagram of the target user are obtained and output.

[0069] The cloud database is used to store the scope of the head deviation planning area and the scope of the eye gaze planning area, store the power consumption threshold corresponding to the high-energy consumption state and the chip surface temperature threshold corresponding to the overheating operation state provided by the chip manufacturer's technical specifications, store the reference color temperature range corresponding to each color tone, and store the reference frame rate, reference resolution and reference display brightness corresponding to the minimum experience standard of the virtual dynamic interactive graph.

[0070] The data sources in the cloud database of this embodiment are shown in Table 1 below.

[0071] Table 1 Detailed description of data sources in cloud database

[0072]

[0073]

[0074] The above contents are merely examples and explanations of the structure of the present invention. The technicians in this technical field may make various modifications or additions to the specific embodiments described or replace them in a similar manner. As long as they do not deviate from the structure of the invention or exceed the scope defined by the present invention, they should all fall within the protection scope of the present invention.

Claims

1. A sensing, storage, computing and display integrated hardware control system, characterized in that: The system includes: The benchmark display setting module is used to set the benchmark display parameters of the virtual dynamic interactive graph when the target user conducts VR interactive activities, including the benchmark frame rate, benchmark resolution, benchmark display brightness and benchmark display color temperature; The real-time data acquisition module is used to track user status, monitor chip operation, and sense the external environment in real time through the multi-integrated sensor array embedded in the chip, and obtain the current target user status data, chip operation monitoring data, and external environment perception data; A primary parameter independent correction module, used to independently correct the benchmark display parameters of the current virtual dynamic interaction diagram of the target user according to the current target user state data and external environment perception data; A secondary parameter independent correction module is used to perform a secondary independent correction on the benchmark display parameters of the current virtual dynamic interaction diagram of the target user according to the current chip operation monitoring data; An optimization parameter output module is used to combine the baseline display parameters after the first independent correction and the second independent correction of the current virtual dynamic interaction diagram of the target user, output the optimized display parameters of the current virtual dynamic interaction diagram of the target user and provide display feedback; A cloud database is used to store the scope of the head deviation planning area and the scope of the eye gaze planning area, store the power consumption threshold corresponding to the high energy consumption state and the chip surface temperature threshold corresponding to the overheating operation state provided by the chip manufacturer's technical specifications, store the reference color temperature range corresponding to each color tone, and store the reference frame rate, reference resolution and reference display brightness corresponding to the minimum experience standard of the virtual dynamic interactive graph; The second independent correction of the benchmark display parameters of the current virtual dynamic interactive diagram of the target user includes: obtaining the abnormal energy consumption trend coefficient and the abnormal overheating trend coefficient of the chip in the current time period by monitoring the chip energy consumption status and the overheating status in the current time period, and using the accumulated value of the two as the operation risk coefficient of the chip in the current time period , according to the operation risk level judgment model Determine the chip's operational risk level in the current time period, where They are respectively the lower limit value and the upper limit value of the chip operation risk coefficient interval corresponding to the preset second-order operation risk level; Set the chip's first-order operation risk level associated display parameter to the base frame rate, set the chip's second-order operation risk level associated display parameter to the base frame rate and base resolution, set the chip's third-order operation risk level associated display parameter to the base frame rate, base resolution and base display brightness, thereby determining the chip's operation risk level corresponding associated display parameters in the current time period; Extract the reference frame rate, reference resolution and reference display brightness corresponding to the minimum experience standard of the virtual dynamic interactive graph stored in the cloud database, and use half of the absolute difference between the corresponding benchmark values ​​as the downward adjustment value, thereby obtaining the downward adjustment value of the associated display parameters corresponding to the chip's operating risk level in the current time period; Thus, a secondary independent correction of the benchmark display parameters of the current virtual dynamic interactive graph of the target user is achieved; The process of obtaining the abnormal energy consumption trend coefficient of the chip in the current time period includes: obtaining the power consumption of the chip at each monitoring time point in the current time period , is the number of each monitoring time point in the current time period, , combined with the power consumption threshold corresponding to the high energy consumption state provided by the chip manufacturer's technical specifications stored in the cloud database , calculate the abnormal trend coefficient of chip energy consumption in the current time period , ,in is the number of monitoring time points in the current time period, The current time period The power consumption of the chip at each monitoring time point; The process of obtaining the overheating abnormal trend coefficient of the chip in the current time period includes: obtaining the temperature value of each unit area of ​​the chip at each monitoring time point in the current time period, combining the chip surface temperature reaching threshold value corresponding to the overheating operation state provided by the chip manufacturer's technical specifications stored in the cloud database, and counting the chip overheating area and its area proportion at each monitoring time point in the current time period , calculate the overheating abnormal trend coefficient of the chip in the current time period , ,in The current time period The area ratio of the chip overheating area at each monitoring time point.

2. The sensing, storage, computing and display integrated hardware control system according to claim 1, characterized in that: The specific process of user state tracking includes: tracking the user's head movement direction and speed through the chip integrated inertial measurement unit to lock the user's head fixed point position in real time, mapping it to the corresponding position coordinates of the VR virtual dynamic interaction map, and according to the head deviation planning area scope stored in the cloud database, obtaining the head deviation area corresponding to the user's head fixed point position in the VR virtual dynamic interaction map in real time, marking it as the user's viewing angle area; The user's pupil position and movement are tracked through the chip's embedded eye tracking sensor to lock the user's pupil gaze position in real time, and mapped to the corresponding position coordinates of the VR virtual dynamic interaction map. According to the eye gaze planning area scope stored in the cloud database, the eye gaze area corresponding to the user's pupil gaze position in the VR virtual dynamic interaction map is obtained in real time, and marked as the user's gaze focus area; Marking other areas of the user's viewing area except the user's focus area as the user's gaze edge area; Therefore, by tracking the user status, the user's gaze focus area and the user's gaze edge area in the virtual dynamic interaction graph can be obtained in real time.

3. The sensing, storage, computing and display integrated hardware control system according to claim 2, characterized in that: The specific process of the chip operation monitoring and external environment perception includes: monitoring the operating voltage and the operating current flowing through the chip in real time through the chip embedded integrated circuit, and taking the product of the two as the power consumption to realize the energy consumption state monitoring of the chip; The temperature value of each unit area on the chip surface is monitored in real time through the chip embedded temperature sensor to realize the overheating status monitoring of the chip; Combine energy consumption status monitoring and overheating status monitoring as chip operation monitoring; The chip's built-in ambient light sensor can sense the brightness and color temperature of the user's actual ambient light in real time to achieve perception of the external environment.

4. The sensing, storage, computing and display integrated hardware control system according to claim 3, characterized in that: The independently correcting the reference display parameters of the current virtual dynamic interaction graph of the target user includes: obtaining the gaze focus area and the user gaze edge area in the current virtual dynamic interaction graph of the target user; Maintain the baseline resolution of the focus area of ​​the target user's current virtual dynamic interaction diagram, and reduce the baseline resolution of the edge area of ​​the target user's current virtual dynamic interaction diagram to a preset permitted resolution; Obtain the brightness and color temperature of the target user's current real ambient light, compare them with the benchmark display brightness and benchmark display color temperature of the target user's current virtual dynamic interaction graph, evaluate the brightness matching coefficient and color temperature synchronization coefficient of the target user's current virtual dynamic interaction graph, and if the brightness matching coefficient is greater than or equal to its corresponding preset standard threshold, maintain the benchmark display brightness of the target user's current virtual dynamic interaction graph; otherwise, confirm the control direction of the benchmark display brightness based on the comparison relationship between the brightness of the target user's current real ambient light and the benchmark display brightness of the target user's current virtual dynamic interaction graph, and further confirm the control value of the benchmark display brightness based on the absolute deviation value between the brightness matching coefficient and its corresponding preset standard threshold and the preset control display brightness corresponding to the unit brightness matching coefficient deviation value; Similarly, if the color temperature synchronization coefficient is greater than or equal to its corresponding preset threshold, the base display color temperature of the current virtual dynamic interactive map of the target user is maintained, otherwise the control direction and control value of the base display color temperature are confirmed; This achieves an independent correction of the baseline display parameters of the target user's current virtual dynamic interactive graph.

5. The sensing, storage, computing and display integrated hardware control system according to claim 4, characterized in that: The evaluation process of the brightness matching coefficient of the target user's current virtual dynamic interaction graph includes: calculating the absolute deviation value between the brightness of the target user's current real environment light and the reference display brightness of the target user's current virtual dynamic interaction graph , by the computational model Get the brightness matching coefficient of the target user's current virtual dynamic interaction graph, where The preset virtual interactive display brightness tolerance threshold, is a natural constant.

6. The sensing, storage, computing and display integrated hardware control system according to claim 4, characterized in that: The evaluation process of the color temperature synchronization coefficient of the target user's current virtual dynamic interaction graph includes: obtaining the color temperature of the target user's current real ambient light and the color temperature of the target user's current virtual dynamic interaction graph according to the reference color temperature interval corresponding to each color tone stored in the cloud database; if the color tones are the same, the basic color temperature synchronization factor of the target user's current virtual dynamic interaction graph is set. Set to , otherwise set to , and ; Calculate the absolute deviation between the color temperature of the target user's current real ambient light and the baseline display color temperature of the target user's current virtual dynamic interactive graph , according to the formula Get the color temperature synchronization coefficient of the target user's current virtual dynamic interaction graph, where The base display color temperature of the current virtual dynamic interactive diagram for the target user.

7. The sensing, storage, computing and display integrated hardware control system according to claim 1, characterized in that: The outputting of the optimized display parameters of the current virtual dynamic interaction graph of the target user includes: respectively calculating the average of the reference resolution and the reference display brightness after the first independent correction and the second independent correction to obtain the optimized resolution and the optimized display brightness; The reference display color temperature after the first independent correction is used as the optimized display color temperature, and the reference frame rate after the second independent correction is used as the optimized frame rate; The optimized display parameters of the current virtual dynamic interactive graph of the target user are obtained and output.

Images