Processing method and system based on XR whole house intelligent control and medium

Abstract

The invention provides a processing method and system based on XR whole house intelligent control and a medium, and belongs to the technical field of intelligent home control and big data. The method comprises the following steps: acquiring home equipment control information, extracting near-to-eye display effect data, perception interaction response rate data, network transmission stability data and rendering imaging effect data, and respectively judging whether the display resolution, the perception interaction response rate, the network transmission stability and the rendering imaging effect meet requirements or not. According to the method, multiple dimensions such as the near-to-eye display effect, the perception interaction response rate, the network transmission stability and the rendering imaging effect of the control effect of the XR equipment are comprehensively considered, and the control information of the home equipment is comprehensively and systematically evaluated. The high efficiency of XR equipment control is realized, and the overall performance of the equipment and the user experience can be reflected more accurately.

Description

Technical Field

[0001] The present application relates to the field of smart home control and big data technology, and specifically, to a processing method, system and medium based on XR whole-house smart control. Background Art

[0002] With the development of Internet of Things technology and artificial intelligence interaction technology, home appliances have begun to realize linkage control of diversified scenarios. With the advancement of technology and the improvement of people's living standards, consumers' demand for smart home control is also increasing. Among them, the control ability of smart home is crucial, which directly affects the user experience.

[0003] Although current smart homes can achieve diversified scenarios and device linkage, the product quality is uneven and there is a lack of a technical method that can comprehensively monitor and control and effectively evaluate its control capabilities.

[0004] In view of the above problems, effective technical solutions are currently awaited. Summary of the invention

[0005] The purpose of this application is to provide a processing method, system and medium based on XR whole-house intelligent control, which can obtain home appliance control information, extract near-eye display effect data, perceived interaction response rate data, network transmission stability data and rendering imaging effect data, and respectively judge whether the display resolution, perceived interaction response rate, network transmission stability and rendering imaging effect meet the requirements. This application comprehensively and systematically evaluates the control information of home appliances by comprehensively considering multiple dimensions such as near-eye display effect, perceived interaction response rate, network transmission stability and rendering imaging effect of XR device control effect. Achieving high efficiency in XR device control can more accurately reflect the overall performance and user experience of the device.

[0006] This application provides a processing method based on XR whole-house intelligent control, comprising the following steps:

[0007] Obtain home device control information for a preset time period, extract near-eye display effect data, perception interaction response rate data, network transmission stability data, and rendering imaging effect data;

[0008] Extracting display resolution data according to the near-eye display effect data and comparing it with a preset resolution threshold to determine whether the display resolution meets the requirements;

[0009] Comparing the perception interaction response rate data with a preset response rate threshold, determining whether the perception interaction response rate meets the requirement;

[0010] Comparing the network transmission stability data with a preset stability threshold, determining whether the network transmission stability meets the requirements;

[0011] Imaging feature data is extracted according to the rendering imaging effect data and compared with a preset imaging feature threshold to determine whether the rendering imaging effect meets the requirements.

[0012] Among them, in a processing method based on XR whole-house intelligent control described in this application, the display resolution data is extracted according to the near-eye display effect data and compared with a preset resolution threshold to determine whether the display resolution meets the requirements, specifically:

[0013] Extracting display resolution data according to the near-eye display effect data;

[0014] Comparing the display resolution data with a preset resolution threshold;

[0015] If the display resolution data is less than or equal to the resolution threshold, the near-eye display effect does not meet the requirements;

[0016] If the display resolution data is greater than the resolution threshold, the near-eye display effect meets the requirements.

[0017] Among them, in a processing method based on XR whole-house intelligent control described in this application, the perception interaction response rate data is compared with a preset response rate threshold to determine whether the perception interaction response rate meets the requirement, specifically:

[0018] comparing the perceived interaction response rate with a preset response rate threshold;

[0019] If the perceived interaction response rate is less than the response rate threshold, the response delay data is obtained and counted to obtain the number of response delay times data;

[0020] Comparing the response delay times data with a preset delay times threshold;

[0021] If the response delay times data is greater than or equal to the delay times threshold, the device performance is degraded.

[0022] Among them, in a processing method based on XR whole-house intelligent control described in this application, the network transmission stability data is compared with a preset stability threshold to determine whether the network transmission stability meets the requirements, specifically:

[0023] Comparing the network transmission stability data with a preset stability threshold to obtain a stability deviation rate;

[0024] comparing the stability deviation rate with a preset stability deviation rate threshold;

[0025] If the stability deviation rate is less than the stability deviation rate threshold, the device communication effect is good;

[0026] If the stability deviation rate is greater than or equal to the stability deviation rate threshold, the device communication effect is poor.

[0027] Among them, in a processing method based on XR whole-house intelligent control described in this application, the imaging feature data is extracted according to the rendering imaging effect data and compared with the preset imaging feature threshold to determine whether the rendering imaging effect meets the requirements, specifically:

[0028] Extracting imaging feature data according to the rendered imaging effect data;

[0029] Obtaining imaging similarity data by comparing the imaging feature data with a preset imaging feature threshold;

[0030] Comparing the imaging similarity data with a preset similarity threshold;

[0031] If the imaging similarity data is less than the similarity threshold, the rendering imaging effect does not meet the requirements;

[0032] If the imaging similarity data is greater than or equal to the similarity threshold, the rendering imaging effect meets the requirements.

[0033] In a second aspect, the present application provides a processing system based on XR whole-house intelligent control, the system comprising: a memory and a processor, the memory comprising a program of a processing method based on XR whole-house intelligent control, the program of the processing method based on XR whole-house intelligent control being executed by the processor to implement the following steps:

[0034] Obtain home device control information for a preset time period, extract near-eye display effect data, perception interaction response rate data, network transmission stability data, and rendering imaging effect data;

[0035] Extracting display resolution data according to the near-eye display effect data and comparing it with a preset resolution threshold to determine whether the display resolution meets the requirement;

[0036] Comparing the perception interaction response rate data with a preset response rate threshold, determining whether the perception interaction response rate meets the requirement;

[0037] Comparing the network transmission stability data with a preset stability threshold, determining whether the network transmission stability meets the requirements;

[0038] Imaging feature data is extracted according to the rendering imaging effect data and compared with a preset imaging feature threshold to determine whether the rendering imaging effect meets the requirements.

[0039] Among them, in a processing system based on XR whole-house intelligent control described in this application, the display resolution data is extracted according to the near-eye display effect data and compared with a preset resolution threshold to determine whether the display resolution number meets the requirements, specifically:

[0040] Extracting display resolution data according to the near-eye display effect data;

[0041] Comparing the display resolution data with a preset resolution threshold;

[0042] If the display resolution data is less than or equal to the resolution threshold, the near-eye display effect does not meet the requirements;

[0043] If the display resolution data is greater than the resolution threshold, the near-eye display effect meets the requirements.

[0044] Among them, in a processing system based on XR whole-house intelligent control described in the present application, the perception interaction response rate data is compared with a preset response rate threshold to determine whether the perception interaction response rate meets the requirement, specifically:

[0045] comparing the perceived interaction response rate with a preset response rate threshold;

[0046] If the perceived interaction response rate is less than the response rate threshold, the response delay data is obtained and counted to obtain the number of response delay times data;

[0047] Comparing the response delay times data with a preset delay times threshold;

[0048] If the response delay times data is greater than or equal to the delay times threshold, the device performance is degraded.

[0049] Among them, in the processing system based on XR whole-house intelligent control described in the present application, the network transmission stability data is compared with a preset stability threshold to determine whether the network transmission stability meets the requirements, specifically:

[0050] Comparing the network transmission stability data with a preset stability threshold to obtain a stability deviation rate;

[0051] comparing the stability deviation rate with a preset stability deviation rate threshold;

[0052] If the stability deviation rate is less than the stability deviation rate threshold, the device communication effect is good;

[0053] If the stability deviation rate is greater than or equal to the stability deviation rate threshold, the device communication effect is poor.

[0054] In the third aspect, the present application also provides a computer-readable storage medium, which includes a processing method program based on XR whole-house intelligent control. When the processing method program based on XR whole-house intelligent control is executed by a processor, the steps of a processing method based on XR whole-house intelligent control as described in any one of the above items are implemented.

[0055] From the above, it can be seen that the embodiments of the present application provide a processing method, system and medium based on XR whole-house intelligent control. By obtaining the control information of home appliances in a preset time period, near-eye display effect data, perceptual interaction response rate data, network transmission stability data and rendering imaging effect data are extracted. The near-eye display effect data includes parameters such as resolution, brightness, contrast, color saturation, etc. The perceptual interaction response rate data reflects the response speed of the device to user operations, including the response time of gesture recognition, the response time of voice recognition, etc. These data can be obtained by modeling user operations and recording the response time. The network transmission stability data focuses on the stability and reliability of the device when connecting to the network, including indicators such as connection speed, packet loss rate, and delay. The rendering imaging effect data mainly focuses on the imaging effect of the device when displaying images or videos, including clarity, smoothness, color reproduction, etc. According to the near-eye display effect data, the display resolution data is extracted and compared with the preset resolution threshold to determine whether the display resolution meets the requirements, according to the perception interaction response rate data, the perception interaction response rate is compared with the preset response rate threshold to determine whether the perception interaction response rate meets the requirements, according to the network transmission stability data, the network transmission stability is compared with the preset stability threshold to determine whether the network transmission stability meets the requirements, according to the rendering imaging effect data, the imaging feature data is extracted and compared with the preset imaging feature threshold to determine whether the rendering imaging effect meets the requirements. The above method of the present application is an important means to evaluate and optimize the performance and user experience of home appliances. Through this process, the performance of the device can be more deeply understood, providing strong support for the improvement and optimization of the device. The present application comprehensively and systematically evaluates the control information of home appliances by comprehensively considering multiple dimensions such as the near-eye display effect, the perception interaction response rate, the network transmission stability and the rendering imaging effect of the XR device control effect. Achieving high efficiency in XR device control can more accurately reflect the overall performance and user experience of the device. It should be noted that XR stands for "Extended Reality". It is a general term for immersive technologies such as virtual reality (VR), augmented reality (AR) and mixed reality (MR). These technologies provide users with an unprecedented immersive experience, allowing users to switch and interact freely between virtual and reality.

[0056] Other features and advantages of the present application will be described in the following description, and partly become apparent from the description, or understood by practicing the embodiments of the present application. The purpose and other advantages of the present application can be realized and obtained by the structures specifically pointed out in the written description and the drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0057] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments of the present application will be briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0058] Figure 1 A flowchart of a processing method based on XR whole-house intelligent control provided in an embodiment of the present application;

[0059] Figure 2 A flowchart of a processing method for determining whether a display resolution meets the requirements based on XR whole-house intelligent control provided in an embodiment of the present application;

[0060] Figure 3 A flowchart of a processing method for determining whether a perception interaction response rate meets requirements based on XR whole-house intelligent control provided in an embodiment of the present application;

[0061] Figure 4 A flowchart of a processing method for judging whether network transmission stability meets the requirements based on XR whole-house intelligent control provided in an embodiment of the present application;

[0062] Figure 5 A flowchart of a processing method based on XR whole-house intelligent control for determining whether a rendering imaging effect meets the requirements is provided in an embodiment of the present application. DETAILED DESCRIPTION

[0063] The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all of the embodiments. The components of the embodiments of the present application described and shown in the drawings here can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present application provided in the drawings is not intended to limit the scope of the application claimed for protection, but merely represents the selected embodiments of the present application. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without making creative work belong to the scope of protection of the present application.

[0064] It should be noted that similar numbers and letters represent similar items in the following figures. Therefore, once an item is defined in one figure, it does not need to be further defined and explained in subsequent figures. At the same time, in the description of this application, the terms "first", "second", etc. are only used to distinguish the description and cannot be understood as indicating or implying relative importance. It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data need to comply with relevant laws, regulations and standards of relevant countries and regions.

[0065] Please refer to Figure 1 , Figure 1 This is a flowchart of a processing method based on XR whole-house intelligent control in some embodiments of the present application. The processing method based on XR whole-house intelligent control is used in terminal devices, such as computers, mobile terminals, etc. The processing method based on XR whole-house intelligent control includes the following steps:

[0066] S101, obtaining home appliance control information in a preset time period, extracting near-eye display effect data, perception interaction response rate data, network transmission stability data, and rendering imaging effect data;

[0067] S102, extracting display resolution data according to the near-eye display effect data and comparing it with a preset resolution threshold to determine whether the display resolution meets the requirement;

[0068] S103, comparing the perception interaction response rate data with a preset response rate threshold to determine whether the perception interaction response rate meets the requirement;

[0069] S104, comparing the network transmission stability data with a preset stability threshold to determine whether the network transmission stability meets the requirement;

[0070] S105 , extracting imaging feature data according to the rendering imaging effect data and comparing it with a preset imaging feature threshold to determine whether the rendering imaging effect meets the requirements.

[0071] Among them, the present application obtains the control information of home appliances in a preset time period to extract near-eye display effect data, perceptual interaction response rate data, network transmission stability data and rendering imaging effect data. The near-eye display effect data includes parameters such as resolution, brightness, contrast, and color saturation. The perceptual interaction response rate data reflects the response speed of the device to user operations, including the response time of gesture recognition and the response time of voice recognition. These data can be obtained by modeling user operations and recording the response time. The network transmission stability data focuses on the stability and reliability of the device when connecting to the network, including indicators such as connection speed, packet loss rate, and delay. The rendering imaging effect data mainly focuses on the imaging effect of the device when displaying images or videos, including clarity, fluency, color restoration, etc. The display resolution data is extracted according to the near-eye display effect data and compared with the preset resolution threshold to determine whether the display resolution meets the requirements. The perceptual interaction response rate data is compared with the preset response rate threshold to determine whether the perceptual interaction response rate meets the requirements. The network transmission stability data is compared with the preset stability threshold to determine whether the network transmission stability meets the requirements. The imaging feature data is extracted according to the rendering imaging effect data and compared with the preset imaging feature threshold to determine whether the rendering imaging effect meets the requirements. The above method of this application is an important means to evaluate and optimize the performance and user experience of home appliances. Through this process, we can have a deeper understanding of the performance of the equipment, and provide strong support for the improvement and optimization of the equipment. This application comprehensively and systematically evaluates the control information of home appliances by comprehensively considering multiple dimensions such as near-eye display effect, perceived interaction response rate, network transmission stability, and rendering imaging effect of the XR device control effect. Achieving high efficiency in XR device control can more accurately reflect the overall performance and user experience of the device. It should be noted that XR stands for "Extended Reality". It is a general term for immersive technologies such as virtual reality (VR), augmented reality (AR), and mixed reality (MR). These technologies provide users with an unprecedented immersive experience, allowing users to switch and interact freely between virtual and reality.

[0072] Please refer to Figure 2 , Figure 2 It is a flowchart of a processing method based on XR whole-house intelligent control in some embodiments of the present application for determining whether the display resolution meets the requirements. According to an embodiment of the present invention, the display resolution data is extracted according to the near-eye display effect data and compared with a preset resolution threshold to determine whether the display resolution meets the requirements, specifically:

[0073] S201, extracting display resolution data according to the near-eye display effect data;

[0074] S202, comparing the display resolution data with a preset resolution threshold;

[0075] S203: If the display resolution data is less than or equal to the resolution threshold, the near-eye display effect does not meet the requirement;

[0076] S204: If the display resolution data is greater than the resolution threshold, the near-eye display effect meets the requirements.

[0077] Among them, in order to determine whether the display resolution meets the requirements, the display resolution data is extracted according to the near-eye display effect data, the near-eye display effect data includes parameters such as resolution, brightness, contrast, color saturation, etc., and the display resolution data is compared with the preset resolution threshold. If the display resolution data is less than or equal to the resolution threshold, it means that the display effect of the near-eye display device does not meet the requirements in terms of resolution, which may cause problems such as blurred image and loss of details, affecting the user's visual experience. If the display resolution data is greater than the resolution threshold, it means that the display effect of the near-eye display device meets the requirements in terms of resolution, which means that the device can provide clearer and more detailed images, thereby enhancing the user's visual experience.

[0078] Please refer to Figure 3 , Figure 3 This is a flowchart of a processing method based on XR whole-house intelligent control in some embodiments of the present application for determining whether the perceived interaction response rate meets the requirements. According to an embodiment of the present invention, the perceived interaction response rate data is compared with a preset response rate threshold to determine whether the perceived interaction response rate meets the requirements, specifically:

[0079] S301, comparing the perceived interaction response rate with a preset response rate threshold;

[0080] S302: If the perceived interaction response rate is less than the response rate threshold, then obtaining and counting the response delay data to obtain the number of response delay times;

[0081] S303, comparing the response delay times data with a preset delay times threshold;

[0082] S304: If the response delay times data is greater than or equal to the delay times threshold, the device performance is degraded.

[0083] Among them, in order to determine whether the perceived interaction response rate meets the requirements, the perceived interaction response rate is compared with the preset response rate threshold. The perceived interaction response rate data reflects the device's response speed to user operations, including the response time of gesture recognition, the response time of voice recognition, etc. These data can be obtained by modeling user operations and recording the response time. If the perceived interaction response rate is less than the response rate threshold, it means that the device's response speed is slow and there is a delay in response. At this time, the delay in response data is recorded once and counted to obtain the delay in response times data. The delay in response times data is compared with the preset delay times threshold. If the delay in response times data is greater than or equal to the delay times threshold, it means that the device's response delay is serious enough, and it can be judged that the device performance has declined. This may be caused by reasons such as device aging, hardware failure, software problems, or excessive system load.

[0084] Please refer to Figure 4 , Figure 4 This is a flowchart of a processing method based on XR whole-house intelligent control in some embodiments of the present application for determining whether the network transmission stability meets the requirements. According to an embodiment of the present invention, the network transmission stability data is compared with a preset stability threshold to determine whether the network transmission stability meets the requirements, specifically:

[0085] S401, comparing the network transmission stability data with a preset stability threshold to obtain a stability deviation rate;

[0086] S402, comparing the stability deviation rate with a preset stability deviation rate threshold;

[0087] S403, if the stability deviation rate is less than the stability deviation rate threshold, the device communication effect is good;

[0088] S404: If the stability deviation rate is greater than or equal to the stability deviation rate threshold, the device communication effect is poor.

[0089] Among them, in order to determine whether the network transmission stability meets the requirements, the network transmission stability data is compared with the preset stability threshold to obtain the stability deviation rate. The network transmission stability data focuses on the stability and reliability of the device when connecting to the network, including connection speed, packet loss rate, delay and other indicators. The stability deviation rate is compared with the preset stability deviation rate threshold. If the stability deviation rate is less than the stability deviation rate threshold, it means that the network transmission stability of the device is good and the deviation is within an acceptable range. Therefore, it can be judged that the device communication effect is good. If the stability deviation rate is greater than or equal to the stability deviation rate threshold, it means that the network transmission stability of the device is poor and the deviation exceeds the acceptable range. Therefore, it can be judged that the device communication effect is poor.

[0090] Please refer to Figure 5 , Figure 5 It is a flowchart of a processing method based on XR whole-house intelligent control in some embodiments of the present application for judging whether the rendering imaging effect meets the requirements. According to an embodiment of the present invention, the imaging feature data is extracted according to the rendering imaging effect data and compared with the preset imaging feature threshold to judge whether the rendering imaging effect meets the requirements, specifically:

[0091] S501, extracting imaging feature data according to the rendering imaging effect data;

[0092] S502, obtaining imaging similarity data by comparing the imaging feature data with a preset imaging feature threshold;

[0093] S503, comparing the imaging similarity data with a preset similarity threshold;

[0094] S504: If the imaging similarity data is less than the similarity threshold, the rendering imaging effect does not meet the requirements;

[0095] S505: If the imaging similarity data is greater than or equal to the similarity threshold, the rendering imaging effect meets the requirements.

[0096] Among them, in order to judge whether the rendered imaging effect meets the requirements, imaging feature data is extracted according to the rendered imaging effect data. The rendered imaging effect data mainly focuses on the imaging effect of the device when displaying images or videos, including clarity, smoothness, color reproduction, etc. The imaging feature data is compared with the preset imaging feature threshold to obtain imaging similarity data, and then compared with the preset similarity threshold. If the imaging similarity data is less than the similarity threshold, it means that the rendered image has a large difference in imaging features from the expected standard, so the rendered imaging effect does not meet the requirements. If the imaging similarity data is greater than or equal to the similarity threshold, it means that the rendered image is close to or consistent with the expected standard in imaging features, so the rendered imaging effect meets the requirements.

[0097] According to an embodiment of the present invention, it also includes:

[0098] The near-eye display effect data, the perception interaction response rate data, the network transmission stability data and the rendering imaging effect data are processed by a preset control force evaluation model to obtain a home appliance control force index;

[0099] The calculation formula of the control force evaluation model is:

[0100]

[0101] Among them, F ca is the index of controllability of home equipment, dp , g s 、w h 、x p They are near-eye display effect data, perceived interaction response rate data, network transmission stability data and rendering imaging effect data respectively, and α, γ, η, κ, τ are preset characteristic coefficients (the preset characteristic coefficients are obtained by querying the preset device control database).

[0102] Among them, in order to comprehensively evaluate and reflect the control ability of XR devices on smart homes, the near-eye display effect data, perception interaction response rate data, network transmission stability data and rendering imaging effect data are processed through a preset control evaluation model to obtain the home device control index. It can comprehensively and objectively evaluate the control ability of XR devices on smart homes and provide strong support for product improvement and optimization. At the same time, this also provides users with valuable reference information when selecting and using XR devices.

[0103] According to an embodiment of the present invention, it also includes:

[0104] Acquire and calculate a plurality of historical home appliance control force indexes corresponding to the preset time period to obtain an average control force index of the historical home appliance;

[0105] According to the historical average control force index of the home appliance, the control force index of the home appliance is corrected by a preset control force correction model to obtain a control force correction index of the home appliance;

[0106] The calculation formula of the control force correction model is:

[0107]

[0108] Among them, F cψ is the home equipment control correction index, F ca is the home equipment control index, F cp is the historical average control index of home equipment, It is the preset characteristic coefficient (the preset characteristic coefficient is obtained by querying the preset device control database).

[0109] Among them, in order to further accurately reflect the control ability of XR devices on smart homes, first obtain and calculate multiple historical home device control power indexes corresponding to the preset time period to obtain the historical average home device control power index, and then correct the home device control power index through the preset control power correction model to obtain the home device control power correction index. The impact of historical data on the evaluation of XR device control power can be more comprehensively considered to obtain a more accurate and reliable home device control power correction index.

[0110] According to an embodiment of the present invention, it also includes:

[0111] Comparing the control force correction index of the home appliance with a preset control force index threshold to obtain a control force index deviation rate;

[0112] comparing the control force index deviation rate with a preset index deviation rate threshold;

[0113] If the controllability index deviation rate is less than or equal to the index deviation rate threshold, the home appliance control capability meets the requirements;

[0114] If the controllability index deviation rate is greater than the index deviation rate threshold, the control capability of the home appliance does not meet the requirements.

[0115] Among them, in order to improve the control ability of XR devices on smart homes, the control force correction index of home devices is compared with the preset control force index threshold to obtain the control force index deviation rate, which is compared with the preset index deviation rate threshold. If the control force index deviation rate is less than or equal to the index deviation rate threshold, it means that the control ability of the home device is within an acceptable range and meets business needs and user expectations. If the control force index deviation rate is greater than the index deviation rate threshold, it means that the control ability of the home device has a large deviation and does not meet business needs and user expectations. At this point, further measures need to be taken to improve and optimize the interaction and control capabilities of XR devices and smart homes.

[0116] The present invention also discloses a processing system based on XR whole-house intelligent control, including a memory and a processor, wherein the memory includes a processing method program based on XR whole-house intelligent control, and when the processing method program based on XR whole-house intelligent control is executed by the processor, the following steps are implemented:

[0117] Obtain home device control information for a preset time period, extract near-eye display effect data, perception interaction response rate data, network transmission stability data, and rendering imaging effect data;

[0118] Extracting display resolution data according to the near-eye display effect data and comparing it with a preset resolution threshold to determine whether the display resolution meets the requirements;

[0119] Comparing the perception interaction response rate data with a preset response rate threshold, determining whether the perception interaction response rate meets the requirement;

[0120] Comparing the network transmission stability data with a preset stability threshold, determining whether the network transmission stability meets the requirements;

[0121] Imaging feature data is extracted according to the rendering imaging effect data and compared with a preset imaging feature threshold to determine whether the rendering imaging effect meets the requirements.

[0122] Among them, the present application obtains the control information of home appliances in a preset time period to extract near-eye display effect data, perceptual interaction response rate data, network transmission stability data and rendering imaging effect data. The near-eye display effect data includes parameters such as resolution, brightness, contrast, and color saturation. The perceptual interaction response rate data reflects the response speed of the device to user operations, including the response time of gesture recognition and the response time of voice recognition. These data can be obtained by modeling user operations and recording the response time. The network transmission stability data focuses on the stability and reliability of the device when connecting to the network, including indicators such as connection speed, packet loss rate, and delay. The rendering imaging effect data mainly focuses on the imaging effect of the device when displaying images or videos, including clarity, fluency, color restoration, etc. The display resolution data is extracted according to the near-eye display effect data and compared with the preset resolution threshold to determine whether the display resolution meets the requirements. The perceptual interaction response rate data is compared with the preset response rate threshold to determine whether the perceptual interaction response rate meets the requirements. The network transmission stability data is compared with the preset stability threshold to determine whether the network transmission stability meets the requirements. The imaging feature data is extracted according to the rendering imaging effect data and compared with the preset imaging feature threshold to determine whether the rendering imaging effect meets the requirements. The above method of this application is an important means to evaluate and optimize the performance and user experience of home appliances. Through this process, we can have a deeper understanding of the performance of the equipment, and provide strong support for the improvement and optimization of the equipment. This application comprehensively and systematically evaluates the control information of home appliances by comprehensively considering multiple dimensions such as near-eye display effect, perceived interaction response rate, network transmission stability, and rendering imaging effect of the XR device control effect. Achieving high efficiency in XR device control can more accurately reflect the overall performance and user experience of the device. It should be noted that XR stands for "Extended Reality". It is a general term for immersive technologies such as virtual reality (VR), augmented reality (AR), and mixed reality (MR). These technologies provide users with an unprecedented immersive experience, allowing users to switch and interact freely between virtual and reality.

[0123] According to an embodiment of the present invention, the display resolution data is extracted according to the near-eye display effect data and compared with a preset resolution threshold to determine whether the display resolution meets the requirement, specifically:

[0124] Extracting display resolution data according to the near-eye display effect data;

[0125] Comparing the display resolution data with a preset resolution threshold;

[0126] If the display resolution data is less than or equal to the resolution threshold, the near-eye display effect does not meet the requirements;

[0127] If the display resolution data is greater than the resolution threshold, the near-eye display effect meets the requirements.

[0128] Among them, in order to determine whether the display resolution meets the requirements, the display resolution data is extracted according to the near-eye display effect data, the near-eye display effect data includes parameters such as resolution, brightness, contrast, color saturation, etc., and the display resolution data is compared with the preset resolution threshold. If the display resolution data is less than or equal to the resolution threshold, it means that the display effect of the near-eye display device does not meet the requirements in terms of resolution, which may cause problems such as blurred image and loss of details, affecting the user's visual experience. If the display resolution data is greater than the resolution threshold, it means that the display effect of the near-eye display device meets the requirements in terms of resolution, which means that the device can provide clearer and more detailed images, thereby enhancing the user's visual experience.

[0129] According to an embodiment of the present invention, comparing the perceived interaction response rate data with a preset response rate threshold to determine whether the perceived interaction response rate meets the requirement is specifically as follows:

[0130] comparing the perceived interaction response rate with a preset response rate threshold;

[0131] If the perceived interaction response rate is less than the response rate threshold, the response delay data is obtained and counted to obtain the number of response delay times data;

[0132] Comparing the response delay times data with a preset delay times threshold;

[0133] If the response delay times data is greater than or equal to the delay times threshold, the device performance is degraded.

[0134] Among them, in order to determine whether the perceived interaction response rate meets the requirements, the perceived interaction response rate is compared with the preset response rate threshold. The perceived interaction response rate data reflects the device's response speed to user operations, including the response time of gesture recognition, the response time of voice recognition, etc. These data can be obtained by modeling user operations and recording the response time. If the perceived interaction response rate is less than the response rate threshold, it means that the device's response speed is slow and there is a delay in response. At this time, the delay in response data is recorded once and counted to obtain the delay in response times data. The delay in response times data is compared with the preset delay times threshold. If the delay in response times data is greater than or equal to the delay times threshold, it means that the device's response delay is serious enough, and it can be judged that the device performance has declined. This may be caused by reasons such as device aging, hardware failure, software problems, or excessive system load.

[0135] According to an embodiment of the present invention, comparing the network transmission stability data with a preset stability threshold to determine whether the network transmission stability meets the requirement is specifically as follows:

[0136] Comparing the network transmission stability data with a preset stability threshold to obtain a stability deviation rate;

[0137] comparing the stability deviation rate with a preset stability deviation rate threshold;

[0138] If the stability deviation rate is less than the stability deviation rate threshold, the device communication effect is good;

[0139] If the stability deviation rate is greater than or equal to the stability deviation rate threshold, the device communication effect is poor.

[0140] Among them, in order to determine whether the network transmission stability meets the requirements, the network transmission stability data is compared with the preset stability threshold to obtain the stability deviation rate. The network transmission stability data focuses on the stability and reliability of the device when connecting to the network, including connection speed, packet loss rate, delay and other indicators. The stability deviation rate is compared with the preset stability deviation rate threshold. If the stability deviation rate is less than the stability deviation rate threshold, it means that the network transmission stability of the device is good and the deviation is within an acceptable range. Therefore, it can be judged that the device communication effect is good. If the stability deviation rate is greater than or equal to the stability deviation rate threshold, it means that the network transmission stability of the device is poor and the deviation exceeds the acceptable range. Therefore, it can be judged that the device communication effect is poor.

[0141] According to an embodiment of the present invention, extracting imaging feature data according to the rendering imaging effect data and comparing it with a preset imaging feature threshold to determine whether the rendering imaging effect meets the requirements is specifically as follows:

[0142] Extracting imaging feature data according to the rendered imaging effect data;

[0143] Obtaining imaging similarity data by comparing the imaging feature data with a preset imaging feature threshold;

[0144] Comparing the imaging similarity data with a preset similarity threshold;

[0145] If the imaging similarity data is less than the similarity threshold, the rendering imaging effect does not meet the requirements;

[0146] If the imaging similarity data is greater than or equal to the similarity threshold, the rendering imaging effect meets the requirements.

[0147] Among them, in order to judge whether the rendered imaging effect meets the requirements, imaging feature data is extracted according to the rendered imaging effect data. The rendered imaging effect data mainly focuses on the imaging effect of the device when displaying images or videos, including clarity, smoothness, color reproduction, etc. The imaging feature data is compared with the preset imaging feature threshold to obtain imaging similarity data, and then compared with the preset similarity threshold. If the imaging similarity data is less than the similarity threshold, it means that the rendered image has a large difference in imaging features from the expected standard, so the rendered imaging effect does not meet the requirements. If the imaging similarity data is greater than or equal to the similarity threshold, it means that the rendered image is close to or consistent with the expected standard in imaging features, so the rendered imaging effect meets the requirements.

[0148] According to an embodiment of the present invention, it also includes:

[0149] The near-eye display effect data, the perception interaction response rate data, the network transmission stability data and the rendering imaging effect data are processed by a preset control force evaluation model to obtain a home appliance control force index;

[0150] The calculation formula of the control force evaluation model is:

[0151]

[0152] Among them, F ca is the index of controllability of home equipment, d p , g s 、w h 、x p They are near-eye display effect data, perceived interaction response rate data, network transmission stability data and rendering imaging effect data respectively, and α, γ, η, κ, τ are preset characteristic coefficients (the preset characteristic coefficients are obtained by querying the preset device control database).

[0153] Among them, in order to comprehensively evaluate and reflect the control ability of XR devices on smart homes, the near-eye display effect data, perception interaction response rate data, network transmission stability data and rendering imaging effect data are processed through a preset control evaluation model to obtain the home device control index. It can comprehensively and objectively evaluate the control ability of XR devices on smart homes and provide strong support for product improvement and optimization. At the same time, this also provides users with valuable reference information when selecting and using XR devices.

[0154] According to an embodiment of the present invention, it also includes:

[0155] Acquire and calculate a plurality of historical home appliance control force indexes corresponding to the preset time period to obtain an average control force index of the historical home appliance;

[0156] According to the historical average control force index of the home appliance, the control force index of the home appliance is corrected by a preset control force correction model to obtain a control force correction index of the home appliance;

[0157] The calculation formula of the control force correction model is:

[0158]

[0159] Among them, F cψ is the home equipment control correction index, F ca is the home equipment control index, F cp is the historical average control index of home equipment, It is the preset characteristic coefficient (the preset characteristic coefficient is obtained by querying the preset device control database).

[0160] Among them, in order to further accurately reflect the control ability of XR devices on smart homes, first obtain and calculate multiple historical home device control power indexes corresponding to the preset time period to obtain the historical average home device control power index, and then correct the home device control power index through the preset control power correction model to obtain the home device control power correction index. The impact of historical data on the evaluation of XR device control power can be more comprehensively considered to obtain a more accurate and reliable home device control power correction index.

[0161] According to an embodiment of the present invention, it also includes:

[0162] Comparing the control force correction index of the home appliance with a preset control force index threshold to obtain a control force index deviation rate;

[0163] comparing the control force index deviation rate with a preset index deviation rate threshold;

[0164] If the controllability index deviation rate is less than or equal to the index deviation rate threshold, the home appliance control capability meets the requirements;

[0165] If the controllability index deviation rate is greater than the index deviation rate threshold, the control capability of the home appliance does not meet the requirements.

[0166] Among them, in order to improve the control ability of XR devices on smart homes, the control force correction index of home devices is compared with the preset control force index threshold to obtain the control force index deviation rate, which is compared with the preset index deviation rate threshold. If the control force index deviation rate is less than or equal to the index deviation rate threshold, it means that the control ability of the home device is within an acceptable range and meets business needs and user expectations. If the control force index deviation rate is greater than the index deviation rate threshold, it means that the control ability of the home device has a large deviation and does not meet business needs and user expectations. At this point, further measures need to be taken to improve and optimize the interaction and control capabilities of XR devices and smart homes.

[0167] The third aspect of the present invention provides a computer-readable storage medium, which includes a processing method program based on XR whole-house intelligent control. When the processing method program based on XR whole-house intelligent control is executed by a processor, the steps of a processing method based on XR whole-house intelligent control as described in any one of the above items are implemented.

[0168] The present invention discloses a processing method, system and medium based on XR whole-house intelligent control. By acquiring the control information of home appliances in a preset time period, near-eye display effect data, perceptual interaction response rate data, network transmission stability data and rendering imaging effect data are extracted. The near-eye display effect data includes parameters such as resolution, brightness, contrast, and color saturation. The perceptual interaction response rate data reflects the response speed of the device to user operations, including the response time of gesture recognition, the response time of voice recognition, etc. These data can be obtained by simulating user operations and recording the response time. The network transmission stability data focuses on the stability and reliability of the device when connecting to the network, including indicators such as connection speed, packet loss rate, and delay. The rendering imaging effect data mainly focuses on the imaging effect of the device when displaying images or videos, including clarity, smoothness, color reproduction, etc. The display resolution data is extracted according to the near-eye display effect data and compared with the preset resolution threshold to determine whether the display resolution meets the requirements. The perceived interaction response rate data is compared with the preset response rate threshold to determine whether the perceived interaction response rate meets the requirements. The network transmission stability data is compared with the preset stability threshold to determine whether the network transmission stability meets the requirements. The imaging feature data is extracted according to the rendering imaging effect data and compared with the preset imaging feature threshold to determine whether the rendering imaging effect meets the requirements. The above method of the present application is an important means to evaluate and optimize the performance and user experience of home appliances. Through this process, the performance of the equipment can be more deeply understood, providing strong support for the improvement and optimization of the equipment. The present application comprehensively and systematically evaluates the control information of home appliances by comprehensively considering multiple dimensions such as the near-eye display effect, the perceived interaction response rate, the network transmission stability and the rendering imaging effect of the XR device control effect. Achieving high efficiency in XR device control can more accurately reflect the overall performance and user experience of the device.

[0169] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as: multiple units or components can be combined, or can be integrated into another system, or some features can be ignored or not executed. In addition, the coupling, direct coupling, or communication connection between the components shown or discussed can be through some interfaces, and the indirect coupling or communication connection of the devices or units can be electrical, mechanical or other forms.

[0170] The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units; they may be located in one place or distributed on multiple network units; some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0171] In addition, all functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may be separately used as a unit, or two or more units may be integrated into one unit; the above-mentioned integrated units may be implemented in the form of hardware or in the form of hardware plus software functional units.

[0172] A person of ordinary skill in the art can understand that: all or part of the steps of implementing the above-mentioned method embodiment can be completed by hardware related to program instructions, and the aforementioned program can be stored in a readable storage medium, which, when executed, executes the steps of the above-mentioned method embodiment; and the aforementioned storage medium includes: mobile storage devices, read-only memories, random access memories, magnetic disks or optical disks, and other media that can store program codes.

[0173] Alternatively, if the above-mentioned integrated unit of the present invention is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present invention can be essentially or partly reflected in the form of a software product that contributes to the prior art. The software product is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the methods described in each embodiment of the present invention. The aforementioned storage medium includes: various media that can store program codes, such as mobile storage devices, ROM, RAM, magnetic disks or optical disks.

Claims

1. A processing method based on XR whole-house intelligent control, characterized in that: The following steps are involved: Obtain home device control information for a preset time period, extract near-eye display effect data, perception interaction response rate data, network transmission stability data, and rendering imaging effect data; Extracting display resolution data according to the near-eye display effect data and comparing it with a preset resolution threshold to determine whether the display resolution meets the requirements; Comparing the perception interaction response rate data with a preset response rate threshold, determining whether the perception interaction response rate meets the requirement; Comparing the network transmission stability data with a preset stability threshold, determining whether the network transmission stability meets the requirements; Imaging feature data is extracted according to the rendering imaging effect data and compared with a preset imaging feature threshold to determine whether the rendering imaging effect meets the requirements.

2. According to claim 1, a processing method based on XR whole-house intelligent control is characterized in that: The extracting of display resolution data according to the near-eye display effect data and comparing it with a preset resolution threshold to determine whether the display resolution meets the requirement is specifically as follows: Extracting display resolution data according to the near-eye display effect data; Comparing the display resolution data with a preset resolution threshold; If the display resolution data is less than or equal to the resolution threshold, the near-eye display effect does not meet the requirements; If the display resolution data is greater than the resolution threshold, the near-eye display effect meets the requirements.

3. A processing method based on XR whole-house intelligent control according to claim 2, characterized in that: The comparing the perception interaction response rate data with a preset response rate threshold to determine whether the perception interaction response rate meets the requirement is specifically as follows: comparing the perceived interaction response rate with a preset response rate threshold; If the perceived interaction response rate is less than the response rate threshold, the response delay data is obtained and counted to obtain the number of response delay times data; Comparing the response delay times data with a preset delay times threshold; If the response delay times data is greater than or equal to the delay times threshold, the device performance is degraded.

4. The processing method based on XR whole-house intelligent control according to claim 3 is characterized in that: The comparing the network transmission stability data with a preset stability threshold to determine whether the network transmission stability meets the requirement is specifically as follows: Comparing the network transmission stability data with a preset stability threshold to obtain a stability deviation rate; comparing the stability deviation rate with a preset stability deviation rate threshold; If the stability deviation rate is less than the stability deviation rate threshold, the device communication effect is good; If the stability deviation rate is greater than or equal to the stability deviation rate threshold, the device communication effect is poor.

5. A processing method based on XR whole-house intelligent control according to claim 4, characterized in that: Extracting imaging feature data according to the rendering imaging effect data and comparing it with a preset imaging feature threshold to determine whether the rendering imaging effect meets the requirements is specifically as follows: Extracting imaging feature data according to the rendered imaging effect data; Obtaining imaging similarity data by comparing the imaging feature data with a preset imaging feature threshold; Comparing the imaging similarity data with a preset similarity threshold; If the imaging similarity data is less than the similarity threshold, the rendering imaging effect does not meet the requirements; If the imaging similarity data is greater than or equal to the similarity threshold, the rendering imaging effect meets the requirements.

6. A processing system based on XR whole-house intelligent control, characterized in that: The system comprises a memory and a processor, wherein the memory comprises a processing method program based on XR whole-house intelligent control, and when the processing method program based on XR whole-house intelligent control is executed by the processor, the following steps are implemented: Obtain home device control information for a preset time period, extract near-eye display effect data, perception interaction response rate data, network transmission stability data, and rendering imaging effect data; Extracting display resolution data according to the near-eye display effect data and comparing it with a preset resolution threshold to determine whether the display resolution meets the requirement; Comparing the perception interaction response rate data with a preset response rate threshold, determining whether the perception interaction response rate meets the requirement; Comparing the network transmission stability data with a preset stability threshold, determining whether the network transmission stability meets the requirements; Imaging feature data is extracted according to the rendering imaging effect data and compared with a preset imaging feature threshold to determine whether the rendering imaging effect meets the requirements.

7. The processing system based on XR whole-house intelligent control according to claim 6 is characterized in that: The extracting of display resolution data according to the near-eye display effect data and comparing it with a preset resolution threshold to determine whether the display resolution meets the requirement is specifically as follows: Extracting display resolution data according to the near-eye display effect data; Comparing the display resolution data with a preset resolution threshold; If the display resolution data is less than or equal to the resolution threshold, the near-eye display effect does not meet the requirements; If the display resolution data is greater than the resolution threshold, the near-eye display effect meets the requirements.

8. The processing system based on XR whole-house intelligent control according to claim 7 is characterized in that: The comparing the perception interaction response rate data with a preset response rate threshold to determine whether the perception interaction response rate meets the requirement is specifically as follows: comparing the perceived interaction response rate with a preset response rate threshold; If the perceived interaction response rate is less than the response rate threshold, the response delay data is obtained and counted to obtain the number of response delay times data; Comparing the response delay times data with a preset delay times threshold; If the response delay times data is greater than or equal to the delay times threshold, the device performance is degraded.

9. The processing system based on XR whole-house intelligent control according to claim 8, characterized in that: The comparing the network transmission stability data with a preset stability threshold to determine whether the network transmission stability meets the requirement is specifically as follows: Comparing the network transmission stability data with a preset stability threshold to obtain a stability deviation rate; comparing the stability deviation rate with a preset stability deviation rate threshold; If the stability deviation rate is less than the stability deviation rate threshold, the device communication effect is good; If the stability deviation rate is greater than or equal to the stability deviation rate threshold, the device communication effect is poor.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes a processing method program based on XR whole-house intelligent control. When the processing method program based on XR whole-house intelligent control is executed by the processor, the steps of a processing method based on XR whole-house intelligent control as described in any one of claims 1 to 5 are implemented.

Images