Space equipment nebula visualization system and method based on multi-dimensional energy consumption mapping
By mapping the status and energy consumption data of smart home devices to a three-dimensional suspended luminous sphere, the spatial expression and interactive response of device energy consumption are realized, which solves the problems of insufficient interactive expression and insufficient perception of edge devices in existing technologies, and improves the user's cognitive efficiency and interaction depth.
Patent Information
- Application Number
- CN202510836795.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-06-22
- Publication Date
- 2025-10-17
AI Technical Summary
Existing smart home systems lack in device interaction expression, spatial visualization capabilities, and the ability to intuitively present the energy consumption ratio between devices. They are also unable to detect when edge devices are offline and lack an overall aesthetic expression of the environmental state.
By mapping device status and energy consumption data into a three-dimensional suspended luminous sphere, and employing a celestial mapping engine and a multimodal interaction layer, combined with the enhancement of carbon energy awareness and artistic scene reconstruction, the spatial expression and interactive response of device energy consumption are realized.
It significantly improves the speed of identifying high-energy-consuming devices, optimizes energy management, assists in diagnosing standby power consumption, provides seamless exploration from panoramic to detailed perspectives, and enhances users' cognitive efficiency and interaction depth.
Smart Images

Figure CN120807745A_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application belongs to the technical field of intelligent home human-computer interaction, and specifically relates to a device state and energy consumption visualization system based on a spatial nebula metaphor, which realizes panoramic monitoring of devices and carbon energy perception through dynamic star mapping in a three-dimensional geometric space, and is suitable for environmental state rendering of media such as LED dot matrix, micro projection screen and flexible display layer. BACKGROUND
[0002] The current technology focuses on protocol compatibility and basic interaction, and there are three faults: (1) CN114827303A Smart home product management unit, system and application method and electronic equipment (China Household Electrical Appliances Research Institute, etc.) Multi-protocol proxy gateway architecture, only solves the problem of device networking, and has no spatial visualization capability; (2) CN112671638A A gateway structure for multi-protocol conversion (Beijing Fangzheng Digital Co., Ltd.) Protocol conversion middleware, which relies on data format standardization and cannot present offline devices; (3) CN113220189A Smart home device, display control method and storage medium (Hisense Optoelectronics Technology Co., Ltd.), panel wake-up response optimization, single interaction dimension, lack of global energy consumption awareness.
[0003] Core defects of existing technology: (1) Lack of interaction expression. Although smart panels such as Hongyan iHousePad support multi-protocol control, the interface is still a flat device list, and users need to manually switch pages to locate high-energy consumption devices; Energy consumption data is only displayed in numbers (such as "air conditioner: 1.5kW"), which cannot intuitively present the energy consumption proportion relationship between devices; (2) Blind area of edge devices. Existing gateway systems (such as CN114827303A) only manage connected devices and cannot sense unregistered Bluetooth devices, infrared-controlled free home appliances, etc.; When the device is offline, it completely disappears from the interface (such as the Mi Home APP), making it impossible for users to diagnose "zombie device" standby power consumption; (3) Art and energy efficiency are separated. The energy-saving patent CN218446609U An environmentally friendly and energy-saving intelligent display terminal (Shanghai Bens Information Technology Co., Ltd.) only reduces power consumption by turning off the screen, and does not convert energy consumption data into visual language; In the healing scene, temperature control and aromatherapy devices are controlled independently, and there is a lack of overall aesthetic expression of environmental state.
[0004] The essence of the industry pain point is that intelligent home interaction still stays at the functional implementation level and has not formed a spatial-level cognitive paradigm and behavior guidance art.
[0005] The innovation of this patent involves three aspects: technical architecture innovation, carbon energy awareness dimensionality, and artistic scene reconstruction.
[0006] Technical Architecture Innovation: From “Control Panel” to “Energy Universe”: (1) Star Mapping Engine ( Figure 6 ). Map the refrigerator (800W) to a 12mm diameter sphere, and the Bluetooth speaker (5W) to a 2mm diameter sphere. Offline devices retain their historical volumes. (2) Multimodal interaction layer. Touch rotation: Slide your finger on the magnetic levitation device to rotate the star map and locate high-energy-consuming equipment (such as the smart toilet in the hotel room, which accounts for 38% of energy consumption); Voice focus: Command "show medical equipment" to automatically zoom in on the fall monitoring device sphere; AR remote operation: Gesture grabbing the "air conditioning star" to adjust the temperature and trigger radial light patterns.
[0007] Raising the Dimension of Carbon Energy Awareness: From Numbers to Intuition: (1) Dynamic narrative of carbon neutrality. When photovoltaic power supply is detected, the background nebula generates leaf-like green light waves (frequency ∝ clean energy proportion); when the gas fireplace is turned on, black mist particles appear on the surface of the corresponding sphere (carbon emission warning); (2) Offline device value mining. The gray sphere shows the historical energy consumption (e.g., the coffee machine’s standby power consumption is 5W), prompting the user to physically disconnect the power.
[0008] Artistic scene reconstruction. The comparison between this patent and traditional solutions is as follows (Table 1): Table 1: Comparison of traditional solutions and this patented solution in three scenarios Scenario Conventional solution Patent implementation Guqin healing room Independent switch control of aromatherapy machine Ball pulsing with sound law + background color gradually changing green with CO2 concentration Metaverse game hall Digital display of VR device power consumption Treadmill sphere expands / contracts with exercise intensity Nursing home Emergency button red icon High-frequency red flashing of bracelet sphere + dark blue environment background to reduce light pollution Summary of the Invention
[0009] The present invention provides a smart home visualization system based on the metaphor of the universe. Through multi-source scanning, the device status and energy consumption data are obtained, and the device is mapped as a three-dimensional suspended luminous sphere. The volume reflects the real-time power in a logarithmic relationship, and the background color of the space changes from ice blue to red with the total energy consumption. When the device is controlled by voice, AR or mobile terminal, a differentiated pulse light effect is triggered. The system architecture of the present invention adopts a spatial intelligence visualization framework, and realizes the mapping of device status and energy consumption through a three-layer structured design ( Figure 1 ).
[0010] The data acquisition layer integrates multi-source signals: the smart home gateway outputs the real-time power and protocol type of the device, the RF scanning module detects the characteristics of free devices (such as infrared carriers), and the dual-channel data is input to the central processor to build the device topology.
[0011] The astral mapping layer performs mathematical conversion: the device power is converted to a logarithmic function V = K·log 10 (P+1) is converted to the volume of a sphere (an 800W refrigerator is mapped to a 12mm diameter sphere), and the total carbon emissions drive the background color to change gradually in the HSL color space (formula H=AB·log 10(C+1). The formula H = A - B log 10 (C+1) are described as follows (A, B, C, H, and Figure 8 (1) C is the real-time carbon emission (unit: kg / h), and the typical smart home scene range is 0.1-1000 kgCO2 / h (for example, 0.2 for a refrigerator and 50 for a central air conditioner); (2) H is the output hue value (0-360°), which directly corresponds to the color of the HSL color space: 240°-180°: blue (low carbon), 180°-60°: green-yellow (medium carbon), and 60°-0°: red-orange (high carbon); (3) +1 is a protection item (to avoid calculation errors of zero carbon emission); (4) The values of parameters A and B determine the starting point and rate of color change. A has a value range of 220-260, and B has a value range of 70-90; B is a scaling factor to ensure that the minimum carbon emission appears as a deep blue (237°) and the maximum carbon emission appears as a positive red (0°).
[0012] The typical embodiment features of the color gamut gradient formula are A=240 and B=80; and the hue mapping formula is expressed as: H=240-80 log 10 (C+1); when the carbon emission of the user's living room changes, the background color changes in real time: (1) Morning (photovoltaic power supply, C=0.3): H≈228°→ the background displays a deep sea blue; (2) Afternoon (air conditioner full on, C=45): H≈112°→ the background turns yellow-green; (3) Night (multiple devices running, C=120): H≈82°→ the background turns orange-yellow.
[0013] The core innovation of the hue mapping formula is to convert the exponential change of carbon emission into linear gradient of hue through logarithmic compression, and the values of parameters A and B determine the starting point and rate of color change. In a typical implementation, A=240 and B=80 are preferred, in which case: low carbon scenario (C=0.1 kgCO2 / h)→ H=237° (deep sea blue #0047AB), high carbon scenario (C=1000 kgCO2 / h)→ H=0° (positive red #FF0000), and if A=230 and B=85 are adjusted, the hue decreases by 10-15° under the same carbon emission, and the overall tone is purple but still conforms to the blue→red gradient logic, and such parameter adjustment belongs to the equivalent replacement range of the present application.
[0014] The optical rendering layer realizes interactive response: voice control triggers the pulsating flashing of the sphere, AR operation generates radial ripples, and the background generates pulsating green light when clean energy is connected (the intensity is proportional to the photovoltaic proportion).
[0015] This architecture focuses on the spatial expression of environmental data and is decoupled from the gateway protocol parsing function.
[0016] The product structure of the present invention adopts an integrated hardware design, wherein the display carrier type includes LED dot matrix, projection imaging surface, and flexible display layer. Taking the LED matrix display mode as an example, the physical structure of the device is as follows Figure 2 As shown: (1) The magnetic levitation base is composed of a permanent magnet ring (201) and an electromagnetic coil (201.1), which realizes stable levitation of the main body (tilt angle ≤ 0.5°), and the bottom capacitive sensor (203) supports gesture sensing; (2) The Micro LED matrix is arranged in a honeycomb pattern (204), with 1024 LEDs covering 150% of the NTSC color gamut, with a spacing of 1.5 mm, and a graphene heat dissipation layer (206) to control heat gain; (3) The optical diffuser is made of micro-prismatic zirconium oxide ceramic (207) and the surface anti-fingerprint coating (208) maintains high light transmittance; (4) Titanium alloy touch ring (209 supports zoom / rotation operation; (5) The hardware design balances visualization accuracy and industrial reliability.
[0017] The power supply system of the device adopts magnetic levitation coupling wireless power transmission technology: (1) Base assembly ( Figure 2 203): A high-frequency alternating current (120kHz) is passed through the annular electromagnetic coil (203.1) to generate an alternating magnetic field; (2) Suspended body: a neodymium iron boron permanent magnet ring (201) and a receiving coil (201.1) are embedded in the bottom, and the magnetic field energy is converted into direct current through electromagnetic induction (conversion efficiency ≥ 85%); (3) Power management: The received current is output through the LDO voltage regulator module (201.2) at 5V / 2A to power the Micro LED matrix and processor, completely eliminating the damage to the visual integrity of the nebula caused by physical cables.
[0018] This design enables the device to work continuously for ≥8 hours in a suspended state. When the battery is low, the LED ring (203.2) on the base emits an amber breathing light to remind charging.
[0019] Other display carrier solutions only need to replace this layer implementation, and the architecture is exactly the same as the mapping layer.
[0020] The workflow of the present invention adopts data-driven closed-loop processing, and the system operation process is as follows: Figure 4 As shown: (1) Device scanning phase: Acquire gateway data and radio frequency detection results (401-403) in parallel, and call historical energy consumption records for offline devices; (2) Energy conversion stage: Real-time power input volume calculation formula (405), total carbon emission driving background color algorithm, clean energy trigger light wave intensity calculation (I=0.8*P_clean / P_total); (3) Interactive feedback stage: External control instruction is converted into light effect code (such as AR operation corresponding to radial corrugation), high-carbon equipment triggers black fog particle warning; (4) The process realizes the systematic conversion of energy consumption data to visual symbols.
[0021] The performance comparison of multiple display carriers such as LED dot matrix, projected imaging surface, flexible display layer is shown in Table 2: Table 2: Performance comparison table of multiple display carriers Performance indicators LED matrix Micro-projection Flexible screen Display brightness 1500nit 300nit (ambient light) 800nit Contrast ratio 1,000,000:1 500:1 500,000:1 Viewing angle 170° 120° 160° Energy consumption 25W 45W 38W Carbon emission warning implementation Black fog particle optical rendering Laser diffraction gray spot Electrochromic
[0022] All carriers can completely present the star volume mapping and background color temperature gradient, and the interaction delay difference is less than 100ms.
[0023] The innovation value of the present application lies in the technical breakthrough and application advantage. The present application provides significant technical improvement ( Figure 5 Customer dining room scene demonstration): (1) Cognitive efficiency is improved. Star volume logarithmic mapping significantly improves the recognition speed of high-energy consumption equipment (such as refrigerator sphere visual proportion 38%); (2) Energy management optimization. Under the typical embodiment, the background color temperature formula H=240-80·log 10 (C) Establishing carbon emission visual index helps to remind people to improve clean energy utilization rate; (3) Interactive depth expansion. Offline device historical power consumption display (such as gray coffee machine sphere) assists in diagnosing standby energy consumption, and combined with touch operation, it realizes seamless exploration from panorama to detail.
[0024] The present application creatively integrates energy consumption data, device status and user interaction into a three-dimensional visual model, providing an innovative solution for smart home management with both functionality and aesthetic value. BRIEF DESCRIPTION OF DRAWINGS
[0025] Figure 1 : System architecture diagram. This figure discloses the three-layer core architecture of the system: (1) Data acquisition layer (left area): The left smart home gateway outputs the device list through MQTT / Modbus, and the right radio frequency scanning module (supports BLE / WiFi / Zigbee) actively detects free devices, and the double-way data is imported into the central processing unit; (2) Star mapping layer (middle): Processor executes energy mapping algorithm: Device power P is converted to spherical volume by logarithmic function V=K·log10(P+1), total carbon emission C is mapped to HSL color domain background (formula H=240-80·log10(C) under typical embodiment); (3) Optical rendering layer (right): Generated control light effect code (voice=pulse wave, AR=radial ripple) drives Micro LED matrix, forming nebula effect in transparent shell through light refraction; Innovation: This architecture strips gateway protocol parsing function and focuses on spatial expression of device state.
[0026] Figure 2 : Product exploded view. This diagram breaks down the four-layer physical structure of the device: (1) Magnetic suspension base (bottom layer): Contains neodymium iron boron permanent magnet ring (201) and electromagnetic coil (201.1), realizing icosahedral main body suspension (inclination ≤0.5°), bottom ring-shaped capacitive sensor (203) sensing gesture rotation instruction; (2) Micro LED matrix (middle layer): 1024 LED beads (204) are arranged in a honeycomb on the spherical PCB board (205) with a spacing of 1.5mm, covering 150% NTSC color gamut, and temperature is controlled by a graphene heat dissipation layer (206); (3) Optical diffusion cover (upper layer): Zirconia ceramic cover (207) with micro-prism structure refracts point light source into soft nebula, surface anti-fingerprint coating (208) maintains light transmittance >95%; (3) Touch ring (outer ring): Titanium alloy ring body (209) integrates 32-electrode capacitive array, supporting double-finger zooming of star map; Industrial design highlight: Magnetic suspension + honeycomb LED realizes zero-physical-obstruction immersive nebula.
[0027] Figure 3 : Data fusion framework. This diagram shows the collaborative logic of environmental data: (1) Gateway data stream (upper half): Smart home gateway (such as KNX / IP router) outputs structured device table, containing online status, real-time power, and protocol type (arrow marked fields: Device_ID, Power, Protocol); (2) Active scanning stream (lower half): Radio frequency module transmits detection signal (waveform example: BLE AdvPacket), captures response characteristics of unregistered devices (such as 38kHz carrier of infrared air conditioner), and generates a list of free devices. After fusion engine (central): After time stamp alignment, the dual-path data outputs a unified device topology (output table contains location confidence field, gateway device=1.0, scanning device=0.8); (3) Technical difference emphasis: This system does not analyze the protocol content, only integrates external data sources for visualization.
[0028] Figure 4 : Workflow diagram. This diagram describes a four-step closed-loop workflow: (1) Device scanning (step 401): Perform gateway query (402) and radio frequency active probe (403) in parallel, retry 3 times (arrow loop) when failed; (2) Energy consumption calculation (step 404): Online devices read real-time power, offline devices call historical records (database icon marked Last_Power); (3) Star generation (step 405): Sphere volume is calculated as V=K·log10(P+1) (formula floating mark), background color temperature is driven by total carbon emissions to gradually change; (4) Interactive response (step 406): Receive AR control signal (407) to trigger radial ripples, voice command (408) to trigger three-pulse flicker, output to optical engine (409); Clean energy detection (410) triggers leaf vein light wave, highlighted in green dashed box in the flowchart.
[0029] Figure 5 : Residential guest dining room example. This diagram presents a typical family scene star cloud layout: (1) Space annotation: Left kitchen area distributes refrigerator (501), oven (502); Right living room area deploys air conditioner (503), projector (504); Central free coffee machine (505); (2) Star features: The refrigerator sphere has the largest diameter (marked 12mm ∝ 800W), with black mist particles appearing on the surface (carbon emission warning); Air conditioner sphere bursts blue ripples (AR control takes effect); Coffee machine is gray offline state (diameter 2mm ∝ historical 5W); (3) Environmental special effects: Background color is orange-red (total power 4.2kW), roof photovoltaic access ripples green light wave (arrow points to leaf vein special effect). User value visualization: Through sphere volume comparison, locate high-energy consumption refrigerator (area ratio 38%) in 3 seconds.
[0030] Figure 6 : Star mapping engine. Map the refrigerator (800W) to a 12mm diameter sphere, the Bluetooth speaker (5W) to a 2mm sphere, and offline devices to retain historical volume.
[0031] Figure 7: Three-dimensional suspended light sphere appearance structure diagram. In the figure: 200, dodecahedron transparent shell; 201, contains neodymium iron boron permanent magnet ring; 201.1, electromagnetic coil; 203, ring-shaped capacitive sensor; 203.1, electromagnetic emission module; 204, 1024 dot matrix Micro LED module; 205, PCB board; 206, heat dissipation graphene layer; 207, zirconia ceramic cover; 208, anti-fingerprint coating; 209, titanium alloy ring body; 210, charging base.
[0032] Figure 8 : Application effect example of color gamut gradient formula. When the user's living room carbon emission changes, the background color gradually changes in real time: (1) Morning (photovoltaic power supply, C=0.3): H≈228° → background display deep blue; (2) Afternoon (air conditioner full on, C=45): H≈112° → background changes to yellow green; (3) Night (multiple devices running, C=120): H≈82° → background turns to orange yellow. DETAILED DESCRIPTION
[0033] Example 1: Intelligent residential energy awakening. The scanned device list is as follows (Table 3): Table 3: Scanned device list in intelligent residence Device type Protocol Real-time power Energy attribute Photovoltaic inverter SunSpec Modbus - Clean energy Tesla Powerwall CAN bus Charging 2kW Energy storage device Siemens refrigerator KNX 800W High-carbon equipment (mains) BLE coffee machine Bluetooth Sleep 5W Free device Gas fireplace Gas fireplace 3.5kW High-carbon equipment Star cloud visualization system power supply: magnetic suspension wireless power supply efficiency ≥85%, base LED ring low power amber warning; The display size of key energy-consuming devices in the star cloud visualization system is designed as: Figure 5 501 in it: refrigerator (800W→▲12mm); Figure 5 502 in it: air conditioner (1200W→●15mm); External control terminal includes: smart glasses (AR perspective photovoltaic power generation efficiency), voice sound box (voice instruction: "display energy flow direction"); Interactive display highlights: (1) Clean energy visualization: photovoltaic power reaches 5kW → background star cloud strong green pulsation (3.2Hz): photovoltaic --62%-> total energy, mains --38%-> total energy; (2) High-carbon device warning: start gas fireplace → black mist particles appear on the surface of the fireplace sphere, and the background color gradually changes from green to orange red; (3) Energy dispatching guidance. Touch the refrigerator sphere display: the refrigerator power supply "photovoltaic" accounts for 42%, and "mains" accounts for 58%; (4) Voice off air conditioner → sphere triggers three pulses → background color gradually changes from orange red (H=20°) to cyan blue (H=180°).
[0034] Example 2: Ground-source heat pump healing room. The scanning device list is as follows (Table 5) Table 5: Ground-source heat pump healing room scanning device list Device type Protocol Real-time power Energy attribute Ground source heat pump host BACnet 4.2kW Clean energy Seven-string guitar resonance sound box Private protocol 150W Art equipment Sandalwood aromatherapy machine WiFi 120W Healing device Free negative ion generator Infrared 80W Free device
[0035] External control terminal: brain wave head ring (meditation concentration regulates heat pump temperature), gesture controller (adjusts the concentration of aromatherapy from a distance); interactive display highlights: (1) Carbon neutral extreme expression: ground-source heat pump ratio > 95% → background presents forest dark green (H = 120°), aromatherapy machine sphere surrounds vein-shaped light lines (diffuses once per second); (2) Artistic energy guidance: user meditation concentration improves → brain wave head ring reduces heat pump 1°C → heat pump sphere shrinks 10% + background pulsation frequency drops to 1.5Hz, system prompts: "energy-saving deep meditation starts"; (3) Off-grid operation proof: geothermal well -->|100%| heat pump host, heat pump host --> speaker, heat pump host --> aromatherapy machine (4) Beneficial effects: healing room annual carbon emissions approach zero (can reach LEED zero carbon certification level), user meditation efficiency improves (alpha wave amplitude monitoring data).
[0036] Example 3: Hotel room. The device list is as follows (Table 4): Table 4: Hotel room device list Device type Protocol Real-time power Intelligent toilet BLE 250W Audio and video system HDMI-CEC 1800W Free humidifier Infrared 60W Control terminal: mobile phone APP adjusts video and audio volume, somatosensory gesture switches humidifier; (1) Nebula response: video and audio system sphere pulsates intensively with increasing volume, and spiral green light track is triggered when gesture controls humidifier; (2) User value: new users immediately master "standby electric tigers" (toilet heater accounts for 32% of energy consumption).
[0037] Example 4: Elderly apartment. Key devices: fall detection carpet (Zigbee), emergency call bracelet (LoRa), and free blood pressure meter (Bluetooth); (1) Elderly-friendly interaction: voice speaker calls: "display medical devices" → enlarge medical device sphere; when bracelet alarms, corresponding sphere flashes high-frequency red; (2) Safety enhancement: background color is forced to switch to dark blue mode at night (to avoid light pollution).
[0038] Example 5: Metaverse game hall. Virtual reality devices: VR treadmill (CAN bus), holographic projector (DMX512), and somatosensory capture suit (WiFi 6E); Cross-dimension interaction: the body-sensing gloves grab the "running planet" to accelerate, and the background color changes with the intensity of the player's movement; energy consumption warning: the core ball flashes red and yellow alternately when the projector is overloaded.
Claims
1. A method for visualizing equipment energy consumption, characterized in that include: a) Convert the device power P through the function V=K·log 10 (P+1) is mapped to the volume of the visualization unit; b) Input the real-time carbon emission intensity C (unit: kgCO2 / h) into the hue mapping formula: H=AB·log 10 (C+1), where parameter A ranges from 220 to 260, and parameter B ranges from 70 to 90; c) generating a background color in the HSL color space according to the hue value H; d) Outputting a nebula visualization interface through a display carrier, wherein the carrier includes: an LED dot matrix, a projection imaging surface, and a flexible display layer.
2. The method according to claim 1, wherein the typical embodiment is characterized by: (1) A=240, B=80; (2) The hue mapping formula is expressed as: H = 240-80·log 10 (C+1); (3) When C increases from 0.1 kgCO2 / h to 1000 kgCO2 / h, H decreases from 237° to 0°, and the corresponding background color gradually changes from dark blue to bright red.
3. The method according to claim 1, wherein the LED dot matrix rendering comprises: (1) Micro LED lamp beads with honeycomb arrangement; (2) Physical suspension is achieved through a magnetic levitation base; (3) When renewable energy power supply is detected, the background nebula generates a pulsating green light wave effect, and the light wave intensity is proportional to the proportion of clean energy; (4) When high-carbon emission equipment is in operation, a black mist particle effect is generated on the surface of the corresponding sphere.
4. The method according to claim 1, wherein the projected imaging surface rendering comprises: (1) Using distortion correction algorithm to adapt the projection surface; (2) Generate carbon emission warning effects through laser diffraction.
5. The method according to claim 1, wherein the flexible display layer rendering comprises: (1) Drive regional deformation according to the device power value; (2) Carbon emission warning is achieved through electrochromic materials.
6. A system for implementing any method of claim 15, comprising: (1) Data acquisition module; (2) Star Mapping Engine; (3) Carrier adaptation rendering module.
Citation Information
Patent Citations
Gateway structure for multi-protocol conversion
CN112671638A
Smart home equipment, display control method and storage medium
CN113220189A
Smart home product management unit and system, application method and electronic equipment
CN114827303A
Environment-friendly and energy-saving intelligent display terminal
CN218446609U