Interaction method, device and system of heating and ventilation equipment and electronic equipment
By extending real-life technology to realize interactive interface and gesture control in HVAC equipment, the problem of low operation and maintenance efficiency of large HVAC equipment is solved, and the efficiency and user experience of monitoring and troubleshooting are improved.
Patent Information
- Application Number
- CN202310662720.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-06-05
- Publication Date
- 2024-12-06
AI Technical Summary
The operating status monitoring and troubleshooting of existing large HVAC equipment such as central air conditioners requires manual operation by engineers, with high professional requirements and low efficiency.
By extending reality technology, providing interactive methods, devices and systems, users can display multiple interface controls in an extended reality environment through input and gesture control, realizing status monitoring and troubleshooting of HVAC equipment, which is simple to operate and efficient.
It improves the operation and maintenance efficiency of HVAC equipment, reduces the requirements for user professionalism, simplifies the operation and maintenance process, and helps users quickly reach the operation and maintenance position by displaying the operation and maintenance guidance path and sound guidance.
Smart Images

Figure CN119088270A_ABST
Abstract
Description
Technical Field
[0001] The present application belongs to the technical field of electrical equipment, and in particular, relates to an interaction method, device, system and electronic equipment for HVAC equipment. Background Art
[0002] HVAC is a general term for heating and ventilation. Equipment related to heating and ventilation, such as air conditioners, boilers, radiators, electric heaters, etc., are collectively referred to as HVAC equipment. HVAC equipment is usually installed in large buildings such as large shopping malls and office buildings to provide better cooling or heating effects for various spaces in large buildings.
[0003] At present, for large HVAC equipment such as central air conditioners, engineers are usually required to manually perform operations such as operating status monitoring and troubleshooting, which places high professional requirements on engineers and has low operating efficiency. Summary of the invention
[0004] The present application aims to solve at least one of the technical problems existing in the prior art. To this end, the present application proposes an interactive method, device, system and electronic device for HVAC equipment, which interacts with HVAC equipment through extended reality technology, thereby helping to improve the operating efficiency of HVAC equipment status monitoring, troubleshooting and other operations.
[0005] In a first aspect, the present application provides an interaction method for HVAC equipment, the method comprising:
[0006] receiving a first input from a user;
[0007] In response to the first input, displaying a first display interface of the HVAC equipment in the extended reality environment, wherein the first display interface includes a plurality of interface controls;
[0008] receiving a second input from the user on the first display interface;
[0009] In response to the second input, a target control is determined from the multiple interface controls, and a target display interface corresponding to the target control is displayed in the extended display environment.
[0010] According to the interactive method of HVAC equipment in the present application, a first display interface including multiple interface controls is displayed through a first input, and then a target display interface of a target control is switched to display through a second input. Extended reality technology is used to interact with the HVAC equipment to implement operations such as HVAC equipment status monitoring and troubleshooting, which is simple and efficient.
[0011] According to one embodiment of the present application, the first display interface includes a user login control, an operation and maintenance task work order control, an operation and maintenance task progress control, and a device overview control.
[0012] According to an embodiment of the present application, the target control is the operation and maintenance task work order control, the target display interface is the operation and maintenance task interface, and the operation and maintenance task interface is used to display the operation and maintenance task work order.
[0013] According to an embodiment of the present application, after displaying the target display interface corresponding to the target control in the extended display environment, the method further includes:
[0014] receiving a third input from the user on the operation and maintenance task interface;
[0015] In response to the third input, an operation and maintenance guidance path is displayed in the extended display environment, where the operation and maintenance guidance path is used to represent a path from the user location to the operation and maintenance task location.
[0016] According to an embodiment of the present application, after receiving the third input of the user on the operation and maintenance task interface, the method further includes:
[0017] Output operation and maintenance guidance voice.
[0018] According to one embodiment of the present application, the target control is the device overview control, the target display interface is the device overview interface, and the device overview interface is used to display the operating status information of the HVAC equipment.
[0019] According to an embodiment of the present application, the first input is an input of the first palm of the user, and the displaying of the first display interface in the extended reality environment includes:
[0020] Determining that the first palm is a left hand, and displaying the first display interface at a first position in an extended reality environment;
[0021] Alternatively, it is determined that the first palm is the right hand, and the first display interface is displayed at a second position of the extended display environment.
[0022] In a second aspect, the present application provides an interactive device for HVAC equipment, the device comprising:
[0023] A first receiving module, used to receive a first input from a user;
[0024] A first response module, configured to display a first display interface of the HVAC equipment in the extended reality environment in response to the first input, wherein the first display interface includes a plurality of interface controls;
[0025] A second receiving module, configured to receive a second input from the user on the first display interface;
[0026] The second response module is used to determine a target control from the multiple interface controls in response to the second input, and display a target display interface corresponding to the target control in the extended display environment.
[0027] According to the interactive device for HVAC equipment of the present application, a first display interface including multiple interface controls is displayed through a first input, and then a target display interface of a target control is switched to display through a second input. Extended reality technology is used to interact with the HVAC equipment to implement operations such as HVAC equipment status monitoring and troubleshooting, with simple operation and high efficiency.
[0028] In a third aspect, the present application provides an interactive system for HVAC equipment, including:
[0029] HVAC equipment;
[0030] An extended reality device, wherein the extended reality device is communicatively connected to the HVAC device, and the extended reality device is used to execute the HVAC device interaction method described in the first aspect above.
[0031] According to the interactive system of HVAC equipment in the present application, a first display interface including multiple interface controls is displayed through a first input, and then a target display interface of a target control is switched to display through a second input. Extended reality technology is used to interact with the HVAC equipment to implement operations such as HVAC equipment status monitoring and troubleshooting, with simple operation and high efficiency.
[0032] In a fourth aspect, the present application provides an electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the method for interacting with HVAC equipment as described in the first aspect above is implemented.
[0033] In a fifth aspect, the present application provides a non-transitory computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the method for interacting with HVAC equipment as described in the first aspect above is implemented.
[0034] In a sixth aspect, the present application provides a computer program product, including a computer program, which, when executed by a processor, implements the interaction method of HVAC equipment as described in the first aspect above.
[0035] The above one or more technical solutions in the embodiments of the present application have at least one of the following technical effects:
[0036] By interacting with HVAC equipment through extended reality technology, operations such as HVAC equipment status monitoring and troubleshooting can be achieved, which is simple and efficient.
[0037] Furthermore, displaying the operation and maintenance guidance path in the extended display environment helps users reach the location in the HVAC equipment that requires operation and maintenance more quickly. The operation is simple, which helps to improve the operation and maintenance efficiency of the HVAC equipment and has low requirements on the user's professionalism.
[0038] Furthermore, the interface display of the extended display environment can automatically adapt to the user's left and right hands. When the user uses his left and right hands to summon the first display interface, the first display interface is displayed in different positions of the extended display environment, effectively improving the user experience.
[0039] Additional aspects and advantages of the present application will be given in part in the description below, and in part will become apparent from the description below, or will be learned through the practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS
[0040] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the description of the embodiments in conjunction with the following drawings, in which:
[0041] Figure 1 It is a flowchart of the interactive method of HVAC equipment provided in an embodiment of the present application;
[0042] Figure 2 is an interface schematic diagram of a first display interface provided in an embodiment of the present application;
[0043] Figure 3 This is one of the interface diagrams of the operation and maintenance task interface provided in the embodiment of the present application;
[0044] Figure 4 This is the second interface diagram of the operation and maintenance task interface provided in the embodiment of the present application;
[0045] Figure 5 This is one of the interface diagrams of the device overview interface provided in the embodiment of the present application;
[0046] Figure 6 This is the second interface diagram of the device overview interface provided in the embodiment of the present application;
[0047] Figure 7 It is a structural schematic diagram of an interactive device for HVAC equipment provided in an embodiment of the present application;
[0048] Figure 8 It is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0049] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.
[0050] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.
[0051] In conjunction with the accompanying drawings, the interactive method for HVAC equipment, the interactive device for HVAC equipment, the electronic device and the readable storage medium provided in the embodiments of the present application are described in detail below through specific embodiments and their application scenarios.
[0052] Among them, the interaction method of HVAC equipment can be applied to the terminal, and can be specifically executed by hardware or software in the terminal.
[0053] The terminal includes, but is not limited to, a portable communication device such as a mobile phone or tablet computer with a touch-sensitive surface (e.g., a touch screen display and / or a touch pad). It should also be understood that in some embodiments, the terminal may not be a portable communication device, but a desktop computer with a touch-sensitive surface (e.g., a touch screen display and / or a touch pad).
[0054] In the following various embodiments, a terminal including a display and a touch-sensitive surface is described. However, it should be understood that the terminal may include one or more other physical user interface devices such as a physical keyboard, a mouse and a joystick.
[0055] The interactive method for HVAC equipment provided in the embodiment of the present application may be executed by an electronic device or a functional module or functional entity in the electronic device that can implement the interactive method for HVAC equipment. The electronic devices mentioned in the embodiment of the present application include but are not limited to mobile phones, tablet computers, computers, cameras, and wearable devices. The interactive method for HVAC equipment provided in the embodiment of the present application is described below using an electronic device as an example of the executing body.
[0056] like Figure 1As shown, the interaction method of the HVAC equipment includes: step 110, step 120, step 130 and step 140.
[0057] Step 110: Receive a first input from a user.
[0058] In this step, the user's first input may be collected through the extended reality device.
[0059] Extended reality (XR) refers to a human-computer interactive environment that combines the real and virtual worlds through computer technology and wearable devices.
[0060] Extended reality includes augmented reality (AR), virtual reality (VR), mixed reality (MR) and other forms.
[0061] In this embodiment, the extended reality device may include XR glasses, XR head-mounted devices, XR display devices, etc. The extended reality device may also be a virtual reality device, an augmented reality device, or a mixed reality device.
[0062] In this embodiment, the hand-worn device of the extended reality device can be worn on the palm of the user, and the palm of the user makes a corresponding gesture to receive the first input.
[0063] For example, the user opens the first palm and raises it to a certain height, and the user's first input is received.
[0064] In this embodiment, the image acquisition device of the extended reality device may also be used to collect image information of the user's first palm, identify gestures made by the user's first palm, and determine whether the user inputs the first input.
[0065] For example, the image acquisition device acquires image information of the user's first palm, recognizes that the user has turned over the first palm to a certain height, and receives the user's first input.
[0066] Step 120: In response to the first input, display a first display interface of the HVAC equipment in the extended reality environment.
[0067] In this embodiment, the first input is used to control the first display interface of the HVAC equipment displayed in the extended reality environment, that is, the first input is an interface summoning operation corresponding to the first display interface.
[0068] Among them, the extended reality environment can be an interactive environment provided by an extended reality device, which can be presented to the user through devices such as extended reality, virtual reality or augmented reality displays.
[0069] For example, an extended reality environment may be a real-time view of a physical real-world environment merged with computer-generated graphical content, or an extended reality environment may be a real-world environment that is a real-time view of a physical real-world environment augmented by computer-generated graphical content.
[0070] In actual implementation, the palm movements of the user can be detected and identified. After the palm space coordinates are identified, the first display interface is controlled to move and displayed in the extended reality environment.
[0071] Among them, the first display interface of the HVAC equipment includes multiple interface controls.
[0072] The interface control is a visual graphic "element" displayed on the first display interface, such as a button, a file edit box, etc., which has the function of executing or triggering the code to run and complete the response through an "event".
[0073] In this embodiment, the first display interface of the HVAC equipment belongs to the main dashboard interface for equipment interaction. The first display interface includes multiple interface controls that can realize interaction with the HVAC equipment. By triggering the interface controls of the first display interface, interactive functions such as viewing the operating status of the HVAC equipment, adjusting the working parameters of the HVAC equipment, and detecting fault points of the HVAC equipment can be realized.
[0074] In this step, if Figure 2 As shown, in response to the user's first input, the first display interface of the current HVAC equipment is displayed in the extended display environment.
[0075] In the first display interface, there are interface controls for realizing different interactive functions, including task work orders, user login, work order task completion, business income, and an overview of water units of HVAC equipment.
[0076] It is understandable that, in response to the user's first input, when the first display interface of the current HVAC equipment is displayed in the extended display environment, a certain animation effect may be added to the display of the first display interface.
[0077] For example, in response to a first user input, the first display interface flies in from around the currently displayed extended display environment.
[0078] Step 130: Receive a second input from the user on the first display interface.
[0079] In this embodiment, the user can use the first palm to summon the first display interface, and then use the second palm to select the interface control to be operated in the first display interface and input the second input.
[0080] For example, the first palm is the left hand and the second palm is the right hand.
[0081] The user opens and raises his left hand to a certain height to display the first display interface of the HVAC equipment. The user uses his right hand to select an interface control on the first display interface and input a second input.
[0082] In this embodiment, the hand-worn device of the extended reality device can be worn on the palm of the user, and the palm of the user makes a corresponding selection action in the first display interface to receive the second input.
[0083] For example, the user uses the index finger of the second palm to select the interface control in the first display interface, and the second input of the second palm of the user is received.
[0084] In this embodiment, the image information of the second palm of the user may also be collected by the image acquisition device of the extended reality device, the gesture made by the second palm of the user may be identified, and it may be determined whether the user inputs the second input.
[0085] In actual implementation, the user may also use the same hand to input the first input to summon the first display interface, input the second input, and select the interface control to be operated in the first display interface.
[0086] It can be understood that inputting the first input summons the first display interface including multiple interface controls, and then inputting the second input is to select the interface control to be operated. When realizing interactive functions such as viewing the operating status of HVAC equipment, adjusting the working parameters of HVAC equipment, and detecting fault points of HVAC equipment, the operation is simple and efficient, and the professional requirements for users are also low.
[0087] Step 140: In response to the second input, determine a target control from a plurality of interface controls, and display a target display interface corresponding to the target control in the extended display environment.
[0088] In this embodiment, the second input is used to select a target control of the interface control that needs to be operated, and the target display interface corresponding to the target control is displayed in the extended display environment, and the first display interface is switched to the target display interface.
[0089] In actual implementation, the palm movement can be detected to identify the palm movement, and after the palm space coordinates are identified, the first display interface and the target display interface are controlled to move, and the target display interface is displayed in the extended reality environment.
[0090] It is understandable that each interface control corresponds to a display interface of different content.
[0091] For example, the first display interface includes interface controls for realizing different interactive functions, such as task work orders, user login, work order task completion, business income, and an overview of water units of HVAC equipment, which correspond to display interfaces with different contents, such as task work orders, user login, work order task completion, business income, and an overview of water units of HVAC equipment.
[0092] In this step, in response to the second input of the user, a target display interface of the target control that needs to be operated is displayed in the extended display environment, and the user can operate the content of the target display interface.
[0093] It is understandable that, in response to the second input of the user, when the target display interface of the target control is displayed in the extended display environment, a certain animation effect may also be added to the display of the target display interface.
[0094] For example, in response to the user's second input, the window range corresponding to the target control in the first display interface expands outward to fill the display boundary.
[0095] In this embodiment, in response to the interface switching operation (second input) performed by the user on the first display interface, the target control corresponding to the interface switching operation is determined, and the target display interface corresponding to the target control is switched to facilitate further interaction between the user and the HVAC equipment.
[0096] According to the interactive method of HVAC equipment provided in the embodiment of the present application, a first display interface including multiple interface controls is displayed through a first input, and then a target display interface of the target control is switched to display through a second input of the user, and extended reality technology is used to interact with the HVAC equipment to realize operations such as HVAC equipment status monitoring and troubleshooting, which is simple to operate and efficient.
[0097] In some embodiments, the first display interface may include a user login control, an operation and maintenance task work order control, an operation and maintenance task progress control, and a device overview control.
[0098] The user login control is an interface control that implements interactive functions such as user login and identity authentication of HVAC equipment. The display interface corresponding to the user login control is the user login display interface.
[0099] In this embodiment, the user can input the second input in the first display interface, determine that the target control is a user login control, and switch to display the user login display interface, which includes information such as user login and identity authentication.
[0100] The operation and maintenance task work order control is an interface control that implements interactive functions such as maintenance and repair tasks of HVAC equipment. The display interface corresponding to the operation and maintenance task work order control is the operation and maintenance task interface.
[0101] In this embodiment, the user can input the second input in the first display interface, determine that the target control is the operation and maintenance task work order control, and switch to display the operation and maintenance task interface, which includes information such as maintenance and repair task work orders.
[0102] The operation and maintenance task progress control is an interface control that displays the operation and maintenance task progress of HVAC equipment. The display interface corresponding to the operation and maintenance task progress control is the operation and maintenance task progress interface.
[0103] In this embodiment, the user can input the second input in the first display interface, determine that the target control is the operation and maintenance task progress control, and switch to display the operation and maintenance task progress interface, which includes information such as the currently completed operation and maintenance tasks, unfinished operation and maintenance tasks, and completion progress.
[0104] The device overview control is an interface control that implements interactive functions such as operation monitoring of HVAC equipment. The display interface corresponding to the device overview control is the device overview interface.
[0105] In this embodiment, the user can input the second input in the first display interface, determine that the target control is the equipment overview control, and switch to display the equipment overview interface, which includes information such as the operating status of the HVAC equipment and the fault status of each component of the HVAC equipment.
[0106] In some embodiments, the target control is an operation and maintenance task work order control, and the target display interface is an operation and maintenance task interface, which is used to display the operation and maintenance task work order.
[0107] In this embodiment, the user inputs the second input in the first display interface, determines that the target control is the operation and maintenance task work order control, and switches to display the operation and maintenance task interface, which is used to display the operation and maintenance task work order.
[0108] Among them, the operation and maintenance task interface can display one or more operation and maintenance task work orders of HVAC equipment.
[0109] For example, the operation and maintenance task interface may include an operation and maintenance task worksheet A for troubleshooting a water unit of a HVAC device and an operation and maintenance task worksheet B for repairing a temperature sensor of the HVAC device.
[0110] In some embodiments, at step 140, after the extended display environment displays the target display interface corresponding to the target control, the HVAC device interaction method may further include:
[0111] Receiving a third input from the user on the operation and maintenance task interface;
[0112] In response to the third input, an operation and maintenance guidance path is displayed in the extended display environment.
[0113] The operation and maintenance guidance path is used to represent the path from the user location to the operation and maintenance task location.
[0114] In this embodiment, the interface displayed in the extended display environment is switched to the operation and maintenance task interface. The user inputs a third input to the operation and maintenance task interface, selects an operation and maintenance task work order, and in response to the third input, the operation and maintenance guidance path corresponding to the operation and maintenance task work order is displayed.
[0115] For example, the user inputs a third input to the operation and maintenance task interface, and the selected operation and maintenance task work order is to troubleshoot a water unit failure of the HVAC equipment. In response to the third input, the extended display environment displays the path from the user's location to the water unit operation and maintenance task location.
[0116] like Figure 3 As shown, the operation and maintenance guidance path can be displayed in the extended display environment in the form of a dotted path combined with an arrow to guide the user to move from the user position to the operation and maintenance task position to perform the operation and maintenance task corresponding to the operation and maintenance task work order.
[0117] In this embodiment, the operation and maintenance guidance path is displayed in the extended display environment, which helps the user to reach the location in the HVAC equipment that needs operation and maintenance more quickly. The operation is simple, which helps to improve the operation and maintenance efficiency of the HVAC equipment and has low requirements on the user's professionalism.
[0118] In actual execution, after determining the operation and maintenance task work order selected by the user, the user position and the target space position corresponding to the operation and maintenance task are calibrated, the target space corresponding to the user and the operation and maintenance task is calculated, and the operation and maintenance guidance path is superimposed and displayed in the extended display environment.
[0119] It can be understood that the operation and maintenance guidance path is a real-time navigation path that changes as the user's location changes.
[0120] In this embodiment, in response to the third input, the operation and maintenance guidance path corresponding to the operation and maintenance task worksheet is displayed, and the operation and maintenance task location corresponding to the operation and maintenance task worksheet may also be highlighted to improve the path navigation effect.
[0121] In some embodiments, after receiving the third input of the user to the operation and maintenance task interface, the HVAC equipment interaction method may further include:
[0122] Output operation and maintenance guidance voice.
[0123] Among them, the operation and maintenance guidance sound is used to instruct the user to perform operation and maintenance tasks.
[0124] In this embodiment, the operation and maintenance guidance sound may be a navigation sound with a sense of space, which is adjusted as the user's head position changes, guiding the user to accurately find the target maintenance point corresponding to the operation and maintenance task work order.
[0125] For example, after the user reaches the operation and maintenance task location according to the operation and maintenance guidance path, he or she can find the target maintenance point corresponding to the operation and maintenance task work order according to the operation and maintenance guidance voice, and perform inspection and maintenance, which helps to improve the operation and maintenance efficiency of HVAC equipment and has low requirements for user professionalism.
[0126] In actual implementation, after determining the operation and maintenance task work order selected by the user, the user's head position and the corresponding target space position are calibrated, the head and task target space coordinate system is constructed, the space position is calibrated, and various sound sources are superimposed. When the user's head rotates, the relative displacement of the space coordinate system is calculated and the spatial audio is processed by gain and attenuation, and finally a spatial operation and maintenance guidance sound is synthesized.
[0127] A specific embodiment is described below.
[0128] In response to the user's second input on the first display interface, the target control is determined to be the operation and maintenance task work order control, and the operation and maintenance task interface is displayed. In response to the user's third input, an operation and maintenance guidance path from the user's location to the operation and maintenance task location is displayed to guide the user to reach the operation and maintenance task location, the target maintenance point is highlighted, and an operation and maintenance guidance voice is output for voice guidance.
[0129] In actual implementation, operation and maintenance prompt sounds related to the progress of operation and maintenance tasks can be output. For example, an operation and maintenance task work order is received, the task completion status of the current operation and maintenance task work order is identified, and sound prompts are given according to the task objectives and task processes. After the task is completed, an operation and maintenance prompt sound indicating the end of the task is output.
[0130] In some embodiments, the target control is a device overview control, and the target display interface is a device overview interface, which is used to display operating status information of HVAC equipment.
[0131] In this embodiment, the user inputs the second input in the first display interface, determines that the target control is the equipment overview control, switches to display the equipment overview interface, and the equipment overview interface displays information such as the equipment operating status and component failure status of the HVAC equipment.
[0132] For example, Figure 5 As shown, the extended reality environment displays the equipment overview interface, and the equipment overview interface displays the unit status, temperature status, load status, compressor status, inlet and outlet water temperatures and other operating status information of unit 1 of the HVAC equipment.
[0133] For example, Figure 6 As shown, the extended reality environment displays the equipment overview interface, and the equipment overview interface displays the operating status information of components such as the compressor and throttle valve of the HVAC equipment.
[0134] In some embodiments, the first input is an input of a first palm of the user, and step 120, displaying a first display interface in an extended reality environment, may include:
[0135] Determining that the first palm is a left hand, and displaying a first display interface at a first position in the extended reality environment;
[0136] Alternatively, it is determined that the first palm is the right hand, and the first display interface is displayed at a second position of the extended display environment.
[0137] In this embodiment, the interface display of the extended display environment can automatically adapt to the user's left and right hands. When the user uses his left and right hands to summon the first display interface, the first display interface is displayed in different positions of the extended display environment, effectively improving the user experience.
[0138] For example, when the user summons the first display interface using his left hand, the first display interface can be displayed on the left side of the extended display environment; when the user summons the first display interface using his right hand, the first display interface can be displayed on the right side of the extended display environment.
[0139] like Figure 3 As shown, the user uses his left hand to summon the first display interface, and the first display interface is displayed on the left side of the extended display environment.
[0140] like Figure 4 As shown, when the user summons the first display interface using his right hand, the first display interface is displayed on the right side of the extended display environment.
[0141] In actual implementation, the first palm movement is detected, the movement of the first palm is identified, and the left and right hands are determined. After the palm space coordinates are identified, the first display interface is controlled to move to a position suitable for the left and right hands, and the first display interface is displayed in the extended reality environment.
[0142] The interactive method for HVAC equipment provided in the embodiment of the present application can be executed by an interactive device for HVAC equipment. In the embodiment of the present application, the interactive device for HVAC equipment executing the interactive method for HVAC equipment is used as an example to illustrate the interactive device for HVAC equipment provided in the embodiment of the present application.
[0143] The embodiment of the present application also provides an interactive device for HVAC equipment.
[0144] like Figure 7 As shown, the interactive device of the HVAC equipment includes:
[0145] A first receiving module 710, configured to receive a first input from a user;
[0146] A first response module 720, configured to display a first display interface of the HVAC equipment in the extended reality environment in response to the first input, wherein the first display interface includes a plurality of interface controls;
[0147] The second receiving module 730 is used to receive a second input of the user on the first display interface;
[0148] The second response module 740 is used to determine a target control from multiple interface controls in response to the second input, and display a target display interface corresponding to the target control in the extended display environment.
[0149] According to the interactive device for HVAC equipment provided in the embodiment of the present application, a first display interface including multiple interface controls is displayed through a first input, and then a target display interface of a target control is switched to display through a second input. Extended reality technology is used to interact with the HVAC equipment to implement operations such as HVAC equipment status monitoring and troubleshooting, with simple operation and high efficiency.
[0150] In some embodiments, the first display interface includes a user login control, an operation and maintenance task work order control, an operation and maintenance task progress control, and a device overview control.
[0151] In some embodiments, the target control is an operation and maintenance task work order control, and the target display interface is an operation and maintenance task interface, which is used to display the operation and maintenance task work order.
[0152] In some embodiments, the second receiving module 730 is further used to receive a third input from a user on the operation and maintenance task interface;
[0153] The second response module 740 is further configured to display an operation and maintenance guidance path in the extended display environment in response to the third input, where the operation and maintenance guidance path is used to represent a path from the user location to the operation and maintenance task location.
[0154] In some embodiments, the second response module 740 is further used to output an operation and maintenance guidance sound, where the operation and maintenance guidance sound is used to instruct the user to move from the user location to the operation and maintenance task location.
[0155] In some embodiments, the target control is a device overview control, and the target display interface is a device overview interface, which is used to display operating status information of HVAC equipment.
[0156] In some embodiments, the first input is an input of a first palm of the user, and the first response module 720 is used to determine that the first palm is a left hand, and display the first display interface at a first position of the extended reality environment;
[0157] Alternatively, it is determined that the first palm is the right hand, and the first display interface is displayed at a second position of the extended display environment.
[0158] The interactive device of the HVAC equipment in the embodiment of the present application can be an electronic device or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other devices other than a terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc. It can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., and the embodiment of the present application is not specifically limited.
[0159] The interactive device of the HVAC equipment in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an IOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.
[0160] The interactive device for HVAC equipment provided in the embodiment of the present application can achieve Figure 1 To avoid repetition, the various processes implemented by the method embodiment are not described here.
[0161] An embodiment of the present application also provides an interactive system for HVAC equipment.
[0162] The interactive system of HVAC equipment includes: HVAC equipment and an extended reality device, the extended reality device is communicatively connected with the HVAC equipment, and the extended reality device is used to execute the above-mentioned interactive method of HVAC equipment.
[0163] According to the interactive system of HVAC equipment provided in the embodiment of the present application, a first display interface including multiple interface controls is displayed through a first input, and then a target display interface of the target control is switched to display through a second input. Extended reality technology is used to interact with the HVAC equipment to implement operations such as HVAC equipment status monitoring and troubleshooting, which is simple and efficient.
[0164] In some embodiments, Figure 8As shown, an embodiment of the present application also provides an electronic device 800, including a processor 801, a memory 802, and a computer program stored in the memory 802 and executable on the processor 801. When the program is executed by the processor 801, each process of the above-mentioned HVAC equipment interaction method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
[0165] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.
[0166] An embodiment of the present application also provides a non-transitory computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the various processes of the above-mentioned HVAC equipment interaction method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
[0167] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.
[0168] An embodiment of the present application also provides a computer program product, including a computer program, which implements the above-mentioned HVAC equipment interaction method when executed by a processor.
[0169] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.
[0170] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned HVAC equipment interaction method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0171] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.
[0172] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.
[0173] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.
[0174] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.
[0175] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "illustrative embodiments", "examples", "specific examples", or "some examples" means that the specific features, structures, materials, or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.
[0176] Although the embodiments of the present application have been shown and described, those skilled in the art will appreciate that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present application, and that the scope of the present application is defined by the claims and their equivalents.
Claims
1. An interactive method for HVAC equipment, characterized in that: include: receiving a first input from a user; In response to the first input, displaying a first display interface of the HVAC equipment in the extended reality environment, wherein the first display interface includes a plurality of interface controls; receiving a second input from the user on the first display interface; In response to the second input, a target control is determined from the multiple interface controls, and a target display interface corresponding to the target control is displayed in the extended display environment.
2. The interactive method of HVAC equipment according to claim 1, characterized in that: The first display interface includes a user login control, an operation and maintenance task work order control, an operation and maintenance task progress control, and a device overview control.
3. The interactive method of HVAC equipment according to claim 2, characterized in that: The target control is the operation and maintenance task work order control, the target display interface is the operation and maintenance task interface, and the operation and maintenance task interface is used to display the operation and maintenance task work order.
4. The interactive method of HVAC equipment according to claim 3, characterized in that: After displaying the target display interface corresponding to the target control in the extended display environment, the method further includes: receiving a third input from the user on the operation and maintenance task interface; In response to the third input, an operation and maintenance guidance path is displayed in the extended display environment, where the operation and maintenance guidance path is used to represent a path from the user location to the operation and maintenance task location.
5. The interactive method of HVAC equipment according to claim 4, characterized in that: After receiving the third input of the user on the operation and maintenance task interface, the method further includes: Output operation and maintenance guidance voice.
6. The interactive method of HVAC equipment according to claim 2, characterized in that: The target control is the device overview control, and the target display interface is the device overview interface, which is used to display the operating status information of the HVAC equipment.
7. The HVAC equipment interaction method according to any one of claims 1 to 6, characterized in that: The first input is an input of a first palm of the user, and the displaying of a first display interface in an extended reality environment includes: Determining that the first palm is a left hand, and displaying the first display interface at a first position in an extended reality environment; Alternatively, it is determined that the first palm is the right hand, and the first display interface is displayed at a second position of the extended display environment.
8. An interactive device for HVAC equipment, characterized in that: include: A first receiving module, used to receive a first input from a user; A first response module, configured to display a first display interface of the HVAC equipment in the extended reality environment in response to the first input, wherein the first display interface includes a plurality of interface controls; A second receiving module, configured to receive a second input from the user on the first display interface; The second response module is used to determine a target control from the multiple interface controls in response to the second input, and display a target display interface corresponding to the target control in the extended display environment.
9. An interactive system for HVAC equipment, characterized in that: include: HVAC equipment; An extended reality device, wherein the extended reality device is communicatively connected to the HVAC device, and the extended reality device is used to execute the HVAC device interaction method according to any one of claims 1 to 7.
10. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the program, the interaction method of the HVAC equipment as described in any one of claims 1-7 is implemented.
11. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the interactive method for HVAC equipment according to any one of claims 1 to 7 is implemented.
12. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the interaction method of the HVAC equipment according to any one of claims 1 to 7 is implemented.
