Method and system for providing virtual projection of human machine interface data in industrial environment
The HMD device scans a QR code on an HMI screen to project industrial data virtually, addressing the inefficiencies of conventional HMIs by enabling efficient 3D navigation and data analysis in industrial environments.
Patent Information
- Application Number
- PCT/IB2025/053730
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-08-02
- Filing Date
- 2025-04-09
- Publication Date
- 2026-02-05
AI Technical Summary
Conventional Human Machine Interfaces (HMI) in industrial environments require operators to navigate through multiple displays and click multiple times to access and analyze large amounts of data, leading to a tedious and complex process.
A method and system utilizing a Head Mounted Display (HMD) device that scans a QR code on an HMI screen to access and project HMI data virtually based on predefined schema mapping, enabling efficient three-dimensional navigation and access to both static and dynamic data.
Facilitates operators to view and analyze industrial device data efficiently in a 3D virtualized manner, allowing quick access to health information and seamless navigation across multiple screens without the need for repeated button clicks.
Smart Images

Figure IB2025053730_05022026_PF_FP_ABST
Abstract
Description
TITLE: METHOD AND SYSTEM FOR PROVIDING VIRTUAL PROJECTION OF HUMAN MACHINE INTERFACE DATA IN INDUSTRIAL ENVIRONMENTTECHNICAL FIELD
[0001] The present disclosure generally relates to visualization of industrial data. More particularly, the present disclosure relates to methods and systems for providing virtual projection of Human Machine Interface (HMI) data in an industrial environment.BACKGROUND 002] Industrial devices are utilized for accomplishing many different and varied purposes such as, monitoring and controlling industrial systems or processes relating to product manufacture, machining, motion control, batch processing, material handling, or other such industrial functions. The industrial systems may correspond to industrial controllers that are deployed throughout an industrial plant environment. The industrial devices may include machineries and equipment used to perform various operations on the industrial systems. Accordingly, the industrial devices may comprise a variety of operational components, including but not limiting to telemetry devices (e.g., temperature sensors, flow meters, level sensors, pressure sensors, etc.), manual operator control devices (e.g., push buttons, selector switches, etc.), safety monitoring devices (e.g., safety mats, safety pull cords, light curtains, etc.), and other such application devices. The industrial devices are programmed by system designers to operate and monitor the industrial systems or processes via user-designed logic programs or user programs. The user programs are associated with a plurality of operations that allow operators to view and understand dynamics of the industrial devices. 003] In the recent years, the need for operators to interact with the industrial devices has increased. This includes employment of Human Machine Interfaces (HMI) to facilitate operations with such devices, where the HMI can be provided as a graphical user interface to the operators. Conventional HMI / automation control systems are generally limited in their ability to make the operators aware of situations that require their atention or of information that may be of interest to them relative to their current tasks. In an industrial environment, local HMIs are generally implemented with the industrial devices to visualize various aspects of the industrial devices, including but not limited to parameters, tag values, process values, and thelike. However, often at times, while analyzing the various aspects through the local HMI, the operators are required to navigate from one display to another display to determine the nature of the information or even to determine whether such information exists. 004] Therefore, the conventional HMIs in the industrial environment are not convenient for the operators to interpret and analyse large amount of data. The conventional HMIs further require the operator to click multiple times on buttons to move from one screen to another, thereby leading to a tedious and complex process of viewing data.
[0005] The information disclosed in this background of the disclosure section is only for enhancement of understanding of the general background of the invention and should not be taken as an acknowledgement or any form of suggestion that this information forms the prior art already known to a person skilled in the art.SUMMARY
[0006] In an embodiment, the present disclosure discloses a method of providing virtual projection of Human Machine Interface (HMI) data in an industrial environment. The method comprising scanning a Quick Response (QR) code located on an HMI screen of an industrial device. The QR code provides an access to data associated with the industrial device, to be displayed on the HMI screen. Further, the method comprises accessing the data from the industrial device based on the scanned QR code. Thereafter, the method comprises providing a virtual projection of the accessed data based on a predefined schema mapping related to projection of the accessed data.
[0007] In an embodiment, the present disclosure discloses a Head Mounted Display (HMD) device for providing virtual projection of Human Machine Interface (HMI) data in an industrial environment. The HMD comprises a processor and a memory. The processor is configured to scan a Quick Response (QR) code located on an HMI screen of an industrial device. The QR code provides an access to data associated with the industrial device, to be displayed on the HMI screen. The HMD further accesses the data associated with the industrial device from the industrial device based on the scanned QR code. Thereafter, the HMD provides a virtual projection of the accessed data based on a predefined schema mapping related to projection of the accessed data.
[0008] In an embodiment, the present disclosure discloses a system for providing virtual projection of Human Machine Interface (HMI) data in an industrial environment. The system comprises a server and a Head Mounted Display (HMD) device comprising a processor and a memory. The memory stores processor-executable instructions, which, on execution, causes the processor associated with the HMD device to scan a Quick Response (QR) code located on an HMI screen of an industrial device. The QR code provides an access to data associated with the industrial device, to be displayed on the HMI screen. The HMD further accesses the data from the industrial device based on the scanned QR code. Thereafter, the HMD provides a virtual projection of the accessed data based on a predefined schema mapping related to projection of the accessed data.
[0009] The foregoing summary is illustrative only and is not intended to be in any way limiting. In addition to the illustrative aspects, embodiments, and features described above, further aspects, embodiments, and features will become apparent by reference to the drawings and the following detailed description.BRIEF DESCRIPTION OF THE ACCOMPANYING DRAWINGS
[0010] The novel features and characteristics of the disclosure are set forth in the appended claims. The disclosure itself, however, as well as a preferred mode of use, further objectives, and advantages thereof, will best be understood by reference to the following detailed description of an illustrative embodiment when read in conjunction with the accompanying figures. One or more embodiments are now described, by way of example only, with reference to the accompanying figures wherein like reference numerals represent like elements and in which:
[0011] Fig. 1A illustrates an exemplary environment for providing virtual projection of Human Machine Interface (HMI) data, in accordance with some embodiments of the present disclosure;
[0012] Fig. IB illustrates an HMI screen of an industrial device with a dynamic QR code, in accordance with some embodiments of the present disclosure;
[0013] Fig. 2 illustrates a detailed diagram of a Head Mounted Device (HMD) for providing virtual projection of HMI data, in accordance with some embodiments of the present disclosure;
[0014] Fig. 3 shows an exemplary illustration for providing virtual projection of HMI data in industrial environment, in accordance with some embodiments of the present disclosure;
[0015] Fig. 4 shows an exemplary flow chart illustrating method steps for providing virtual projection of HMI data, in accordance with some embodiments of the present disclosure; and
[0016] Fig. 5 illustrates a block diagram of an exemplary system for implementing embodiments consistent with the present disclosure.
[0017] It should be appreciated by those skilled in the art that any block diagram herein represents conceptual views of illustrative systems embodying the principles of the present subject matter. Similarly, it will be appreciated that any flow charts, flow diagrams, state transition diagrams, pseudo code, and the like represent various processes which may be substantially represented in computer readable medium and executed by a computer or processor, whether or not such computer or processor is explicitly shown.DETAILED DESCRIPTION
[0018] In the present document, the word “exemplary” is used herein to mean “serving as an example, instance, or illustration.” Any embodiment or implementation of the present subject matter described herein as “exemplary” is not necessarily to be construed as preferred or advantageous over other embodiments.
[0019] While the disclosure is susceptible to various modifications and alternative forms, specific embodiment thereof has been shown by way of example in the drawings and will be described in detail below. It should be understood, however that it is not intended to limit the disclosure to the particular forms disclosed, but on the contrary, the disclosure is to cover all modifications, equivalents, and alternatives falling within the scope of the disclosure.
[0020] The terms “comprises”, “comprising”, or any other variations thereof, are intended to cover a non-exclusive inclusion, such that a setup, device or method that comprises a list of components or steps does not include only those components or steps but may include othercomponents or steps not expressly listed or inherent to such setup or device or method. In other words, one or more elements in a system or apparatus proceeded by “comprises. . . a” does not, without more constraints, preclude the existence of other elements or additional elements in the system or apparatus.
[0021] The present disclosure provides methods and systems for providing virtual projection of Human Machine Interface (HMI) data in an industrial environment. The present disclosure provides a Head Mounted Display (HMD) device for scanning a Quick Response (QR) code located on an HMI screen of an industrial device. Based on the scanned QR code, the data associated with the industrial device is accessed by the HMD device, from the industrial device. Thereafter, the HMD device provides a virtual projection of the accessed data based on a predefined schema mapping.
[0022] In this way, the present disclosure enables operators of the industrial device to view the HMI data in a three-dimensional (3D) virtualized manner. This facilitates the operators to analyse various aspects of the industrial device in an efficient manner. Particularly, the present disclosure allows the operators to have a quick access to health information of the industrial device, thereby allowing the operators to take quick actions. The present disclosure also allows the operators to navigate across multiple values on multiple screens.
[0023] Fig. 1A illustrates an exemplary environment 100 for providing the virtual projection of the HMI data in the industrial environment, in accordance with some embodiments of the present disclosure. The exemplary environment 100 comprises a system 101 and an industrial device 105, for providing the virtual projection of the HMI data. In an embodiment, the system 101 may be configured to monitor and control industrial devices. As seen in Fig. lA, the system 101 comprises an HMD device 103 and a server 106. As seen from Fig. 1A, the industrial device 105 comprises an HMI screen 105A. In the industrial environment, a number of industrial devices are deployed throughout an industrial plant environment to monitor and control respective industrial systems or processes relating to product manufacture, machining, motion control, batch processing, material handling, or other such industrial functions. The industrial device 105 may include, but are not limited to, sensors, samplers, actuators, relays, control units, transmitters, transducers, and the like. For example, consider a sensor such as a temperature sensor measuring temperature of the industrial system such as a controller. Further, various other industrial devices such as the control unit may be configured to perform functionsbased on the measured temperature. For instance, when the temperature is above 40 degree Celsius, the control unit may be configured to turn on a cooling fan for the controller and when the temperature is below 23 degree Celsius, then the control unit may be configured to turn on a bulb for the controller, which may increase the temperature around the controller.
[0024] Further, the industrial device 105 is configured to display corresponding data on the HMI screen 105 A of the industrial device 105. In an embodiment, the data associated with the industrial device 105 includes dynamic data and static data. The dynamic data and the static data are analysed by operators of the industrial device 105 for making control decisions. The dynamic data comprises process and asset values measured by the industrial device 105. In another embodiment, the dynamic data includes telemetry data and status data related to measured or calculated values representing operational states of a controlled machine or process (e.g., tank levels, positions, alarms, etc.). In another embodiment, the dynamic data comprises time series data that is collected during operation of the industrial device 105 (e.g., status information for multiple points in time, diagnostic occurrences, etc.). In an embodiment, the static data includes configuration data associated with the industrial device 105. As shown in Fig. IB, the industrial device 105 includes the HMI screen 105A displaying a QR code 105B. For instance, the HMI screen 105 A allows an operator to view the telemetry data and the status data associated with the industrial device 105 on scanning the QR code 105B, and to control operations associated with the industrial device 105. The operator may communicate with the industrial device 105 through the HMI screen 105 A to analyse the dynamic data and static data.
[0025] The HMD device 103 may be a user wearable device such as, an Augmented Reality (AR) device, a Virtual Reality (VR) device, a Mixed Reality (MR) device, and the like. In an embodiment, the HMD device 103 is configured according to the industrial environment. For instance, AR / VR devices may be configured to provide industrial device data, notifications, and proactive guidance to the operator by modifying presentation of the HMI data for the operator. Such modifications can include, for example, superimposing data values or indicators on the operator’s view of the industrial device 105 through the HMD device 103 (or other devices capable of rendering a substantially real-time view of the corresponding industrial device). The HMD device 103 may customize the presentation of this information based on a role of the operator, a location of the operator, a line of sight of the HMD device 103, a type of the HMD device 103, and / or other contextual information associated with the operator and the HMD device 103.
[0026] In the present disclosure, the HMI screen 105 A is configured to display a QR code which provides access to the dynamic data and the static data associated with the industrial device 105. According to the present disclosure, the HMD device 103 scans the QRcode 105B. Further, the HMD device 103 accesses the data associated with the industrial device 105 from the industrial device 105 based on the scanned QR code 105B. In an embodiment, the scanned QR code 105B corresponds to a dynamic QR code associated with updates in the data along with the static data of the industrial device 105. Therefore, the industrial device 105 is configured to update the QR code 105B when there are changes in values measured by the industrial device 105. Thus, as the industrial device 105 stores the data and the measured values, the HMD device 103 is configured to extract the HMI data associated with the industrial device 105 directly from the industrial device 105 based on the scanned QR code 105B.
[0027] In an embodiment, the HMD device 103 is configured to store a predefined schema mapping in a memory 109 of the HMD device 103. In an embodiment, the predefined schema mapping may correspond to an interpretation of the HMI data that is to be displayed to the operator via the HMD device 103. For example, the predefined schema mapping may include a blueprint for displaying values measured by the industrial device 105. For instance, the blueprint may indicate the data to be represented in a tabular format comprising a first column of the virtual presentation to be indicative of serial number, a second column indicative of temperature values when the industrial device 105 may correspond to the temperature sensor and a third column indicative of possible actions to be taken by the operator. In an embodiment, the predefined schema mapping may be stored on the server 106. In an embodiment, the predefined schema mapping may be updated in the server 106 when there is an update in the interpretation of the data. The update in the interpretation of the data may occur either when the predefined schema mapping of an existing device is updated or when a new industrial device is added in the industrial environment. Further, based on the update in the server 106, the HMD device 103 is configured to be synchronized with the updated schema mapping. In an embodiment, when the accessed data is associated with the existing industrial device, the HMD device 103 accesses the predefined schema mapping from the memory 109 of the HMD device 103. In another embodiment, when the accessed data is associated with one of, the new industrial device or the existing industrial device having the updated schema mapping, then the HMD device 103 accesses the predefined schema mapping from the server 106 comprising the updated schema mapping. Upon accessing the predefined schema mapping from the server106, the HMD device 103 is configured to store the accessed predefined schema mapping in the memory 109. Therefore, in the next cycle of accessing the predefined schema mapping, the HMD device 103 may access the predefined schema mapping from the memory 109 of the HMD device 103.For example, consider a new industrial device such as a pressure sensor is introduced in the industrial environment. In such case, the HMD device 103 may not be familiar with the type of data being received from the pressure sensor device. Therefore, in such situation, the HMD device 103 is configured to access the predefined schema mapping by synchronizing with the server 106, as the HMD device 103 may not be aware of the data associated with the pressure sensor device and the interpretation of presenting such data.
[0028] Thereafter, the HMD device 103 is configured to provide a virtual projection of the accessed data based on the predefined schema mapping. The data is virtually projected in three dimensional (3D) form, thereby facilitating the operator with an easier navigation through the data. That is, the HMD device 103 provides simultaneous navigation of one or more parameters associated with the data to the operator. According to the present disclosure, the manner in which the data is projected to the operator is interpreted by the HMD device 103, based on the predefined schema mapping.
[0029] Fig. 2 illustrates a detailed diagram of the HMD device 103 for providing virtual projection of HMI data in an industrial environment, in accordance with some embodiments of the present disclosure. The HMD device 103 comprises an Input / Output (I / O) interface 107, the memory 109, and a processor 111. In some embodiments, the memory 109 may be communicatively coupled to the processor 111. The memory 109 stores instructions executable by the processor 111. The processor 111 may comprise at least one data processor for executing program components for executing user or system-generated requests. The memory 109 may be communicatively coupled to the processor 111. The memory 109 stores instructions, executable by the processor 111, which, on execution, may cause the processor 111 to provide the virtual projection of the data.
[0030] In an embodiment, the memory 109 may include data 200 and one or more modules 202. The one or more modules 202 may be configured to perform the steps of the present disclosure using the data 200, to provide the virtual projection of the data associated with the industrial device 105 in the industrial environment. In an embodiment, each of the one or more modules 202 may be a hardware unit which may be outside the memory 109 and coupled withthe HMD device 103. As used herein, the term modules 202 refers to an Application Specific Integrated Circuit (ASIC), an electronic circuit, a Field-Programmable Gate Arrays (FPGA), Programmable System-on-Chip (PSoC), a combinational logic circuit, and / or other suitable components that provide described functionality. The one or more modules 202 when configured with the described functionality defined in the present disclosure will result in a novel hardware. Further, the I / O interface 107 is coupled with the processor 111 through which an input signal or / and an output signal is communicated. For example, the HMD device 103 may communicate with the industrial device 105 and the server 106, via the I / O interface 107.
[0031] In one implementation, the modules 202 may include, for example, a scanning module 212, an accessing module 214, a projection module 216, and other modules 218. It will be appreciated that such aforementioned modules 202 may be represented as a single module or a combination of different modules. In one implementation, the data 200 may include, for example, scanned data 204, accessed data 206, projection data 208 and other data 210.
[0032] In an embodiment, the scanning module 212 is configured to scan the QR code 105B displayed on the HMI screen 105 A of the industrial device 105. In an embodiment, the QR code 105B may correspond to a dynamic QR code associated with updates in the data associated with the industrial device 105. Therefore, the scanning module 212 is configured to scan the dynamic QR code, generated by the industrial device 105, when there are changes in values measured by the industrial device 105. In an embodiment, the QR code 105B scanned by the scanning module 212 corresponds to the scanned data 204. Therefore, upon performing the scan, the scanning module 212 may send the scanned data 204 to the accessing module 214.
[0033] In an embodiment, the accessing module 214 may receive the scanned data 204 from the scanning module 212. The accessing module 214 is configured to access the data associated with the industrial device 105 based on the scanned data 204. The accessing module 214 is configured to access the data from the industrial device 105. In an embodiment, the data may correspond to static data and dynamic data. In an example, device information of the industrial device 105, such as configuration information of the industrial device 105 may correspond to the static data. In another example, changes in the measurement values measured by the industrial device 105, may correspond to the dynamic data associated with the industrial device 105. Therefore, the accessing module 214 extracts the static and the dynamic data from the industrial device 105. In an embodiment, when the industrial device 105 identifies changes in the data, the industrial device 105 is configured to update the QR code 105B and display theupdated QR code 105B on the HMI screen 105 A. Therefore, the QR code 105B is dynamically updated for each change in the data associated with the industrial device 105. In an embodiment, the data accessed by the accessing module 214 corresponds to the accessed data 206. The accessing module 214 sends the accessed data 206 to the projection module 216 for projecting to the operator.
[0034] In an embodiment, the projection module 216 receives the accessed data 206 from the accessing module 214. The projection module 216 is configured to provide a virtual projection of the accessed data based on the predefined schema mapping comprising schema defining an interpretation of the data to be projected. The predefined schema mapping is stored in one of, the memory 109 of the HMD device 103 or the server 106. In an embodiment, when the accessed data is associated with an existing industrial device, the projection module 216 is configured to access the predefined schema mapping from the memory 109 of the HMD device 103. In another embodiment, when the accessed data is associated with one of, the new industrial device or the existing industrial device having an updated schema mapping, then the projection module 216 is configured to access the predefined schema mapping by synchronizing the HMD device 103 with the server 106 comprising the updated schema mapping. In one instance, synchronization may be performed by identifying updates in the schema mapping associated with the existing industrial device. In another instance, the synchronization may be performed by identifying the schema mapping corresponding to a new industrial device based on device information of the new industrial device. Upon accessing the predefined schema mapping from the server 106, the projection module 216 is configured to store the accessed predefined schema mapping in the memory 109.
[0035] Further, the projection module 216 is configured to virtually project the data to the operator, thereby facilitating the operator with an easier navigation through the data. In an embodiment, the projection module 216 provides simultaneous navigation of one or more parameters associated with the data to the operator. In an example, when the industrial device 105 corresponds to the temperature sensor, the one or more parameters may include, but not limiting to, heat output at specific areas of the industrial system, potential malfunctions, friction points, rotational axes, and the like. The projection module 216 facilitates generation of one or more display screens through which the operator interacts with the data of the industrial device 105. For instance, the projection module 216 visualizes the data associated with the industrial device 105 using graphical representations for presenting relevant data to the operator. In anembodiment, the data projected by the projection module 216 corresponds to projection data 208.
[0036] For example, Fig. 3 shows an exemplary illustration for providing a virtual projection of the HMI data in an industrial environment. As seen from Fig. 3, an operator 300 wears an HMD device 302 for scanning a QR code 306B presented on an HMI screen 306A of an industrial device 304 such as a temperature sensor for measuring heat output of the industrial system. The scanning module 212 of the HMD device 302 initiates scanning of the QRcode 306B displayed on the HMI screen 306A of the industrial device 304. The accessing module 214 accesses the data from the industrial device 304, based on the identified QR code 306B. Post accessing the data, as shown in Fig. 3, the projection module 216 of the HMD device 302, provides a virtual projection 308 of the data to the operator 300 in a 3D holographic view. Therefore, the HMD device 302 allows the operator 300 to view the data in an efficient manner by providing the operator 300 with options to display multiple screens with data in a parallel manner. For example, the HMD device 302 may allow the operator 300 to simultaneously navigate through the one or more parameters, such as the heat output, the potential malfunctions, the friction points, and the rotational axes on the multiple screens. Thus, the present disclosure provides an improved readability of data associated with the industrial device 304. The present disclosure further avoids the need to click on buttons of the HMI screen 306A multiple times to switch from one screen to another screen, thereby facilitating the operator 300 to navigate through the data in an efficient manner. The present disclosure further provides projection of the data, from critical to naive, which is navigated easily by the operator 300 for performing control actions.
[0037] Fig. 4 shows an exemplary flow chart illustrating method steps for providing virtual projection of HMI data in the industrial environment, in accordance with some embodiments of the present disclosure. As illustrated in Fig. 4, the method 400 may comprise one or more steps. The method 400 may be described in the general context of computer executable instructions. Generally, computer executable instructions can include routines, programs, objects, components, data structures, procedures, modules, and functions, which perform particular functions or implement particular abstract data types.
[0038] The order in which the method 400 is described is not intended to be construed as a limitation, and any number of the described method blocks can be combined in any order to implement the method. Additionally, individual blocks may be deleted from the methods without departing from the scope of the subject matter described herein. Furthermore, themethod can be implemented in any suitable hardware, software, firmware, or combination thereof.
[0039] At step 402, the HMD device 103 scans the QR code 105B located on the HMI screen 105 A of the industrial device 105. The QR code 105B provides the access to the data displayed on the HMI screen 105A. In an embodiment, the data associated with the industrial device 105 comprises dynamic data and static data.
[0040] At step 404, the HMD device 103 accesses the data associated with the industrial device 105 from the industrial device 105based on the scanned QR code 105B. . In an embodiment, accessing the data comprises extracting the static data and the dynamic data from the industrial device 105.
[0041] At step 406, the HMD device 103 provides a virtual projection of the accessed data based on a predefined schema mapping. The predefined schema mapping may be accessed from one of, the HMD device or a server. In an embodiment, the predefined schema mapping is accessed from the HMD device, when the accessed data is associated with an existing industrial device. In another embodiment, the predefined schema mapping is accessed from the server, when the accessed data is associated with one of, a new industrial device or the existing industrial device having an updated schema mapping. In an embodiment, predefined schema mapping corresponds to schema defining the interpretation of the HMI data to be displayed to the operator via the HMD device 103. In an embodiment, the virtual projection of the accessed data comprises providing simultaneous navigation of one or more parameters associated with the data.COMPUTER SYSTEM
[0042] Fig. 5 illustrates a block diagram of an exemplary system 500 for implementing embodiments consistent with the present disclosure. In an embodiment, the system 500 may be used to implement the HMD device 103. Thus, the system 500 may be used for configuring components of the HMD device 103. The system 500 may comprise a Central Processing Unit 502 (also referred as “CPU” or “processor”). The processor 502 may comprise at least one data processor. The processor 502 may include specialized processing units such as integrated system (bus) controllers, memory management control units, floating point units, graphics processing units, digital signal processing units, etc.
[0043] The processor 502 may be disposed in communication with one or more input / output (I / O) devices (not shown) via I / O interface 501. The I / O interface 501 may employ communication protocols / methods such as, without limitation, audio, analog, digital, monoaural, RCA, stereo, IEEE (Institute of Electrical and Electronics Engineers) -1394, serial bus, universal serial bus (USB), infrared, PS / 2, BNC, coaxial, component, composite, digital visual interface (DVI), high-definition multimedia interface (HDMI), Radio Frequency (RF) antennas, S-Video, VGA, IEEE 816.n / b / g / n / x, Bluetooth, cellular (e.g., code-division multiple access (CDMA), high-speed packet access (HSPA+), global system for mobile communications (GSM), long-term evolution (LTE), WiMax, or the like), etc.
[0044] Using the I / O interface 501, the system 500 may communicate with one or more I / O devices. For example, the input device 507 may be an antenna, keyboard, mouse, joystick, (infrared) remote control, camera, card reader, fax machine, dongle, biometric reader, microphone, touch screen, touchpad, trackball, stylus, scanner, storage device, transceiver, video device / source, etc. The output device 508 may be a printer, fax machine, video display (e.g., cathode ray tube (CRT), liquid crystal display (LCD), light-emitting diode (LED), plasma, Plasma display panel (PDP), Organic light-emitting diode display (OLED) or the like), audio speaker, etc.
[0045] In some embodiments, the processor 502 may be disposed in communication with a memory 504 (e.g., RAM, ROM, etc. not shown in Fig. 5) via a storage interface 503. The storage interface 503 may connect to memory 504 including, without limitation, memory drives, removable disc drives, etc., employing connection protocols such as serial advanced technology attachment (SATA), Integrated Drive Electronics (IDE), IEEE-1394, Universal Serial Bus (USB), fiber channel, Small Computer Systems Interface (SCSI), etc. The memory drives may further include a drum, magnetic disc drive, magneto-optical drive, optical drive, Redundant Array of Independent Discs (RAID), solid-state memory devices, solid-state drives, etc.
[0046] The memory 504 may store a collection of program or database components, including, without limitation, user interface 505, an operating system 506, etc. In some embodiments, system 500 may store user / application data, such as, the data, variables, records, etc., as described in this disclosure. Such databases may be implemented as fault-tolerant, relational, scalable, secure databases such as Oracle ® or Sybase®.
[0047] The operating system 506 may facilitate resource management and operation of the system 500. Examples of operating systems include, without limitation, APPLE MACINTOSHROS X, UNIXR, UNIX-like system distributions (E G., BERKELEY SOFTWARE DISTRIBUTION™ (BSD), FREEBSD™, NETBSD™, OPENBSD™, etc ), LINUX DISTRIBUTIONS™ (E G., RED HAT™, UBUNTU™, KUBUNTU™, etc ), IBM™ OS / 2, MICROSOFT™ WINDOWS™ (XP™, VISTA™ / 7 / 8, 10 etc ), APPLERIOS™, GOOGLERANDROID™, BLACKBERRYROS, or the like.
[0048] Furthermore, one or more computer-readable storage media may be utilized in implementing embodiments consistent with the present disclosure. A computer-readable storage medium refers to any type of physical memory on which information or data readable by a processor may be stored. Thus, a computer-readable storage medium may store instructions for execution by one or more processors, including instructions for causing the processor(s) to perform steps or stages consistent with the embodiments described herein. The term “computer-readable medium” should be understood to include tangible items and exclude carrier waves and transient signals, i.e., be non-transitory. Examples include Random Access Memory (RAM), Read-Only Memory (ROM), volatile memory, non-volatile memory, hard drives, Compact Disc Read-Only Memory (CD ROMs), Digital Video Disc (DVDs), flash drives, disks, and any other known physical storage media.
[0049] Embodiments of the present disclosure provides methods and systems for providing virtual projection of HMI data in the industrial environment. The present disclosure allows the operator 300 to view the data in an efficient manner by providing the operator 300 with options to display multiple screens for the HMI data in a parallel manner. Therefore, the present disclosure provides an improved readability of data associated with the industrial device 105. The present disclosure further avoids the need to click on various buttons of the HMI screen 105 A multiple times to switch from one screen to another screen, thereby facilitating the operator to navigate through the data in an efficient manner. The present disclosure further provides projection of the data, from critical to naive, which is navigated easily by the operators for performing control actions in the industrial devices.
[0050] The terms "an embodiment", "embodiment", "embodiments", "the embodiment", "the embodiments", "one or more embodiments", "some embodiments", and "one embodiment"mean "one or more (but not all) embodiments of the invention(s)" unless expressly specified otherwise.
[0051] The terms "including", "comprising", “having” and variations thereof mean "including but not limited to", unless expressly specified otherwise.
[0052] The enumerated listing of items does not imply that any or all of the items are mutually exclusive, unless expressly specified otherwise. The terms "a", "an" and "the" mean "one or more", unless expressly specified otherwise.
[0053] A description of an embodiment with several components in communication with each other does not imply that all such components are required. On the contrary a variety of optional components are described to illustrate the wide variety of possible embodiments of the invention.
[0054] When a single device or article is described herein, it will be readily apparent that more than one device / article (whether or not they cooperate) may be used in place of a single device / article. Similarly, where more than one device or article is described herein (whether or not they cooperate), it will be readily apparent that a single device / article may be used in place of the more than one device or article or a different number of devices / articles may be used instead of the shown number of devices or programs. The functionality and / or the features of a device may be alternatively embodied by one or more other devices which are not explicitly described as having such functionality / features. Thus, other embodiments of the invention need not include the device itself.
[0055] The illustrated operations of Fig. 5 show certain events occurring in a certain order. In alternative embodiments, certain operations may be performed in a different order, modified, or removed. Moreover, steps may be added to the above-described logic and still conform to the described embodiments. Further, operations described herein may occur sequentially or certain operations may be processed in parallel. Yet further, operations may be performed by a single processing unit or by distributed processing units.
[0056] Finally, the language used in the specification has been principally selected for readability and instructional purposes, and it may not have been selected to delineate or circumscribe the inventive subject matter. It is therefore intended that the scope of the invention be limited not by this detailed description, but rather by any claims that issue on an applicationbased here on. Accordingly, the disclosure of the embodiments of the invention is intended to be illustrative, but not limiting, of the scope of the invention, which is set forth in the following claims.
[0057] While various aspects and embodiments have been disclosed herein, other aspects and embodiments will be apparent to those skilled in the art. The various aspects and embodiments disclosed herein are for purposes of illustration and are not intended to be limiting, with the true scope being indicated by the following claims. Referral Numerals:
Claims
CLAIMS:
1. A method of providing virtual projection of Human Machine Interface (HMI) data in an industrial environment, the method comprising: scanning, by a Head Mounted Display (HMD) device, a Quick Response (QR) code located on an HMI screen of an industrial device, wherein the QR code provides an access to data associated with the industrial device, to be displayed on the HMI screen; accessing, by the HMD device, the data from the industrial device based on the scanned QR code; and providing, by the HMD device, a virtual projection of the accessed data based on a predefined schema mapping related to projection of the accessed data.
2. The method as claimed in claim 1, wherein the data associated with the industrial device comprises dynamic data and static data.
3. The method as claimed in claim 2, wherein the dynamic data comprises process and asset values measured by the industrial device and the static data comprises information of the industrial device.
4. The method as claimed in claim 1, wherein the predefined schema mapping is accessed from one of: the HMD device, when the accessed data is associated with an existing industrial device; or a server, when the accessed data is associated with one of, a new industrial device or the existing industrial device having an updated schema mapping.
5. The method as claimed in claim 1, wherein the virtual projection of the accessed data comprises providing simultaneous navigation of one or more parameters associated with the data.
6. A Head Mounted Display (HMD) device for providing virtual projection of Human Machine Interface (HMI) data in an industrial environment, the HMD device comprises: a processor; and a memory, wherein the memory stores processor-executable instructions, which, on execution, causes the processor to:scan a Quick Response (QR) code located on an HMI screen of an industrial device, wherein the QR code provides an access to data associated with the industrial device, to be displayed on the HMI screen; access the data from the industrial device based on the scanned QR code; and provide a virtual projection of the accessed data based on a predefined schema mapping related to projection of the accessed data.
7. The HMD device as claimed in claim 6, wherein the data associated with the industrial device comprises dynamic data and static data.
8. The HMD device as claimed in claim 7, wherein the dynamic data comprises process and asset values measured by the industrial device and the static data comprises information of the industrial device.
9. The HMD device as claimed in claim 6, wherein the processor is configured to access the predefined schema mapping from one of: the HMD device, when the accessed data is associated with an existing industrial device; or a server, when the accessed data is associated with one of, a new industrial device or the existing industrial device having an updated schema mapping.
10. The HMD device as claimed in claim 6, wherein the processor is configured to perform the virtual projection of the accessed data by providing simultaneous navigation of one or more parameters associated with the data.
11. A system for providing virtual projection of Human Machine Interface (HMI) data in an industrial environment, the system comprises: a server; and a Head Mounted Display (HMD) device comprising a processor and a memory, wherein the memory stores processor-executable instructions, which, on execution, causes the processor associated with the HMD device to: scan a Quick Response (QR) code located on an HMI screen of the industrial device, wherein the QR code provides an access to data associated with the industrial device, to be displayed on the HMI screen;access the data from the industrial device based on the scanned QR code; and provide a virtual projection of the accessed data based on a predefined schema mapping related to projection of the accessed data.
12. The system as claimed in claim 11, wherein the data associated with the industrial device comprises dynamic data and static data.
13. The system as claimed in claim 12, wherein the dynamic data comprises process and asset values measured by the industrial device and the static data comprises information of the industrial device.
14. The system as claimed in claim 11, wherein the processor of the HMD device is configured to access the predefined schema mapping from one of: the HMD device, when the accessed data is associated with an existing industrial device; or the server, when the accessed data is associated with one of, a new industrial device or the existing industrial device having an updated schema mapping.
15. The system as claimed in claim 11, wherein the processor is configured to perform the virtual projection of the accessed data by providing simultaneous navigation of one or more parameters associated with the data.
Citation Information
Patent Citations
Augmented reality for sensor applications
US20180253876A1
Dynamic and soft QR based monitoring of process equipment health / status in a connected plant
US20190042819A1
Sensing device and report generation web site accessed through dynamic QR codes
US20240160682A1