Quantum, biological, computer vision, and neural network systems for the industrial Internet of Things
Patent Information
- Application Number
- JP2023568428
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2022-04-15
- Filing Date
- 2022-05-06
- Publication Date
- 2026-08-21
- Estimated Expiration
- 2042-05-06
Smart Images

Figure 0007909228000001 
Figure 0007909228000002 
Figure 0007909228000003
Abstract
Claims
1. A computer-implemented method for fault diagnosis in an industrial environment having multiple components, The present invention provides a plurality of sensors to the industrial environment, wherein each of the plurality of sensors is operably coupled to at least one of the plurality of components and is configured to generate a plurality of sensor data values in accordance with one or more sensed parameters. The process of processing the aforementioned multiple sensor data values and determining the pattern recognized therefrom, Obtaining at least one industrial environment digital twin corresponding to the aforementioned industrial environment, wherein the at least one industrial environment digital twin includes a plurality of component digital twins, each of which corresponds to one of the plurality of components in the industrial environment, and the at least one industrial environment digital twin and the plurality of component digital twins are visual digital twins configured to be rendered in a visual manner. In response to the determination of the recognized pattern of the corresponding component, update at least in part the at least one industrial environment digital twin and at least one component digital twin of the at least one component digital twin of the at least one component digital twin based on the plurality of sensor data values. Receiving a request from a client application to confirm the operating status of a specific component from the multiple components in the industrial environment, and A computer-implemented method characterized by including, in response to the received request, rendering to the client application the at least one industrial environment digital twin and the at least one component digital twin corresponding to the particular component, based on the operating state of the particular component.
2. The computer-implemented method according to claim 1, further comprising determining whether the recognized pattern is related to at least one system characteristic, which includes at least one of the following: a fault behavior of a predetermined component among the plurality of components, an out-of-spec behavior of a predetermined component among the plurality of components, or an excess value of a predetermined component among the plurality of components.
3. The computer-implemented method according to claim 2, further comprising generating a notification to the client application in response to a determination that the recognized pattern is related to at least one system characteristic of the predetermined component.
4. The computer-implemented method according to claim 3, further comprising configuring the client application to enable the selection of the notification, wherein rendering the at least one industrial environment digital twin and the at least one component digital twin corresponding to a predetermined component is in response to the selection of the notification.
5. The computer-implemented method according to claim 1, further comprising rendering the at least one industrial environment digital twin and the at least one respective component digital twin based on the recognized pattern.
6. The computer-implemented method according to claim 5, characterized in that the simulation simulates the effect of the recognized pattern on the operation of the corresponding component.
7. The computer-implemented method according to claim 5, further comprising rendering another second simulation for the at least one industrial environment digital twin and the at least one respective component digital twin based on the normal operation of the corresponding component.
8. The computer-implemented method according to claim 1, characterized in that rendering the at least one industrial environment digital twin and the at least one respective component digital twin to the client application is performed via the display device of a user device.
9. The computer-implemented method according to claim 1, characterized in that rendering the at least one industrial environment digital twin and the at least one respective component digital twin to the client application is performed via an augmented reality-enabled device.
10. The computer-implemented method according to claim 1, characterized in that rendering the at least one industrial environment digital twin and the at least one respective component digital twin to the client application is performed via a virtual reality headset.
11. The computer-implemented method according to claim 1, wherein the plurality of sensors include at least one vibration measuring sensor coupled to the motor of the corresponding component, and the one or more sensed parameters include vibration parameters related to the wobble of the motor of the corresponding component.
12. The computer-implemented method according to claim 11, characterized in that the recognized pattern includes at least one of a damaged bearing in the motor, a damaged or cracked rotor bar in the motor, misalignment in the motor, imbalance in the motor, or material accumulation in the motor.
13. The computer-implemented method according to claim 1, characterized in that the one or more sensed parameters include at least one of the following: temperature parameters, pressure parameters, humidity parameters, wind parameters, rainfall parameters, tidal parameters, storm surge parameters, cloud cover parameters, snowfall parameters, visibility parameters, radiation parameters, sound parameters, video parameters, image parameters, water level parameters, quantum parameters, flow rate parameters, signal power parameters, signal frequency parameters, motion parameters, velocity parameters, acceleration parameters, illumination level parameters, analyte concentration parameters, biological compound concentration parameters, metal concentration parameters, or organic compound concentration parameters.
14. The computer-implemented method according to claim 1, characterized in that the multiple component digital twins are generated based on the properties of the corresponding components, imported from at least one of the component manufacturers, onboard libraries, crowdsourced materials, or subscription marketplaces.
15. The computer-implemented method according to claim 2, further comprising providing an executive digital twin configured to provide predictive financial information of a predetermined component based at least in part on the at least one system characteristic determined to be associated with the recognized pattern.
16. The computer-implemented method according to claim 2, further comprising providing an operator digital twin configured to provide workflow information for performing maintenance on a predetermined component based at least partially on the at least one system characteristic determined to be associated with the recognized pattern.
17. The computer-implemented method according to claim 1, characterized in that rendering the at least one industrial environment digital twin includes rendering the at least one industrial environment digital twin as a digital representation of real-world elements.
18. The computer-implemented method according to claim 17, wherein rendering the at least one industrial environment digital twin further comprises at least one of simulating, copying, or modeling the behavior of the real-world elements in accordance with at least one of the inputs, outputs, or states of the environment.
19. The computer-implemented method according to claim 1, characterized in that rendering each of the at least one component digital twins corresponding to the particular component includes rendering each of the at least one component digital twins as a set of discrete component digital twins embedded within the at least one industrial environment digital twin.
20. The computer-implemented method according to claim 19, characterized in that rendering the set of discrete component digital twins includes rendering the set of discrete component digital twins based on the imported properties of the particular component and the past behavior of the particular component for execution in the industrial environment.
21. The computer-implemented method according to claim 1, further comprising providing an operator digital twin configured to generate a visual cue indicating a potential problem of an identified component among the plurality of components.
22. The computer-implemented method according to claim 21, wherein providing the operator digital twin further includes generating a selector for a user to select to instruct the identified component to perform maintenance, and the method further includes instructing the identified component to perform maintenance in accordance with the selection of the selector.
23. The computer-implemented method according to claim 1, further comprising generating at least one of an image or video of a component in response to instructions from a user, and further comprising detecting wobble induced by a faulty pole based on at least one of the image or video.
24. The computer-implemented method according to claim 1, characterized in that rendering the at least one industrial environment digital twin and the at least one respective component digital twin is in response to a selection of an received request.
25. The computer-implemented method according to claim 1, wherein rendering the at least one industrial environment digital twin and the at least one respective component digital twin comprises rendering the at least one industrial environment digital twin and the at least one respective component digital twin in a visual manner, the method further comprising drilling down into a particular element to display additional information about that particular element in response to a user selection on a display corresponding to the at least one industrial environment digital twin and the at least one respective component digital twin rendered in a visual manner.
26. A computing system for fault diagnosis in an industrial environment having multiple components, A plurality of sensors associated with the industrial environment, each of the plurality of sensors being operably coupled to at least one of the plurality of components, and the plurality of sensors being configured to generate a plurality of sensor data values in accordance with one or more sensed parameters, The at least one industrial environment digital twin, which corresponds to the industrial environment, wherein the at least one industrial environment digital twin includes a plurality of component digital twins, each of which corresponds to one of the plurality of components in the industrial environment, and the at least one industrial environment digital twin and the plurality of component digital twins are a visual digital twin configured to be rendered in a visual manner, Including one or more processors, The one or more processors are Processing the aforementioned multiple sensor data values and determining the pattern recognized from them, Updating the at least one industrial environment digital twin and at least one component digital twin of the plurality of component digital twins based on the plurality of sensor data values, in at least partially in response to the determination of the recognized pattern of the corresponding component. Receiving a request from a client application to confirm the operating status of a specific component from the multiple components in the industrial environment, and A system characterized in that, in response to a received request, it is configured to render, in a client application, the at least one industrial environment digital twin and the at least one component digital twin corresponding to the particular component, based on the operating state of the particular component.
27. The system according to claim 26, further comprising an executive digital twin configured to provide predictive financial information about a given component based at least in part on at least one system characteristic determined to be associated with the recognized pattern.
28. The system according to claim 26, further comprising an operator digital twin configured to provide workflow information for performing maintenance on a given component, at least partially based on at least one system characteristic determined to be associated with the recognized pattern.
29. The system according to claim 26, wherein the one or more processors are further configured to determine whether the recognized pattern is related to at least one system characteristic, which includes at least one of the following: a fault behavior for a predetermined component of the plurality of components, an out-of-spec behavior for a predetermined component of the plurality of components, or an excess value for a predetermined component of the plurality of components.
30. The system according to 29, wherein the one or more processors are further configured to generate a notification to the client application in response to a determination that the recognized pattern is related to at least one system characteristic of the predetermined component.
31. The system according to claim 30, wherein the one or more processors are further configured to configure the client application to enable the selection of the notification, and rendering the at least one industrial environment digital twin and the at least one respective component digital twin corresponding to the predetermined component is in response to the selection of the notification.
32. The system according to claim 26, characterized in that the plurality of sensors are configured to generate the plurality of sensor data values such that they include a stream of phase-based data for at least one of temperature, humidity, or load.
33. The system according to claim 26, characterized in that the plurality of sensors are configured to generate at least one of the following: a continuous stream of data over time, a nearly continuous stream of data over time, periodic readings, event-driven readings, or readings according to a selected schedule.
34. The system according to claim 26, characterized in that the plurality of sensors include a computer vision system for further determining the recognized pattern.
35. The computer vision system according to claim 34, characterized in that it includes one or more liquid lenses.
36. The system according to claim 26, wherein the plurality of sensor data values include vibration parameters related to motor wobble of at least one of the plurality of components, and the one or more processors are further configured to generate maintenance instructions based on the vibration parameters related to the wobble.
37. The system according to claim 36, wherein the one or more processors are further configured to perform at least one of the following: predicting the lifespan of the motor bearings; identifying bearing health parameters; identifying bearing performance parameters; identifying bearing wear; identifying the presence of foreign matter in the bearings; identifying bearing gaps; identifying fluid loss in fluid-coated bearings; identifying stress and strain in bent bearings; or identifying the behavior of the plurality of components at selected operating frequencies.
38. A non-transient computer-readable storage medium storing multiple instructions, wherein, when the multiple instructions are executed across one or more processors, at least a portion of the one or more processors, To provide multiple sensors in an industrial environment having multiple components, each of the multiple sensors being operably coupled to at least one of the multiple components and configured to generate multiple sensor data values in response to one or more sensed parameters, The process of processing the aforementioned multiple sensor data values and determining the pattern recognized therefrom, Obtaining at least one industrial environment digital twin corresponding to the aforementioned industrial environment, wherein the at least one industrial environment digital twin includes a plurality of component digital twins, each of which corresponds to one of the plurality of components in the industrial environment, and the at least one industrial environment digital twin and the plurality of component digital twins are visual digital twins configured to be rendered in a visual manner. In response to the determination of the recognized pattern of the corresponding component, update at least in part the at least one industrial environment digital twin and at least one component digital twin of the at least one component digital twin of the at least one component digital twin based on the plurality of sensor data values. Receiving a request from a client application to confirm the operating status of a specific component from the multiple components in the industrial environment, and In response to the received request, rendering to the client application the at least one industrial environment digital twin and the at least one component digital twin corresponding to the specific component, based on the operating state of the specific component. A storage medium characterized by performing an operation that includes such an operation.
Citation Information
Patent Citations
Method and system for industrial internet of things
JP2019523425A
Method and system for detection in an industrial internet of things data collection environment using large data sets
JP2020530159A
Machine condition monitoring using a flexible monitoring framework
US20090037155A1
System and Method to Facilitate Welding Software as a Service
US20170032281A1
Digital twin of twinned physical system
US20170286572A1