Machine state visualization
By replacing interactive graphical objects with extended objects in the graphical user interface, the problem of intuitively presenting the operational status and parameter information of complex machines was solved, enabling intuitive identification of machine behavior and improving security.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- BAKER HUGHES CO
- Filing Date
- 2022-04-22
- Publication Date
- 2026-07-07
AI Technical Summary
When monitoring the operational status and parameter information of complex machines, existing technologies are difficult to effectively combine and provide intuitive visual presentations, making it difficult for users to identify unwanted machine behaviors.
The machine's operating status is represented by interactive graphical objects in the graphical user interface, and users are allowed to interact with these objects to replace them with extended interactive objects that cover the curved portions of the operating parameters, thus displaying both operating parameters and status information simultaneously.
It provides an intuitive visual representation of machine operating status and parameters, helping users identify unwanted behaviors and improving understanding and safety of machine operation.
Smart Images

Figure CN115328589B_ABST
Abstract
Description
[0001] Related Applications
[0002] This application claims priority to U.S. Provisional Patent Application No. 63 / 178,299, filed April 22, 2021, pursuant to 35 USC §119(e), the entire contents of which are expressly incorporated herein by reference. Background Technology
[0003] Manually monitoring complex machines with several moving and / or vibrating components (e.g., turbines, compressors, etc.) can be difficult. Monitoring systems are typically used to monitor the operation of complex machines and generate alarms when the machine is not operating as required. Monitoring systems may include sensors to detect operational information associated with the machine (e.g., temperature, pressure, vibration, etc.) and relay the signals to a computing device that can visually present the operational information to designated personnel. Operational information for complex machines may include information related to multiple operating parameters and multiple operating states of the machine. Viewing trend data over time is valuable when reviewing machine operation and investigating triggered alarms. Summary of the Invention
[0004] The various aspects of the disclosed subject matter may provide one or more of the following capabilities.
[0005] In some embodiments, a method includes receiving data characterizing operating parameters of a machine, a time period during which the operating parameters are detected, and one or more operating states associated with the machine. The method further includes presenting a graph in a graphical user interface (GUI) display space, the graph including a curve characterizing the received data representing the operating parameters. A first axis of the graph indicates the time period, and a second axis of the graph indicates the operating parameters. The method further includes receiving data characterizing user interaction with a first interactive graphical object located in the GUI display space. The first interactive graphical object indicates a first operating state of the machine within a first sub-period of the time period. The method further includes replacing the first interactive graphical object with a first extended interactive graphical object. The first extended interactive graphical object covers a first portion of the curve of the operating parameters detected during the first sub-period.
[0006] One or more of the following features may be included in any feasible combination.
[0007] In some embodiments, the first sub-time period extends temporally from a first time value to a second time value. The first and second time values are included in the time period associated with the detection of the operating parameter. In some embodiments, the first extended interactive graphical object is defined by a first edge and a second edge parallel to the second axis. The first edge passes through a first point on the first axis indicating the first time value, and the second edge passes through a second point on the first axis indicating the second time value. In some embodiments, the method further includes: receiving data characterizing user interaction with the first extended interactive graphical object; and replacing the first extended interactive graphical object with the first interactive graphical object. In some embodiments, the first extended interactive graphical object and the first portion of the curve of the operating parameter are displayed simultaneously.
[0008] In some embodiments, the method further includes receiving data characterizing user interaction with a second interactive graphical object located in the GUI display space. The second interactive graphical object indicates a second operational state of the machine during a second sub-period of the time period. The method further includes replacing the second interactive graphical object with a second extended interactive graphical object. The second extended interactive graphical object covers a second portion of the curve of the operational parameter detected during the second sub-period. In some embodiments, the GUI display space includes a plurality of interactive graphical objects indicating multiple operational states of the machine and arranged parallel to the first axis. The plurality of interactive graphical objects includes the first interactive graphical object and the second interactive graphical object.
[0009] The document also describes a non-transitory computer program product (i.e., a physically embodied computer program product) that stores instructions, causing at least one data processor to perform the operations described herein when executed by one or more data processors of one or more computing systems. Similarly, a computer system is described that may include one or more data processors and memory coupled to the one or more data processors. The memory may temporarily or permanently store instructions that cause at least one processor to perform one or more of the operations described herein. Furthermore, the methods may be implemented by one or more data processors within a single computing system or by one or more data processors distributed among two or more computing systems. Such computing systems may be connected and able to exchange data and / or commands or other instructions via one or more connections, including connections on networks (e.g., the Internet, wireless wide area networks, local area networks, wide area networks, wired networks, etc.), direct connections between one or more computing systems, etc.
[0010] These and other capabilities disclosed will be more fully understood upon review of the following figures, detailed descriptions and claims. Attached Figure Description
[0011] These and other features will be more readily understood from the following detailed description taken in conjunction with the accompanying drawings, in which:
[0012] Figure 1 This is a flowchart of an exemplary method for presenting operation parameters and operation status in a graphical user interface display space;
[0013] Figure 2 An exemplary embodiment of a graphical user interface display space including operating parameters and operating status is shown;
[0014] Figure 3 Show Figure 2 An exemplary embodiment of the graphical user interface display space includes a first extended interactive graphical object; and
[0015] Figure 4 Show Figure 3 An exemplary implementation of a graphical user interface display space includes a second extended interactive graphical object. Detailed Implementation
[0016] Complex machines can operate in multiple operating states and have numerous operating parameters. Monitoring complex machines can be a challenging task. Monitoring machine operation can improve machine lifespan and the security of the facilities housing the machine. Machine operation can be detected (e.g., via sensor networks), and appropriate responses can be taken to detected undesirable behavior. Monitoring can be performed by detecting (e.g., via sensor networks) the machine's operating parameters. Detected operating parameters can be presented to the machine's user (e.g., a curve of the operating parameters as a function of time can be displayed on the GUI display space). However, simply displaying operating parameters may not provide the user with information relevant to potential undesirable machine behavior.
[0017] For example, by simply viewing the curves of operating parameters, a user might not be aware that the values of the operating parameters may be unexpected. For instance, values of operating parameters that are considered normal when the machine is in a startup state might be considered abnormal when the machine is in a steady-state operating state. Embodiments of this disclosure provide an improved graphical user interface (GUI) that can simultaneously present both operating parameter information and operating status information. This can provide the user with the expected machine operating context. Furthermore, the GUI can be interactive and allow the user to determine how the operating parameter information and operating status information are displayed.
[0018] In some implementations, operation status information may be represented as an interactive object on or adjacent to a graph, which has a curve representing the operation parameters as a function of time. A user can interact with the interactive graphical object (e.g., by clicking it). Based on this interaction, the interactive graphical object can be replaced (or expanded) with an expanded interactive graphical object that can overlay the curve of the operation parameters. The expanded interactive object can be transparent / semi-transparent, allowing simultaneous viewing of the portion of the curve that overlaps with the expanded interactive object. The user can interact with the expanded interactive graphical object (e.g., by clicking it). Based on this interaction, the expanded interactive graphical object can be replaced with the original interactive graphical object.
[0019] Figure 1 This is a flowchart of an exemplary method for presenting operating parameters and operating states in a GUI display space. At step 102, data characterizing the machine's operating parameters, the time period for detecting the operating parameters, and one or more operating states associated with the machine may be received. For example, data may be received from a sensor operatively coupled to the machine and configured to detect the operating parameters. In some embodiments, the operating parameters may be determined from one or more operating parameters of the machine. In some embodiments, data characterizing the operating parameters and / or operating states may be received from a database configured to store operating parameters and / or operating states (e.g., as a function of detection time).
[0020] At step 104, a graph comprising curves representing the received data and characterizing the operating parameters can be displayed in the GUI display space. The graph may include a first axis indicating a time period and a second axis indicating the operating parameters. Figure 2 An exemplary embodiment of a GUI display space 200 including graphics 202 is shown. Graphics 202 includes a first axis 204 indicating a time period for detecting operating parameters and / or operating states, and a second axis 206 indicating the detected operating parameters (or multiple detected operating parameters). Graphics 202 may include curves 208 representing the operating parameters as a function of time. Graphics 202 may also include curves 210 for second operating parameters and curves 212 for third operating parameters. Additionally, the GUI display space 200 may include bands 220 of interactive graphical objects 222 to 240. Various interactive graphical objects may represent the operating states of the machine (e.g., startup state, stable state, shutdown state, etc.) within various sub-periods of the time period represented by the first axis 204. In some embodiments, the color of the interactive graphical objects in band 220 may indicate the operating state represented by the interactive graphical objects.
[0021] In some implementations, the strips 220 of interactive graphical objects 222 to 240 may be oriented parallel to the first axis 204 (e.g., each interactive graphical object in the strips 220 may be oriented parallel to the first axis 204 (e.g., including an edge parallel to it)) and may be displaced from the first axis 204 (e.g., along the second axis 206). The position and length of the edge of the interactive graphical object (e.g., parallel to the first axis) relative to the first axis 204 may indicate the start time, end time, and duration of a corresponding operating state of the machine. For example, the edge 242 of interactive graphical object 226 extends from the start time to the end time. In other words, the operating state corresponding to interactive graphical object 226 occurs during a sub-period having a start time (corresponding to position 244 on the first axis 204), an end time 246 (corresponding to position 246 on the first axis 204), and a time period (or a first sub-period) 248. The edge 252 of another interactive graphical object 232 extends from a second start time to a second end time. In other words, the operation state corresponding to the interactive graphical object 232 occurs during a second sub-period having a second start time (corresponding to position 254 on the first axis 204), a second end time (corresponding to position 256 on the first axis 204), and a second duration 258.
[0022] At step 106, data characterizing a user interaction with a first interactive graphical object (e.g., interactive graphical object 226) located in the GUI display space may be received. The user interaction may include, for example, a user clicking the interactive graphical object. The first interactive graphical object may indicate a first operational state of the machine within a first sub-segment of a time period. For example, interactive graphical object 226 may indicate an operational state (e.g., startup state, shutdown state, stable state, etc.) occurring during a sub-segment having a first start time (corresponding to position 244 on the first axis 204), a first end time (corresponding to position 246 on the first axis 204), and a first sub-segment 248. The first start time and the first end time are included in the time period associated with the operational parameters received at step 102.
[0023] At step 108, the first interactive graphical object can be replaced with the first extended interactive graphical object. Figure 3An exemplary embodiment of a graphical user interface display space 200 is shown, which includes a first extended interactive graphical object 302 (replacing the first interactive graphical object 226). The first extended interactive graphical object 302 is defined by a first edge 304 and a second edge 306. The first edge and the second edge may be parallel to a second axis 206. The first edge 304 passes through a position 244 on the first axis 204 (indicating a first start time), and the second edge 306 passes through a position 246 on the first axis 204 (indicating a first end time). The first extended interactive graphical object 302 covers a first portion 308 of a curve 208 of operating parameters detected during a first sub-period.
[0024] In some implementations, data representing user interaction with a second interactive graphical object (e.g., interactive graphical object 232) located in the GUI display space may be received. User interaction may include, for example, a user clicking the second interactive graphical object. The second interactive graphical object may indicate a second operating state of the machine within a second sub-segment of a time period. For example, interactive graphical object 232 may indicate an operating state (e.g., startup state, shutdown state, stable state, etc.) occurring during a sub-segment having a second start time (corresponding to position 254 on the first axis 204), a second end time (corresponding to position 256 on the first axis 204), and a second sub-segment 258. The second start time and the second end time may be included within a time period associated with the operating parameters received in step 102. Alternatively, the second interactive graphical object may indicate a first operating state associated with the first interactive graphical object. In other words, the machine may return to the first operating state during a time period defined by the second start time and the second end time after the first sub-segment 248.
[0025] Based on user interaction with the second interactive graphical object, the second interactive graphical object can be replaced with a second extended interactive graphical object. Figure 4 An exemplary embodiment of a graphical user interface display space 200 is shown, comprising a first extended interactive graphical object 302 (replacing the first interactive graphical object 226) and a second interactive graphical object 402 (replacing the second interactive graphical object 232). The second extended interactive graphical object 402 is defined by a third edge 404 and a fourth edge 406. The third and fourth edges may be parallel to a second axis 206. The third edge 404 passes through a position 254 on the first axis 204 (indicating a second start time), and the second edge 406 passes through a position 256 on the first axis 204 (indicating a second end time). The second extended interactive graphical object 402 covers a second portion 408 of the curve 208 of the operating parameters detected during a second sub-period.
[0026] The first and second extended interactive graphical objects can be semi-transparent. In other words, the portions of curve 208 that overlap with the first and second extended graphical objects (e.g., first portion 308, second portion 408) are visible to the viewer. This allows a user to simultaneously determine the machine's operating state for the values of operating parameters within a given sub-time period (e.g., first sub-time period 248, second sub-time period 258, etc.). Knowing the operating state based on the values of the operating parameters allows the user to determine whether the machine is operating as needed. In some implementations, the color of the extended interactive graphical object can indicate the operating state represented by the interactive graphical object.
[0027] Users can interact with extended interactive graphical objects (e.g., first interactive graphical object 302, second interactive graphical object 402, etc.). For example, a user can click on an extended interactive graphical object. Data representing user interaction with the first and / or second extended interactive graphical objects (e.g., via a computing device) can be received. Based on this received data, the first and / or second extended interactive graphical objects can be replaced with the first and / or second interactive graphical objects. For example, if the user interacts with... Figure 3 Interact with the first extended interactive graphical object 302 in the GUI display 200, which can be returned to. Figure 2 In the implementation scheme, the first extended interactive graphical object 302 is replaced with the first graphical object 226.
[0028] Certain exemplary embodiments will now be described to provide a comprehensive understanding of the principles of the structure, function, manufacture, and use of the systems, apparatuses, and methods disclosed herein. One or more examples of these embodiments are illustrated in the accompanying drawings. It will be understood by those skilled in the art that the systems, apparatuses, and methods specifically described herein and illustrated in the accompanying drawings are non-limiting exemplary embodiments, and that the scope of the invention is defined only by the claims. Features shown or described in conjunction with one exemplary embodiment may be combined with features of other embodiments. Such modifications and variations are intended to be included within the scope of the invention. Furthermore, in this disclosure, similarly named components of embodiments generally have similar features, and therefore, within a specific embodiment, not every feature of every similarly named component is necessarily fully described.
[0029] The subject matter described herein may be implemented in digital electronic circuits and / or computer software, firmware, or hardware (including the structural means disclosed herein and their structural equivalents) or combinations thereof. The subject matter described herein may be implemented as one or more computer program products, such as those tangibly embodied in an information carrier (e.g., in a machine-readable storage device) or embodied in a propagated signal, for execution by or control of the operation of a data processing device (e.g., a programmable processor, a computer, or multiple computers). A computer program (also referred to as a program, software, software application, or code) may be written in any form of programming language (including compiled or interpreted languages) and may be deployed in any form, including as a standalone program or as a module, component, subroutine, or other unit suitable for a computing environment. A computer program does not necessarily correspond to a file. A program may be stored as a portion of a file containing other programs or data, in a single file dedicated to the program under consideration, or in multiple co-located files (e.g., a file storing portions of one or more modules, subroutines, or code). Computer programs can be deployed to run on one computer or on multiple computers located at one site or distributed across multiple sites and interconnected by a communication network.
[0030] The processes and logical flows described in this specification, including the method steps of the subject matter herein, can be executed by one or more programmable processors that execute one or more computer programs to perform the functions of the subject matter herein by manipulating input data and generating output. These processes and logical flows can also be executed by special-purpose logic circuitry (e.g., FPGAs (Field-Programmable Gate Arrays) or ASICs (Application-Specific Integrated Circuits)), and the devices of the subject matter herein can be implemented as special-purpose logic circuitry (e.g., FPGAs or ASICs).
[0031] By way of example, processors suitable for executing computer programs include both general-purpose microprocessors and special-purpose microprocessors, as well as any one or more processors in any kind of digital computer. Generally, a processor receives instructions and data from read-only memory or random access memory, or both. The basic components of a computer are a processor for executing instructions and one or more memory devices for storing instructions and data. Generally, a computer will also include one or more mass storage devices (e.g., magnetic disks, magneto-optical disks, or optical disks) for storing data, or operatively coupled to receive data from or / and transfer data to one or more mass storage devices (e.g., magnetic disks, magneto-optical disks, or optical disks) for storing data. Information carriers suitable for embodying computer program instructions and data include all forms of non-volatile memory, including, for example, semiconductor memory devices (e.g., EPROM, EEPROM, and flash memory devices); magnetic disks (e.g., internal hard disks or removable magnetic disks); magneto-optical disks; and optical disks (e.g., CDs and DVDs). The processor and memory may be supplemented by or incorporated into special-purpose logic circuitry.
[0032] To provide interaction with the user, the subject matter described herein can be implemented on a computer having a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user, and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the computer. Other types of devices can also be used to provide interaction with the user. For example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback), and input from the user can be received in any form, including sound, speech, or tactile input.
[0033] The techniques described herein can be implemented using one or more modules. As used herein, the term "module" refers to computing software, firmware, hardware, and / or various combinations thereof. However, at a minimum, a module should not be construed as software not implemented on hardware, firmware, or documented on a non-transitory processor-readable storage medium (i.e., a module itself is not software). In practice, a "module" will be interpreted as always including at least some physical non-transitory hardware, such as a processor or part of a computer. Two different modules may share the same physical hardware (e.g., two different modules may use the same processor and network interface). Modules described herein can be combined, integrated, separated, and / or replicated to support a variety of applications. Additionally, instead of functions performed at a particular module, or functions performed at a particular module, the functions described herein as performing at a particular module may be performed at one or more other modules and / or by one or more other devices. Furthermore, modules may be implemented locally or remotely across multiple devices and / or other components relative to each other. Additionally, modules may be moved from one device and added to another device, and / or may be included in two devices.
[0034] The subject matter described herein can be implemented in a computing system that includes back-end components (e.g., a data server), middleware components (e.g., an application server), or front-end components (e.g., a client computer with a graphical user interface or web browser through which a user interacts with embodiments of the subject matter described herein), or any combination of such back-end, middleware, and front-end components. Components of the system can be interconnected via any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include local area networks (“LANs”) and wide area networks (“WANs”), such as the Internet.
[0035] As used herein throughout the specification and claims, approximate language may be used to modify any quantitative expression that may vary but does not result in a change in the essential function associated with it. Therefore, values modified by one or more terms such as “about” and “substantially” should not be limited to the specified precise value. In at least some cases, approximate language may correspond to the precision of the instrument used to measure the value. Scope limitations may be combined and / or interchanged herein and throughout the specification and claims, and unless otherwise indicated by context or language, such scopes are identified and include all subscopes contained therein.
Claims
1. A method for monitoring the operation of a machine, the method comprising: The system receives status data characterizing multiple operating states of the machine during operation and monitoring data characterizing one or more operating parameters of the machine during the operation period from sensors coupled to the machine. A graphical user interface (GUI) displays a graph that includes curves of the status data and the monitoring data over time. A first axis of the graph indicates the operation time period and the multiple operation states within the operation time period, and a second axis of the graph indicates the one or more operation parameters. The GUI also includes a strip of interactive graphical objects that is generated along the upper edge of the graph and includes multiple interactive graphical objects arranged parallel to the first axis and along the second axis. The multiple interactive graphical objects correspond to the multiple operation states within the operation time period. Receive data representing a user interaction with a first interactive graphical object among a plurality of interactive graphical objects within the band of the interactive graphical object, the first interactive graphical object indicating a first operating state of the machine within a first sub-segment of the operating time period, wherein the first interactive graphical object is defined by a first edge indicating a first time value of the first sub-segment and a second edge indicating a second time value of the first sub-segment. as well as In response to the user interaction, the first interactive graphical object is extended downwards from the upper edge of the graphic along the first axis to form an extended view of the first interactive graphical object, wherein the extended view of the first interactive graphical object covers a first portion of the curve extending from the first time value to the second time value, such that the monitoring data detected during the first sub-period between the first time value and the second time value is visible to the user through the extended view of the first interactive graphical object.
2. The method according to claim 1, wherein, The first time value and the second time value are included in the operation time period.
3. The method according to claim 2, wherein, The expanded view of the first interactive graphical object is defined by a first edge and a second edge parallel to the second axis, wherein the first edge passes through a first point on the first axis indicating the first time value, and wherein the second edge passes through a second point on the first axis indicating the second time value.
4. The method according to claim 3, further comprising: Receive data representing user interactions with an expanded view of the first interactive graphical object; as well as The expanded view of the first interactive graphic object is shrunk back up to the top edge of the graphic, thereby forming the first interactive graphic object.
5. The method of claim 1, wherein the plurality of operating states of the machine during the operating time period include at least the machine's start-up state, shutdown state, or stable state.
6. The method according to claim 1, further comprising: Receive data representing a user interaction with a second interactive graphical object among a plurality of interactive graphical objects within the band of the interactive graphical object, the second interactive graphical object indicating a second operating state of the machine within a second sub-segment of the operating time period, wherein the second interactive graphical object is defined by a third edge indicating a third time value of the second sub-segment and a fourth edge indicating a fourth time value of the second sub-segment; as well as In response to the user interaction, the second interactive graphical object is extended downwards from the upper edge of the graph to the first axis, thereby forming an extended view of the second interactive graphical object, wherein the extended view of the second interactive graphical object covers a second portion of the curve extending from the third time value to the fourth time value, such that the monitoring data detected during the second sub-period between the third time value and the fourth time value is visible to the user through the extended view of the second interactive graphical object, such that the graphical user interface display space includes both the extended view of the first interactive graphical object and the extended view of the second interactive graphical object.
7. A system for monitoring the operation of a machine, the system comprising: At least one data processor; A memory coupled to the at least one data processor, the memory storing instructions to cause the at least one data processor to perform an operation, the operation including: The system receives status data characterizing multiple operating states of the machine during operation and monitoring data characterizing one or more operating parameters of the machine during the operation period from sensors coupled to the machine. A graphical user interface (GUI) displays a graph that includes curves of the status data and the monitoring data over time. A first axis of the graph indicates the operation time period and the multiple operation states within the operation time period, and a second axis of the graph indicates the one or more operation parameters. The GUI also includes a strip of interactive graphical objects that is generated along the upper edge of the graph and includes multiple interactive graphical objects arranged parallel to the first axis and along the second axis. The multiple interactive graphical objects correspond to the multiple operation states within the operation time period. Receive data representing a user interaction with a first interactive graphical object among a plurality of interactive graphical objects within a band of the interactive graphical object, the first interactive graphical object indicating a first operating state of the machine within a first sub-segment of the operating time period, wherein the first interactive graphical object is defined by a first edge indicating a first time value of the first sub-segment and a second edge indicating a second time value of the first sub-segment; and In response to the user interaction, the first interactive graphical object is extended downwards from the upper edge of the graphic along the first axis to form an extended view of the first interactive graphical object, wherein the extended view of the first interactive graphical object covers a first portion of the curve extending from the first time value to the second time value, such that the monitoring data detected during the first sub-period between the first time value and the second time value is visible to the user through the extended view of the first interactive graphical object.
8. The system according to claim 7, wherein, The first time value and the second time value are included in the operation time period.
9. The system according to claim 8, wherein, The expanded view of the first interactive graphical object is defined by a first edge and a second edge parallel to the second axis, wherein the first edge passes through a first point on the first axis indicating the first time value, and wherein the second edge passes through a second point on the first axis indicating the second time value.
10. The system of claim 9, wherein the operation further comprises: Receive data representing user interactions with an expanded view of the first interactive graphical object; as well as The expanded view of the first interactive graphic object is shrunk back up to the top edge of the graphic, thereby forming the first interactive graphic object.
11. The system of claim 7, wherein the plurality of operating states of the machine during the operating time period include at least the machine's startup state, shutdown state, or stable state.
12. The system of claim 7, wherein the at least one data processor is configured to perform an operation further comprising the following steps: Receive data representing user interaction with a second interactive graphical object among a plurality of interactive graphical objects within the band of the interactive graphical object, the second interactive graphical object indicating a second operating state of the machine within a second sub-segment of the operating time period, wherein the second interactive graphical object is defined by a third edge indicating a third time value of the second sub-segment and a fourth edge indicating a fourth time value of the second sub-segment; and In response to the user interaction, the second interactive graphical object is extended downwards from the upper edge of the graph to the first axis, thereby forming an extended view of the second interactive graphical object, wherein the extended view of the second interactive graphical object covers a second portion of the curve extending from the third time value to the fourth time value, such that the monitoring data detected during the second sub-period between the third time value and the fourth time value is visible to the user through the extended view of the second interactive graphical object, such that the graphical user interface display space includes both the extended view of the first interactive graphical object and the extended view of the second interactive graphical object.