Information processing device, display device, information processing method and program

Abstract

To provide an information processing device capable of shortening a time required to present slow images.SOLUTION: An information processing device for outputting slow images to a display part for simultaneously and parallelly displaying a plurality of respective slow images in a plurality of respective slow display areas includes a time range allocation part for allocating a different time range to each of the slow display areas, a slow data generation part for generating slow data being slow-motion about a first parameter for reference data with a second parameter changing according to a change in the first parameter being a time parameter or a parameter corresponding to a time in each of the slow display areas on the basis of an allocation result of the time range by the time range allocation part, and a display output part for outputting the slow images based on the slow data generated by the slow data generation part to the display part so as to be displayed in each of the slow display areas.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to an information processing device, a display device, an information processing method, and a program. [Background technology]

[0002] For example, if a moving image including an event that changes rapidly over time is displayed as is, it may not be possible for the human eye to continuously grasp the displayed content in real time. Therefore, slow-motion images are displayed at a slow-motion magnification (magnification of the playback speed) set for a reference moving image.

[0003] For example, in the image processing device described in Patent Document 1, a standard speed moving image and a slow motion image are displayed side by side at the same time in a simultaneous comparison mode (see Patent Document 1).

[0004] For example, the automatic video delay display program described in Patent Document 2 automatically plays back a slow-motion video after shooting it at a set delay time and playback speed (slow-motion magnification) in order to check the swing form (see Patent Document 2). [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Laid-Open No. 2009-49471 [Patent Document 2] Japanese Patent Application Laid-Open No. 2017-225099 Summary of the Invention [Problem to be solved by the invention]

[0006] However, with conventional techniques, when slow-motion images are played back, there is a problem in that the playback position is delayed as the playback progresses.

[0007] For example, it may take a long time to check the slow-motion images. As a specific example, if the entire duration of a reference video is covered by slow-motion playback at 1 / M times the normal speed (M is an integer), it takes M times as long to play the reference video (at standard speed).

[0008] Furthermore, for example, when slow-motion images are played back, the deviation from the playback position of the reference moving image increases as the playback progresses, which can make it difficult for viewers of these images to grasp the images. As a specific example, even if the playback display of the reference moving image (playback display at standard speed) and the playback display of the slow-motion images are performed simultaneously in parallel, the progress of the slow-motion images will cumulatively be delayed compared to the playback display at standard speed, and they will not be able to keep up with the playback position at standard speed.

[0009] However, the techniques disclosed in Patent Document 1 and Patent Document 2 cannot solve such problems. For example, even if the technology disclosed in Patent Document 2 can automatically play back slow-motion images from new time periods one after another, if the playback speed of the slow-motion images is set to half the standard speed, half (e.g., 5 seconds) of the total time (e.g., 10 seconds) will not be played back in slow motion. In this way, there are cases where the proportion of time that can be covered by slow motion is limited.

[0010] The present disclosure has been made in consideration of these circumstances, and aims to provide an information processing device, a display device, an information processing method, and a program that can shorten the time required to present slow-motion images when displaying slow-motion images relative to a reference moving image. [Means for solving the problem]

[0011] One aspect is an information processing device that outputs slow motion images to a display unit that simultaneously displays multiple slow motion images in each of multiple slow motion display areas, and is equipped with a time range allocation unit that allocates a different time range to each of the slow motion display areas, a slow motion data generation unit that generates slow motion data for each of the slow motion display areas, based on the result of the time range allocation by the time range allocation unit, for reference data in which a second parameter changes in accordance with a change in a first parameter that is a time parameter or a parameter corresponding to time, and a display output unit that outputs the slow motion images based on the slow motion data generated by the slow motion data generation unit to the display unit so as to be displayed in each of the slow motion display areas.

[0012] One aspect is a display device including the information processing device and the display unit.

[0013] One aspect is an information processing method for outputting slow motion images to a display unit that simultaneously displays multiple slow motion images in each of multiple slow motion display areas, wherein a time range allocation unit allocates a different time range to each of the slow motion display areas, a slow motion data generation unit generates, for each of the slow motion display areas based on the result of the time range allocation by the time range allocation unit, slow motion data that is slow motion with respect to a first parameter with respect to reference data in which a second parameter changes in accordance with a change in a first parameter that is a time parameter or a parameter corresponding to time, and a display output unit outputs the slow motion images based on the slow motion data generated by the slow motion data generation unit to the display unit so as to be displayed in each of the slow motion display areas.

[0014] One aspect is a program for realizing a time range allocation function that allocates different time ranges to each of a plurality of slow motion display areas on a computer that outputs the slow motion images to a display unit that simultaneously displays each of a plurality of slow motion images in parallel in each of a plurality of slow motion display areas; a slow motion data generation function that generates, for each of the slow motion display areas based on the result of the time range allocation by the time range allocation function, slow motion data that is slow motion with respect to a first parameter for reference data in which a second parameter changes in accordance with a change in a first parameter that is a time parameter or a parameter corresponding to time; and a display output function that outputs the slow motion images based on the slow motion data generated by the slow motion data generation function to the display unit so as to be displayed in each of the slow motion display areas. [Effects of the Invention]

[0015] According to the present disclosure, in an information processing device, a display device, an information processing method, and a program, when a slow-motion image is displayed relative to a reference moving image, the time required to present the slow-motion image can be shortened. [Brief explanation of the drawings]

[0016] [Figure 1] 1 is a diagram illustrating a schematic configuration example of an information processing device, a display device, and an information processing system according to an embodiment. [Figure 2] FIG. 2 is a diagram illustrating a more detailed configuration example of an information processing device, a display device, and an information processing system according to an embodiment. [Figure 3A] 1A to 1C are diagrams illustrating an example of a reference image group and a slow image group according to an embodiment. [Figure 3B] FIG. 10 is a diagram illustrating an example of a real-time display and a parallel slow-motion display according to an embodiment. [Figure 3C] FIG. 10 is a diagram showing an example of a real-time display and a parallel slow-motion display at 0.00 seconds according to the embodiment. [Figure 3D] FIG. 10 is a diagram showing an example of a real-time display and a parallel slow-motion display at 0.75 seconds according to an embodiment. [Figure 3E] FIG. 10 is a diagram showing an example of a real-time display and a parallel slow-motion display at 1.00 seconds according to an embodiment. [Figure 3F] FIG. 10 is a diagram showing an example of a real-time display and a parallel slow-motion display at 1.80 seconds according to an embodiment. [Figure 3G] FIG. 10 is a diagram showing an example of a real-time display and a parallel slow-motion display at 2.00 seconds according to an embodiment. [Figure 3H] FIG. 10 is a diagram showing an example of a real-time display and a parallel slow-motion display at 2.40 seconds according to an embodiment. [Figure 3I] FIG. 10 is a diagram showing an example of a real-time display and a parallel slow-motion display at 3.00 seconds according to an embodiment. [Figure 3J] FIG. 10 is a diagram showing an example of how a slow motion display area is reused in real time display and parallel slow motion display from 3.00 seconds onwards according to an embodiment. [Figure 4A] FIG. 10 is a diagram showing an example of a real-time display and a parallel slow-motion display according to a first modified example of the embodiment. [Figure 4B] 10A and 10B are diagrams showing specific examples of a real-time electrocardiogram image and a slow electrocardiogram image according to a first modified example of the embodiment. [Figure 4C] FIG. 10 is a diagram showing an example of a time range of parallel slow-motion display according to a comparative example to the first modified example of the embodiment. [Figure 5A] FIG. 10 is a diagram showing an example of a real-time display and a parallel slow-motion display at 0.60 seconds according to a second modified example of the embodiment. [Figure 5B] FIG. 10 is a diagram showing an example of a real-time display and a parallel slow-motion display at 2.60 seconds according to a second modified example of the embodiment. [Figure 6] FIG. 11 is a diagram showing an example of time ranges of real-time display and slow-motion display according to a third modified example of the embodiment. [Figure 7A] FIG. 13 is a diagram showing an example of a slow display according to a first example of an eighth modified example of the embodiment. [Figure 7B] FIG. 13 is a diagram showing an example of a slow display according to a second example of the eighth modified example of the embodiment. [Figure 7C] FIG. 13 is a diagram showing an example of a slow display according to a third example of the eighth modified example of the embodiment. [Figure 7D] FIG. 13 is a diagram showing an example of a slow display according to a fourth example of the eighth modified example of the embodiment. [Figure 7E] FIG. 13 is a diagram showing an example of a slow display according to a fifth example of the eighth modified example of the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0017] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. In the following, for the sake of convenience, slow motion may be abbreviated to simply "slow." For example, in the following, slow motion image, slow motion display, slow motion playback, slow motion magnification, slow motion display area, and slow motion data may be abbreviated as slow image, slow display, slow playback, slow magnification, slow display area, and slow data, respectively.

[0018] [Outline of information processing system] FIG. 1 is a diagram showing an example of a schematic configuration of an information processing device 21, a display device 11, and an information processing system 1 according to the embodiment. FIG. 1 also shows a user 41 operating the information processing device 21. In this embodiment, the user 41 is not included in the information processing system 1.

[0019] The names of the devices and systems are given for the convenience of explanation and are not necessarily limited to the names used in this embodiment. Furthermore, the device in this embodiment may be called a system, and the system in this embodiment may be called an apparatus.

[0020] The information processing system 1 includes a display device 11 and a data supply unit 12. The display device 11 includes an information processing device 21 and a display unit 22. The information processing device 21 includes an input unit 31, an output unit 32, a communication unit 33, a storage unit 34, and a control unit 35.

[0021] In this embodiment, for the sake of convenience, the information processing device 21 and the display unit 22 are shown as separate devices, but they may be configured as an integrated device. When the information processing device 21 and the display unit 22 are configured as an integrated device, the display unit 22 may be included in, for example, the output unit 32. In this case, the information processing device 21 coincides with the display device 11 in the example of FIG. The names of the devices or systems are given for the convenience of explanation in this embodiment, and any name may be used as long as the devices or systems are substantially equivalent.

[0022] The information processing device 21 is configured using, for example, a computer. The input unit 31 inputs information. The output unit 32 outputs the information. The communication unit 33 communicates information with an external device via a wired or wireless connection. In this embodiment, the input unit 31, the output unit 32, and the communication unit 33 are distinguished from each other, but it may be understood that the input unit 31 includes a receiving function (receiving unit) of the communication unit 33, and the output unit 32 includes a transmitting function (transmitting unit) of the communication unit 33, for example. The storage unit 34 stores information. The control unit 35 performs predetermined processing and control.

[0023] In this embodiment, the control unit 35 has a processor such as a CPU (Central Processing Unit), and the processor executes a predetermined program (control program) to perform predetermined processing and control. The program may be stored in the storage unit 34, for example.

[0024] In this embodiment, the data supply unit 12 and the display device 11 are shown as separate entities, but, for example, a configuration in which the data supply unit 12 is included in the information processing device 21, or a configuration in which the data supply unit 12 is not included in the information processing device 21 but is included in the display unit 22 may be used. As an example, all of the components shown as the information processing system 1 in the example of FIG. 1 may be configured as an integrated system (or may be called an integrated device).

[0025] [More detailed configuration example of information processing system] FIG. 2 is a diagram showing a more detailed example of the configuration of the information processing device 21, the display device 11, and the information processing system 1 according to the embodiment.

[0026] <Information processing device> The information processing device 21 includes a reference time image display unit 111, a time range allocation unit 112, a slow motion data generation and supply unit 113, a slow motion display processing unit 114, a screen output unit 115, a parameter storage unit 121, a processing control unit 131, and an operation unit 141. The operation unit 141 may be, for example, a keyboard or a mouse, and is operated by the user 41 . The slow motion display processing unit 114 includes a plurality of n (n is an integer of 2 or more) slow motion display units (first slow motion display unit A1 to n-th slow motion display unit An).

[0027] In this embodiment, the reference time image display unit 111, the time range allocation unit 112, the slow motion data generation and supply unit 113, and the slow motion display processing unit 114 are configured by the control unit 35 shown in FIG. 1 executing processing corresponding to each of the components. In this embodiment, the process control unit 131 is configured by the control unit 35 shown in FIG. 1 executing the corresponding control. In this embodiment, the functions of the screen output unit 115 are included in the functions of the output unit 32 shown in FIG. In this embodiment, the function of the parameter storage unit 121 is included in the function of the storage unit 34 shown in FIG. In this embodiment, the functions of the operation unit 141 are included in the functions of the input unit 31 shown in FIG. The correspondence between the components shown in FIG. 2 and the components shown in FIG. 1 is an example for the convenience of explanation in this embodiment, and is not necessarily limited to this embodiment.

[0028] <Display section> The display unit 22 is configured using a display device such as a display screen, for example. The display unit 22 includes a screen unit 161 . The screen unit 161 has one or more screens. Here, in this embodiment, when multiple images are displayed, for example, the same number of screens as the multiple images may be used, and each image may be displayed on a separate screen, or a smaller number of screens than the multiple images may be used, and the display area of one or more screens may be divided into two or more, and each image may be displayed in a separate display area (the display area of the entire screen or a partial display area into which the screen is divided). As an example, the display area of one screen may be divided into the same number of display areas as the number of images (here, for convenience of explanation, referred to as split display areas), and each image may be displayed in a respective split display area.

[0029] <Data Supply Department> The data supply unit 12 includes a data observation unit 181 and a data storage unit 182. The data observation unit 181 observes predetermined data. The data storage unit 182 stores the data of the results observed by the data observation unit 181 . Note that observation may also be called measurement, measurement, detection, or sensing, for example.

[0030] Here, the specified data may be any data, for example, data resulting from observation of information about a living organism such as a human being by a sensor, or data resulting from observation of information about an object other than a living organism by a sensor. As an example, the sensor may be a camera, in which case the predetermined data is image data. As another example, the sensor may be a heart rate sensor, a magnetic sensor, a sound sensor, or an optical sensor, etc. As a specific example, the predetermined data may be electrocardiogram data or magnetocardiogram (cardiac magnetic field) data.

[0031] The data supply unit 12 may supply data on the observed results in real time, or may store the data on the observed results and then supply it in non-real time, for example. The data supply unit 12 may be provided in, for example, a server device that can communicate with the information processing device 21.

[0032] <Outline of operations in information processing systems> Illustrated here is an outline of the operation of the information processing system 1. Note that, because an outline of the operation is illustrated here, the information processing system 1 is not limited to the operations illustrated here, and other operations may also be performed.

[0033] The data supply unit 12 outputs the observed data to the reference time image display unit 111, the time range allocation unit 112, and the slow data generation and supply unit 113, respectively. The reference time image display unit 111 generates image data for display based on the data supplied from the data supply unit 12 and outputs the image data to the screen output unit 115 . Here, the image data may be, for example, data of a moving image in which values representing the image (for example, pixel values) change over time. The image may be, for example, an image captured by a camera, or an image representing a waveform or the like detected by a predetermined sensor. In this embodiment, the reference time image display unit 111 is used as a functional unit for displaying the reference image in the reference display area. In this embodiment, an image based on data supplied by the data supply unit 12 is used as a reference image, but any data (any image) may be used as such data (reference image).

[0034] The time range allocation unit 112 allocates a time range to each of the first slow display section A1 to the n-th slow display section An based on the data supplied from the data supply unit 12. It is not necessary that all of the n slow motion display sections (first slow motion display section A1 to n-th slow motion display section An) are always used, and for example, there may be times when only a part of one or more slow motion display sections is used. In other words, the time range allocating section 112 only needs to allocate time ranges to the required number of slow motion display sections each time. In this embodiment, each slow motion display section is used as a functional section for displaying slow motion images in the corresponding slow motion display area. A time range has, for example, a start point and an end point. However, if necessary, a time range that has a start point but no end point may be used.

[0035] The slow data generating and supplying unit 113 generates and supplies slow data for each of the first slow display unit A1 to the n-th slow display unit An based on the result of the time range allocation by the time range allocation unit 112 and the data supplied from the data supplying unit 12. Here, in this embodiment, the slow motion data is data for slow motion based on data supplied from the data supply unit 12, and is, for example, data for the time range assigned to each slow motion display unit (i.e., part of the data supplied from the data supply unit 12). The slow motion data generating and supplying unit 113 may generate and supply slow motion data for the required number of slow motion display sections each time.

[0036] Each of the first slow motion display unit A1 to the n-th slow motion display unit An generates slow motion image data for display based on the slow motion data supplied from the slow motion data generating and supplying unit 113 and outputs the generated slow motion image data to the screen output unit 115. Here, the image data may be, for example, data of a moving image in which values (for example, pixel values) representing slow-motion images change as time progresses. It should be noted that the necessary number of slow display sections (one or more of the first slow display section A1 to the n-th slow display section An) may perform the process each time. Furthermore, for example, there may be a period in which no processing is performed in any of the slow display sections (first slow display section A1 to n-th slow display section An).

[0037] The screen output unit 115 outputs the display image data input from the reference time image display unit 111 to the display unit 22 so that it is displayed in a predetermined display area (reference display area) on the screen unit 161 of the display unit 22. The screen output unit 115 outputs the slow motion image data for display input from each of the first slow motion display unit A1 to the nth slow motion display unit An to the display unit 22 so that the data is displayed in a predetermined display area (each slow motion display area) on the screen unit 161 of the display unit 22.

[0038] The screen section 161 of the display unit 22 displays the image data for display from the reference time image display unit 111 input from the screen output unit 115 in the reference display area, and displays the slow motion image data for display from each slow motion display unit input from the screen output unit 115 in each slow motion display area.

[0039] In this embodiment, the image data for display from the reference time image display unit 111 is image data for real-time display, but as another example, image data for non-real-time display may also be used. In this embodiment, the slow motion image data for display from each slow motion display unit is image data for slow motion relative to the image data for display from the reference time image display unit 111. In addition, the image data for display from the reference time image display unit 111 and the slow motion image data for display from each slow motion display unit only need to be generated and displayed each time when needed, and there may be periods during which they are not generated or displayed.

[0040] The operation unit 141 accepts an operation performed by the user 41 and outputs the content of the operation to the process control unit 131 . The operation by the user 41 may be performed when necessary, but is not necessarily required.

[0041] The parameter storage unit 121 stores various parameters used in various processes in this embodiment. It should be noted that such parameters may be used if necessary for processing, but are not necessarily used. Furthermore, such parameters may be set in advance, or may be newly set or changed at any time.

[0042] The process control unit 131 controls, for example, the process performed by the time range allocation unit 112 and the process performed by the slow data generation and supply unit 113. Note that the process control unit 131 may also control other processes. Furthermore, the process control unit 131 performs processing based on the content of an operation input from the operation unit 141 . Furthermore, the processing control unit 131 reads out parameters stored in the parameter storage unit 121 as necessary, and supplies the parameters to components that require them (for example, one or both of the time range allocation unit 112 and the slow data generation and supply unit 113). In addition, the processing control unit 131 may perform processing such as setting new parameters in the parameter storage unit 121 or changing parameters stored in the parameter storage unit 121 based on, for example, the content of an operation by the user 41.

[0043] As another example of the configuration of the slow motion data generating and supplying unit 113 shown in FIG. 2, the function of the slow motion data generating and supplying unit 113 may be included in each of the first slow motion display unit A1 to the n-th slow motion display unit An. In this case, for example, the slow data generation and supply unit 113 is not provided, and the data from the data supply unit 12 and the results of the allocation of time ranges to each slow display unit by the time range allocation unit 112 are input to each slow display unit. Also, the processing control unit 131 may control each slow display unit.

[0044] [Image display example] 3A to 3J, examples of image displays are shown. It should be noted that the drawings shown in FIGS. 3A to 3J are schematic drawings for the purpose of explanation, and are not necessarily strict drawings. In this example, the data observing unit 181 observes image data showing a person running a marathon. In this example, the reference image is an image at real time (real-time image). In reality, there may be a slight time lag from the actual time due to image processing, etc., but in this embodiment, even if there is such a time lag, this time lag is ignored and the image is considered to be real time.

[0045] FIG. 3A is a diagram showing an example of a reference image group V1 and a slow image group W1 according to the embodiment. In FIG. 3A, the horizontal axis indicates real time (in this embodiment, time that coincides with actual time). In FIG. 3A, a reference image group V1 and a slow image group W1 are shown along the horizontal axis. In this example, the reference image group V1 is a group of images that match real time and are played back at standard speed (in this embodiment, the original speed, which is neither slow nor double speed). In the example of Fig. 3A, the reference image group V1 is shown for real time from 0 sec to 1 sec.

[0046] In this example, the slow motion image group W1 is a group of images that are played back at half the speed of real time. In the example of Fig. 3, the slow motion image group W1 is shown for real time periods of 0 sec to 2 sec. In this example, the slow motion images W1 advance at half the speed of the reference image group V1, so that, for example, one second of the reference image group V1 is displayed over two seconds.

[0047] FIG. 3B is a diagram showing an example of a real-time display and a parallel slow-motion display according to the embodiment. In the example of FIG. 3B, three parallel slow-motion presentations are shown at (1 / 3) speed. FIG. 3B shows a real time display area Re1, a first slow motion display area Rs1, a second slow motion display area Rs2, and a third slow motion display area Rs3. In addition, in FIG. 3B, the horizontal axis indicates real time corresponding to the real-time display area Re1. In addition, in FIG. 3B, the horizontal axis indicates the range of real time that is the target of slow display, corresponding to each slow display area (first slow display area Rs1 to third slow display area Rs3). In this embodiment, the real-time display area Re1 is an example of a reference display area. Displaying a plurality of images in parallel may be called, for example, parallel display.

[0048] The reference time image display unit 111 displays a real-time image (an example of a reference image) in the real-time display area Re1 via the screen output unit 115. The first slow motion display unit A1 displays the first slow motion image in the first slow motion display area Rs1 via the screen output unit 115. The second slow motion display unit A2 displays the second slow motion image in the second slow motion display area Rs2 via the screen output unit 115. The third slow motion display unit A3 displays the third slow motion image in the third slow motion display area Rs3 via the screen output unit 115.

[0049] Here, each of the slow motion display sections (first to third slow motion display sections A1 to A3 in this example) displays slow motion images covering different time periods in real time. In this example, the first slow motion image is a slow motion image corresponding to the reference image from 0 sec to 1 sec, the second slow motion image is a slow motion image corresponding to the reference image from 1 sec to 2 sec, and the third slow motion image is a slow motion image corresponding to the reference image from 2 sec to 3 sec. In this case, the first to third slow display sections A1 to A3 each slowly display images from different time periods in real time, and these display sections collectively cover the entirety of a predetermined period in real time (in this example, a period of 1 second).

[0050] <Example of image display transition over time> 3C to 3I, an example of the time transition of image display is shown. 3C to 3I each show three parallel slow-motion displays at (1 / 3) speed. 3C to 3I show a real time display area Re1, a first slow motion display area Rs1, a second slow motion display area Rs2, and a third slow motion display area Rs3, respectively. In addition, in each of FIGS. 3C to 3I, the horizontal axis indicates real time corresponding to the real-time display area Re1. In addition, in Figures 3C to 3I, the horizontal axis shows the real-time range that is the subject of slow display and the time of the image being displayed in slow motion (time expressed using real time) for each slow display area (first slow display area Rs1 to third slow display area Rs3). For the sake of convenience, the numerical value resulting from multiplying by (1 / 3) may be explained using an approximate value (that is, an approximate value when the value is not divisible by 3) rather than the exact solution.

[0051] FIG. 3C is a diagram showing an example of a real-time display and a parallel slow-motion display at 0.00 seconds according to the embodiment. In the real time display area Re1, a real time image Ge1 when the real time is 0.00 seconds is displayed. In the first slow motion display area Rs1, a slow motion image Gs1 corresponding to when the real time is 0.00 (=0.00 / 3) seconds is displayed. Furthermore, for example, nothing is displayed in the second slow display area Rs2 and the third slow display area Rs3.

[0052] FIG. 3D is a diagram showing an example of a real-time display and a parallel slow-motion display at 0.75 seconds according to an embodiment. In the real-time display area Re1, a real-time image Ge2 when the real time is 0.75 seconds is displayed. In the first slow motion display area Rs1, a slow motion image Gs2 corresponding to when the real time is 0.25 (=0.75 / 3) seconds is displayed. Furthermore, for example, nothing is displayed in the second slow display area Rs2 and the third slow display area Rs3.

[0053] FIG. 3E is a diagram showing an example of a real-time display and a parallel slow-motion display at 1.00 seconds according to the embodiment. In the real-time display area Re1, a real-time image Ge3 when the real time is 1.00 seconds is displayed. In the first slow motion display area Rs1, a slow motion image Gs3 corresponding to when the real time is 0.33 (=1.00 / 3) seconds is displayed. In the second slow motion display area Rs2, a slow motion image Gs21 corresponding to when the real time is 1.00 (=1.00+0.00 / 3) seconds is displayed. Furthermore, for example, nothing is displayed in the third slow display area Rs3.

[0054] FIG. 3F is a diagram showing an example of a real-time display and a parallel slow-motion display at 1.80 seconds according to the embodiment. In the real-time display area Re1, a real-time image Ge4 when the real time is 1.80 seconds is displayed. In the first slow motion display area Rs1, a slow motion image Gs4 corresponding to when the real time is 0.60 (=1.80 / 3) seconds is displayed. In the second slow motion display area Rs2, a slow motion image Gs22 corresponding to the actual time being 1.26 (=1.00+0.80 / 3) seconds is displayed. Furthermore, for example, nothing is displayed in the third slow display area Rs3.

[0055] FIG. 3G is a diagram showing an example of a real-time display and a parallel slow-motion display at 2.00 seconds according to the embodiment. In the real-time display area Re1, a real-time image Ge5 when the real time is 2.00 seconds is displayed. In the first slow motion display area Rs1, a slow motion image Gs5 corresponding to when the real time is 0.66 (=2.00 / 3) seconds is displayed. In the second slow motion display area Rs2, a slow motion image Gs23 corresponding to when the real time is 1.33 (=1.00+1.00 / 3) seconds is displayed. In the third slow motion display area Rs3, a slow motion image Gs41 corresponding to when the real time is 2.00 (=2.00+0.00 / 3) seconds is displayed.

[0056] FIG. 3H is a diagram showing an example of a real-time display and a parallel slow-motion display at 2.40 seconds according to the embodiment. In the real-time display area Re1, a real-time image Ge6 when the real time is 2.40 seconds is displayed. In the first slow motion display area Rs1, a slow motion image Gs6 corresponding to the actual time being 0.80 (=2.40 / 3) seconds is displayed. In the second slow motion display area Rs2, a slow motion image Gs24 corresponding to the actual time being 1.46 (=1.00+1.40 / 3) seconds is displayed. In the third slow motion display area Rs3, a slow motion image Gs42 corresponding to when the real time is 2.13 (=2.00+0.40 / 3) seconds is displayed.

[0057] FIG. 3I is a diagram showing an example of a real-time display and a parallel slow-motion display at 3.00 seconds according to the embodiment. In the real-time display area Re1, a real-time image Ge7 when the real time is 3.00 seconds is displayed. In the first slow motion display area Rs1, a slow motion image Gs7 corresponding to when the real time is 1.00 (=3.00 / 3) seconds is displayed. In the second slow motion display area Rs2, a slow motion image Gs25 corresponding to the actual time being 1.66 (=1.00+2.00 / 3) seconds is displayed. In the third slow motion display area Rs3, a slow motion image Gs43 corresponding to when the real time is 2.33 (=2.00+1.00 / 3) seconds is displayed.

[0058] In the example of FIG. 3I, when the real time reaches 3.00 seconds, the display of the slow motion images corresponding to the reference images from 0 seconds to 1 second in the first slow motion display area Rs1 ends. Therefore, the first slow motion display area Rs1 may be reused as a display area for the slow motion images corresponding to the next reference image from 3.00 seconds to 4.00 seconds in real time. Similarly, the second slow motion display area Rs2 may be reused as a display area for the slow motion images corresponding to the next reference image from 4.00 seconds to 5.00 seconds in real time, and the third slow motion display area Rs3 may be reused as a display area for the next reference image from 5.00 seconds to 6.00 seconds in real time. This process may be repeated.

[0059] FIG. 3J is a diagram showing an example of how the slow motion display area is reused in the real time display and the parallel slow motion display from 3.00 seconds onwards according to the embodiment. The example of FIG. 3J schematically shows how the first slow motion display area Rs1 is reused as a display area for slow motion images corresponding to the reference images from 3.00 seconds to 4.00 seconds immediately after (substantially simultaneously with) the example of FIG. 3I. In this way, in each slow display area, when the end of the assigned time range is reached, the next time range may be assigned. As another example, in each slow display area, the next time range may be assigned at a point in time after the end of the assigned time range is reached.

[0060] [First Modification] In the description of the first modified example, detailed description of the same points as in this embodiment will be omitted, and only the points that differ from this embodiment will be described in detail.

[0061] FIG. 4A is a diagram showing an example of a real-time display and a parallel slow-motion display according to a first modified example of the embodiment. Figure 4A shows three parallel slow-motion displays at (1 / 3) speed. FIG. 4A shows a real time display area Re1, a first slow motion display area Rs1, a second slow motion display area Rs2, and a third slow motion display area Rs3. In addition, in FIG. 4A, the horizontal axis indicates real time corresponding to the real-time display area Re1. In addition, in FIG. 4A, the horizontal axis indicates the time range that is the subject of slow display, corresponding to each slow display area (first slow display area Rs1 to third slow display area Rs3).

[0062] In this example, the electrocardiogram data of one person is observed by the data observation unit 181. FIG. 4A shows a waveform 1011 of electrocardiogram data. The example of FIG. 4A shows a case where the timing of one heart beat does not follow a constant cycle but fluctuates, and there is variation in the time intervals between events (in this example, one heart beat).

[0063] The time range allocation unit 112 determines the time range to which the slow motion display is to be allocated based on the timing of the event. For example, the time range allocation unit 112 analyzes the waveform 1011 of the electrocardiogram data to detect a characteristic portion, and determines a time range based on the characteristic portion. As an example, the time range allocation unit 112 may determine a time range that includes the characteristic portion at the same timing (or close timing) within the time range. Here, the characteristic portion may be, for example, a maximum point (peak) or a minimum point, or a portion that matches a waveform pattern of a predetermined time length.

[0064] In the example of FIG. 4A, the time range allocating unit 112 determines a time range B1 from 0.00 sec to 1.00 sec as a target for slow motion display. In the example of FIG. 4A, the time range allocating unit 112 determines a time range B2 to be displayed in slow motion from 1.00 sec to 2.00 sec and beyond (in this example, the range where one beat of the waveform extends beyond this range). In the example of FIG. 4A, the time range allocating unit 112 determines a time range B3 to be displayed in slow motion, within the range from 2.00 sec to 3.00 sec and beyond (in this example, the range where one beat of the waveform extends beyond this range).

[0065] In this example, each of these time ranges B1 to B3 has a time length of 0.80 seconds. Note that this time length is just an example, and other time lengths such as 1.00 seconds may also be used. In this example, these time ranges B1 to B3 have the same value, but as another example, some or all of them may have different values.

[0066] When such time ranges B1 to B3 are assigned, information based on waveform section D1 corresponding to time range B1 is displayed in chronological order in the first slow motion display area Rs1, information based on waveform section D2 corresponding to time range B2 is displayed in chronological order in the second slow motion display area Rs2, and information based on waveform section D3 corresponding to time range B3 is displayed in chronological order in the third slow motion display area Rs3. The example of Figure 4A shows waveform sections (in this example, waveform sections D1 to D3) in the time range assigned to each slow motion display area, and waveform section D1 displayed in the first slow motion display area Rs1, waveform section D2 displayed in the second slow motion display area Rs2, and waveform section D3 displayed in the third slow motion display area Rs3 all have waveforms (e.g., characteristic parts) that fit within the time range of each slow motion display area.

[0067] FIG. 4A also shows an example of the timing (timing in real time) of slow motion images displayed in parallel simultaneously in each slow motion display area, in which a slow motion image at a position corresponding to the reference image at time C1 is displayed in the first slow motion display area Rs1, a slow motion image at a position corresponding to the reference image at time C2 is displayed in the second slow motion display area Rs2, and a slow motion image at a position corresponding to the reference image at time C3 is displayed in the third slow motion display area Rs3. Note that for 3.00 seconds and onward, the time range allocating unit 112 allocates time ranges in a similar manner, and reuses each slow motion display area, for example.

[0068] FIG. 4B is a diagram showing a specific example of a real-time electrocardiogram image 1021 and a slow electrocardiogram image 1022 according to the first modified example of the embodiment. FIG. 4B shows specific examples of a real-time electrocardiogram image 1021 and a slow electrocardiogram image 1022 based on electrocardiogram data. In this example, a real-time electrocardiogram image 1021 is displayed in the real-time display area Re1, and a slow-motion electrocardiogram image 1022 (a specific example of a first slow-motion image) is displayed in the first slow-motion display area Rs1. Generally, when displaying an image (electrocardiogram map) based on electrocardiogram data, the image changes too quickly to be grasped, so slow display is sometimes desired. In such cases, it is effective to simultaneously display multiple slow images of different time ranges in parallel, as in this embodiment.

[0069] FIG. 4C is a diagram showing an example of a time range of parallel slow-motion display according to a comparative example to the first modified example of the embodiment. FIG. 4C shows a case where the first modification example is not applied. Figure 4C shows three parallel slow-motion displays at (1 / 3) speed. FIG. 4C shows a first slow motion display area Rs1, a second slow motion display area Rs2, and a third slow motion display area Rs3. In addition, in Figure 4C, for each slow display area (first slow display area Rs1 to third slow display area Rs3), the horizontal axis shows the real time range that is the subject of slow display and the time of the image being displayed in slow motion (time expressed using real time).

[0070] As shown in Figure 4C, when there is variation in the time intervals of events, if the time range allocation according to the first variant is not performed but rather the time range is allocated at fixed time intervals, the placement positions in the time ranges of the respective slow display areas of waveform section D11 corresponding to waveform section D1 in the example of Figure 4A, waveform section D12 corresponding to waveform section D2 in the example of Figure 4A, and waveform section D13 corresponding to waveform section D3 in the example of Figure 4A will not be aligned. The example of FIG. 4C shows the time ranges of the respective slow motion display areas and the relative positions of the waveform sections D11 to D13 for each time range when slow motion playback is started at 1-second intervals. The example in FIG. 4C is not included in the first modified example, but is included in this embodiment.

[0071] In this example, electrocardiogram data (repetitive waveform data) is used as an example of repeatable data, but other data may also be used, for example, image data of marathon runners may also be used. As a specific example, the form of a marathon runner may be assumed to be repeatable, for example, the movement of the runner's hands (e.g., right or left hand) or the movement of the runner's legs (e.g., right or left leg) may be assumed to be repeatable. As other specific examples, the form of a person swinging a golf or baseball, the form of a person pitching a baseball, or the form of a person swimming may be assumed to have repeatability.

[0072] In this example, when images based on repeatable data are displayed in multiple display areas (in this example, the real-time display area Re1 and the first to third slow display areas Rs1 to Rs3), images of characteristic repeatable areas can be displayed in each display area.

[0073] [Second Modification] In the description of the second modified example, detailed description of the same points as in this embodiment will be omitted, and only the points that differ from this embodiment will be described in detail.

[0074] FIG. 5A is a diagram showing an example of a real-time display and a parallel slow-motion display at 0.60 seconds according to a second modified example of the embodiment. In this example, the data observing unit 181 observes image data showing a person running a marathon.

[0075] Figure 5A shows three parallel slow-motion displays at (1 / 3) speed. FIG. 5A shows a real time display area Re1, a first slow motion display area Rs1, a second slow motion display area Rs2, and a third slow motion display area Rs3. In addition, in FIG. 5A, the horizontal axis indicates real time corresponding to the real-time display area Re1. In addition, in FIG. 5A, the horizontal axis indicates the range of real time that is the target of slow display, corresponding to each slow display area (first slow display area Rs1 to third slow display area Rs3).

[0076] In this example, in a plurality of parallel slow-motion images, the timings at which the slow-motion images of corresponding characteristic portions start to be displayed are synchronized. In the real-time display area Re1, a real-time image Ge111 when the real time is 0.60 seconds is displayed. In the example of FIG. 5A, even at 0.60 seconds, the display of the first slow motion image in the first slow motion display area Rs1 has not started and the display is still on standby.

[0077] FIG. 5B is a diagram showing an example of a real-time display and a parallel slow-motion display at 2.60 seconds according to a second modified example of the embodiment. FIG. 5B shows various information similar to that shown in FIG. 5A for the situation at 2.60 seconds. In addition, in Figure 5B, for each slow display area (first slow display area Rs1 to third slow display area Rs3), the horizontal axis shows the real time range that is the subject of slow display and the time of the image being displayed in slow motion (time expressed using real time).

[0078] In the real-time display area Re1, a real-time image Ge112 when the real time is 2.60 seconds is displayed. In the first slow motion display area Rs1, a slow motion image Gs111 corresponding to when the real time is 0.20 (=0.60 / 3) seconds is displayed. In the second slow motion display area Rs2, a slow motion image Gs121 corresponding to the actual time being 1.20 (=1.00+0.60 / 3) seconds is displayed. In the third slow motion display area Rs3, a slow motion image Gs131 corresponding to when the real time is 2.20 (=2.00+0.60 / 3) seconds is displayed.

[0079] In this example, when the display time of the slow images in the last slow display area (in this example, the third slow display area Rs3) among the multiple slow display areas reaches 2.00 seconds in real time in this example, all slow display areas (in this example, the first slow display area Rs1 to the third slow display area Rs3) simultaneously start displaying the slow images. In the example of FIG. 5B, the timing at which slow motion images corresponding to the reference image from 0.00 sec to 1.00 sec are displayed in the first slow motion display area Rs1, the timing at which slow motion images corresponding to the reference image from 1.00 sec to 2.00 sec are displayed in the second slow motion display area Rs2, and the timing at which slow motion images corresponding to the reference image from 2.00 sec to 3.00 sec are displayed in the third slow motion display area Rs3 are all synchronized.

[0080] Furthermore, when the slow display of the time range allocated to each slow display area (in this example, the time range obtained by dividing the real time from 0.00 sec to 3.00 sec into three equal parts) ends, the time range allocation unit 112 updates the time range allocated to each slow display area to the next time range (in this example, the time range obtained by dividing the real time from 3.00 sec to 6.00 sec into three equal parts), and performs slow playback in a similar manner.

[0081] That is, in this example, the time range of 3.00 sec to 4.00 sec is assigned to the first slow display region Rs1, the time range of 4.00 sec to 5.00 sec is assigned to the second slow display region Rs2, and the time range of 5.00 sec to 6.00 sec is assigned to the third slow display region Rs3. In this case, when the display time of the slow images in the last slow display area (in this example, the third slow display area Rs3) among the multiple slow display areas reaches (in this example, 5.00 seconds in real time), all slow display areas (in this example, the first slow display area Rs1 to the third slow display area Rs3) simultaneously start displaying the slow images.

[0082] In this example, the first simultaneous display of slow motion images starts at 2.00 seconds and ends at 5.00 seconds. In this example, the second simultaneous display of slow motion images starts at 5.00 seconds and ends at 8.00 seconds. The same applies to the third time and beyond. In this way, in this example, the end time of simultaneous display of slow motion images and the start time of the next image match, so that the images can be displayed cyclically.

[0083] In this example, the start time of the first slow motion display after 0.00 seconds is set to 2.00 seconds, but as another example, it may be set to any time after 2.00 seconds.

[0084] <Combination of the first and second modified examples> As in the first modified example, when the time intervals of events vary and the time range displayed in each slow motion display area is set to a time range based on a characteristic part of the waveform, applying the second modified example will, for example, cause the waveforms in the time range displayed in each slow motion display area to be the same waveform (or similar waveforms), and the waveform positions (positions in each time range) displayed at the same timing in each slow motion display area to be synchronized. As a result, slow motion images showing the same waveform (or similar waveforms) are displayed in parallel simultaneously in multiple slow motion display areas. Therefore, in this example, when images based on repeatable data are displayed in multiple display areas (in this example, the real-time display area Re1 and the first to third slow display areas Rs1 to Rs3), images of characteristic repeatable areas can be displayed in each display area at the same time. In this example as well, once all the slow display areas are in a state where slow display is possible, all the slow display areas start displaying slow images simultaneously.

[0085] [Third Modification] In the description of the third modified example, detailed description of the same points as in this embodiment will be omitted, and only the points that differ from this embodiment will be described in detail.

[0086] FIG. 6 is a diagram showing an example of time ranges of real-time display and slow-motion display according to the third modified example of the embodiment. Figure 6 shows three parallel slow-motion displays at (1 / 3) speed. FIG. 6 shows a real-time display area Re1, a first slow motion display area Rs1, a second slow motion display area Rs2, and a third slow motion display area Rs3. In addition, in FIG. 6, the horizontal axis indicates real time corresponding to the real-time display area Re1.

[0087] In this example, the time range allocation unit 112 sets the start time (real time) of the time range for slow playback in response to a predetermined start operation (start instruction) by the user 41. The predetermined start operation is not particularly limited, and may be, for example, pressing a predetermined start button.

[0088] In the example of FIG. 6, the user 41 performs a predetermined start operation at time C11, thereby setting the start time of time range B11. Furthermore, the user 41 performs a predetermined start operation at time C12, thereby setting the start time of time range B12. Furthermore, the user 41 performs a predetermined start operation at time C13, thereby setting the start time of time range B13. Furthermore, the user 41 performs a predetermined start operation at time C14, thereby setting the start time of time range B14.

[0089] In this example, when a real-time image is being displayed (played back) in the real-time display area Re1, if the user 41 performs a predetermined start operation, a new slow motion playback is started with the timing of the start operation as the start timing. Note that the display of the real-time image (playback of the real-time image) may be started, for example, in response to an operation by the user 41, or may be started at some other opportunity.

[0090] The end times of the respective time ranges B11 to B14 may be determined by any method, that is, various conditions may be used as the end conditions for each slow motion playback. For example, the duration of each of the time ranges B11 to B14 may be set in advance, and each time range B11 to B14 may end when that duration has elapsed from its start time. The duration may be constant for all of the time ranges B11 to B14, or may differ for each of the time ranges B11 to B14.

[0091] As another example, after slow images (for convenience of explanation, referred to as slow images α1) start to be displayed in one slow display area, the display of slow images α1 may end when it is time to start displaying the next slow images (another slow images) in that slow display area. As a specific example, after slow images of a first time range start to be displayed in the first slow display area Rs1, when slow images of a second time range are to be displayed in the first slow display area Rs1, that time may be set as the end time of the first time range.

[0092] As another example, the time range allocation unit 112 may set the end time (real time) of the time range for slow playback in response to a predetermined end operation (end instruction) by the user 41. The predetermined end operation is not particularly limited, and may be, for example, pressing a predetermined end button. The end operation, end instruction, and end button may be called, for example, a stop operation, a stop instruction, and a stop button, respectively.

[0093] Here, there is no particular limitation on the method for changing the slow motion display area each time the user 41 performs a start operation. As an example, a method may be used in which a predetermined display area (for example, the display area of one screen) is first prepared, and then each time a start operation is performed by the user 41, the display area is divided into the required number of display areas (split display areas), in which case the maximum number of divisions may be predetermined. As another example, a method may be used in which a specified number of display areas (split display areas) are prepared in advance by dividing a predetermined display area, and the specified number of display areas (split display areas) are used in turn each time the user 41 performs a start operation. In these examples, a divided display area that has been used once may be reused.

[0094] Furthermore, each of the time ranges B11 to B14 may have a time interval greater than 0 between it and the preceding and succeeding time ranges (i.e., may be separated from the preceding and succeeding time ranges), or may have a time that overlaps with the preceding and succeeding time ranges.

[0095] [Fourth Modification] In the description of the fourth modified example, detailed description of the same points as in this embodiment will be omitted, and only the points that differ from this embodiment will be described in detail.

[0096] In the third modified example, the user 41 specifies the start time or end time of the time range for slow playback while the real-time image is being displayed. The user 41 specifies the start time or end time of the time range for slow playback, for example, by performing a predetermined operation.

[0097] As another example, the user 41 may specify in advance the start time or end time of the time range for slow playback when the real-time image is not being displayed. In this case, for example, the user 41 may be aware in advance of the characteristics of the image observed as the real-time image. As a specific example, a condition may be used in which electrocardiogram data is played back in slow motion only within a time range in which a predetermined characteristic waveform is present, or in which image data of a person running a marathon is played back in slow motion only within a time range in which the person is present in a predetermined running section.

[0098] As another example, the user 41 may specify the start time or end time of a time range in which slow playback is not performed while a real-time image is being displayed. In this case, the time range allocation unit 112 allocates a time range in accordance with the instruction of the user 41 so that slow playback is not performed for the corresponding time range. Here, the end time of the range of time in which slow playback is not performed may be determined by various methods, for example, as in the third modified example.

[0099] As another example, the user 41 may specify in advance the start time or end time of a time range in which slow playback will not be performed when a real-time image is not being displayed. In this case, the time range allocation unit 112 allocates a time range in accordance with the instruction of the user 41 so that slow playback will not be performed for the corresponding time range. Here, the end time of the range of time in which slow playback is not performed may be determined by various methods, for example, as in the third modified example.

[0100] As a specific example, a setting may be used in which slow playback is not performed for a time range in which a predetermined characteristic waveform does not exist in electrocardiogram data, or in which slow playback is not performed for a time range in image data of a person running a marathon in which the person is present in a predetermined running section (or outside that running section).

[0101] [Fifth Modification] In the description of the fifth modified example, detailed description of the same points as in this embodiment will be omitted, and only the points that differ from this embodiment will be described in detail.

[0102] In the above, when slow images are displayed in multiple slow display areas, the slow magnification is the same for all of them. However, as another example, the slow magnification of the slow images displayed in some or all of the slow display areas may be different. For example, slow-motion images at (1 / 2) speed may be displayed in the first slow-motion display area Rs1, and slow-motion images at (1 / 3) speed may be displayed in the second slow-motion display area Rs2 and the third slow-motion display area Rs3. For example, slow-motion images at (1 / 2) speed may be displayed in the first slow-motion display area Rs1, slow-motion images at (1 / 3) speed may be displayed in the second slow-motion display area Rs2, and slow-motion images at (1 / 4) speed may be displayed in the third slow-motion display area Rs3.

[0103] Here, the magnification of the slow motion in each slow motion display area may be set in response to an operation by the user 41, for example, or may be set automatically in accordance with a predetermined rule.

[0104] [Sixth Modification] In the description of the sixth modified example, detailed description of the same points as in this embodiment will be omitted, and only the points that differ from this embodiment will be described in detail.

[0105] The above describes the case where the reference image used as the basis for slow playback is a real-time image, but the reference image may also be, for example, an image based on data observed in the past and stored in a specified memory unit. The storage unit may be, for example, the data storage unit 182 of the data supply unit 12, or the storage unit 34 of the information processing device 21, or may be a storage unit such as another database.

[0106] In the above, the reference image serving as the basis for slow playback is an image (standard image) played at a standard speed, but the reference image may also be, for example, a slow image or a high-speed image (fast-forward image). For example, a configuration may be used in which the reference image is a slow motion image, and a plurality of slow motion images at a slower magnification than the reference image (slow motion image) are displayed in parallel. Also, for example, a configuration may be used in which the reference image is a high-speed image, and a plurality of slow-motion images at a slow magnification are displayed in parallel with respect to the reference image (high-speed image).

[0107] [Seventh Modification] In the explanation of the seventh modification, detailed explanation of the points similar to the present embodiment will be omitted, and points different from the present embodiment will be explained in detail.

[0108] The processing control unit 131 may select, manually or automatically by the user 41, a time range to actually allocate to slow motion (or a time range not actually allocated to slow motion) from among the time ranges allocated by the time range allocation unit 112. For example, if you only need to view slow-motion images of one beat out of every two beats in an electrocardiogram, or if you only need to view slow-motion images of events that meet certain conditions, you can select the time range for slow-motion playback. Here, an event that satisfies a certain condition may be, for example, an event that satisfies the condition that the waveform is normal, or an event that satisfies the condition that the waveform is abnormal. An abnormal waveform may be, for example, a portion where noise exceeds a predetermined threshold. Also, for example, a selection may be made such that slow display is not performed for a time range in which a desired event does not occur within an already allocated time range.

[0109] In a slow motion display area where slow motion display is not performed due to an operation by the user 41 or automatically, for example, nothing may be displayed during the time range where slow motion display is not performed, or the slow motion display area may be used to display slow motion images of another time range.

[0110] [Eighth Modification] In the description of the eighth modified example, detailed description of the same points as in this embodiment will be omitted, and only the points that differ from this embodiment will be described in detail. In the eighth modified example, examples of information that may be displayed in the slow display area will be shown with reference to each of FIGS. 7A to 7E. 7A to 7E, the slow motion images displayed in each slow motion display area are not shown. The information according to the eighth modified example displayed in each example may be displayed in a position that does not overlap with the slow motion images, or may be displayed in a position that overlaps with the slow motion images.

[0111] FIG. 7A is a diagram showing an example of slow display according to a first example of the eighth modified example of the embodiment. FIG. 7A shows a first slow motion display area Rs1, a second slow motion display area Rs2, and a third slow motion display area Rs3. A predetermined mark 2011 is displayed in the first slow display area Rs1. Mark 2011 indicates that, among all the slow motion display areas (three slow motion display areas in this example), this is the slow motion display area that displays the slow motion image that corresponds to the most recent real time. The example in FIG. 7A indicates that the real time corresponding to the slow motion image displayed in the first slow motion display area Rs1 is the most recent time. When the time range of the slow motion images displayed in each slow motion display area is switched, the slow motion display area in which the mark 2011 is displayed is also switched.

[0112] FIG. 7B is a diagram showing an example of a slow display according to a second example of the eighth modified example of the embodiment. FIG. 7B shows a first slow motion display area Rs1, a second slow motion display area Rs2, and a third slow motion display area Rs3. In the second slow display area Rs2, a mark 2111 indicating that it is the first is displayed. In the third slow display area Rs3, a mark 2112 indicating that it is second is displayed. In the first slow display area Rs1, a mark 2113 indicating that it is the third is displayed. In the example of Figure 7B, the times (times expressed using real time) corresponding to the slow images displayed in the three slow display areas are, from newest to oldest, the second slow display area Rs2, the third slow display area Rs3, and the first slow display area Rs1. When the time range of the slow motion images displayed in each slow motion display area is switched, the slow motion display areas in which the marks 2111 to 2113 are displayed are switched. Here, in this example, information representing the order of time (time expressed using real time) from newest to oldest is displayed, but as another example, information representing the order of time (time expressed using real time) from oldest to newest may be displayed.

[0113] FIG. 7C is a diagram showing an example of slow display according to a third example of the eighth modified example of the embodiment. FIG. 7C shows a first slow motion display area Rs1, a second slow motion display area Rs2, and a third slow motion display area Rs3. In the first slow display area Rs1, a mark 2211 indicating that it is the 61st one is displayed. In the second slow display area Rs2, a mark 2212 indicating that it is the 62nd one is displayed. In the third slow display area Rs3, a mark 2213 indicating that it is the 63rd one is displayed. Here, the numbers indicated by the marks 2211 to 2213 indicate the total number of slow motion images since the slow motion playback of the target reference image started. Here, in this example, information representing the order of time (time expressed using real time) from oldest to newest is displayed, but as another example, information representing the order of time (time expressed using real time) from newest to oldest may be displayed.

[0114] Furthermore, for example, if a time range for displaying slow motion images is once assigned, but slow motion images are not displayed during that time range due to an operation by user 41 or an automatic decision, the number of slow motion images may be counted as one time and may be included in the total number of times, or may not be included in the total number of times. When the time range of the slow motion images displayed in each slow motion display area is switched, the values (numbers) of the marks 2211 to 2213 are switched.

[0115] FIG. 7D is a diagram showing an example of slow display according to a fourth example of the eighth modified example of the embodiment. FIG. 7D shows the first slow display area Rs1. The first slow motion display area Rs1 displays a time range B111 of the slow motion images displayed in the first slow motion display area Rs1 and a currently displayed position P1 within that time range B111. Here, the time range B111 and the position P1 may be displayed at any position in the first slow display area Rs1, for example, at any of the top, bottom, left, and right positions.

[0116] The time range B111 may be represented, for example, by a bar. The position P1 may also be represented by, for example, a line segment or a predetermined figure. As the time of the slow motion images displayed in the first slow motion display area Rs1 advances, the position P1 advances. As a specific example, one end of a bar indicating the time range B111 may be 0% and the other end may be 100%, and the position P1 may be initially set to the 0% position and then moved from the 0% position to the 100% position. In this case, when a change is made to another time range, the position P1 is again initially set to the 0% position. Here, in the example of FIG. 7D, the first slow display area Rs1 is illustrated, but the same applies to other slow display areas (for example, the second slow display area Rs2, the third slow display area Rs3).

[0117] FIG. 7E is a diagram showing an example of slow display according to a fifth example of the eighth modified example of the embodiment. FIG. 7E shows the first slow display area Rs1. In the first slow display area Rs1, time information 2511 and time information 2512 are displayed. The time information 2511 indicates absolute time, for example, a reference time (in this example, real time). The time information 2512 indicates a relative time, for example, the time elapsed from a predetermined reference time. As a specific example, in the case of a marathon, the predetermined reference time may be the start time of the marathon race.

[0118] As the time of the slow motion images displayed in the first slow motion display area Rs1 advances, the time information 2511 and the time information 2512 are updated. Furthermore, the example of FIG. 7E shows a case where both time information 2511 and time information 2512 are displayed in one slow display area (in this example, the first slow display area Rs1), but as another example, a mode in which only one of the two is displayed may be used. Furthermore, in this example, the absolute time represents real-time time, but as another example, when the reference image is a recorded image, the absolute time may be the time when the image was recorded (or the time when the image was photographed). Here, in the example of FIG. 7E, the first slow display area Rs1 is illustrated, but the same applies to other slow display areas (for example, the second slow display area Rs2, the third slow display area Rs3).

[0119] <Regarding the above modifications> The functions for realizing the various modified examples shown above may be applied to the information processing system 1, the display device 11, and the information processing device 21 individually, for example, as functions relating to each modified example, or may be applied to the information processing system 1, the display device 11, and the information processing device 21 in combination with functions relating to any two or more modified examples.

[0120] [Regarding the above embodiment] As described above, in the information processing system 1 of this embodiment, when displaying a slow motion image relative to a reference moving image, the time required to present the slow motion image (in this embodiment, the information presentation is a combination of multiple slow motion displays displayed simultaneously in parallel) can be shortened.

[0121] Furthermore, in the information processing system 1 according to the present embodiment, by starting the display of a plurality of slow-motion images one after another, it is possible to suppress the delay from the latest time of the reference video image within a certain range. As a result, for example, even in slow-motion playback, it is possible to suppress the delay from the latest time (actual time in the case of real-time display) within a certain range, and it is possible to perform slow-motion display that covers the entire time range without omission.

[0122] In the information processing system 1 according to this embodiment, for example, when displaying data in real time while also displaying the same data in slow motion at the same time, the delay of each slow motion image increases as time progresses, but by displaying multiple slow motion images simultaneously in parallel, it is possible to display slow motion images of the required time range while keeping the overall delay from real time within a certain range. In this way, for example, the entire time range of the data can be viewed in slow motion while continuing to follow real time.

[0123] In this embodiment, for example, it is possible to achieve effects that cannot be obtained by simply performing slow motion playback separately from real-time playback, or by simply performing slow motion playback during a specified limited time period during real-time playback. For example, in this embodiment, a plurality of slow motion images are simultaneously displayed in parallel, and real time images are played back at real time speed while slow motion images are played back at slow motion speed, and the delay between the slow motion images and the real time images is kept below a certain level, making it easy to continuously observe them. In this way, in this embodiment, a plurality of slow motion images can be simultaneously displayed in parallel while maintaining the playback speed of the real time display. In this embodiment, it is possible to display slow motion images covering the entire time range while following a reference time.

[0124] In the information processing system 1 according to this embodiment, for example, when the interval between events included in the observed data cannot be controlled, the data portion (time range) to be displayed in slow motion can be assigned according to the position of the event (in this embodiment, the time position), thereby adjusting the time range in which the slow motion display is performed to the time range in which the event exists. In this way, the time range can be assigned according to the nature of the event, enabling more effective information presentation. In this way, in the information processing system 1 according to this embodiment, for example, the timing at which the display of multiple slow motion images starts may be adjusted, and for example, it is possible to synchronize and display the same event in multiple slow motion images in parallel.

[0125] In this embodiment, it is possible to select whether the timing of displaying each of the multiple slow motion images displayed simultaneously is sequential or simultaneous. For example, in this embodiment, it is possible to select whether to display slow-motion images for a time range assigned according to a fixed rule unrelated to an event, or to display slow-motion images for a time range assigned according to a rule according to an event. In this way, in this embodiment, even if the timing of an event included in observed data cannot be adjusted, it is possible to automatically or manually set a time range suited to each event. In this embodiment, by comparing a plurality of slow motion images that are simultaneously displayed in parallel, it is possible to easily and effectively compare repetitive events with each other.

[0126] In the information processing system 1 according to this embodiment, various aspects of the slow motion display may be set in accordance with the operation performed by the user 41. In this way, time ranges may be allocated in accordance with the focus of the user 41, making it possible to present information more effectively.

[0127] Furthermore, a configuration example in this embodiment will be shown. The display device 11 in the information processing system 1 according to this embodiment is equipped with a display unit 22 that can simultaneously display multiple slow motion images in parallel in addition to real-time images, which are images of a progressing reference time (a reference time, which in this embodiment is actual time) for data progressing in the time direction. The display unit 22 has a plurality of display areas. In this embodiment, the display areas include a real-time display area and a plurality of slow motion display areas. The display device may be called, for example, an image display device. The display unit may also be called, for example, an image display unit.

[0128] The information processing system 1 according to this embodiment includes a data supply unit 12 that supplies data. In this embodiment, the data supply unit 12 supplies data to each unit (one or more predetermined components) of the information processing device 21 included in the display device 11.

[0129] In the information processing device 21, the time range allocation unit 112 allocates different time ranges (time ranges that each slow motion display area is responsible for) to each slow motion display area so as to keep the delay from the reference time (a reference time, which in this embodiment is the actual time) to the time of the latest slow motion image (here, the time at the corresponding position on the reference time) below a certain level, and issues an instruction to start slow motion playback. In the information processing device 21, the slow motion data generation and supply unit 113 generates slow motion images based on the data from the data supply unit 12, the time range allocation unit 112's time range allocation and an instruction to start slow motion playback, and supplies the slow motion images to each of the multiple slow motion display areas. In the information processing device 21, the screen output unit 115 outputs an image to be displayed on the display unit 22 to the screen of the screen unit 161 of the display unit 22.

[0130] Therefore, in the information processing system 1, display device 11, and information processing device 21 of this embodiment, by parallelizing slow motion displays that cover different time periods, it is possible to cover all time periods or a desired part of time periods with slow motion displays while following real time within a certain delay without increasing the delay from real time.

[0131] Here, the data that progresses in the time direction may be, for example, data whose value originally changes as time progresses, or data that does not originally have an element of time progression but is replaced with data that progresses in the time direction. For example, for data of multiple pixels arranged both vertically and horizontally, one of the vertical and horizontal directions may be regarded as the time direction, and the data of the group of pixels arranged in the other direction may be regarded as a value that changes as time progresses. Note that the number of the group of pixels arranged in the other direction is, for example, two or more, but may also be one pixel.

[0132] Furthermore, in this embodiment, a case has been shown in which both an image of a reference time (a reference time, which in this embodiment is actual time) and a plurality of slow motion images are simultaneously displayed in parallel, but, for example, a mode may be used in which a plurality of slow motion images are simultaneously displayed in parallel without displaying an image of the reference time.

[0133] Furthermore, in this embodiment, a case has been shown in which a time range is assigned to each slow motion display area using the condition that the delay from the reference time (a reference time, which in this embodiment is the actual time) to the time of the latest slow motion image (here, the time at the corresponding position on the reference time) is kept below a certain level, but a configuration in which such a condition is not used may also be used.

[0134] In addition, in the present embodiment, a real-time image is used as the image at the reference time, but the present invention is not limited to this, and an image that is not real-time (non-real-time image) may be used. For example, an image based on data that has been temporarily stored in a storage unit may be used as the non-real-time image.

[0135] In the information processing system 1, the display device 11, and the information processing device 21 according to this embodiment, the reference time may progress at the same speed as the progress of real time. Therefore, in the information processing system 1, the display device 11, and the information processing device 21 according to this embodiment, it is possible to follow the display in slow motion in parallel with the real-time reproduction. Here, the actual time is the time of a real-time clock.

[0136] In the information processing system 1, the display device 11, and the information processing device 21 according to this embodiment, the reference time may progress at a speed different from that of the actual time. Therefore, in the information processing system 1, display device 11, and information processing device 21 according to this embodiment, for example, when performing subsequent playback, the main playback may not be real-time playback but may also be slow-motion playback, and all of the other parallel slow-motion playbacks may be multiplied by that multiplier (the multiplier of the main slow-motion playback). In other words, in the information processing system 1, display device 11, and information processing device 21 according to this embodiment, the slow-motion playback is used as a reference, and multiple slow-motion playbacks relative to it can be displayed in parallel.

[0137] Here, for example, if the image at the reference time (reference image) is a recorded image, the reference time is a time in the past. As the reference image, instead of a normal speed image, for example, a slow motion image may be used, or an image with a speed greater than 1 may be used.

[0138] In the information processing system 1, the display device 11, and the information processing device 21 according to this embodiment, data at a reference time is displayed in a predetermined display area of the display unit 22 in parallel. Therefore, in the information processing system 1, the display device 11, and the information processing device 21 according to this embodiment, the information on the reference time can also be checked at all times.

[0139] In the information processing system 1, display device 11, and information processing device 21 according to this embodiment, after the display of the time range allocated to one slow display area is completed, the time range allocation unit 112 allocates a new time range to that slow display area and displays it from the beginning of that time range. Therefore, the information processing system 1, the display device 11, and the information processing device 21 according to this embodiment can automatically switch between slow motion playback time periods within a limited display area to cover different time periods one after another. In other words, this embodiment allows the slow motion display area to be reused (for example, refreshed). The slow display area may be called, for example, a slow display window.

[0140] In the information processing system 1, the display device 11, and the information processing device 21 according to this embodiment, the time range that the time range allocation unit 112 allocates to each slow display area is a time range whose start point is determined at regular time intervals. Therefore, in the information processing system 1, display device 11, and information processing device 21 according to this embodiment, by allocating the next slow display area at a predetermined time interval (for example, every second), it is possible to cover all time periods regardless of the content of the display object.

[0141] In the information processing system 1, the display device 11, and the information processing device 21 according to this embodiment, the time range allocated to each slow motion display area is determined so as to include a characteristic time during a recurring event at a specified timing. Therefore, in the information processing system 1, the display device 11, and the information processing device 21 according to this embodiment, it is possible to assign a time range in synchronization with an event. This makes it easier to grasp the event and to compare the display content between multiple different slow motion display areas. For example, the time range allocation unit 112 may determine the time range after detecting a predetermined peak (e.g., the R peak of an electrocardiogram) so that the peak occurs after a predetermined time (e.g., 300 ms) has elapsed since the start of slow playback.

[0142] In the information processing system 1, the display device 11, and the information processing device 21 according to this embodiment, the time range allocation unit 112 receives a real-time instruction from the user 41 to generate a new start point of a time range. Therefore, in the information processing system 1, display device 11, and information processing device 21 according to this embodiment, the user 41 can start slow playback in an empty slow display area by performing a predetermined operation such as pressing a button.

[0143] In the information processing system 1, the display device 11, and the information processing device 21 according to this embodiment, the time range allocation unit 112 sets the end point of the time range to be allocated to each slow display area to either a direct instruction from the user 41 (an instruction by pressing a predetermined button, for example), a predetermined time length, or the start point of another time range that is the earliest after the start point of the time range. Therefore, in the information processing system 1, the display device 11, and the information processing device 21 according to this embodiment, the slow motion playback started in response to an instruction from the user 41 can be ended under any appropriate condition (method).

[0144] Here, in the information processing system 1, display device 11, and information processing device 21 according to this embodiment, for example, a process of automatically setting a time range and performing slow playback may be executed, and a process of manually setting a time range by the user 41 and performing slow playback may also be executed, or these processes may be executed simultaneously in parallel. As a specific example, slow motion images of automatic slow motion playback may be displayed in parallel at the top of a given screen, and slow motion images of manual slow motion playback may be displayed in parallel at the bottom of the same screen. The number of parallel images at the top (the number of slow motion display areas) and the number of parallel images at the bottom (the number of slow motion display areas) are not particularly limited, and may be, for example, a maximum of three.

[0145] For example, the end side (terminal end side) of the time range may be infinite, that is, a configuration may be used in which the end point of the time range is not predetermined.

[0146] In the information processing system 1, the display device 11, and the information processing device 21 according to this embodiment, the display speed of each slow motion is the same. Therefore, the information processing system 1, the display device 11, and the information processing device 21 according to this embodiment can perform slow motion display with a uniform slow motion magnification.

[0147] In the information processing system 1, the display device 11, and the information processing device 21 according to this embodiment, the multiple slow motion images displayed in parallel include slow motion images with different display speeds. Therefore, the information processing system 1, the display device 11, and the information processing device 21 according to this embodiment can perform slow motion display with two or more types of slow motion magnifications. The slow motion magnifications of the respective slow motion images may be independent, that is, may be different.

[0148] In the information processing system 1, the display device 11, and the information processing device 21 according to this embodiment, when the reference time reaches the beginning of the time range assigned to each slow motion display area, playback of the slow motion images of that time range in that slow motion display area begins. Therefore, in the information processing system 1, the display device 11, and the information processing device 21 according to this embodiment, playback of slow motion images in each slow motion display area starts in a cascading manner, thereby reducing, for example, the maximum delay from the reference time. In this case, when a viewer of such slow motion images (e.g., user 41) focuses on a specific peak (e.g., the R peak of an electrocardiogram), for example, after seeing the specific peak in the first slow motion display area, the user then hops (moves) his / her gaze to the second slow motion display area, whereby the specific peak is seen in the second slow motion display area, and then hops his / her gaze to the third slow motion display area, whereby the specific peak is seen in the third slow motion display area, and so on. In this way, the user can hop his / her gaze to check the peaks of interest one after another.

[0149] In the information processing system 1, display device 11, and information processing device 21 according to this embodiment, when the reference time reaches the start point of the latest time range among the time ranges assigned to multiple slow display areas that are displayed in parallel or any time thereafter, the slow display of these multiple slow display areas begins all at once. Therefore, in the information processing system 1, the display device 11, and the information processing device 21 according to the present embodiment, the timings of events in the slow motion images in the multiple slow motion display areas are aligned, which makes it easier to compare the differences (differences between events) between the slow motion images in two or more slow motion display areas while viewing the slow motion images in the multiple slow motion display areas.

[0150] In the information processing system 1, the display device 11, and the information processing device 21 according to this embodiment, time ranges are allocated so that there is a gap between adjacent time ranges. Therefore, in the information processing system 1, display device 11, and information processing device 21 according to this embodiment, there are time regions that are not covered by any of the time ranges assigned by the time range assignment unit 112, and it is possible not to assign, for example, no-signal sections or sections with a lot of noise to the slow display region.

[0151] For example, if you want to observe 100 ms before and after a peak, and take a time span of 50 ms - peak - 50 ms, but the peak intervals are random and vary from 40 ms to 200 ms, there will be gaps in the time periods before and after the peaks that are 200 ms apart. This configuration example may be applied to such cases. Furthermore, this configuration example may be applied to repetitive playback with gaps, such as playing back slow motion images corresponding to a one-second image portion of the reference image, leaving a gap of 0.1 seconds in the reference image, and then playing back slow motion images corresponding to a one-second image portion of the reference image again.

[0152] In the information processing system 1, the display device 11, and the information processing device 21 according to this embodiment, time ranges are allocated so that adjacent time ranges overlap. Therefore, in the information processing system 1, the display device 11, and the information processing device 21 according to this embodiment, for example, when heartbeat data is observed, there may be an overlapping portion where the slow motion image of the latter half of a heartbeat wraps around to the slow motion image of the first half of the next heartbeat.

[0153] For example, if you want to observe 100 ms before and after a peak, and take a time span of 50 ms - peak - 50 ms, but the peak intervals are random and vary from 40 ms to 200 ms, there will be overlap between the time periods before and after the peaks that are 40 ms apart. This configuration example may be applied to such cases. Furthermore, this configuration example may be applied to repetitive playback in which there are overlapping portions, such as by playing back slow motion images corresponding to a one-second image portion in a reference image, then going back to a 0.1-second image portion in the reference image, and again playing back slow motion images corresponding to a one-second image portion in the reference image.

[0154] In the information processing system 1, the display device 11, and the information processing device 21 according to this embodiment, the user 41 manually or automatically selects a time range to actually allocate to slow motion from among the time ranges allocated by the time range allocation unit 112. Therefore, in the information processing system 1, the display device 11, and the information processing device 21 according to this embodiment, for example, when it is sufficient to view only a portion of the slow motion images, it is possible to select the time range for slow motion playback. In this way, for example, whether or not to display slow motion images for an already assigned time range can be selected by manual selection or automatic selection.

[0155] In the information processing system 1, the display device 11, and the information processing device 21 according to this embodiment, a mark indicating that the time (e.g., actual time or the time when the data was recorded, etc.) of the currently displayed data is the most recent is displayed in the slow motion display area. Therefore, in the information processing system 1, the display device 11, and the information processing device 21 according to this embodiment, it is easy to know in which slow motion display area the slow motion images of the latest time range are being displayed.

[0156] In the information processing system 1, the display device 11, and the information processing device 21 according to this embodiment, a mark indicating the ordinal number of the time range being played back among the multiple slow motion display areas is displayed in each slow motion display area. Therefore, in the information processing system 1, the display device 11, and the information processing device 21 according to this embodiment, it is possible to make it easier to understand the order (sequence) of the slow motion images displayed in each of the multiple slow motion display areas.

[0157] In the information processing system 1, the display device 11, and the information processing device 21 according to this embodiment, a mark is displayed in each slow motion display section indicating the ordinal number of the time range being played in the slow motion display section from the start of the overall playback. Therefore, in the information processing system 1, the display device 11, and the information processing device 21 according to the present embodiment, it is possible to make it easier to grasp the cumulative number (the cumulative order) of the slow motion images displayed in each slow motion display area.

[0158] In the information processing system 1, display device 11, and information processing device 21 according to this embodiment, a mark is displayed in each slow motion display area to indicate to which time within the time range being played back the currently displayed data corresponds. Therefore, in the information processing system 1, the display device 11, and the information processing device 21 according to the present embodiment, for example, by using a bar graph or the like, it is possible to easily grasp the timing of the slow motion images currently being displayed within the allocated time range. This makes it easy to grasp, for example, the time of an event (for example, the actual time or the time when the image was recorded), the timing of refreshing the slow motion playback, etc.

[0159] In the information processing system 1, display device 11, and information processing device 21 according to this embodiment, a mark representing absolute time information relating to the data displayed in each of the predetermined display areas that displays the reference image and in each of the multiple slow display areas, or a mark representing relative time information relating to the data displayed in each of the slow display areas, is displayed. Therefore, in the information processing system 1, the display device 11, and the information processing device 21 according to this embodiment, it is possible to make it easier to grasp predetermined time information when displaying the reference image or the slow motion images. Here, the absolute time may be, for example, the time in the reference image. Furthermore, when a marathon runner is observed, the relative time may be the time that has elapsed since the start of the marathon (relative time). Such time information may be called, for example, a time stamp.

[0160] A program for implementing the functions of any of the components of any of the above-described devices may be recorded on a computer-readable recording medium and loaded into a computer system for execution. The term "computer system" as used herein includes hardware such as an operating system or peripheral devices. The term "computer-readable recording medium" refers to portable media such as flexible disks, optical magnetic disks, ROMs, and compact discs (CDs) and read-only memories (ROMs), as well as storage devices such as hard disks built into computer systems. The term "computer-readable recording medium" also includes devices that retain a program for a certain period of time, such as volatile memory within a computer system that acts as a server or client when a program is transmitted over a network such as the Internet or a communication line such as a telephone line. Such volatile memory may be, for example, random access memory (RAM). The recording medium may also be, for example, a non-transitory recording medium.

[0161] The above program may be transmitted from a computer system storing the program in a storage device or the like to another computer system via a transmission medium or by transmission waves in the transmission medium. Here, the "transmission medium" that transmits the program refers to a medium that has the function of transmitting information, such as a network such as the Internet or a communication line such as a telephone line. The above program may also be one that realizes part of the above-mentioned functions. Furthermore, the above program may be a so-called differential file that can realize the above-mentioned functions in combination with a program already recorded in a computer system. A differential file may also be called a differential program.

[0162] Furthermore, the functions of any of the components in any of the above-described devices may be implemented by a processor. For example, each process in the embodiments may be implemented by a processor operating based on information such as a program and a computer-readable recording medium storing information such as the program. Here, the functions of each unit of the processor may be implemented by, for example, individual hardware, or may be implemented by integrated hardware. For example, the processor may include hardware, and the hardware may include at least one of a circuit for processing digital signals and a circuit for processing analog signals. For example, the processor may be configured using one or more circuit devices mounted on a circuit board, or one or both of one or more circuit elements. An integrated circuit (IC) or the like may be used as the circuit device, and a resistor or a capacitor may be used as the circuit element.

[0163] Here, the processor may be, for example, a CPU. However, the processor is not limited to a CPU, and various types of processors such as a GPU (Graphics Processing Unit) or a DSP (Digital Signal Processor) may be used. The processor may also be, for example, a hardware circuit such as an ASIC (Application Specific Integrated Circuit). The processor may also be, for example, composed of multiple CPUs, or may be, for example, composed of a hardware circuit such as a multiple ASIC. The processor may also be, for example, composed of a combination of multiple CPUs and a hardware circuit such as a multiple ASIC. The processor may also include, for example, one or more of an amplifier circuit or a filter circuit that processes analog signals.

[0164] The embodiments of this disclosure have been described in detail above with reference to the drawings, but the specific configuration is not limited to this embodiment, and includes designs within the scope that do not deviate from the gist of this disclosure.

[0165] [Note] (Configuration example 1) to (Configuration example 26) are shown.

[0166] (Configuration example 1) An information processing device that outputs a plurality of slow motion images (slow images) to a display unit that simultaneously displays the slow motion images in a plurality of slow motion display areas (slow display areas), a time range allocation unit that allocates different time ranges to the slow motion display areas; a slow motion data generating unit that generates, for each of the slow motion display areas based on a result of the allocation of the time ranges by the time range allocating unit, slow motion data (slow data) that is slow motion with respect to a first parameter, the first parameter being a time parameter or a parameter corresponding to time, with respect to reference data in which a second parameter changes in accordance with a change in the first parameter; a display output unit that outputs the slow motion images based on the slow motion data generated by the slow motion data generation unit to the display unit so as to be displayed in each of the slow motion display areas; An information processing device comprising:

[0167] In this embodiment, the function of the slow motion data generating unit 113 is realized by the function of the slow motion data generating unit. In this embodiment, the function of the slow motion display processing unit 114 (first slow motion display unit A1 to n-th slow motion display unit An) and the function of the screen output unit 115 realize the function of a display output unit. In this embodiment, the data supplied by the data supply unit 12 is an example of reference data. For example, if the reference data is video data, a time parameter in the video data corresponds to the first parameter, and a parameter representing an image (for example, pixel value) in the video data corresponds to the second parameter. For example, when the reference data is electrocardiogram data, a time parameter in the electrocardiogram data corresponds to the first parameter, and a parameter representing an image (for example, a waveform or an electrocardiogram map) in the electrocardiogram data corresponds to the second parameter. Furthermore, the reference data may be data having, for example, a parameter other than time that can be associated with time (an example of a first parameter) and a parameter that changes in accordance with a change in the parameter (an example of a second parameter). For example, even if the first parameter represents something other than time, it is possible to regard a change in the first parameter as a change in time and display it like a moving image. The second parameter may be, for example, composed of one value, or may include multi-dimensional values.

[0168] (Configuration example 2) the first parameter of the reference data is a time parameter; The rate of change of the first parameter of the reference data is equal to the rate of progress of real time. The information processing device described in (Configuration Example 1).

[0169] (Configuration example 3) the first parameter of the reference data is a time parameter; The rate of change of the first parameter of the reference data is different from the rate of progress of real time. The information processing device described in (Configuration Example 1).

[0170] (Configuration example 4) The display unit further displays a reference image based on the reference data in a reference display area simultaneously with the slow motion image, the display output unit outputs a reference image based on the reference data to the display unit so as to display the reference image in the reference display area. The information processing device according to any one of (Configuration Example 1) to (Configuration Example 3).

[0171] (Configuration Example 5) the time range allocation unit allocates another time range to one of the slow motion display areas after display of the time range allocated to one of the slow motion display areas is completed. The information processing device according to any one of (Configuration Example 1) to (Configuration Example 4).

[0172] (Configuration Example 6) the start points of the time ranges that the time range allocation unit allocates to each of the slow motion display areas are at regular time intervals; The information processing device according to any one of (Configuration Example 1) to (Configuration Example 5).

[0173] (Configuration Example 7) the time ranges that the time range allocation unit allocates to the respective slow motion display areas include characteristic portions of a repetitive event at predetermined timings; The information processing device according to any one of (Configuration Example 1) to (Configuration Example 6).

[0174] (Configuration Example 8) the time range allocation unit allocates the time range having a starting point according to an instruction from a user. The information processing device according to any one of (Configuration Example 1) to (Configuration Example 7).

[0175] (Configuration Example 9) an end point of the time range that the time range allocation unit allocates to each of the slow motion display areas is set to any one of a timing according to an instruction from the user, a timing according to a predetermined time length, or a timing of a start point of another time range that is later than the start point of the time range and that is the earliest. The information processing device according to (Configuration Example 8).

[0176] (Configuration Example 10) the display speed of the slow motion images in each of the slow motion display areas is the same; The information processing device according to any one of (Configuration Example 1) to (Configuration Example 9).

[0177] (Configuration Example 11) At least one of the display speeds of the slow motion images in each of the slow motion display areas is different from the other. The information processing device according to any one of (Configuration Example 1) to (Configuration Example 9).

[0178] (Configuration Example 12) In each of the slow motion display areas, when the first parameter reaches a start point of the time range assigned to the slow motion display area, display of the slow motion images of the time range starts. The information processing device according to any one of (Configuration Example 1) to (Configuration Example 11).

[0179] (Configuration Example 13) When the first parameter reaches the start point of the time range of the slow motion display area having the latest start point of the time range assigned to the slow motion display area among the plurality of slow motion display areas that are simultaneously displayed in parallel, or a predetermined time point after the start point, the display of the slow motion images of the time range in each of the plurality of slow motion display areas is started simultaneously. The information processing device according to any one of (Configuration Example 1) to (Configuration Example 11).

[0180] (Configuration Example 14) the time range allocation unit allocates the time ranges with a gap between adjacent time ranges. The information processing device according to any one of (Configuration Example 1) to (Configuration Example 13).

[0181] (Configuration Example 15) the time range allocation unit allocates the time ranges such that adjacent time ranges overlap. The information processing device according to any one of (Configuration Example 1) to (Configuration Example 13).

[0182] (Configuration Example 16) a selection unit that selects, manually or automatically by a user, the time range in which the slow motion images are to be displayed from the time ranges allocated by the time range allocation unit; The information processing device according to any one of (Configuration Example 1) to (Configuration Example 14).

[0183] In this embodiment, the function of the automatic selection unit is realized by the function of the process control unit 131. In this embodiment, the function of the selection unit that is manually operated by the user 41 is realized by the function of the operation unit 141 and the function of the process control unit 131.

[0184] (Configuration Example 17) displaying first information in the slow motion display area in which the slow motion image is most recently displayed among the plurality of slow motion display areas; The information processing device according to any one of (Configuration Example 1) to (Configuration Example 16).

[0185] Here, the term "latest" means the latest when considered in terms of time parameters (that is, the most advanced in time). In this embodiment (variation), the information of the mark 2011 shown in FIG. 7A is an example of the first information.

[0186] (Configuration Example 18) In each of the slow motion display areas, second information is displayed which is the number of the slow motion images displayed in the slow motion display area in order from newest to oldest, or in reverse order. The information processing device according to any one of (Configuration Example 1) to (Configuration Example 17).

[0187] Here, "new" means new when considered in terms of time parameters (i.e., advanced in time), and conversely, "old" means old when considered in terms of time parameters (i.e., delayed in time). In this embodiment (modification), the information of the marks 2111 to 2113 shown in FIG. 7B is an example of the second information.

[0188] (Configuration Example 19) In each of the slow motion display areas, third information is displayed which is the cumulative number of the slow motion images displayed in the slow motion display area in order from newest to oldest, or the cumulative number in reverse order. The information processing device according to any one of (Configuration Example 1) to (Configuration Example 18).

[0189] In this embodiment (modification), the information of marks 2211 to 2213 shown in FIG. 7C is an example of the third information.

[0190] (Configuration Example 20) displaying, in the slow motion display area, fourth information indicating a position of the slow motion image being displayed within the time range allocated to the slow motion display area; The information processing device according to any one of (Configuration Example 1) to (Configuration Example 19).

[0191] In this embodiment (variation), the information on the time range B111 and the position P1 shown in FIG. 7D is an example of the fourth information.

[0192] (Configuration Example 21) displaying, in at least one of the slow motion display area and the reference display area, one or both of fifth information indicating an absolute time corresponding to the first parameter of the reference data and sixth information indicating a relative time with respect to the absolute time; The information processing device according to (Configuration Example 4).

[0193] In this embodiment (variation), the time information 2511 shown in FIG. 7E is an example of the fifth information, and the time information 2512 shown in FIG. 7E is an example of the sixth information.

[0194] (Configuration Example 22) Further, a data supply unit that supplies the reference data is provided. The information processing device according to any one of (Configuration Example 1) to (Configuration Example 21).

[0195] (Configuration Example 23) maintaining a time delay of the latest slow-motion image being displayed relative to a time corresponding to the reference image being displayed at or below a certain value; The information processing device according to (Configuration Example 4).

[0196] In this embodiment, it is also possible to provide a display device. (Configuration Example 24) An information processing device according to any one of (Configuration Example 1) to (Configuration Example 23); The display unit; A display device comprising:

[0197] In this embodiment, it is also possible to provide an information processing method performed in an information processing device (or a display device). (Configuration Example 25) 1. An information processing method for outputting slow motion images to a display unit that simultaneously displays a plurality of slow motion images in a plurality of slow motion display areas, the slow motion images comprising: a time range allocation unit allocating a different time range to each of the slow motion display areas; a slow motion data generating unit generates, for each of the slow motion display areas based on a result of the allocation of the time ranges by the time range allocating unit, slow motion data that is slow motion with respect to a first parameter with respect to reference data in which a second parameter changes in accordance with a change in a first parameter that is a time parameter or a parameter corresponding to time; a display output unit that outputs the slow motion images based on the slow motion data generated by the slow motion data generating unit to the display unit so as to display the images in each of the slow motion display areas; Information processing methods.

[0198] In this embodiment, it is also possible to provide a program (computer program) that is executed on a computer that constitutes an information processing device (or a display device). (Configuration Example 26) a computer that outputs the slow motion images to a display unit that simultaneously displays a plurality of slow motion images in a plurality of slow motion display areas, a time range allocation function for allocating different time ranges to the slow motion display areas; a slow motion data generating function that generates, for each of the slow motion display areas, slow motion data that is slow motion with respect to a first parameter, which is a time parameter or a parameter corresponding to time, for reference data in which a second parameter changes in accordance with a change in the first parameter based on a result of the time range allocation by the time range allocation function; a display output function that outputs the slow motion images based on the slow motion data generated by the slow motion data generation function to the display unit so as to be displayed in each of the slow motion display areas; A program to achieve this. [Explanation of symbols]

[0199] 1...information processing system, 11...display device, 12...data supply unit, 21...information processing device, 22...display unit, 31...input unit, 32...output unit, 33...communication unit, 34...storage unit, 35...control unit, 41...user, 111...reference time image display unit, 112...time range allocation unit, 113...slow data generation and supply unit, 114...slow display processing unit, 115...screen output unit, 131...processing control unit, 141...operation unit, 161...screen unit, 181...data observation unit, 182...data storage unit, 1011...waveform, 1021...real-time electrocardiogram image, 1022...slow electrocardiogram image, 2011, 2111 to 2113, 2211 to 2213 ...mark, 2511-2512...time information, A1-An...first slow motion display section to nth slow motion display section, B1-B3, B11-B14, B111...time range, C1-C3, C11-C14...time, D1-D3, D11-D13...waveform section, Ge1-Ge7, Ge111-Ge112...real-time image, Gs1-Gs7, Gs21-Gs25, Gs41-Gs43, Gs111, Gs121, Gs131...slow motion image, P1...position, Re1...real-time display area, Rs1...first slow motion display area, Rs2...second slow motion display area, Rs3...third slow motion display area, V1...reference image group, W1...slow motion image group

Claims

1. 1. An information processing device that outputs a plurality of slow motion images to a display unit that simultaneously displays each of a plurality of slow motion images in a plurality of slow motion display areas, a time range allocation unit that allocates different time ranges to the slow motion display areas; a slow motion data generating unit that generates, for each of the slow motion display areas based on a result of the allocation of the time ranges by the time range allocating unit, slow motion data that is slow motion with respect to a first parameter, the first parameter being a time parameter or a parameter corresponding to time, with respect to reference data in which a second parameter changes in accordance with a change in the first parameter; a display output unit that outputs the slow motion images based on the slow motion data generated by the slow motion data generation unit to the display unit so as to be displayed in each of the slow motion display areas; An information processing device comprising:

2. the first parameter of the reference data is a time parameter; a rate of change of the first parameter of the reference data is equal to the rate of progress of real time; The information processing device according to claim 1 .

3. the first parameter of the reference data is a time parameter; a rate of change of the first parameter of the reference data is different from the rate of progress of real time; The information processing device according to claim 1 .

4. The display unit further displays a reference image based on the reference data in a reference display area simultaneously with the slow motion image, the display output unit outputs a reference image based on the reference data to the display unit so as to display the reference image in the reference display area. The information processing device according to any one of claims 1 to 3.

5. the time range allocation unit allocates another time range to one of the slow motion display areas after display of the time range allocated to one of the slow motion display areas has ended; The information processing device according to any one of claims 1 to 3.

6. the start points of the time ranges that the time range allocation unit allocates to each of the slow motion display areas are at regular time intervals; The information processing device according to any one of claims 1 to 3.

7. the time ranges that the time range allocation unit allocates to the respective slow motion display areas include characteristic portions of a repetitive event at predetermined timings; The information processing device according to any one of claims 1 to 3.

8. the time range allocation unit allocates the time range having a starting point according to an instruction from a user. The information processing device according to any one of claims 1 to 3.

9. an end point of the time range that the time range allocation unit allocates to each of the slow motion display areas is set to any one of a timing according to an instruction from the user, a timing according to a predetermined time length, or a timing of a start point of another time range that is later than the start point of the time range and that is the earliest. The information processing device according to claim 8 .

10. the display speed of the slow motion images in each of the slow motion display areas is the same; The information processing device according to any one of claims 1 to 3.

11. At least one of the display speeds of the slow motion images in each of the slow motion display areas is different from the other. The information processing device according to any one of claims 1 to 3.

12. In each of the slow motion display areas, when the first parameter reaches a start point of the time range assigned to the slow motion display area, display of the slow motion images of the time range starts. The information processing device according to any one of claims 1 to 3.

13. When the first parameter reaches the start point of the time range of a slow motion display area that has the latest start point of the time range assigned to the slow motion display area among the plurality of slow motion display areas that are simultaneously displayed in parallel, or a predetermined time point after the start point, the display of the slow motion images of the time range in each of the plurality of slow motion display areas is started simultaneously. The information processing device according to any one of claims 1 to 3.

14. the time range allocation unit allocates the time ranges with a gap between adjacent time ranges. The information processing device according to any one of claims 1 to 3.

15. the time range allocation unit allocates the time ranges such that adjacent time ranges overlap. The information processing device according to any one of claims 1 to 3.

16. a selection unit that selects, manually or automatically by a user, the time range in which the slow motion images are to be displayed from the time ranges allocated by the time range allocation unit; The information processing device according to any one of claims 1 to 3.

17. displaying first information in the slow motion display area in which the slow motion image is most recently displayed among the plurality of slow motion display areas; The information processing device according to any one of claims 1 to 3.

18. In each of the slow motion display areas, second information is displayed which is the number of the slow motion images displayed in the slow motion display area in order from newest to oldest, or in reverse order. The information processing device according to any one of claims 1 to 3.

19. In each of the slow motion display areas, third information is displayed which is the total number of the slow motion images displayed in the slow motion display area in order from newest to oldest, or the total number in reverse order. The information processing device according to any one of claims 1 to 3.

20. displaying, in the slow motion display area, fourth information indicating a position of the slow motion image being displayed within the time range allocated to the slow motion display area; The information processing device according to any one of claims 1 to 3.

21. displaying, in at least one of the slow motion display area and the reference display area, one or both of fifth information indicating an absolute time corresponding to the first parameter of the reference data and sixth information indicating a relative time with respect to the absolute time; The information processing device according to claim 4 .

22. Further, a data supply unit that supplies the reference data is provided. The information processing device according to any one of claims 1 to 3.

23. maintaining a time delay of the latest slow-motion image being displayed relative to a time corresponding to the reference image being displayed at or below a certain value; The information processing device according to claim 4 .

24. An information processing device according to any one of claims 1 to 3; The display unit; A display device comprising:

25. 1. An information processing method for outputting slow motion images to a display unit that simultaneously displays a plurality of slow motion images in a plurality of slow motion display areas, the slow motion images comprising: a time range allocation unit allocating a different time range to each of the slow motion display areas; a slow motion data generating unit generates, for each of the slow motion display areas based on a result of the allocation of the time ranges by the time range allocating unit, slow motion data that is slow motion with respect to a first parameter, with respect to reference data in which a second parameter changes in accordance with a change in a first parameter that is a time parameter or a parameter corresponding to time; a display output unit that outputs the slow motion images based on the slow motion data generated by the slow motion data generating unit to the display unit so as to display the images in each of the slow motion display areas; Information processing methods.

26. a computer that outputs the slow motion images to a display unit that simultaneously displays a plurality of slow motion images in a plurality of slow motion display areas, a time range allocation function for allocating different time ranges to the slow motion display areas; a slow motion data generating function that generates, for each of the slow motion display areas, slow motion data that is slow motion with respect to a first parameter, which is a time parameter or a parameter corresponding to time, for reference data in which a second parameter changes in accordance with a change in the first parameter based on a result of the time range allocation by the time range allocation function; a display output function that outputs the slow motion images based on the slow motion data generated by the slow motion data generation function to the display unit so as to be displayed in each of the slow motion display areas; A program to achieve this.

Images