Information processing device, control method and program for information processing device
The information processing device optimizes video display across multiple pages by storing and updating video data proactively, addressing time lag and resource consumption issues.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-08-30
- Publication Date
- 2026-03-12
AI Technical Summary
When displaying video across multiple pages, the time lag due to video capture on new pages causes a loss of usability, and continuous background capture of videos from multiple cameras leads to excessive network bandwidth and resource consumption.
The information processing device acquires and stores video data from multiple cameras, displaying stored video when switching pages and updating with newly captured data only when necessary, thereby optimizing resource usage and reducing lag.
This approach improves usability by ensuring immediate video display across pages while minimizing network bandwidth and resource consumption.
Smart Images

Figure 2026044546000001_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to an information processing device, a control method for an information processing device, and a program. [Background technology]
[0002] There are applications that acquire and display camera images via a network. Some of these applications have the function of displaying images from multiple cameras across multiple pages, with each page displaying images from a predetermined number of cameras. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2012-253712 Summary of the Invention [Problem to be solved by the invention]
[0004] When displaying video across multiple pages, if the camera starts capturing video to be displayed on the new page when switching pages, a time lag occurs before the video is displayed due to the time required to capture the video, resulting in a loss of usability. To address this issue, a technology has been proposed that reduces the time lag in video display by constantly capturing video in the background even when the video is not displayed. However, because video is captured in the background even when the video is not displayed, a problem arises in that as the number of videos from the target cameras increases, a large amount of network bandwidth and application resources related to video processing are consumed. The present invention aims to improve usability while reducing the consumption of video processing resources when displaying video from an imaging device across multiple pages. [Means for solving the problem]
[0005] The information processing device of the present invention comprises an acquisition means for acquiring multiple images captured by multiple imaging devices, a storage means for holding the multiple images acquired by the acquisition means, and a display control means for dividing the multiple images into multiple pages and switching between pages to display them on a display unit, wherein the multiple images include images displayed on the display unit and images not displayed on the display unit, and when it is determined that an image captured by a first imaging device among the multiple images will be displayed as the page is switched, the display control means displays the image captured by the first imaging device stored in the storage means on the display unit, and then updates the image captured by the first imaging device displayed on the display unit with the image newly acquired by the acquisition means. [Effects of the Invention]
[0006] According to the present invention, when displaying images from an imaging device divided into multiple pages, it is possible to improve usability while suppressing consumption of resources related to image processing. [Brief explanation of the drawings]
[0007] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of a system including an information processing device. [Figure 2] FIG. 2 is a diagram illustrating an example of a hardware configuration of an imaging apparatus. [Figure 3] FIG. 2 illustrates an example of a hardware configuration of an information processing device. [Figure 4] FIG. 2 is a diagram illustrating an example of information stored in the imaging device. [Figure 5] FIG. 2 is a diagram illustrating an example of information stored in an information processing device. [Figure 6] FIG. 2 is a diagram illustrating an example of a functional configuration of an information processing apparatus. [Figure 7] 1 is a flowchart showing an example of processing in the first embodiment. [Figure 8] 10 is a flowchart showing an example of processing in the second embodiment. [Figure 9] 11 is a flowchart showing an example of processing in the third embodiment. DETAILED DESCRIPTION OF THE INVENTION
[0008] Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. However, the embodiments of the present invention are not limited to the embodiments described below. In the accompanying drawings, the same or similar components are denoted by the same reference numerals, and redundant explanations will be omitted. Furthermore, the term "page" is used in each embodiment, but this term also includes tabs and other similar functions. In other words, a "page" may be anything that allows multiple images captured by multiple imaging devices to be displayed by switching between one or more images at a time.
[0009] <Embodiment 1> 1 is a diagram showing an example of the configuration of a system including an information processing device according to this embodiment. The system in this embodiment includes a network 101, a camera 102, and an information processing device 103.
[0010] The network 101 is a network that communicatively connects the camera 102 and the information processing device 103. The network 101 may be realized by a plurality of routers, switches, cables, etc. that comply with a communication standard such as ETHERNET (registered trademark). Note that the network 101 may also be realized by the Internet, a wired LAN (Local Area Network), a wireless LAN, a WAN (Wide Area Network), etc.
[0011] The camera 102 is an imaging device that captures video data (image data or video data) through a lens, and includes a plurality of imaging devices in this embodiment. In this embodiment, the camera 102 transmits captured video data and the status of the camera 102 to the information processing device 103 via the network 101 in response to a request from the information processing device 103. However, this is not limiting, and the camera 102 may actively transmit video data to the information processing device 103 or the like to which it is connected in advance, for example, at regular intervals.
[0012] The information processing device 103 can acquire video data and information from the camera 102 and perform various processes described below. The information processing device 103 is an information terminal used as a general client device, such as a personal computer (PC), tablet, or smartphone. In this embodiment, an example will be described in which the information processing device 103 manages the camera 102, but the present invention is not limited to this. The device to be managed does not have to be a camera as long as it can be controlled via a network, such as a controller that controls the camera or a switching device that switches camera images.
[0013] 2 is a diagram showing an example of the hardware configuration of the camera 102 in this embodiment. The camera 102 has a CPU 202, a primary storage device 203, a secondary storage device 204, an image input I / F (interface) 205, an imaging unit 206, a PTZ (pan-tilt-zoom) driving unit 207, a camera control unit 208, and a network I / F 209. The CPU 202, the primary storage device 203, the secondary storage device 204, the image input I / F 205, the imaging unit 206, the PTZ driving unit 207, the camera control unit 208, and the network I / F 209 are connected via an internal bus 201.
[0014] The CPU (Central Processing Unit) 202 is a central processing unit that performs overall control of the operations of the camera 102. The primary storage device 203 is a writable storage device such as a RAM (Random Access Memory). The primary storage device 203 is loaded with, for example, an OS (Operating System), various programs, and various data, and is also used as a working area when the CPU 202 executes the OS, various programs, and the like.
[0015] The secondary storage device 204 is a non-volatile storage device such as a hard disk drive (HDD), a solid state drive (SSD), a flash memory, or an SD card. The secondary storage device 204 is used as a permanent storage area for, for example, an OS, various programs, and various data. The secondary storage device 204 may also be used as a short-term storage area for various data.
[0016] The image input I / F 205 is an interface for inputting image data from the communicatively connected imaging unit 206. The imaging unit 206 has a lens, an imaging sensor (image sensor), etc., and captures an image via the lens, etc.
[0017] The PTZ driving unit 207 controls motors and the like to pan, tilt, and zoom the camera 102, thereby controlling the PTZ (pan-tilt-zoom) of the camera 102. The PTZ driving unit 207 may not only control the PTZ of the camera 102, but may also perform settings and control of the camera 102, such as focus and white balance. Also, a video camera that is only capable of zooming, an interchangeable lens camera that does not have a zoom function, or the like may be configured without the PTZ control unit 207.
[0018] The camera control unit 208 controls imaging parameters such as white balance and focus. The camera control unit 208 also executes various functions such as rebooting the camera 102 and updating firmware. The network I / F 209 is an interface for connecting to the network 101. For example, network communication from the information processing device 103 is transmitted to various programs via the network I / F 209.
[0019] 3 is a diagram showing an example of the hardware configuration of the information processing device 103 in this embodiment. The information processing device 103 has a CPU 302, a primary storage device 303, a secondary storage device 304, an input / output I / F 305, and a network I / F 306. The CPU 302, the primary storage device 303, the secondary storage device 304, the input / output I / F 305, and the network I / F 306 are connected via an internal bus 301.
[0020] The CPU 302 is a central processing unit that performs overall control of the operations of the information processing device 103. The primary storage device 303 is a writable storage device such as a RAM. The primary storage device 303 is loaded with, for example, an OS, various programs, and various data, and is also used as a work area when the CPU 302 executes the OS, various programs, and the like.
[0021] The secondary storage device 304 is a non-volatile storage device such as an HDD, SSD, flash memory, or SD card. The secondary storage device 304 is used as a permanent storage area for, for example, an OS, various programs, and various data. The secondary storage device 304 may also be used as a short-term storage area for various data.
[0022] The input / output I / F 305 is an interface through which the information processing device 103 receives operations from a user, inputs user information, and outputs images and the like to the user. Examples of the input / output I / F 305 include a display, a touch panel, a keyboard, a mouse, a microphone, and the like. Here, the touch panel and display may be configured as an integrated unit, such as a touch panel-equipped display that can detect touch positions. These interfaces are used for touch / mouse operations, voice input, processing using captured images, and the like. The network I / F 306 is an interface for connecting to the network 101. For example, network communication from the camera 102 is transmitted to various programs via the network I / F 306.
[0023] Fig. 4 is a diagram showing an example of information stored in the camera 102. Fig. 4 shows an example of various programs and various data stored in the primary storage device 203 and secondary storage device 204 of the camera 102. An OS 401, an imaging program 402, and a communication control program 403 are loaded into the primary storage device 203. Setting information 404 is saved in the secondary storage device 204. The various programs (OS 401, imaging program 402, and communication control program 403) loaded into the primary storage device 203 are also saved in the secondary storage device 204.
[0024] The OS 401 is a basic program for controlling the entire camera 102. Here, for example, the OS 401 manages the positions (addresses) and sizes of various programs (image capture program 402 and communication control program 403) and various data (setting information 404) in the storage devices 203 and 204. The image capture program 402 is a program for acquiring an image captured by the image capture unit 206 via the image input I / F 205 in response to an image acquisition request from the information processing device 103 or an instruction from another program. The image capture program 402 may also convert the acquired image into image data such as JPEG or video data such as H.264.
[0025] The communication control program 403 is a program for controlling communication between the network I / F 209 and the information processing device 103 via the network 101. Examples of the content of communication include receiving an acquisition request for an image captured by the imaging unit 206 and receiving a PTZ control request for the PTZ driving unit 207 of the camera 102. Note that requests received from the information processing device 103 may use a general communication protocol such as HTTP (Hypertext Transfer Protocol). The setting information 404 is information including setting values such as an IP address used in communication realized by the communication control program 403, and is stored in the secondary storage device 204 of the camera 102.
[0026] FIG. 5 is a diagram showing an example of information stored in the information processing device 103. FIG. 5 shows an example of various programs and various data stored in the primary storage device 303 and secondary storage device 304 of the information processing device 103. An OS 501, a communication control program 502, a display program 503, and a device management program 504 are loaded into the primary storage device 303. Device management information 505 is stored in the secondary storage device 304. The various programs (OS 501, communication control program 502, display program 503, and device management program 504) loaded into the primary storage device 303 are also stored in the secondary storage device 304. In this embodiment, the device management information 505 is stored in the secondary storage device 304, but it may also be stored in the primary storage device 303 as temporary information.
[0027] The OS 501 is a basic program for controlling the entire information processing device 103. Here, for example, the OS 501 manages the locations (addresses) and sizes of various programs (communication control program 502, display program 503, device management program 504) and various data (device management information 505) in the storage devices 303 and 304. The communication control program 502 is a program for controlling communication with the camera 102 from the network I / F 306 via the network 101. Examples of the content of communication include sending an acquisition request for an image captured by the imaging unit 206 of the camera 102 and sending a PTZ control request to the PTZ driving unit 207 of the camera 102. Note that requests sent to the camera 102 may use a common communication protocol, such as HTTP (Hypertext Transfer Protocol).
[0028] The display program 503 is a program for displaying data related to images acquired from the camera 102 and icons for controlling the camera 102 on a display device, which is one of the input / output I / Fs 305 of the information processing device 103. The display program 503 can also receive user inputs, such as inputs from an external device such as a mouse or keyboard, or, if the display device is a touch display, touch operations, and the like, and can instruct the camera 102 to execute various functions based on this input. When there are multiple cameras 102 displaying images, the display program 503 can use a page switching function to divide the images from the cameras into multiple pages, each containing a predetermined number of images, and switch between the images. Instead of using the page switching function, the displayed camera images may be switched by scrolling. For example, each camera 102 may be numbered, and images from cameras 1 to 4 may be displayed on the first page, and images from cameras 5 to 8 may be displayed on the second page.
[0029] The device management program 504 is a program for managing the status of each camera 102, connection information with each camera 102, and the like, for multiple cameras 102 connected to the system. The device management program 504 stores the managed information, for example, as device management information 505 (described later) in the secondary storage device 304. The device management information 505 is information about the devices to be managed, created by the device management program 504. The device management information 505 includes information for connecting to each camera 102, including IP addresses, and the like, as well as the display position of each camera 102 and page information used by the display program 503.
[0030] 6 is a diagram showing an example of the functional configuration of the information processing device 103 according to this embodiment. The information processing device 103 includes a control unit 601, an input / output unit 602, a storage unit 603, an acquisition unit 604, a management unit 605, a display control unit 606, and a display unit 607.
[0031] The control unit 601 performs overall control of the operations of the information processing device 103. For example, the control unit 601 controls the acquisition of video data and information related to the camera status from the camera 102 by the acquisition unit 604, and controls the display of the camera video by the display control unit 606. The control unit 601 also performs PTZ control processing for controlling the PTZ (pan-tilt-zoom) position of the camera 102 based on input from the user received by the input / output unit 602, etc.
[0032] The input / output unit 602, for example, receives input from a user through user operation and outputs various information to the user. The storage unit 603 stores various programs and various data for executing various processes in the information processing device 103. The storage unit 603 stores, for example, video data acquired from the camera 102 by the acquisition unit 604, device management information generated by the management unit 605, and the like.
[0033] The acquisition unit 604 acquires video data, information on the camera status, and the like from the camera 102 under the control of the control unit 601. The acquired video data, information on the camera status, and the like are stored in, for example, the storage unit 603. The management unit 605 manages the status of each camera 102 among the multiple cameras 102 connected to the system and connection information with each camera 102. The management unit 605 generates system management information for managing this information. The generated device management information is stored in, for example, the storage unit 603. The system management information includes information on the page on which the video from each camera is displayed when video from the multiple cameras 102 connected to the system is displayed using a page switching function. Based on this information, for example, the management unit 605 can manage the show / hide state of each camera when video from the camera is displayed using the page switching function.
[0034] The display control unit 606 controls the display of the video data of the camera 102 by the display unit 607 and the display of icons for controlling the camera 102. For example, the display control unit 606 controls the display unit 607 to display the video data acquired by the acquisition unit 604 and held in the storage unit 603 as video from each camera 102.
[0035] Fig. 7 is a flowchart showing an example of processing performed by the information processing device 103 in embodiment 1. The processing of the flowchart shown in Fig. 7 is realized, for example, by the CPU 302 of the information processing device 103 executing various programs including the display program 503 that are loaded into the primary storage device 303. Fig. 7 shows an example of processing by the information processing device 103 to acquire video from one camera 102 (target camera 102) connected via the network 101. The information processing device 103 executes the processing of the flowchart shown in Fig. 7 for each camera 102 connected via the network 101.
[0036] In step S701, the control unit 601 of the information processing device 103 acquires the device management information 505 stored in the storage unit 603 and acquires camera information related to the camera 102 from which video is to be acquired based on the acquired device management information 505. Then, the control unit 601 acquires video data from the target camera 102 using the acquisition unit 604 based on the acquired camera information. If multiple cameras 102 are being targeted, multiple videos captured by the multiple cameras are acquired. The device management information 505 is generated by the management unit 605 and stored in the storage unit 603. If video is already being displayed, video acquisition of the video from the currently displayed camera 102 continues. Video from cameras displayed on pages before and after the currently displayed page is also continuously acquired. Pages before and after the currently displayed page can often be switched with a single click, requiring minimal operations. Therefore, video is acquired in advance. It is also possible to acquire only the page before the currently displayed page or the page after the currently displayed page. In this way, the video acquired by the acquisition unit 604 includes the video displayed on the display unit 607 and the video not displayed on the display unit 607. In other words, acquisition of the video not displayed on the display unit 607 has already started.
[0037] In step S702, the control unit 601 stores the video data acquired from the target camera 102 in step S701 in the storage unit 603 as display video data related to the camera 102. Note that if the video data acquired from the target camera 102 is already stored in the storage unit 603 as display video data related to the camera 102, the display control unit 606 overwrites the stored video data with the video data acquired in step S701.
[0038] In step S703, the control unit 601 determines whether or not the image of the target camera 102 is displayed on a UI (user interface) for displaying camera images, which is displayed on the display unit 607 by the display control unit 606. For example, it determines whether new image of the target camera 102 is displayed by switching pages. If the control unit 601 determines that the image of the target camera 102 is displayed on the UI (YES), the process proceeds to step S704. On the other hand, if the control unit 601 determines that the image of the target camera 102 is not displayed on the UI (NO), the process proceeds to step S709. Note that the UI here includes a display screen for displaying each image. The UI in each embodiment may simply be a screen for displaying an image.
[0039] In step S704, the display control unit 606 displays the display image data of the target camera 102 stored in the storage unit 603 as an image of the camera 102 on the UI.
[0040] In step S705, the control unit 601 acquires video data from the target camera 102 using the acquisition unit 604 based on the acquired camera information. That is, video acquisition is continued for video from the camera 102 that will be switched from a hidden target to a displayed target as the page changes. The video data acquired here is, for example, video data currently being captured or video data currently being distributed.
[0041] In step S706, the display control unit 606 overwrites (updates) the display video data of the target camera 102 stored in the storage unit 603 with the video data acquired from the target camera 102 in step S705.
[0042] In step S707, the display control unit 606 displays the display image data of the target camera 102, which was overwritten in step S706, as an image of the camera 102 on the UI.
[0043] In step S708, the control unit 601 determines whether the image from the target camera 102 is being displayed on the UI for displaying camera images. If the control unit 601 determines that the image from the target camera 102 is being displayed on the UI (YES), the process returns to step S705. Therefore, while the image from the target camera 102 is being displayed on the UI, the processes of steps S705 to S707 described above are repeated. In other words, the currently acquired image continues to be displayed. Furthermore, the image held in the storage unit 603 is maintained as the most recently acquired image. On the other hand, if the control unit 601 determines that the image from the target camera 102 is not being displayed on the UI (NO), the process returns to step S703.
[0044] In step S709, the control unit 601 determines, based on the device management information 505, whether the video of the target camera 102 will be displayed on a page preceding or following the currently displayed page (display page) in the page switching function. That is, the control unit 601 determines whether the video of the target camera 102 will be displayed on a page preceding or following the currently displayed page (display page). If the control unit 601 determines that the video of the target camera 102 will be displayed on a page preceding or following the currently displayed page (display page) (YES), the process returns to step S701. Then, the processes of steps S701 and S702 are executed, and the display video data of the target camera 102 stored in the storage unit 603 is overwritten with the video data acquired from the target camera 102. On the other hand, if the control unit 601 determines that the video of the target camera 102 will not be displayed on a page preceding or following the currently displayed page (display page) (NO), the process returns to step S703. In this way, the control unit 601 determines that the images captured by the camera 102 corresponding to the pages before and after the current page are likely to be actually displayed in the future as the page is about to be switched. Then, under the control of the control unit 601, these images are also acquired in advance. Note that it is also possible to acquire only the page before the currently displayed page or the page after the currently displayed page.
[0045] As described above, according to the first embodiment, the information processing device 103 first acquires video data from the camera 102, and then switches whether or not to acquire the video depending on whether or not the video from the camera 102 is displayed on the UI. By performing processing in this manner, when the video from the camera 102 is displayed across multiple pages, it is possible to display the video data immediately when the display state of the camera 102 changes due to a page change, even if the video from the camera 102 is not always acquired. This makes it possible to improve usability while reducing the consumption of network bandwidth and application resources related to video processing when displaying the video from the camera across multiple pages.
[0046] Furthermore, if the image from the target camera 102 is displayed on the page before or after the currently displayed page (display page), the process returns to step S701, and image data is acquired from the target camera 102, overwriting the image data for display. By processing in this manner, it is possible to reduce consumption of network bandwidth and application resources related to image processing, and improve usability, compared to acquiring images from all cameras 102.
[0047] In the example described above, in step S709, if the image from the target camera 102 is displayed on the page before or after the currently displayed page (display page), the process returns to step S701, and image data is acquired from the target camera 102 and the display image data is overwritten. However, the present embodiment is not limited to this.
[0048] For example, if the video of the target camera 102 is displayed at the top of the page before or after the currently displayed page (display page), the process may return to step S701, and video data may be acquired from the target camera 102 and overwrite the video data for display. This reduces the network bandwidth required for communication compared to acquiring video from all cameras 102 displayed on the previous and next pages, and reduces resource consumption. Furthermore, when switching pages, video from only some of the cameras 102 that are displayed can be displayed without a time lag, improving usability.
[0049] Also, for example, when a predetermined time has passed since the last time the image was acquired from the camera 102, the process may return to step S701, acquire image data from the camera 102, and overwrite the image data for display. In this way, it is possible to avoid displaying an image that is too old when starting to display an image by switching pages.
[0050] Also, for example, if the resolution of the image captured by the camera 102 is higher than a predetermined resolution, the process may return to step S701, and image data may be acquired from the camera 102 and overwritten with the image data for display. When the image resolution is high, it is generally likely to take a long time to acquire the image data, but by switching pages, the time until the image is displayed can be shortened, thereby improving usability.
[0051] <Embodiment 2> The second embodiment is different from the first embodiment described above in the processing performed by the information processing device 103, but is otherwise similar to the first embodiment, so the following describes the processing performed by the information processing device 103 in the second embodiment. Note that the second embodiment can also be combined with the first embodiment.
[0052] Fig. 8 is a flowchart showing an example of processing performed by the information processing device 103 in embodiment 2. The processing of the flowchart shown in Fig. 8 is realized, for example, by the CPU 302 of the information processing device 103 executing various programs including the display program 503 that are loaded into the primary storage device 303. Fig. 8 shows an example of processing by the information processing device 103 to acquire video from one camera 102 (target camera 102) connected via the network 101. The information processing device 103 executes the processing of the flowchart shown in Fig. 8 for each camera 102 connected via the network 101.
[0053] In step S801, the control unit 601 of the information processing device 103 acquires camera information regarding the target camera 102, similar to step S701 in Figure 7, and acquires video data from the target camera 102 using the acquisition unit 604 based on the acquired camera information.
[0054] In step S802, the control unit 601 measures the time taken in step S801 to acquire video data from the target camera 102. In other words, the control unit 601 measures the round-trip time involved in acquiring video data from the target camera 102. The measured time taken to acquire the video is stored in the device management information 505 by the management unit 605.
[0055] In step S803, the control unit 601 stores the video data acquired from the target camera 102 in step S801 in the storage unit 603 as display video data related to the camera 102. Note that if the video data acquired from the target camera 102 is already stored in the storage unit 603 as display video data related to the camera 102, the display control unit 606 overwrites the stored video data with the video data acquired in step S801.
[0056] In step S804, the control unit 601 determines whether or not the image of the target camera 102 is displayed on the UI for displaying camera images, which is displayed on the display unit 607 by the display control unit 606. For example, it determines whether the image of the target camera 102 is newly displayed as a result of the page being switched. If the control unit 601 determines that the image of the target camera 102 is displayed on the UI (YES), the process proceeds to step S805. On the other hand, if the control unit 601 determines that the image of the target camera 102 is not displayed on the UI (NO), the process proceeds to step S810.
[0057] In step S805, the display control unit 606 displays the display image data of the target camera 102 stored in the storage unit 603 as an image of the camera 102 on the UI.
[0058] In step S806, the control unit 601 acquires video data from the target camera 102 using the acquisition unit 604 based on the acquired camera information. That is, video acquisition is continued for video from the camera 102 that will be switched from a hidden target to a displayed target as the page changes. The video data acquired here is, for example, video data currently being captured or video data currently being distributed.
[0059] In step S807, the display control unit 606 overwrites the display video data of the target camera 102 stored in the storage unit 603 with the video data acquired from the target camera 102 in step S806.
[0060] In step S808, the display control unit 606 displays the display image data of the target camera 102, which was overwritten in step S807, on the UI as an image of the camera 102.
[0061] In step S809, the control unit 601 determines whether or not the image from the target camera 102 is being displayed on the UI for displaying camera images. If the control unit 601 determines that the image from the target camera 102 is being displayed on the UI (YES), the process returns to step S806. Therefore, while the image from the target camera 102 is being displayed on the UI, the processes of steps S806 to S808 described above are repeated. On the other hand, if the control unit 601 determines that the image from the target camera 102 is not being displayed on the UI (NO), the process returns to step S804.
[0062] In step S810, the control unit 601 determines, based on the device management information 505, whether the time required to acquire the video of the target camera 102, measured in step S802, exceeds a predetermined time. If the control unit 601 determines that the time required to acquire the video of the target camera 102 exceeds the predetermined time (YES), the process returns to step S801. Then, the processes of steps S801 to S803 are executed, and the display video data of the target camera 102 stored in the storage unit 603 is overwritten with the video data acquired from the target camera 102. On the other hand, if the control unit 601 determines that the time required to acquire the video of the target camera 102 does not exceed the predetermined time (NO), the process returns to step S804. In this way, acquisition of the video of the camera 102 determined to exceed the predetermined time is started in advance, even if the video is not displayed on the display unit 607.
[0063] As described above, according to the second embodiment, the information processing device 103 acquires video data according to the time required to acquire the video, even when the video from the camera 102 is not displayed on the UI. This reduces the network bandwidth while enabling video display to start immediately when switching pages, thereby improving usability.
[0064] <Embodiment 3> The third embodiment differs from the first embodiment in the processing performed by the information processing device 103, but is otherwise similar to the first embodiment, so the following describes the processing performed by the information processing device 103 in the third embodiment. Note that the third embodiment can also be combined with the first and second embodiments.
[0065] Fig. 9 is a flowchart showing an example of processing performed by the information processing device 103 in the third embodiment. The processing of the flowchart shown in Fig. 9 is realized, for example, by the CPU 302 of the information processing device 103 executing various programs including the display program 503 that are loaded into the primary storage device 303. Fig. 9 shows an example of processing by the information processing device 103 to acquire video from one camera 102 (target camera 102) connected via the network 101. The information processing device 103 executes the processing of the flowchart shown in Fig. 9 for each camera 102 connected via the network 101.
[0066] In step S901, the control unit 601 of the information processing device 103 acquires camera information regarding the target camera 102, similar to step S701 in Figure 7, and acquires video data from the target camera 102 using the acquisition unit 604 based on the acquired camera information.
[0067] In step S902, the control unit 601 stores the video data acquired from the target camera 102 in step S901 in the storage unit 603 as display video data related to the camera 102. Note that if the video data acquired from the target camera 102 is already stored in the storage unit 603 as display video data related to the camera 102, the display control unit 606 overwrites the stored video data with the video data acquired in step S901.
[0068] In step S903, the control unit 601 determines whether or not the image of the target camera 102 is displayed on the UI for displaying camera images, which is displayed on the display unit 607 by the display control unit 606. For example, it determines whether the image of the target camera 102 is newly displayed as a result of the page being switched. If the control unit 601 determines that the image of the target camera 102 is displayed on the UI (YES), the process proceeds to step S904. On the other hand, if the control unit 601 determines that the image of the target camera 102 is not displayed on the UI (NO), the process proceeds to step S909.
[0069] In step S904, the display control unit 606 displays the display image data of the target camera 102 stored in the storage unit 603 as an image of the camera 102 on the UI.
[0070] In step S905, the control unit 601 acquires video data from the target camera 102 using the acquisition unit 604 based on the acquired camera information. That is, video acquisition is continued for video from the camera 102 that will be switched from a hidden target to a displayed target as the page changes. The video data acquired here is, for example, video data currently being captured or video data currently being distributed.
[0071] In step S906, the display control unit 606 overwrites the display video data of the target camera 102 stored in the storage unit 603 with the video data acquired from the target camera 102 in step S905.
[0072] In step S907, the display control unit 606 displays the display image data of the target camera 102 overwritten in step S906 as an image of the camera 102 on the UI.
[0073] In step S908, control unit 601 determines whether or not the image from the target camera 102 is being displayed on the UI for displaying camera images. If control unit 601 determines that the image from the target camera 102 is being displayed on the UI (YES), the process returns to step S905. Therefore, while the image from the target camera 102 is being displayed on the UI, the processes of steps S905 to S907 described above are repeated. On the other hand, if control unit 601 determines that the image from the target camera 102 is not being displayed on the UI (NO), the process returns to step S903.
[0074] In step S909, the control unit 601 determines whether PTZ control has been performed on the target camera 102 and whether the PTZ position of the camera 102 has changed. The control unit 601 determines that the PTZ position has changed if at least one of the pan, tilt, and zoom positions of the target camera 102 has changed. If the control unit 601 determines that the PTZ position of the target camera 102 has changed (YES), the process returns to step S901. Then, the processes of steps S901 and S902 are executed, and the display video data of the target camera 102 stored in the storage unit 603 is overwritten with the video data acquired from the target camera 102. On the other hand, if the control unit 601 determines that the PTZ position of the target camera 102 has not changed (NO), the process returns to step S903. In this way, acquisition of the video from the camera 102 whose PTZ position has been determined to have changed is started in advance, even if the video is not being displayed on the display unit 607.
[0075] As described above, according to the third embodiment, the information processing device 103 acquires video data if the PTZ position of the camera 102 has changed, even if the video from the camera 102 is not being displayed on the UI. This makes it possible to immediately start video display when switching pages, while avoiding the situation where video with a different angle of view is displayed due to a different PTZ position, thereby improving usability.
[0076] (Another embodiment of the present invention) The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program.The present invention can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.
[0077] It should be noted that the above-described embodiments are merely examples of specific embodiments for carrying out the present invention, and the technical scope of the present invention should not be construed as being limited by these embodiments. In other words, the present invention can be carried out in various forms without departing from its technical concept or main features.
[0078] The disclosure of this embodiment includes the following configurations, methods, etc. (Configuration 1) an acquisition means for acquiring a plurality of images captured by a plurality of imaging devices; a storage means for storing the plurality of images acquired by the acquisition means; a display control means for dividing the plurality of images into a plurality of pages and switching between the pages to display them on a display unit; and the plurality of images include an image displayed on the display unit and an image not displayed on the display unit, When it is determined that the image captured by the first imaging device among the plurality of images is displayed by switching pages, The display control means causes the display unit to display the image captured by the first imaging device stored in the storage means, and thereafter updates the image captured by the first imaging device displayed on the display unit with the image newly acquired by the acquisition means. 1. An information processing device comprising: (Configuration 2) The information processing device according to configuration 1 is characterized in that it has a control means for causing the acquisition means to acquire the image captured by the first imaging device while the image captured by the first imaging device is being displayed, and for overwriting the image of the first imaging device stored in the storage means. (Configuration 3) 3. The information processing device according to configuration 1 or 2, further comprising a control means for controlling the acquisition means to acquire images of the imaging device in which images are displayed on pages before and after the currently displayed page among the plurality of pages, and to overwrite the images of the imaging device stored in the storage means. (Configuration 4) The information processing device according to configuration 3, further comprising a control means for controlling the acquisition means to acquire, among the imaging devices whose images are displayed on the previous and next pages, the image of the imaging device that is displayed at the top of the previous and next pages. (Configuration 5) The information processing device according to any one of configurations 1 to 4, further comprising a control means for controlling the acquisition means to acquire an image of the imaging device after a predetermined time has elapsed since the image was acquired by the acquisition means, and to overwrite the image of the imaging device stored in the storage means. (Configuration 6) The information processing device according to any one of configurations 1 to 5, further comprising a control means for controlling the acquisition means to acquire an image of an imaging device among the plurality of imaging devices, the image of which resolution is higher than a predetermined resolution, and to overwrite the image of the imaging device stored in the storage means. (Configuration 7) The information processing device according to any one of configurations 1 to 6, further comprising a control means for controlling the acquisition means to acquire an image of an imaging device among the plurality of imaging devices that takes longer than a predetermined time to acquire the image, and to overwrite the image of the imaging device stored in the storage means. (Configuration 8) The information processing device according to any one of configurations 1 to 7, further comprising a control means for controlling the acquisition means to acquire an image of an imaging device in which at least one of pan, tilt, and zoom positions of the imaging device has changed, among the plurality of imaging devices, and to overwrite the image of the imaging device stored in the storage means. (Method 1) A control method for an information processing device, comprising: an acquisition step of acquiring a plurality of images captured by a plurality of imaging devices; a storage step of storing the plurality of images acquired in the acquisition step in a storage means; a display control step of dividing the plurality of images into a plurality of pages and switching between the pages to display them on a display unit; and the plurality of images include an image displayed on the display unit and an image not displayed on the display unit, When it is determined that the image captured by the first imaging device among the plurality of images is displayed by switching pages, A control method for an information processing device, characterized in that in the display control step, the image captured by the first imaging device and stored in the storage means is displayed on the display unit, and then the image captured by the first imaging device displayed on the display unit is updated with newly acquired image. (Program 1) an acquisition step of acquiring a plurality of images captured by a plurality of imaging devices; a storage step of storing the plurality of images acquired in the acquisition step in a storage means; a display control step of dividing the plurality of images into a plurality of pages and switching between the pages to display them on a display unit; on the computer, the plurality of images include an image displayed on the display unit and an image not displayed on the display unit, When it is determined that the image captured by the first imaging device among the plurality of images is displayed by switching pages, In the display control step, a program for causing a computer to execute a process of displaying on the display unit the image captured by the first imaging device stored in the storage means, and then updating the image captured by the first imaging device displayed on the display unit with newly acquired image. [Explanation of symbols]
[0079] 101: Network 102: Camera 103: Information processing device
Claims
1. an acquisition means for acquiring a plurality of images captured by a plurality of imaging devices; a storage means for storing the plurality of images acquired by the acquisition means; a display control means for dividing the plurality of images into a plurality of pages and displaying the images on a display unit by switching between the pages; and the plurality of images include an image displayed on the display unit and an image not displayed on the display unit, When it is determined that the image captured by the first imaging device among the plurality of images is displayed by switching pages, The display control means causes the display unit to display the image captured by the first imaging device stored in the storage means, and thereafter updates the image captured by the first imaging device displayed on the display unit with the image newly acquired by the acquisition means.
1. An information processing device comprising:
2. The information processing device according to claim 1, further comprising a control means for causing the acquisition means to acquire the image captured by the first imaging device while the image captured by the first imaging device is displayed, and for overwriting the image of the first imaging device stored in the storage means.
3. The information processing device according to claim 1 or 2, characterized in that it has a control means for controlling the acquisition means to acquire images of the imaging device on which images are displayed on pages before and after the currently displayed page of the plurality of pages, and to overwrite the images of the imaging device stored in the storage means.
4. 4. The information processing device according to claim 3, further comprising a control means for controlling the acquisition means to acquire the image of the imaging device displayed at the top of the previous or next page, among the imaging devices whose images are displayed on the previous or next page.
5. 3. The information processing device according to claim 1, further comprising a control means for controlling the acquisition means to acquire an image of the imaging device after a predetermined time has elapsed since the image was acquired by the acquisition means, and to overwrite the image of the imaging device stored in the storage means.
6. 3. The information processing device according to claim 1, further comprising a control means for controlling the acquisition means to acquire an image from an imaging device among the plurality of imaging devices, the image of which resolution is higher than a predetermined resolution, and to overwrite the image from the imaging device stored in the storage means.
7. 3. The information processing device according to claim 1, further comprising a control means for controlling the acquisition means to acquire an image from an imaging device among the plurality of imaging devices that takes longer than a predetermined time to acquire the image, and to overwrite the image from the imaging device stored in the storage means.
8. 3. The information processing device according to claim 1, further comprising a control means for controlling the acquisition means to acquire an image of an imaging device among the plurality of imaging devices in which at least one of the pan, tilt, and zoom positions of the imaging device has changed, and to overwrite the image of the imaging device stored in the storage means.
9. A control method for an information processing device, comprising: an acquisition step of acquiring a plurality of images captured by a plurality of imaging devices; a storage step of storing the plurality of images acquired in the acquisition step in a storage means; a display control step of dividing the plurality of images into a plurality of pages and switching between the pages to display them on a display unit; and the plurality of images include an image displayed on the display unit and an image not displayed on the display unit, When it is determined that the image captured by the first imaging device among the plurality of images is displayed by switching pages, A control method for an information processing device, characterized in that in the display control process, the image captured by the first imaging device and stored in the storage means is displayed on the display unit, and then the image captured by the first imaging device displayed on the display unit is updated with newly acquired image.
10. an acquisition step of acquiring a plurality of images captured by a plurality of imaging devices; a storage step of storing the plurality of images acquired in the acquisition step in a storage means; a display control step of dividing the plurality of images into a plurality of pages and switching between the pages to display them on a display unit; on the computer, the plurality of images include an image displayed on the display unit and an image not displayed on the display unit, When it is determined that the image captured by the first imaging device among the plurality of images is displayed by switching pages, In the display control step, a program for causing a computer to execute a process of displaying the image captured by the first imaging device stored in the storage means on the display unit, and then updating the image captured by the first imaging device displayed on the display unit with newly acquired image.
Citation Information
Patent Citations
Video transmission system
JP2008211503A
Decoder
JP2010220020A
Video image display system and method
JP2018113628A
Method and apparatus for distributing multimedia to remote clients
US20050091311A1
Device and method for reproducing video content, program, and recording medium
JP2012253712A