Information processing device, information processing method, information processing program, and information processing system

Abstract

The objective is to provide an information processing device, information processing method, information processing program, and information processing system that can appropriately delete and save data. [Solution] The management server 50 includes a setting unit 54 that sets images stored in a second external storage 91, which is an example of a storage means, as targets to be deleted from the second external storage 91 when predetermined conditions are met, and a transmitting / receiving unit 51 that transmits input screen information related to an input screen 400 for inputting information to set images to be excluded from deletion to a communication terminal 10. The setting unit 54 sets images to be excluded from deletion in response to operations on the input screen 400 displayed on the communication terminal 10 based on the transmitted input screen information.

Description

Technical Field

[0001] The present disclosure relates to an information processing apparatus, an information processing method, an information processing program, and an information processing system.

Background Art

[0002] In recent years, with the spread of cloud (cloud services, cloud computing), various services can be used via a network. There are service provision forms such as SaaS (Software as a Service) and PaaS (Platform as a Service) in the cloud.

[0003] Patent Document 1 discloses an external service setting information storage means for storing settings for using an external service in association with a user, a destination setting information storage means for storing destination setting information in which an external service is set as a data transmission destination in association with the user, an identification means for identifying one or more users, and a transmission means for transmitting data to a transmission destination of a different external service for each of the one or more identified users based on the destination setting information associated with each of the one or more users. Thus, an information processing system is disclosed that can reduce the trouble of selecting an external service that requires settings for use as a transmission destination for each user when transmitting data related to an image to be displayed.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] An object of the present invention is to provide an information processing apparatus, an information processing method, an information processing program, and an information processing system that can appropriately perform data deletion and storage. [Means for solving the problem]

[0006] The information processing device according to claim 1 of the present invention comprises: setting means for setting images transmitted from a shooting device and stored in a storage means as targets to be deleted from the storage means when predetermined conditions are met; and transmitting means for transmitting input screen information relating to an input screen for inputting information to set images to be excluded from deletion to a communication terminal, wherein the setting means sets images to be excluded from deletion in response to operations on the input screen displayed on the communication terminal based on the transmitted input screen information. [Effects of the Invention]

[0007] According to the present invention, it is possible to provide an information processing device, an information processing method, an information processing program, and an information processing system that can appropriately delete and save data. [Brief explanation of the drawing]

[0008] [Figure 1] This diagram shows an example of the overall configuration of a communication system. [Figure 2] This figure shows an example of the hardware configuration of a communication terminal. [Figure 3] This figure shows an example of the hardware configuration of an imaging device. [Figure 4] This figure shows an example of the hardware configuration of the management server. [Figure 5] This diagram shows an example of the functional configuration of a communication system. [Figure 6] This is a conceptual diagram showing an example of an account management table. [Figure 7] This is a conceptual diagram showing an example of a user information management table. [Figure 8] This is a conceptual diagram showing an example of an image information management table. [Figure 9] This sequence diagram shows an example of the process for saving a normal image. [Figure 10] This is a sequence diagram showing an example of the process for saving time-lapse images. [Figure 11] It is a sequence diagram showing an example of the management process of time-lapse images. [Figure 12] It is a flowchart showing an example of the storage process of normal images. [Figure 13] It is a flowchart showing an example of the storage process of time-lapse images. [Figure 14] It is a flowchart showing an example of the setting process of the confirmation screen. [Figure 15] It is a flowchart showing an example of the setting process of the input screen. [Figure 16] It is a flowchart showing an example of the deletion exclusion process of time-lapse images. [Figure 17] It is a flowchart showing an example of the deletion process of time-lapse images. [Figure 18] It is a diagram showing an example of the confirmation screen. [Figure 19] It is a diagram showing an example of the input screen. [Figure 20] It is a diagram showing the functional configuration in a modified example of the communication system. [Figure 21] It is a sequence diagram showing the storage process of normal images in the modified example shown in FIG. 20. [Figure 22] It is a sequence diagram showing the storage process of time-lapse images in the modified example shown in FIG. 20. [Figure 23] It is a diagram showing the functional configuration in the second modified example of the communication system. [Figure 24] It is a sequence diagram showing the streaming process in the second modified example. [Figure 25] It is a diagram showing an example of the input screen in the second modified example. [Figure 26] It is a flowchart showing the processing of the messaging server in the second modified example. [Figure 27] It is a flowchart showing the processing of the streaming server in the second modified example. [Figure 28] It is a flowchart showing the processing of the imaging device in the second modified example. [Figure 29]This figure shows the functional configuration of the imaging device in a third modified example of the communication system. [Figure 30] This is a flowchart showing the processing of the imaging device in the third modified example. [Figure 31] This is a flowchart showing other operations of the imaging device in the third modified example. [Modes for carrying out the invention]

[0009] The embodiments for carrying out the invention will be described below with reference to the drawings. In the description of the drawings, the same elements will be denoted by the same reference numeral, and redundant explanations will be omitted.

[0010] ●Embodiment● ● Overview of the communication system First, an overview of the configuration of the communication system according to the embodiment will be explained using Figure 1. Figure 1 is a diagram showing an example of the overall configuration of the communication system. The communication system 1 shown in Figure 1 is a system that allows viewing locations to view the status of a distribution location in real time by participating in predetermined services such as remote communication provided by the management server 50, and displaying captured images such as video distributed from a distribution location at a viewing location.

[0011] Here, the specified services include interval shooting mode (also referred to as time-lapse shooting mode in this specification), remote meetings, remote classes, remote medical examinations, discussions or consultations, or inspections, monitoring or patrols of remote locations, etc., which are realized through communication between remote locations via the management system 5.

[0012] Here, time-lapse shooting mode refers to the continuous capture of multiple images under predetermined shooting conditions (including shooting interval, number of shots, shooting period (start and end times), etc.). Time-lapse service, on the other hand, is a service for sharing multiple images captured using time-lapse shooting mode.

[0013] Furthermore, the time-lapse service may also have a time-lapse video function that creates a video using multiple images taken in time-lapse shooting mode. The time-lapse video function is a function that generates a video by stitching together multiple images taken at a fixed shooting interval under predetermined shooting conditions, and when the video is played back at normal speed (1x speed), it is possible to view a video that shows the passage of time quickly, like a fast-forward video. By having a time-lapse video function, the status of the distribution site can be viewed like a fast-forward video, and users at the viewing site can easily and quickly grasp the changes in the situation on site over time.

[0014] As shown in Figure 1, communication system 1 is an example of an information processing system and includes a communication terminal 10 located at a viewing point, a camera 30 located at a distribution point (the field), and a management server 50. The communication terminal 10, camera 30, and management server 50 that constitute communication system 1 can communicate via a communication network 100. The communication network 100 is constructed using the Internet, a mobile communication network, a LAN (Local Area Network), etc. Note that the communication network 100 may include not only wired communication but also wireless communication networks such as 3G (3rd Generation), 4G (4th Generation), 5G (5th Generation), Wi-Fi (Wireless Fidelity) (registered trademark), WiMAX (Worldwide Interoperability for Microwave Access), or LTE (Long Term Evolution).

[0015] The communication terminal 10 is a computer such as a notebook PC (Personal Computer), smartphone, or tablet used by a user at the viewing location. The communication terminal 10 participates in a predetermined service provided by the management server 50 after user authentication by the management server 50. The communication terminal 10 displays images captured by the camera 30 installed at the distribution location, allowing the user to view the status of the distribution location.

[0016] Furthermore, the communication terminal 10 is not limited to notebook PCs, smartphones, or tablet devices, but may also be, for example, a desktop PC, a wearable device, an HMD (head-mounted display), or an IWB (Interactive White Board: a whiteboard with electronic blackboard functionality that enables mutual communication).

[0017] The camera 30 is installed at a distribution site, such as an office or factory, and is a device that participates in a predetermined service provided by the management server 50. The camera 30 is pre-registered with the management server 50, and when the service is started at the request of a user, it launches the installed application and participates in the service as a participant. The camera 30 takes pictures of subjects, scenery, etc., within the distribution site, acquires captured images, and transmits them to the communication terminal 10 participating in the service via the management server 50. The captured images obtained by the camera 30 may be videos, still images, or both. The captured images may also include audio.

[0018] Here, the camera 30 is an example of a device that participates in the service provided by the management server 50. The devices that participate in the service are not limited to the camera, but may also be video conferencing terminals, IWBs (Interactive White Boards: whiteboards with electronic blackboard functions that enable mutual communication), or mobile devices such as robots that move around within the distribution center.

[0019] Furthermore, the imaging device 30 is an example of a measuring device and acquires captured images, which are an example of the measurement data acquired by the measuring device. The distribution location where the imaging device 30 is installed is not limited to offices or factories, but may be an outdoor location such as a business office, construction site, substation, farm, field, or cultivated land, road or intersection or disaster site, or an indoor location such as a school, warehouse, commercial facility, hospital, real estate or nursing home. In other words, the distribution location where the imaging device 30 is installed can be any location where there is a need to perform services such as remote conferencing or inspection with users located at the viewing location. As will be described later, the communication system 1 may include multiple imaging devices 30.

[0020] The management server 50 is an example of an information processing device and is a server computer that provides and manages services performed between the communication terminal 10 and the imaging device 30. The management server 50 manages and controls communication between the communication terminal 10 and the imaging device 30 and relays transmitted and received image data. The management server 50 also cooperates with an external storage service that provides a first external storage 90 and a second external storage 91, and stores access information to the first external storage 90 and the second external storage 91. Here, the first external storage 90 and the second external storage 91 are examples of storage means for storing images, which are an example of data, with the first external storage 90 being an example of a first storage means and the second external storage 91 being an example of a second storage means.

[0021] The management server 50 may be configured to distribute its functions across multiple computers. Furthermore, although the management server 50 is described as a server computer located in a cloud environment, it may also be a server located in an on-premises environment.

[0022] The first external storage 90 and the second external storage 91 are storage services (or online storage) provided by an external service provider via the communication network 100. The first external storage 90 and the second external storage 91 are, for example, storage locations for saving data files on the cloud, and users who subscribe to the use of the external storage service can save and view data there.

[0023] ● Hardware configuration Next, the hardware configuration of each device or terminal constituting the communication system according to the embodiment will be described using Figures 2 to 4. Note that the hardware configuration shown in Figures 2 to 4 may have components added or removed as needed.

[0024] ○Hardware configuration of communication terminals○ First, the hardware configuration of the communication terminal 10 will be explained using Figure 2. Figure 2 is a diagram showing an example of the hardware configuration of a communication terminal. The communication terminal 10 is built by a computer and, as shown in Figure 2, is equipped with a CPU (Central Processing Unit) 101, ROM (Read Only Memory) 102, RAM (Random Access Memory) 103, HD (Hard Disk) 104, HDD (Hard Disk Drive) controller 105, display 106, external device connection I / F (Interface) 107, network I / F 108, bus line 110, keyboard 111, pointing device 112, sound input / output I / F 113, microphone 114, speaker 115, camera 116, DVD-RW (Digital Versatile Disk Rewritable) drive 117, and media I / F 119.

[0025] Of these, the CPU 101 controls the operation of the entire communication terminal 10. The ROM 102 stores programs used to drive the CPU 101, such as the IPL (Initial Program Loader). The RAM 103 is used as the work area for the CPU 101. The HD 104 stores various data such as programs. The HDD controller 105 controls the reading or writing of various data to the HD 104 according to the control of the CPU 101. The display 106 is a type of display means that displays various information such as cursors, menus, windows, characters, or images. Note that the display 106 may be a touch panel display equipped with input means. The external device connection I / F 107 is an interface for connecting various external devices. The network I / F 108 is an interface for data communication using the communication network 100. The bus line 110 is an address bus or data bus, etc., for electrically connecting each component such as the CPU 101 shown in Figure 2.

[0026] Furthermore, the keyboard 111 is a type of input means equipped with multiple keys for inputting characters, numbers, various instructions, etc. The pointing device 112 is a type of input means for selecting or executing various instructions, selecting a processing target, or moving a cursor, etc. Note that the input means may not be limited to the keyboard 111 and the pointing device 112, but may also be a touch panel or an audio input device, etc. The audio input / output I / F 113 is a circuit that processes the input and output of audio signals between the microphone 114 and the speaker 115 according to the control of the CPU 101. The microphone 114 is a type of built-in sound collection means for inputting sound. The speaker 115 is a type of built-in output means for outputting audio signals. The camera 116 is a type of built-in shooting means for taking pictures of a subject and obtaining image data. Note that the microphone 114, speaker 115 and camera 116 may be external devices instead of being built into the communication terminal 10. The DVD-RW drive 117 controls the reading or writing of various data to the DVD-RW 118, which is an example of a removable recording medium. The removable recording medium is not limited to DVD-RW; it may also be DVD-R or Blu-ray® Disc, etc. The media I / F 119 controls the reading or writing (storage) of data to or from the recording medium 121, such as flash memory.

[0027] ○Hardware configuration of the imaging device○ Next, the hardware configuration of the imaging device 30 will be explained using Figure 3. Figure 3 is a diagram showing an example of the hardware configuration of the imaging device. Figure 3 shows an example of a 360-degree imaging device that captures a subject or landscape and acquires a 360-degree image as the imaging device 30. The imaging device 30 may be a regular digital camera or a smartphone or other camera that acquires regular planar images, or it may be a wide-angle camera that can acquire wide-angle images with a field of view of a predetermined value or greater. Furthermore, in the following, the imaging device 30 will be described as a 360-degree (omnidirectional) imaging device using two image sensors, but there may be more than two image sensors. Also, it is not necessarily required to be a device dedicated to omnidirectional imaging; a regular digital camera or smartphone may have an omnidirectional imaging unit attached to it to have essentially the same function as the imaging device 30.

[0028] As shown in Figure 3, the imaging device 30 consists of an imaging unit 301, an image processing unit 304, an imaging control unit 305, a microphone 308, a sound processing unit 309, a CPU (Central Processing Unit) 311, a ROM (Read Only Memory) 312, an SRAM (Static Random Access Memory) 313, a DRAM (Dynamic Random Access Memory) 314, an operation unit 315, an input / output interface (I / F) 316, a short-range communication circuit 317, an antenna 317a for the short-range communication circuit 317, an electronic compass 318, a gyro sensor 319, an acceleration sensor 320, and a network interface 321.

[0029] Of these, the imaging unit 301 includes wide-angle lenses (so-called fisheye lenses) 302a and 302b (hereinafter referred to as lens 302 unless otherwise specified) each having a field of view of 180° or more for forming a hemispherical image, and two imaging elements 303a and 303b provided in correspondence with each lens. The imaging elements 303a and 303b have an image sensor such as a CMOS (Complementary Metal Oxide Semiconductor) sensor or a CCD (Charge Coupled Device) sensor that converts the optical image from the lenses 302a and 302b into electrical signal image data and outputs it, a timing generation circuit that generates horizontal or vertical synchronization signals and pixel clocks for the image sensor, and a group of registers on which various commands or parameters necessary for the operation of the imaging element are set.

[0030] The image sensors 303a and 303b of the imaging unit 301 are each connected to the image processing unit 304 via a parallel I / F bus. On the other hand, the image sensors 303a and 303b of the imaging unit 301 are each connected to the imaging control unit 305 via a serial I / F bus (such as an I2C bus). The image processing unit 304, the imaging control unit 305, and the sound processing unit 309 are connected to the CPU 311 via bus 310. Furthermore, ROM 312, SRAM 313, DRAM 314, operation unit 315, input / output I / F 316, short-range communication circuit 317, electronic compass 318, gyro sensor 319, acceleration sensor 320, and network I / F 321 are also connected to bus 310.

[0031] The image processing unit 304 receives image data output from the image sensors 303a and 303b via a parallel I / F bus, performs predetermined processing on each image data, and then combines these image data to create equirectangular projection image data.

[0032] The imaging control unit 305 generally uses the I2C bus to set commands and other information in the registers of the image sensors 303a and 303b, with the imaging control unit 305 acting as the master device and the image sensors 303a and 303b as slave devices. The necessary commands and other information are received from the CPU 311. The imaging control unit 305 also uses the I2C bus to capture status data and other information from the registers of the image sensors 303a and 303b and send it to the CPU 311.

[0033] Furthermore, the shooting control unit 305 instructs the image sensors 303a and 303b to output image data when the shutter button on the operation unit 315 is pressed. Depending on the shooting device 30, there may also be functions to display a preview or video on a display (for example, the display of an external terminal such as a smartphone that communicates with the shooting device 30 via a short-range communication circuit 317). In this case, the image data output from the image sensors 303a and 303b is performed continuously at a predetermined frame rate (frames / minute).

[0034] Furthermore, as will be described later, the shooting control unit 305 also functions as a synchronization control means that works in cooperation with the CPU 311 to synchronize the output timing of image data from the image sensors 303a and 303b. In this embodiment, the shooting device 30 is not provided with a display unit, but a display unit may be provided. The microphone 308 converts sound into sound (signal) data. The sound processing unit 309 takes in the sound data output from the microphone 308 through the I / F bus and performs predetermined processing on the sound data.

[0035] The CPU 311 controls the overall operation of the imaging device 30 and performs necessary processing. The ROM 312 stores various programs for the CPU 311. The SRAM 313 and DRAM 314 are work memories that store programs executed by the CPU 311 and data in progress. In particular, the DRAM 314 stores image data in progress and processed equirectangular projection image data from the image processing unit 304.

[0036] The control unit 315 is a collective term for various operation buttons, a power switch, a shutter button, and a touch panel that combines display and operation functions. The user inputs various shooting modes, shooting conditions, etc., by operating the control unit 315.

[0037] The input / output interface (I / F) 316 is a general term for interface circuits (such as USB I / F) to external media such as SD cards or personal computers. The I / F 316 can be wireless or wired. The data of the equirectangular projection image stored in the DRAM 314 is recorded to external media via the I / F 316, or transmitted to an external terminal (device) via the I / F 316 as needed.

[0038] The short-range communication circuit 317 communicates with an external terminal (device) via an antenna 317a provided on the imaging device 30 using short-range wireless communication technologies such as NFC (Near Field Communication), Bluetooth (registered trademark), or Wi-Fi. The short-range communication circuit 317 can transmit equirectangular projection image data to the external terminal (device).

[0039] The electronic compass 318 calculates the orientation of the camera 30 from the Earth's magnetic field and outputs orientation information. This orientation information is an example of related information (metadata) according to Exif and is used for image processing such as image correction of captured images. The related information also includes the date and time the image was taken and the data size of the image data. The gyro sensor 319 is a sensor that detects changes in angle (Roll angle, Pitch angle, Yaw angle) associated with the movement of the camera 30. The changes in angle are an example of related information (metadata) according to Exif and are used for image processing such as image correction of captured images. Furthermore, the accelerometer 320 is a sensor that detects acceleration in three axes. The camera 30 calculates its own orientation (angle relative to the vertical) based on the angular velocity and acceleration detected by the gyro sensor 319 and the accelerometer 320. By providing the gyro sensor 319 and the accelerometer 320, the accuracy of image correction is improved in the camera 30.

[0040] For example, the imaging device 30 has a zenith correction means (not shown) that corrects the zenith direction of the 360-degree image so that it coincides with or closely coincides with the vertical direction, and an image stabilization means (not shown) that corrects camera shake, and the implementation and accuracy of zenith correction and image stabilization can be improved based on angular velocity and acceleration. The zenith correction means and image stabilization means may also be provided by the image processing unit 304. The network I / F 321 is an interface for data communication using a communication network 100 such as the Internet via a router or the like.

[0041] ○Hardware configuration of the management server○ Next, the hardware configuration of the management server 50 will be described using Figure 4. Figure 4 is a diagram showing an example of the hardware configuration of the management server. Each hardware component of the management server 50 is indicated by a code in the 500 series. The management server 50 is built by a computer and, as shown in Figure 4, includes a CPU 501, ROM 502, RAM 503, HD 504, HDD controller 505, display 506, external device connection I / F 508, network I / F 509, bus line 510, keyboard 511, pointing device 512, DVD-RW drive 514, and media I / F 516.

[0042] Of these, the CPU 501 controls the operation of the entire management server 50. The ROM 502 stores programs used to drive the CPU 501, such as IPL. The RAM 503 is used as the work area for the CPU 501. The HD 504 stores various data such as programs. The HDD controller 505 controls the reading or writing of various data to the HD 504 according to the control of the CPU 501. The display 506 displays various information such as cursors, menus, windows, characters, or images. The display 506 may be a touch panel display equipped with input means. The external device connection I / F 508 is an interface for connecting various external devices. The network I / F 509 is an interface for data communication using the communication network 100. The bus line 510 is an address bus or data bus, etc., for electrically connecting each component such as the CPU 501 shown in Figure 4.

[0043] Furthermore, the keyboard 511 is a type of input means equipped with multiple keys for inputting characters, numbers, various instructions, etc. The pointing device 512 is a type of input means for selecting or executing various instructions, selecting a processing target, or moving a cursor, etc. Note that the input means may not be limited to the keyboard 511 and the pointing device 512, but may also be a touch panel or an audio input device, etc. The DVD-RW drive 514 controls the reading or writing of various data to the DVD-RW 513, which is an example of a removable recording medium. Note that the removable recording medium is not limited to DVD-RW, but may also be DVD-R or Blu-ray Disc, etc. The media I / F 516 controls the reading or writing (storage) of data to the recording medium 515, such as flash memory.

[0044] Furthermore, each of the above programs may be distributed as an installable or executable file recorded on a computer-readable recording medium. Examples of recording media include CD-R (Compact Disc Recordable), DVD (Digital Versatile Disk), Blu-ray Disc, SD card, USB memory, etc. The recording media can also be provided domestically or internationally as a program product. For example, the management server 50 implements the processing method according to the present invention by executing the program according to the present invention.

[0045] ●Functional Configuration Next, the functional configuration of the communication system according to the embodiment will be described using Figures 5 to 8. Figure 5 is a diagram showing an example of the functional configuration of the communication system. Note that Figure 5 shows the devices or terminals shown in Figure 1 that are related to the processing or operation described later.

[0046] ○Communication terminal function configuration○ First, the functional configuration of the communication terminal 10 will be explained using Figure 5. The communication terminal 10 has a transmitting / receiving unit 11, a receiving unit 12, a display control unit 13, a determination unit 14, and a storage / reading unit 19. Each of these units is a function or means realized by the operation of any of the components shown in Figure 2 by instructions from the CPU 101 according to the communication terminal program deployed from the HD 104 onto the RAM 103. The communication terminal 10 also has a storage unit 1000 constructed from the ROM 102, HD 104, or recording medium 121 shown in Figure 2.

[0047] The transmitting / receiving unit 11 is mainly implemented by the processing of the network interface 108 by the CPU 101, and transmits and receives various data or information with other devices or terminals via the communication network 100.

[0048] The reception unit 12 is primarily implemented by the processing of the keyboard 111 or pointing device 112 by the CPU 101, and accepts various selections or inputs from the user.

[0049] The display control unit 13 is primarily implemented by the CPU 101 and displays various screen data on the display 106 by accessing the management server 50 using a web browser. Specifically, the display control unit 13 accesses the management server 50 by, for example, launching and executing an application or browser installed on the communication terminal 10. The display control unit 13 then downloads a WebApp (WebApplication) that includes at least HTML (HyperText Markup Language) and CSS (Cascading Style Sheets) or JAVA SCRIPT (registered trademark), and displays various image data generated by that WebApp on the display 106. The display control unit 13 also displays image data generated by HTML5 that includes data in formats such as XML (Extensible Markup Language), JSON (JavaScript Object Notation), or SOAP (Simple Object Access Protocol) on the display 106.

[0050] The decision unit 14 is implemented by the CPU 101 and performs various decisions. The storage / reading unit 19 is mainly implemented by the CPU 101 and stores various data (or information) in the storage unit 1000 and reads various data (or information) from the storage unit 1000.

[0051] ○Functional Configuration of the Imaging Device○ Next, the functional configuration of the imaging device 30 will be explained using Figure 5. The imaging device 30 has a transmitting / receiving unit 31, an imaging control unit 33, and a storage / reading unit 39. Each of these units is a function or means realized by the operation of any of the components shown in Figure 3 by instructions from the CPU 311 according to a program for the imaging device deployed on the SRAM 313 to the DRAM 314. The imaging device 30 also has a storage unit 3000 constructed from the ROM 312, SRAM 313, and DRAM 314 shown in Figure 3. The storage unit 3000 stores the GUID (Globally Unique Identifier) ​​of the device.

[0052] The transmitting / receiving unit 31 is primarily implemented by the processing of the CPU 311 and communicates various data or information with other devices or terminals. Furthermore, the transmitting / receiving unit 31 uses the network I / F 321 to perform data communication with other devices or terminals via the communication network 100.

[0053] The shooting control unit 33 is mainly implemented by the processing performed by the CPU 311 on the shooting unit 301, image processing unit 304, and shooting control unit 305, and captures subjects such as landscapes and acquires captured image data.

[0054] The storage and reading unit 39 is primarily implemented by the CPU 311 and stores various data (or information) in the storage unit 3000 and reads various data (or information) from the storage unit 3000. The storage unit 3000 also stores captured image data acquired by the shooting control unit 33. The captured image data stored in the storage unit 3000 has the shooting time of the captured image associated with it as metadata.

[0055] ○Management Server Functional Configuration○ Next, the functional configuration of the management server 50 will be described using Figure 5. The management server 50 has a transmitting / receiving unit 51, a determination unit 52, a setting unit 54, and a storage / reading unit 59. Each of these units is a function or means realized by the operation of any of the components shown in Figure 4 by instructions from the CPU 501 according to the management server program deployed from the HD 504 onto the RAM 503. The management server 50 also has a storage unit 5000 constructed from the ROM 502, HD 504, or recording media 515 shown in Figure 4.

[0056] The transmitting / receiving unit 51 is mainly implemented by the processing of the network interface 509 by the CPU 501, and transmits and receives various data or information with other devices or terminals via the communication network 100.

[0057] The determination unit 52 is implemented by the CPU 501 and performs various decisions. The setting unit 54 is mainly implemented by the CPU 501 and performs various settings.

[0058] The storage and reading unit 59 is primarily implemented by the CPU 501 and performs the storage of various data (or information) to the storage unit 5000 and the reading of various data (or information) from the storage unit 5000. The storage unit 5000 may be configured to be built on an external storage device of the management server 50.

[0059] ○Account Management Table○ Figure 6 is a conceptual diagram showing an example of an account management table. The storage unit 5000 has an account management DB 5001 constructed, which consists of the account management table shown in Figure 6.

[0060] The account management table manages account information (account ID) that identifies accounts managed by the management server 50, the maximum number of images that can be stored in the first external storage 90 and the second external storage 91, and the maximum number of terminals that can use the services provided by the management server 50. The account management table stores the maximum number of images that can be stored and the maximum number of terminals that can use the service for each account, associating them with each account.

[0061] ○Challenges of the Business Model○ In infrastructure development sites and construction sites, it is sometimes necessary to manage work and site conditions over a long period of time.

[0062] In recent years, cloud services have emerged in various forms, such as SaaS (Software as a Service) and PaaS (Platform as a Service).

[0063] In this embodiment, a cloud service for saving and sharing images can be suitably provided. Various contents can be considered for the cloud service usage agreement, for example, it is conceivable to define "the maximum number of images that can be saved," "the maximum storage capacity for saving still images and videos," and "the maximum number of users (devices) that can use the service."

[0064] The fixed monthly fee may be determined based on usage conditions such as the maximum number of photos that can be stored, the maximum storage capacity, and the maximum number of users (devices). For the fixed monthly fee, a subscription model is possible, where a fee is charged for the right to use the service.

[0065] For example, if time-lapse photography is performed at a construction site, the sequential saving of the captured images could potentially exceed the "maximum number of images that can be saved" and "maximum storage capacity" stipulated in the usage agreement.

[0066] Specifically, for example, if the shooting conditions for time-lapse photography are set to "10-minute intervals and a 10-day shooting period," the number of images captured and saved will amount to 1440. In this case, if the "maximum number of images that can be saved" in the usage conditions is 1000, time-lapse photography alone will exceed the upper limit of the saving conditions.

[0067] This means that images taken using methods other than time-lapse photography (normal photography) cannot be saved, and users face challenges such as deleting saved images to increase the remaining maximum number of saved images, or reviewing their service agreement and changing to a plan that allows for more storage, which may make them hesitant to use time-lapse photography.

[0068] This embodiment provides an information processing device, an information processing method, an information processing program, and an information processing system that can appropriately delete and save data.

[0069] ○Usage Information Management Table○ Figure 7 is a conceptual diagram showing an example of a user information management table. The user information management table is a table for managing users who can use the time-lapse service provided by the management server 50 and devices such as the imaging device 30. The storage unit 5000 has a user information management DB 5002 constructed, which is composed of user information management tables like the one shown in Figure 7.

[0070] The usage information management table manages each account information (account ID) by associating it with a usage ID and either user identification information (user ID) or device identification information (model ID). The number of usage IDs is set to the maximum number of terminals per account managed in the account management DB5001 shown in Figure 6.

[0071] ○Image Information Management Table○ Figure 8 is a conceptual diagram showing an example of an image information management table. The image management table is a table for managing images stored in the first external storage 90 and the second external storage 91. The storage unit 5000 has an image information management DB 5003 constructed, which is composed of the image information management table shown in Figure 8.

[0072] The image information management table manages images stored in the first external storage 90 and the second external storage 91 by associating them with image identification information (image ID), a time-lapse flag indicating whether or not the time-lapse service is used, device identification information (model ID) registered for use with the time-lapse service, the acquisition time of images taken by time-lapse photography, and a deletion exclusion flag indicating that images taken by time-lapse photography should be excluded from deletion.

[0073] ●Processing or operation of the embodiment ○Normal image saving process○ Figure 9 is a sequence diagram showing an example of the normal image saving process. The communication system 1 will first be described assuming that it is authorized to use the first external storage 90 and the second external storage 91.

[0074] The shooting control unit 33 of the shooting device 30 manually takes a picture when the user operates the operation unit 315 (step S1), and the transmitting / receiving unit 31 of the shooting device 30 transmits the account ID and the image to the first external storage 90 (step S2).

[0075] The first external storage 90 stores the images transmitted from the imaging device 30 (step S3) and transmits the account ID and image ID to the management server 50 (step S4).

[0076] Here, the image ID that the first external storage 90 sends to the management server 50 may be attached to the image sent from the imaging device 30, or it may be assigned by the first external storage 90 based on the image sent from the imaging device 30.

[0077] When the transmission / reception unit 51 of the management server 50 receives the account ID and image ID transmitted from the first external storage 90, the determination unit 52 of the management server 50 retrieves the account ID managed in the account management DB 5001 via the storage / reading unit 59 and determines whether the account ID transmitted from the first external storage 90 matches the account ID managed in the account management DB 5001.

[0078] The decision unit 52 of the management server 50 further obtains the maximum number of images to be stored managed in the account management DB 5001 and the number of images to be stored managed in the image information management DB 5003 via the storage / reading unit 59, and determines whether the number of images to be stored has reached the upper limit, the maximum number of images to be stored (step S5). Details of the images to be stored managed in the image information management DB 5003 will be described later.

[0079] If the determination unit 52 of the management server 50 determines that the account ID sent from the first external storage 90 does not match an account ID managed in the account management DB 5001, or that the number of images to be saved managed in the image information management DB 5003 has reached the maximum number of saved images, the transmission / reception unit 51 of the management server 50 sends the image ID to be deleted to the first external storage 90 (step S6).

[0080] When the first external storage 90 receives an image ID sent from the management server 50, it deletes the image corresponding to that image ID (step S7).

[0081] If the determination unit 52 of the management server 50 determines that the account ID transmitted from the first external storage 90 matches an account ID managed in the account management DB 5001, and that the number of images to be saved managed in the image information management DB 5003 has not reached the maximum number of images to be saved, the setting unit 54 of the management server 50 stores the image ID in the image information management DB 5003 in association with the account ID via the storage / reading unit 59 (step S8).

[0082] ○Saving time-lapse images○ Figure 10 is a sequence diagram showing an example of the time-lapse image saving process.

[0083] The transmitting / receiving unit 11 of the communication terminal 10 transmits the account ID, the model ID of the shooting device 30 that will use the time-lapse service, and time-lapse ON information indicating registration for time-lapse use to the management server 50 (step S11).

[0084] All or part of the account ID, model ID, and time-lapse ON information may be entered by the reception unit 12 of the communication terminal 10, or obtained from the management server 50.

[0085] When the transmission / reception unit 51 of the management server 50 receives the account ID, model ID, and time-lapse ON information transmitted from the communication terminal 10, the setting unit 54 of the management server 50 stores the model ID in association with the account ID in the user information management DB 5002 via the storage / reading unit 59 (step S12).

[0086] The transmitting / receiving unit 11 of the communication terminal 10 transmits the account ID, time-lapse ON information, and shooting conditions for the time-lapse service to the shooting device 30 (step S13).

[0087] When the transmitting / receiving unit 31 of the imaging device 30 receives the account ID, time-lapse ON information, and shooting conditions transmitted from the communication terminal 10, the shooting control unit 33 of the imaging device 30 automatically takes a time-lapse image with the received shooting conditions (step S14), and the transmitting / receiving unit 31 of the imaging device 30 transmits the account ID, model ID, image, and image acquisition time to the second external storage 91 (step S15).

[0088] The shooting conditions received by the transmitting / receiving unit 31 of the shooting device 30 from the communication terminal 10 include conditions such as the shooting interval, shooting period, and whether to blur people in time-lapse photography, but these conditions may also be obtained from the management server 50 instead of being received from the communication terminal 10.

[0089] In the sequence diagram shown in Figure 10, an example is described in which the camera 30 receives the account ID, time-lapse ON information, and shooting conditions transmitted from the communication terminal 10, assuming that the camera 30 has an automatic shooting function (time-lapse shooting function). However, if the camera 30 does not have an automatic shooting function, the camera 30 can receive an application related to the automatic shooting function transmitted from the communication terminal 10 and install the application.

[0090] Here, as shown in step S2 of Figure 9 and step S14 of Figure 10, the shooting control unit 33 of the shooting device 30 transmits images and other information to the first external storage 90 via the transmitting / receiving unit 31 when shooting manually, and transmits images and other information to the second external storage 91 via the transmitting / receiving unit 31 when automatically shooting time-lapse images.

[0091] Here, the imaging device 30 shown in Figure 10 may be a different imaging device from the imaging device 30 shown in Figure 9.

[0092] The second external storage 91 stores the image transmitted from the imaging device 30 and its thumbnail image (step S16), and transmits the account ID, model ID, image ID, and image acquisition time to the management server 50 (step S17).

[0093] Here, the thumbnail image stored in the second external storage 91 may be attached to the image transmitted from the imaging device 30, or it may be created by the second external storage 91 based on the image transmitted from the imaging device 30.

[0094] Furthermore, the image ID that the second external storage 91 transmits to the management server 50 may be attached to the image transmitted from the imaging device 30, or it may be assigned by the second external storage 91 based on the image transmitted from the imaging device 30.

[0095] When the transmission / reception unit 51 of the management server 50 receives the account ID, model ID, image ID, and image acquisition time transmitted from the second external storage 91, the determination unit 52 of the management server 50 retrieves the account ID and model ID managed in the user information management DB 5002 via the storage / reading unit 59, and determines whether the account ID and model ID transmitted from the second external storage 91 match the account ID and model ID managed in association with the user information management DB 5002 (step S18).

[0096] If the management server 50's determination unit 52 determines that the account ID and model ID transmitted from the second external storage 91 do not match the account ID and model ID managed in association with the user information management DB 5002, the management server 50's transmission / reception unit 51 will send a message to the second external storage 91 regarding the image ID to be deleted. When the second external storage 91 receives an image ID sent from the management server 50, it deletes the image corresponding to that image ID (step S20).

[0097] If the management server 50's determination unit 52 determines that the account ID transmitted from the second external storage 91 matches an account ID managed in the user information management DB 5002, and the model ID transmitted from the second external storage 91 matches a model ID managed in the user information management DB 5002, the management server 50's setting unit 54 stores the image ID, image acquisition time, and deletion exclusion flag (initial value 0) in the image information management DB 5003 via the storage / reading unit 59, associating them with the account ID, time lapse flag 1, and model ID (step S21) (an example of a setting step).

[0098] ○Management and processing of time-lapse images○ Figure 11 is a sequence diagram showing an example of time-lapse image management processing.

[0099] The transmitting / receiving unit 11 of the communication terminal 10 sends a confirmation screen request along with the account ID to the management server 50 (step S31).

[0100] When the transmission / reception unit 51 of the management server 50 receives a confirmation screen request and account ID sent from the communication terminal 10, the setting unit 54 of the management server 50 retrieves the maximum number of images to be stored and the maximum number of terminals to be used managed in the account management DB 5001, the user ID and model ID managed in the usage information management DB 5002, and the number of images to be stored managed in the image information management DB 5003 via the storage / reading unit 59, and sets the confirmation screen (step S32). The transmission / reception unit 51 of the management server 50 then sends confirmation screen information indicating the confirmation screen to the communication terminal 10 (step S33).

[0101] When the transmitting / receiving unit 11 of the communication terminal 10 receives confirmation screen information transmitted from the management server 50, the display control unit 13 of the communication terminal 10 displays a confirmation screen on the display 106 based on the received confirmation screen information (step S34).

[0102] The transmitting / receiving unit 11 of the communication terminal 10 sends an input screen request to the management server 50 along with the account ID and model ID (step S35) (an example of a transmission step).

[0103] When the transmission / reception unit 51 of the management server 50 receives the input screen request, account ID, and model ID sent from the communication terminal 10, the setting unit 54 of the management server 50 retrieves the image ID, acquisition time, and deletion exclusion flag of time-lapse flag 1, which are managed in the image information management DB 5003, via the storage / reading unit 59, based on the received account ID and model ID (step S36).

[0104] The transmitting / receiving unit 51 of the management server 50 sends a thumbnail image request to the second external storage 91, which includes the account ID, the image ID acquired by the setting unit 54, and a thumbnail image of the said image ID (step S37).

[0105] When the second external storage 91 receives a thumbnail image request and an image ID from the management server 50, it sends the image ID and a thumbnail image of that image ID to the management server 50 (step S38).

[0106] When the transmitting / receiving unit 51 of the management server 50 receives the thumbnail image and image ID transmitted from the second external storage 91, the setting unit 54 of the management server 50 sets up the input screen based on the account ID and model ID received from the communication terminal 10, the thumbnail image and image ID received from the second external storage 91, and the acquisition time and deletion exclusion flag obtained from the image information management DB 5003 (step S36). The transmitting / receiving unit 51 of the management server 50 then transmits input screen information indicating the input screen to the communication terminal 10 (step S39).

[0107] When the transmitting / receiving unit 11 of the communication terminal 10 receives input screen information transmitted from the management server 50, the display control unit 13 of the communication terminal 10 displays the input screen on the display 106 based on the received input screen information (an example of a display step), and the receiving unit 12 of the communication terminal 10 accepts a predetermined input operation from the user on the displayed input screen (step S40).

[0108] When a user enters information requesting an image with a specific image ID on the input screen, the receiving unit 12 accepts the input request for an image with the specific image ID, and the transmitting / receiving unit 11 sends the account ID and the image request for the entered image ID to the second storage 91 (step S41).

[0109] When the second external storage 91 receives an image request, account ID, and image ID sent from the communication terminal 10, it sends the image with the image ID to the communication terminal 10 (step S42).

[0110] When the transmitting / receiving unit 11 of the communication terminal 10 receives an image transmitted from the second external storage 91, the display control unit 13 of the communication terminal 10 displays the input screen including the received image on the display 106 (step S40).

[0111] When a user enters information on the input screen to set an image with a specific image ID to be excluded from deletion, the receiving unit 12 accepts the input of information to set an image with a specific image ID to be excluded from deletion, and the transmitting / receiving unit 11 transmits the input information, including the account ID and the entered image ID, to the management server 50 (step S43).

[0112] When the transmission / reception unit 51 of the management server 50 receives the account ID and image ID transmitted from the communication terminal 10, the setting unit 54 of the management server 50 stores a deletion exclusion flag 1 for the image ID of the received account ID in the image information management DB 5003 via the storage / reading unit 59 (step S44) (an example of a setting step). The detailed processing in step S44 will be described later.

[0113] By submitting input information for multiple image IDs in step S43, you can set multiple images to be excluded from deletion in step S44.

[0114] The configuration unit 54 of the management server 50 deletes image IDs and data associated with image IDs from the image information management DB 5003 after 30 days have passed since acquisition (step S45). Although the sequence diagram in Figure 11 shows step S45 being executed after step S44, in reality, the configuration unit 54 of the management server 50 executes step S45 triggered by a predetermined timing within the management server 50.

[0115] The transmitting / receiving unit 51 of the management server 50 transmits the image ID and account ID to be deleted from the image information management DB 5003 to the second external storage 91 (step S46). When the second external storage 91 receives the account ID and image ID transmitted from the management server 50, it deletes the image corresponding to the image ID of the account ID (step S47).

[0116] ○Storage of normal images○ Figure 12 is a flowchart showing an example of the storage process for a normal image, and corresponds to steps S5, S6, and S8 of the sequence diagram shown in Figure 9.

[0117] The determination unit 52 of the management server 50 obtains the account ID managed in the account management DB 5001 via the storage / reading unit 59 and determines whether the account ID sent from the first external storage 90 matches a registered account ID managed in the account management DB 5001 (step S51).

[0118] If the management server 50 determines in step S51 that the account ID is already registered, the determination unit 52 of the management server 50 obtains the maximum number of images to be stored managed in the account management DB 5001 and the number of images to be stored managed in the image information management DB 5003 via the storage / reading unit 59, and determines whether the number of images to be stored has reached the maximum number of images to be stored (step S52). The determination unit 52 may also determine whether the number of images to be stored managed in the image information management DB 5003 exceeds the maximum number of images to be stored when the image corresponding to the image ID received this time is added.

[0119] Here, the number of images to be saved, managed in the image information management DB5003, is the sum of regular images and time-lapse images excluded from deletion.

[0120] A normal image is an image corresponding to an image ID for which there is no data in the time-lapse flag shown in Figure 8, while a time-lapse deletion exclusion image is an image corresponding to an image ID for which the deletion exclusion flag shown in Figure 8 is 1.

[0121] If it is determined in step S53 that the maximum number of images to be stored has not been reached, the setting unit 54 of the management server 50 stores the image ID in the image information management DB 5003 in association with the account ID via the storage / reading unit 59, and leaves the image corresponding to that image ID stored in the first external storage 90 (step S53).

[0122] If it is determined in step S51 that the account ID is not registered, or if it is determined in step S52 that the maximum number of images to be stored has been reached, the transmission / reception unit 51 of the management server 50 transmits the image ID to be deleted and its account ID to the first external storage 90, causing the image corresponding to the image ID to be deleted from the first external storage 90 (step S54).

[0123] If, in step S52, it is determined that the maximum number of images to be saved has been reached, the transmission / reception unit 51 of the management server 50 may send a notification to the communication terminal 10 informing it that manually taken images cannot be saved.

[0124] Furthermore, if the decision unit 52 of the management server 50 determines that the number of images to be saved managed in the image information management DB 5003 will reach the maximum number of images to be saved when the image corresponding to the image ID received this time is added, the transmission / reception unit 51 of the management server 50 may send notification information to the communication terminal 10 in advance that the next manually taken image will not be saved.

[0125] Furthermore, the transmitting and receiving unit 51 of the management server 50 may transmit not only the notification information mentioned above, but also the contract information for the cloud service, the web page link information of the contracting party, and the application information for changes to the contract details to the communication terminal 10.

[0126] According to this embodiment, even if time-lapse photography is used, the upper limit of the storage conditions stipulated in the usage contract will not be immediately exceeded. However, if the user determines in step S52 that the maximum number of saved images has been reached and wishes to increase the upper limit of the storage conditions beyond the plan they have contracted, this embodiment is effective.

[0127] ○Time-lapse image storage processing○ Figure 13 is a flowchart showing an example of the time-lapse image storage process, corresponding to steps S18, S19, and S20 of the sequence diagram shown in Figure 10.

[0128] The determination unit 52 of the management server 50 obtains the account ID managed in the user information management DB 5002 via the storage / reading unit 59, and determines whether the account ID transmitted from the second external storage 91 matches a registered user account ID managed in the user information management DB 5002 (step S61).

[0129] If the management server 50 determines in step S61 that the account ID is already registered, the determination unit 52 retrieves the model ID managed in the user information management DB 5002 in association with the account ID determined to match in step S61 via the storage / reading unit 59, and determines whether the model ID transmitted from the second external storage 91 matches the registered model ID obtained from the user information management DB 5002 (step S62).

[0130] If the device ID is determined to be registered in step S62, the setting unit 54 of the management server 50 stores the image ID, image acquisition time, and the deletion exclusion flag (initial value 0) in the image information management DB 5003 via the storage / reading unit 59, associating them with the account ID, time lapse flag 1, and device ID, and leaves the image corresponding to that image ID stored in the second external storage 91 (step S63).

[0131] If it is determined in step S61 that the account ID is not registered, or if it is determined in step S62 that the model ID is not registered, the transmitting / receiving unit 51 of the management server 50 transmits the image ID to be deleted and its account ID to the first external storage 90, causing the image corresponding to the image ID to be deleted from the second external storage 91 (step S64).

[0132] ○Confirmation screen setup process○ Figure 14 is a flowchart showing an example of the confirmation screen setting process, and corresponds to step S32 in the sequence diagram shown in Figure 11.

[0133] The configuration unit 54 of the management server 50 obtains the maximum number of stored items and the maximum number of terminals that can use the account ID corresponding to the received account ID from the management DB 5001 via the storage / reading unit 59 (step S71).

[0134] The configuration unit 54 of the management server 50 obtains the number of registered user IDs and the number of model IDs corresponding to the account ID transmitted from the communication terminal 10 from the user information management DB 5002 via the storage / reading unit 59 (step S72).

[0135] The configuration unit 54 of the management server 50 obtains the number of image IDs to be saved corresponding to the account ID transmitted from the communication terminal 10 from the image information management DB 5003 via the storage / reading unit 59 (step S73).

[0136] Here, the number of images to be saved, managed in the image information management DB5003, is the sum of regular images and time-lapse images excluded from deletion.

[0137] A normal image is an image corresponding to an image ID for which there is no data in the time-lapse flag shown in Figure 8, while a time-lapse deletion exclusion image is an image corresponding to an image ID for which the deletion exclusion flag shown in Figure 8 is 1.

[0138] The configuration unit 54 of the management server 50 sets up a confirmation screen based on the information obtained in steps S71 to S73 (step S74).

[0139] ○Input screen settings process○ Figure 15 is a flowchart showing an example of the input screen setting process, and corresponds to step S36 in the sequence diagram shown in Figure 10.

[0140] The configuration unit 54 of the management server 50 obtains the maximum number of records to be stored corresponding to the received account ID from the account management DB 5001 via the storage / reading unit 59 (step S91).

[0141] The configuration unit 54 of the management server 50 retrieves the image ID, acquisition time, and deletion exclusion flag of the time-lapse flag 1 corresponding to the received account ID and model ID from the image information management DB 5003 via the storage / reading unit 59 (step S92).

[0142] The configuration unit 54 of the management server 50 configures the input screen based on the information obtained in steps S91 and S92 (step S93).

[0143] ○Exclusion process for deleting time-lapse images○ Figure 16 is a flowchart showing an example of the process for deleting or excluding time-lapse images, and provides details of step S44 in the sequence diagram shown in Figure 10.

[0144] The determination unit 52 of the management server 50 obtains the maximum number of images to be stored corresponding to the received account ID from the account management DB 5001 via the storage / reading unit 59, and also obtains the number of images to be stored corresponding to the received account ID from the image information management DB 5003, and determines whether the number of images to be stored has reached the maximum number of images to be stored (step S101). The determination unit 52 may also determine whether the number of images to be stored managed in the image information management DB 5003 exceeds the maximum number of images to be stored when the image corresponding to the image ID received this time is added.

[0145] Here, the number of images to be saved, managed in the image information management DB5003, is the sum of regular images and time-lapse images excluded from deletion.

[0146] A normal image is an image corresponding to an image ID for which there is no data in the time-lapse flag shown in Figure 8, while a time-lapse deletion exclusion image is an image corresponding to an image ID for which the deletion exclusion flag shown in Figure 8 is 1.

[0147] If it is determined in step S101 that the maximum number of images to be stored has not been reached, the setting unit 54 of the management server 50 receives the input information and, via the storage / reading unit 59, stores the deletion exclusion flag 1 for the received image ID in the image information management DB 5003 (step S102).

[0148] If it is determined in step S101 that the maximum number of images to be stored has been reached, the setting unit 54 of the management server 50 sets an error and does not accept input information, preventing the received image ID from being stored in the image information management DB 5003 (step S102).

[0149] In step S102, the setting unit 54 of the management server 50 may set an input screen that includes error information indicating that the input information could not be accepted, and the transmitting / receiving unit 51 of the management server 50 may transmit the input screen information, including the error screen, to the communication terminal 10. Here, the error screen shall include notification information indicating that it is not possible to set an image to be excluded from the items to be deleted.

[0150] Furthermore, the transmitting and receiving unit 51 of the management server 50 may transmit not only the notification information mentioned above, but also the contract information for the cloud service, the web page link information of the contracting party, and the application information for changes to the contract details to the communication terminal 10.

[0151] According to this embodiment, even if time-lapse photography is used, the upper limit of the storage conditions stipulated in the usage contract will not be immediately exceeded. However, if the user determines in step S101 that the maximum number of saved images has been reached and wishes to increase the upper limit of the storage conditions beyond the plan they have contracted, this embodiment is effective.

[0152] ○Deletion process for time-lapse images○ Figure 17 is a flowchart showing an example of the time-lapse image deletion process, corresponding to step S45 in the sequence diagram shown in Figure 11.

[0153] The decision unit 52 of the management server 50 retrieves the image ID and acquisition time, which are managed in the image information management DB 5003 and have a time lapse flag of 1 and a deletion exclusion flag of 0, via the storage / reading unit 59 at a predetermined timing, and determines whether there are any image IDs that have been acquired more than 30 days ago (step S111).

[0154] If there are image IDs that have been acquired more than 30 days ago in step S111, the setting unit 54 of the management server 50 deletes the image IDs and the data associated with them from the image information management DB 5003 (step S112).

[0155] ○Confirmation screen○ Figure 18 shows an example of a confirmation screen corresponding to step S34 in the sequence diagram shown in Figure 11.

[0156] The display control unit 13 of the communication terminal 10 displays the confirmation screen 200 shown in Figure 18 on the display 106 based on the received confirmation screen information.

[0157] The display control unit 13 displays a confirmation screen 200 which includes member count information 201 indicating the number of user IDs "14" obtained from the user information management DB 5002, model count information 202 indicating the number of model IDs "3" obtained from the user information management DB 5002, image count information 203 indicating the number of normal images "7" obtained from the image information management DB 5003, image count information 204 indicating the number of time-lapse images excluded from deletion obtained from the image information management DB 5003, maximum member count information 205 indicating the maximum number of terminals "20" obtained from the account management DB 5001, and maximum image count information 206 indicating the maximum number of saved images "1000" obtained from the account management DB 5001.

[0158] Here, "Live View" displayed on confirmation screen 200 is an example of the term "Time-Lapse Service".

[0159] Furthermore, the "Number of Live View Models" displayed in conjunction with the model number information 202 is an example of a term used for the "Number of devices that can use the time-lapse service," as explained in Figure 7.

[0160] The "Number of Locked Live View Images" displayed in conjunction with the image count information 204 is an example of a term used for "images taken by time-lapse photography with a deletion exclusion flag assigned," as explained in Figure 9.

[0161] The display control unit 13 displays the member count information 201 to include information indicating the remaining number of members, "3 people," which is obtained by subtracting the number of user IDs, "14 people," obtained from the user information management DB 5002, and the number of model IDs, "3," obtained from the user information management DB 5002, from the maximum number of terminals used, "20 people," obtained from the account management DB 5001.

[0162] The display control unit 13 displays the number of device models information 202, which further includes information indicating the remaining number "3" obtained by subtracting the number of user IDs "14" obtained from the user information management DB 5002 and the number of device model IDs "3" obtained from the user information management DB 5002 from the maximum number of user terminals "20" obtained from the account management DB 5001.

[0163] Note that the remaining number of members in member count information 201 and the remaining number of models in model count information 202 are both determined based on the maximum number of members information 205, so the remaining number of members in member count information 201 and the remaining number of models in model count information 202 will be the same value.

[0164] The display control unit 13 displays the image count information 203, which further includes information indicating the remaining number of images, "993 people," obtained by subtracting the number of normal images, "7," obtained from the image information management DB 5003 and the number of time-lapse images excluded from deletion, "0," obtained from the image information management DB 5003, from the maximum number of images to be saved, "1000," obtained from the account management DB 5001.

[0165] The display control unit 13 displays the image count information 204, which further includes information indicating the remaining number of images, "993 people," obtained by subtracting the number of normal images, "7," obtained from the image information management DB 5003 and the number of time-lapse images excluded from deletion, "0," obtained from the image information management DB 5003, from the maximum number of images to be saved, "1000," obtained from the account management DB 5001.

[0166] Note that the remaining number of images in image count information 203 and image count information 204 are both determined based on the maximum number of images information 206, so the remaining number of images in image count information 203 and image count information 204 will be the same value.

[0167] ○Input screen○ Figure 19 shows an example of an input screen corresponding to step S40 in the sequence diagram shown in Figure 11.

[0168] The display control unit 13 of the communication terminal 10 displays the input screen 400 shown in Figure 19 on the display 106 based on the received input screen information.

[0169] The display control unit 13 displays an input screen 400 which includes account information 401 indicating the account ID "A0001" that requested the input screen in step S35, model information 402 indicating the model ID "D02345" that requested the input screen in step S35, image information 410 indicating the image acquired from the second external storage 91 in step S42, thumbnail image information 410A to 410H indicating the thumbnail image acquired from the second external storage 91 in step S38, acquisition time information 415, 415A to 415H indicating the acquisition time of the image acquired from the image information management DB 5003, setting information 405A to 405H indicating the deletion exclusion flag acquired from the image information management DB 5003, a change button 405 for changing the deletion exclusion flag, and a confirmation button 420 for confirming the deletion exclusion flag.

[0170] The display control unit 13 displays the input screen 400 such that each of the acquired time information 415A to 415H is positioned above each of the thumbnail image information 410A to 410H, each of the setting information 405A to 405H is superimposed on each of the thumbnail image information 410A to 410H, and the change button 405 is superimposed on the image information 410.

[0171] The display control unit 13 displays thumbnail image information 410A to 410H from left to right in order of acquisition time, from newest to oldest. The display control unit 13 scrolls the thumbnail image information 410A to 410H horizontally to display, for example, 60 thumbnail images.

[0172] The display control unit 13 initially displays the image corresponding to the thumbnail image information 410A with the most recent acquisition time as image information 410.

[0173] Specifically, the transmitting / receiving unit 11 sends an image request to the second storage 91, specifying the account ID and the image ID of the most recent acquisition time. The display control unit 13 receives the image of the most recent acquisition time transmitted from the second storage 91, and initially displays the received image as image information 410, as well as the acquisition time of the received image as acquisition time information 415. Furthermore, it highlights and displays the acquisition time information 415A corresponding to the thumbnail image information 410A of the most recent acquisition time.

[0174] When a user manipulates any of the thumbnail image information 410A to 410H, the receiving unit 12 of the communication terminal 10 receives an instruction to manipulate any of the thumbnail image information 410A to 410H. Figure 19 shows the state when the user manipulates thumbnail image information 410D.

[0175] Then, as shown in steps S41 and S42 of Figure 11, the transmitting / receiving unit 11 sends an image request to the second storage 91 for the account ID and the image ID of the thumbnail image information 410D for which an operation instruction has been received. The display control unit 13 receives the image sent from the second storage 91 and displays the received image as image information 410, displays the acquisition time of the received image as acquisition time information 415, and further highlights and displays the acquisition time information 415D of the image corresponding to the thumbnail image information 410D operated by the user.

[0176] In the state shown in Figure 19, when the user presses the change button 405, the reception unit 12 receives a change instruction to change the deletion exclusion flag to 1 for the image shown in the thumbnail image information 410D, which is displayed as image information 410. Based on the receipt of the change instruction, the display control unit 13 highlights the change button 405 and the setting information 405D.

[0177] When the user presses the confirmation button 420, the reception unit 12 receives a confirmation instruction to set the deletion exclusion flag to 1 for the image shown in the thumbnail image information 410D, which is displayed as image information 410. Alternatively, the confirmation button 420 may be omitted, and the change button 405 may be configured to serve as both a change instruction to change the deletion exclusion flag to 1 and a confirmation instruction to set the deletion exclusion flag to 1. This prevents the user from forgetting to press the confirmation button 420 and thus prevents work errors.

[0178] Then, as shown in step S43 of Figure 11, the transmitting / receiving unit 11 sends input information to the management server 50 that sets the deletion exclusion flag to 1 for the account ID and the image ID corresponding to the thumbnail image information 410D.

[0179] Here, the user may operate on any of the thumbnail image information 410A to 410H and press the change button 405 for multiple thumbnail image information, and then press the confirm button 420. If the user has made a change instruction to change the deletion exclusion flag to 1 by pressing the change button 405 for multiple thumbnail image information, a cancel button to cancel all change instructions at once may be displayed on the input screen 400. In this way, the user can cancel change instructions for multiple thumbnail image information at once.

[0180] In that case, the receiving unit 12 receives a confirmation instruction to set the deletion exclusion flag to 1 for each of the multiple images shown in each of the multiple thumbnail images, and the transmitting / receiving unit 11 sends input information to the management server 50 to set the deletion exclusion flag to 1 for each of the account ID and the multiple image IDs corresponding to each of the multiple thumbnail images.

[0181] Furthermore, even after confirming the deletion exclusion flag to 1, it is possible to remove the deletion exclusion flag from 1. In this case, the user can remove the deletion exclusion flag from 1 for a thumbnail image information for which they have confirmed the deletion exclusion flag to 1 by manipulating any of the thumbnail image information 410A to 410H, by pressing the change button 405 again. At this time as well, the confirmation instruction can be made by pressing the confirmation button 420, just as when changing the deletion exclusion flag to 1, or the system can be configured so that pressing the change button 405 serves as both a change instruction to remove the deletion exclusion flag and a confirmation instruction to remove the deletion exclusion flag. In addition, the deletion exclusion flag may be removed from 1 for multiple thumbnail image information. Furthermore, the system may have a function to display only thumbnail images with the deletion exclusion flag attached, and in that state, a release specification button may be displayed on the input screen 400 to remove the deletion exclusion flag by specifying a predetermined period from the image acquisition time information. Furthermore, a full release button to remove all deletion exclusion flags may be displayed on the input screen 400.

[0182] ●Modified Examples of Embodiments● Figure 20 shows the functional configuration in a modified version of the communication system. In the communication system 1 shown in Figure 5, the imaging device 30 communicated with the communication terminal 10 via the communication network 100, but in the modified version of the communication system 1 shown in Figure 20, the imaging device 30 is built into the communication terminal 10.

[0183] Figure 21 is a sequence diagram showing the normal image saving process in the modified example shown in Figure 20.

[0184] The shooting control unit 33 of the shooting device 30 built into the communication terminal 10 manually takes a picture when the user operates the operation unit 315 (step S201), and the transmitting / receiving unit 11 of the communication terminal 10 transmits the account ID and the image to the first external storage 90 (step S202). The other processes are the same as shown in the sequence diagram in Figure 9.

[0185] Figure 22 is a sequence diagram showing the time-lapse image saving process in the modified example shown in Figure 20.

[0186] The shooting control unit 33 of the shooting device 30 built into the communication terminal 10 automatically captures a time-lapse image under predetermined shooting conditions (step S214), and the transmitting / receiving unit 11 of the communication terminal 10 transmits the account ID, model ID, image, and image acquisition time to the second external storage 91 (step S215). The other processes are the same as shown in the sequence diagram in Figure 10.

[0187] In the modified communication system shown in Figures 20 and 21, the communication terminal 10 transmits and stores images captured manually or automatically by the built-in imaging control unit 33 of the imaging device 30 to the first external storage 90 and the second external storage 91. In a further modified version, the communication terminal 10 may transmit and store data such as images acquired from an external source to the first external storage 90 and the second external storage 91.

[0188] Furthermore, in another form of the communication system, the communication system 1 includes an imaging device 30, which is an example of a measuring device, and a communication terminal 10, which are capable of communicating via a communication network 100, and the communication terminal 10 may also incorporate the functions of a management server 50. In this case, the first external storage 90 and the second external storage 91 may be configured to communicate with the communication terminal 10 via the communication network 100, or they may be built into the communication terminal 10 or connected to it by wire.

[0189] ●Second variation● Figure 23 shows the functional configuration in a second modified example of the communication system.

[0190] The communication system 1 shown in Figure 23 further includes, in addition to the communication system 1 shown in Figure 5, a messaging server 92 that manages video streaming and a streaming server 93 that streams video. Specifically, the messaging server 92 is an intermediary server for exchanging triggers for starting and ending streaming between the shooting device 30 and the management server 50.

[0191] Figure 24 is a sequence diagram showing the streaming process in the second modified example.

[0192] When the shooting device 30 is plugged into the shooting control unit 33, for example, to enable video recording, and prepares to send and receive messages to manage video streaming (step S301), the sending / receiving unit 31 of the shooting device 30 sends the account ID and model ID to the messaging server 92, and the messaging server 92 registers the shooting device 30 corresponding to the received model ID as waiting for message reception (step S302).

[0193] As explained in Figure 1, if the communication system 1 includes multiple imaging devices 30, the messaging server 92 can register the multiple imaging devices 30 as waiting to receive messages.

[0194] Meanwhile, when the user makes an input on the input screen, the receiving unit 12 of the communication terminal 10 receives an input request to start streaming for the designated imaging device 30 (step S303), and the transmitting / receiving unit 11 of the communication terminal 10 transmits the account ID and the model ID of the designated imaging device 30 along with the streaming start request to the management server (step S304).

[0195] When the transmitting / receiving unit 51 of the management server 50 receives a streaming start request, account ID, and model ID sent from the communication terminal 10, the setting unit 54 of the management server 50 sets a streaming start notification (step S305), and the transmitting / receiving unit 51 sends the streaming start notification, the account ID, and the model ID received in step S305 to the messaging server 92 (step S306).

[0196] Furthermore, the setting unit 54 of the management server 50 sets a streaming video waiting notification (step S307), the transmitting / receiving unit 51 sends the streaming video waiting notification, the account ID received in step S305, and the model ID to the streaming server 93, and the streaming server 93 registers the camera 30 corresponding to the received model ID (step S308).

[0197] If the messaging server 92 finds that the model ID received in step S306 matches the model ID registered in step S302, it sets a streaming start notification for the imaging device 30 associated with that model ID (step S309), and sends the streaming start notification and the model ID to the imaging device 30 associated with that model ID (step S310).

[0198] When the transmitting / receiving unit 31 of the camera 30 receives a streaming start notification from the messaging server 92, the camera control unit 33 of the camera 30 starts recording the streaming video (step S311), and the transmitting / receiving unit 31 of the camera 30 sends the account ID and model ID along with the video data to the streaming server 93 (step S312).

[0199] If the streaming server 93 finds that the model ID received in step S312 matches the model ID registered in step S308, it sends video data to the management server 50 (step S313).

[0200] When the transmitting / receiving unit 51 of the management server 50 receives video data from the streaming server 93, it transmits the video data to the communication terminal 10 (step S314).

[0201] When the transmitting / receiving unit 11 of the communication terminal 10 receives video data transmitted from the management server 50, the display control unit 13 of the communication terminal 10 displays the received video data on the display 106 (step S315).

[0202] Subsequently, when the user makes an operation input on the input screen, the receiving unit 12 of the communication terminal 10 receives an input requesting the termination of streaming for the designated imaging device 30 (step S316), and the transmitting / receiving unit 11 of the communication terminal 10 sends the account ID and the model ID of the designated imaging device 30, along with a streaming termination notification, to the management server (step S317).

[0203] When the transmitting / receiving unit 51 of the management server 50 receives the streaming termination request, account ID, and model ID sent from the communication terminal 10, the setting unit 54 of the management server 50 sets up a streaming termination notification (step S319), and the transmitting / receiving unit 51 sends the streaming termination notification, the account ID, and the model ID received in step S317 to the messaging server 92 (step S320).

[0204] If the messaging server 92 finds that the model ID received in step S320 matches the model ID of the imaging device 30 for which a streaming start notification was set in step S309, it sets a streaming end notification for the imaging device 30 associated with that model ID (step S321), and sends the streaming end notification and the model ID to the imaging device 30 associated with that model ID (step S322).

[0205] When the transmitting / receiving unit 31 of the recording device 30 receives a streaming completion notification, the recording control unit 33 of the recording device 30 terminates video recording, and the transmitting / receiving unit 31 of the recording device 30 terminates the transmission of video data to the streaming server 93 (step S323).

[0206] Figure 25 shows an example of the input screen in the second modified example.

[0207] Figure 25 shows an example of an input screen corresponding to step S303 in the sequence diagram shown in Figure 24.

[0208] The display control unit 13 of the communication terminal 10 causes the input screen 400 shown in Figure 25 to display a video button 430 and a video display window 450 in addition to the input screen 400 shown in Figure 19.

[0209] The video display window 450 includes a video display unit 451 and a video start / stop button 452.

[0210] When the user operates the video button 430, the reception unit 12 receives the operation instruction, and the display control unit 13 displays the video display window 450 on the input screen 400.

[0211] When the user operates the video start / stop button 452, the system accepts input for a streaming start request to the recording device 30 specified by the model ID displayed in the model information 402.

[0212] In step S315 of the sequence diagram shown in Figure 24, the display control unit 13 displays the video data on the video display unit 451. If the designated shooting device 30 is experiencing an error that prevents shooting, such as being powered off or having no communication connection, the video button 430 displayed on the input screen 400 may be displayed at half brightness or grayed out, and the reception unit 12 may not accept operation instructions even if the video button 430 is operated. In addition, if an error that prevents shooting has occurred, the input screen 400 may display a notification that an error has occurred, such as "Cannot start video".

[0213] Figure 26 is a flowchart showing the processing of the messaging server in a second modified example.

[0214] When the messaging server 92 receives the account ID and model ID from the camera 30 (step S331), it registers the camera 30 corresponding to the received model ID as waiting for a message (step S332).

[0215] When the messaging server 92 receives the account ID and model ID from the management server 50 (step S333), if the received model ID matches the model ID of the imaging device 30 that is waiting to receive a message, which was registered in step S332 (step S334), the messaging server 92 sets up a streaming start notification for the imaging device 30 associated with that model ID and sends the streaming start notification to the imaging device 30 associated with that model ID (step S335).

[0216] On the other hand, if the model ID received in step S333 does not match the model ID of the camera 30 that is waiting to receive a message and was registered in step S332, the messaging server 92 performs error processing, such as notifying the communication terminal 10 via the management server 50 (step S336).

[0217] Figure 27 is a flowchart illustrating the processing of the streaming server in a second modified example.

[0218] When the streaming server 93 receives the account ID and model ID from the management server 50 (step S341), it registers the camera 30 associated with the received model ID as waiting for streaming video (step S342).

[0219] When the streaming server 93 receives video data and a model ID from the camera 30 (step S343), if the received model ID matches the model ID of the camera 30 registered in step S342 (step S344), it sends the streaming video data to the management server 50 (step S345).

[0220] On the other hand, if the streaming server 93 finds that the model ID received in step S343 does not match the model ID of the recording device 30 waiting for streaming video, which was registered in step S342, it performs error processing such as notifying the communication terminal 10 via the management server 50 (step S346).

[0221] Figure 28 is a flowchart showing the processing of the imaging device in the second modified example.

[0222] The transmitting / receiving unit 31 of the imaging device 30 receives a notification from the messaging server 92 (step S351), and if the model ID received from the messaging server 92 matches the model ID of the imaging device 30 (step S352), and the received message is a streaming start notification (step S353), the imaging control unit 33 of the imaging device 30 starts recording the streaming video, and the transmitting / receiving unit 31 transmits the video data to the streaming server 93 (step S354).

[0223] On the other hand, if the received message is a streaming termination notification (step S355), the shooting control unit 33 of the shooting device 30 terminates the shooting of the streaming video and automatically resumes the shooting of the time-lapse image (step S356).

[0224] ●Third variation● Figure 29 shows the functional configuration of the imaging device in a third modified example of the communication system.

[0225] The camera 30 of the communication system 1 shown in Figure 29 has a streaming control unit 35, which has a video recording function, plugged into it, compared to the camera 30 of the communication system 1 shown in Figure 5.

[0226] The streaming control unit 35 performs some of the processing that the shooting control unit 33 performed in the second modified example.

[0227] Figure 30 is a flowchart showing the processing of the imaging device in the third modified example.

[0228] The transmitting / receiving unit 31 of the camera 30 receives a notification from the messaging server 92 (step S361), and if the model ID received from the messaging server 92 matches the model ID of the camera 30 (step S362), and the received message is a streaming start notification (step S363), the streaming control unit 35 of the camera 30 starts recording the streaming video, and the transmitting / receiving unit 31 transmits the video data to the streaming server 93 (step S364).

[0229] Figure 31 is a flowchart showing other operations of the imaging device in the third modified example.

[0230] If the transmitting / receiving unit 31 of the imaging device 30 receives a notification from the messaging server 92 (step S371), and the model ID received from the messaging server 92 matches the model ID of the imaging device 30 (step S372), and the received message is a streaming termination notification (step S373), then the imaging control unit 33 of the imaging device 30 terminates the recording of the streaming video and automatically resumes the recording of the time-lapse image (step S374).

[0231] Furthermore, a time-lapse photography function is plugged into the shooting device 30 so that time-lapse photography as described in the embodiment can be performed. The relationship with the video streaming function plug-in described in the second and third modified examples in this case will be explained.

[0232] First, when the camera 30 is taking time-lapse images, the time-lapse shooting function plugin is activated (enabled). When the camera 30 receives a streaming start notification, it switches the plugin to be activated (enabled) and activates the video streaming function plugin. Subsequently, when the camera 30 receives a streaming end notification, it switches the plugin to be activated and activates the time-lapse shooting function plugin.

[0233] In this way, when executing different functions such as time-lapse photography and video streaming based on the content of the received notification, the desired function can be used by controlling the switching of the plugin that the shooting device 30 activates.

[0234] The time-lapse shooting function plugin and the video streaming function plugin may be separate plugins, or they may be a single plugin that encompasses both.

[0235] Furthermore, the control mechanism for switching plugins in the shooting device 30 is not limited to just the two plugins: the time-lapse shooting function plugin and the video streaming function plugin. For example, an update plugin could be used to check if each plugin installed in the shooting device 30 is up to date.

[0236] In this case, after the power to the shooting device 30 is turned on, the update plugin starts up and queries a designated server to check whether the plugins installed on the shooting device 30 are the latest version. If a newer version exists as a result of the query, the latest plugin is downloaded from the designated server and installed. After that, the system switches to plugins related to shooting functions, such as the time-lapse shooting function plugin or the video streaming function plugin.

[0237] Furthermore, the update plugin can also be used with single-function plugins for the time-lapse photography or video streaming functions. In other words, it can be used with single-function plugins such as checking for updates to the time-lapse photography plugin and then activating the time-lapse photography function, or checking for updates to the video streaming plugin and then activating the video streaming function plugin.

[0238] In this way, even while a time-lapse image is being recorded, it is possible to temporarily check the streaming video, which is useful in situations such as when you want to quickly check the situation on site in real time, such as during an earthquake.

[0239] Additionally, a maximum viewing time (time limit) can be set for streaming videos. For example, if the maximum viewing time is set to 5 minutes, the system will automatically return to shooting time-lapse images 5 minutes after the start of video streaming.

[0240] This prevents mistakes such as forgetting to end a video stream after watching it, which can lead to missing the opportunity to capture a time-lapse image.

[0241] Furthermore, if a maximum viewing time is set for a streaming video, the input screen 400 may display the viewing time or a countdown timer for the remaining time.

[0242] ●Summary As described above, the management server 50, which is an example of an information processing device according to one embodiment of the present invention, includes a setting unit 54, which is an example of setting means for setting images, which are an example of data stored in the storage means and the second external storage 91, which is an example of a second storage means, as targets to be deleted from the second external storage 91 when predetermined conditions are met, and a transmitting / receiving unit 51, which is an example of transmitting means for transmitting input screen information relating to an input screen 400 for inputting information to set images to be excluded from deletion to the communication terminal 10. The setting unit 54 sets images to be excluded from deletion in response to operations on the input screen 400 displayed on the communication terminal 10 based on the transmitted input screen information.

[0243] This allows images to be saved to the second external storage 91 until a predetermined condition is met, and after the predetermined condition is met, images to be deleted from the second external storage 91 and images to be continuously saved to the second external storage 91 can be reserved before the predetermined condition is met.

[0244] In other words, it prevents unwanted images from being deleted without the user's knowledge and allows for proper deletion and saving of images.

[0245] Here, the data stored in the second external storage 91 is not limited to still images, but may also be video, and may be measurement data such as vibration waveform data measured by a vibration sensor or 3D distance data measured by LIDAR.

[0246] Furthermore, the images stored in the second external storage 91 may be transmitted and stored from a device other than the communication terminal 10, or they may be transmitted and stored from the communication terminal 10.

[0247] The setting unit 54 sets an image, which is an example of measurement data transmitted from the imaging device 30, which is an example of a measuring device, and stored in the second external storage 91, as an item to be deleted from the second external storage 91 when predetermined conditions are met.

[0248] In this case, images captured by the camera 30 are often saved to the second external storage 91 without user confirmation. However, in this embodiment, the user can use the input screen 400 to reserve, before the predetermined conditions are met, which images to delete from the second external storage 91 and which images to continue saving to the second external storage 91.

[0249] Here, the measuring device, such as the imaging device 30, may be integrated with the communication terminal 10.

[0250] The setting unit 54 sets images stored in the second external storage 91 as targets to be deleted from the second external storage 91 when a predetermined period of time has elapsed since the image was taken, as an example of when predetermined conditions are met.

[0251] This allows images to be stored in the second external storage 91 until a predetermined period has elapsed, and also allows users to reserve, before the predetermined period has elapsed, which images to delete from the second external storage 91 and which images to continue to be stored in the second external storage 91.

[0252] The setting unit 54 may also set images stored in the second external storage 91 as targets for deletion from the second external storage 91 when the number of images stored in the second external storage 91 exceeds a predetermined amount (for example, 5,000 images), as another example of when a predetermined condition is met. In this case, images are deleted in order from the oldest to the newest, based on their capture date and time.

[0253] The setting unit 54 sets images that are automatically captured by the shooting device 30 in a predetermined shooting mode, transmitted from the shooting device 30, and stored in the second external storage 91 as targets for deletion.

[0254] In this case, images are often saved to the second external storage 91 without user confirmation. However, in this embodiment, the user can use the input screen 400 to reserve, before the predetermined conditions are met, which images to delete from the external storage 91 after the predetermined conditions are met, and which images to continue saving to the second external storage 91.

[0255] The transmitting / receiving unit 51 transmits to the communication terminal 10 video footage that is automatically captured by the camera 30 and not saved to the second external storage 91.

[0256] The transmitting / receiving unit 51 does not transmit input screen information to the communication terminal 10 while transmitting video.

[0257] The setting unit 54 does not set images that are manually captured by the shooting device 30, transmitted from the shooting device 30, and stored in the storage means and the first external storage 90, which is an example of the first storage means, as targets for deletion.

[0258] The setting unit 54 does not set images that have been manually captured by a different imaging device than the imaging device 30, transmitted from the other imaging device, and stored in the first external storage 90 as targets for deletion.

[0259] The setting unit 54 sets the images to be excluded from deletion, provided that the sum of the amount of images manually taken and saved to the first external storage 90 and the number of images to be excluded from deletion is within a predetermined range.

[0260] This allows for the appropriate selection of images to be excluded from deletion, even when the amount of images that can be stored in the second external storage 91 and the first external storage 90 is limited to a maximum number of images or other upper limits. The amount of images and the predetermined amount may be the number of images or the storage capacity.

[0261] When the total reaches the maximum number of stored images, which is an example of the upper limit value of the predetermined amount range, the transmission / reception unit 51 transmits notification information to the communication terminal 10 to notify that the images manually captured cannot be stored or / and that the images that cannot be set as the objects to be deleted cannot be set.

[0262] When the total reaches the maximum number of stored images, the transmission / reception unit 51 transmits information for further increasing the maximum number of stored images to the communication terminal.

[0263] The setting unit 54 sets the images stored in the second external storage 91 as the objects to be deleted in association with the account information transmitted from the imaging device 30, and the transmission / reception unit 51 transmits the input screen information related to the input screen 400 including the account information.

[0264] Thereby, even when setting images as the objects to be deleted for each account information, it is possible to reserve, before the predetermined conditions are satisfied, the images to be deleted from the second external storage 91 and the images to be continuously stored in the second external storage 91 after the predetermined conditions are satisfied for each account information.

[0265] When the account information transmitted from the imaging device 30 matches the account information stored in advance, the setting unit 54 sets the images stored in the second external storage 91 as the objects to be deleted in association with the account information.

[0266] Thereby, it is possible to set images as the objects to be deleted for each account information.

[0267] When the account information transmitted from the imaging device 30 and the identification information for identifying the imaging device 30 respectively match the account information and the identification information stored in advance in association, the setting unit 54 sets the images stored in the second external storage 91 as the objects to be deleted in association with the account information.

[0268] This allows only images transmitted from the camera 30 that have been pre-stored in association with account information to be designated for deletion.

[0269] An information processing method according to one embodiment of the present invention includes a setting step of setting an image, which is an example of data transmitted from a photographing device 30, which is an example of a measuring device, and stored in a second external storage 91, which is an example of a storage means, as an item to be deleted from the second external storage 91 when predetermined conditions are met, and a display step of displaying an input screen 400 for inputting information to set images to be excluded from the items to be deleted, wherein the setting step includes processing to set images to be excluded from the items to be deleted in response to an operation on the displayed input screen 400.

[0270] The information processing method further includes a transmission step of transmitting input screen information relating to an input screen 400 for inputting information to set images to be excluded from deletion to a communication terminal 10, and the setting step includes a process of setting images to be excluded from deletion in response to an operation on the input screen 400 displayed on the communication terminal 10 based on the transmitted input screen information.

[0271] An information processing system according to one embodiment of the present invention comprises a camera 30, an information processing device capable of communicating with the camera 30, and a communication terminal 10 capable of communicating with the information processing device, wherein the information processing device includes a setting unit 54 that sets images transmitted from the camera 30 and stored in a second external storage 91 as targets for deletion from the second external storage 91 when predetermined conditions are met, and a transmitting / receiving unit 51 that transmits input screen information relating to an input screen 400 for inputting information to set images to be excluded from deletion to the communication terminal 10, wherein the setting unit 54 sets images to be excluded from deletion in response to operations on the input screen 400 displayed on the communication terminal 10 based on the transmitted input screen information.

[0272] A management server 50 according to one embodiment of the present invention includes a setting unit 54 that sets data stored in a second external storage 91 as data to be deleted from the second external storage 91 when predetermined conditions are met. The setting unit 54 sets data to be excluded from deletion in response to an operation on an input screen 400 for inputting information to set data to be excluded from deletion.

[0273] In this case, the input screen 400 may be configured and displayed on the communication terminal 10 side, or it may be configured and displayed on the management server side.

[0274] ●Additional Information● Each function of the embodiment described above can be realized by one or more processing circuits. Here, "processing circuit" in this embodiment includes processors programmed to execute each function by software, such as processors implemented by electronic circuits, as well as devices such as ASICs (Application Specific Integrated Circuits), DSPs (digital signal processors), FPGAs (field programmable gate arrays), SOCs (System on a chip), GPUs (Graphics Processing Units), and conventional circuit modules designed to execute each of the functions described above.

[0275] Furthermore, the various tables in the embodiments described above may be generated by the learning effect of machine learning, and tables may not be used if the data of each related item is classified by machine learning. Here, machine learning is a technique for enabling computers to acquire human-like learning abilities, and it refers to a technique in which a computer autonomously generates algorithms necessary for judgments such as data identification from pre-incorporated training data, and applies these to new data to make predictions. The learning method for machine learning may be supervised learning, unsupervised learning, semi-supervised learning, reinforcement learning, or deep learning, or a combination of these learning methods may be used, and the learning method for machine learning is not limited.

[0276] While an information processing apparatus, information processing method, program, and information processing system according to one embodiment of the present invention have been described so far, the present invention is not limited to the embodiments described above. It can be modified to the extent that a person skilled in the art can imagine, such as by adding, changing, or deleting other embodiments, and any embodiment that achieves the effects and advantages of the present invention is included within the scope of the present invention. [Explanation of Symbols]

[0277] 1. Communication System (An Example of an Information Processing System) 10 Communication terminals 11 Transmitter / Receiver 12 Reception Department 13 Display Control Unit (An example of display control means) 30. Imaging device (an example of a measuring device) 31 Transmitter / Receiver 33. Image capture control unit 35 Streaming Control Unit 50 Management Server (An example of an information processing device) 51 Transmitting / receiving unit (an example of a transmission means) 54 Setting section (an example of setting means) 90 First external storage (storage means, an example of the first storage means) 91. Second external storage (storage means, an example of the second storage means) 92 Messaging Servers 93 Streaming Servers 200 Confirmation screen 400 Input screen 5000 Memory Unit (An example of a memory means)

Claims

1. A setting means for setting an image transmitted from a shooting device and stored in a storage means as an object to be deleted from the storage means when a predetermined condition is met, A transmission means for transmitting input screen information relating to an input screen for inputting information to set images to be excluded from the items to be deleted to a communication terminal, A receiving means for receiving information regarding images to be excluded from the items to be deleted based on operations performed on the input screen displayed on the communication terminal based on the transmitted input screen information, Equipped with, The setting means is, Based on the received information regarding the images to be excluded from deletion, the images to be excluded from deletion are set. When the aforementioned predetermined conditions are met, the information relating to the image to be deleted is deleted from the storage means. Information processing device.

2. The setting means is, The information processing apparatus according to claim 1, wherein the image stored in the storage means is set as an object to be deleted from the storage means when a predetermined period of time has elapsed since the image was taken.

3. The setting means is, The information processing apparatus according to claim 1 or 2, wherein the image, which is automatically captured by the shooting device, transmitted from the shooting device, and stored in the storage means, is set as the target to be deleted.

4. The information processing apparatus according to any one of claims 1 to 3, wherein the transmitting means transmits to the communication terminal a video that is automatically captured by the shooting device and not stored in the storage means.

5. The information processing apparatus according to claim 4, wherein the transmission means does not transmit the input screen information to the communication terminal while transmitting the video.

6. The setting means is, An information processing apparatus according to any one of claims 3 to 5, wherein an image that is manually captured by the shooting device, transmitted from the shooting device, and stored in the storage means is not set as an object to be deleted.

7. The setting means is, An information processing apparatus according to any one of claims 3 to 5, wherein an image that is manually captured by a different imaging device than the aforementioned imaging device, transmitted from the other imaging device, and stored in the storage means is not set as an object to be deleted.

8. The setting means is, The information processing apparatus according to claim 6 or 7, wherein the total amount of the images that are manually photographed and stored in the storage means and the amount of the images to be excluded from the items to be deleted is within a predetermined range.

9. If the above total reaches the upper limit of the predetermined range, The aforementioned transmission means is The information processing apparatus according to claim 8, which transmits notification information to the communication terminal indicating that the manually taken image cannot be saved, or that it is not possible to set an image to be excluded from the items to be deleted.

10. If the above total reaches the upper limit of the predetermined range, The aforementioned transmission means is The information processing apparatus according to claim 8 or 9, which transmits information to the communication terminal for further raising the upper limit of the range of the predetermined amount.

11. The setting means is, The image stored in the storage means is set as the target to be deleted in association with the account information transmitted from the shooting device, The information processing apparatus according to any one of claims 1 to 10, wherein the transmission means transmits the input screen information relating to the input screen, which includes the account information.

12. The setting means is, The information processing apparatus according to claim 11, wherein if the account information transmitted from the imaging device matches pre-stored account information, the image stored in the storage means is set as the target to be deleted in association with the account information.

13. The setting means is, The information processing apparatus according to claim 12, wherein when the account information and identification information for identifying the shooting device transmitted from the shooting device match the account information and identification information stored in advance in association with each other, the image stored in the storage means is set as the target for deletion in association with the account information.

14. The information processing apparatus according to claim 1, wherein the information relating to the image is the image ID of the image.

15. A setting step of setting an image transmitted from the imaging device and stored in the storage means as an image to be deleted from the storage means when a predetermined condition is met, A transmission step of transmitting input screen information relating to an input screen for inputting information to set images to be excluded from the items to be deleted to a communication terminal, A receiving step of receiving information regarding images to be excluded from the items to be deleted based on operations on the input screen displayed on the communication terminal based on the transmitted input screen information, Equipped with, The aforementioned setup step is, The process includes setting the images to be excluded from deletion based on the received information regarding the images to be excluded from deletion. When the aforementioned predetermined conditions are met, the information relating to the image to be deleted is deleted from the storage means. Information processing methods.

16. An information processing system comprising a photographing device, an information processing device capable of communicating with the photographing device, and a communication terminal capable of communicating with the information processing device, The aforementioned information processing device is A setting means for setting an image transmitted from the imaging device and stored in the storage means as an image to be deleted from the storage means when a predetermined condition is met, A transmission means for transmitting input screen information relating to an input screen for inputting information to set images to be excluded from the items to be deleted to the aforementioned communication terminal, A receiving means for receiving information regarding images to be excluded from the items to be deleted based on operations performed on the input screen displayed on the communication terminal based on the transmitted input screen information, Equipped with, The setting means is, Based on the received information regarding the images to be excluded from deletion, the images to be excluded from deletion are set. When the aforementioned predetermined conditions are met, the information relating to the image to be deleted is deleted from the storage means. Information processing system.

17. A setting means for setting data stored in a storage means to be deleted from the storage means when certain conditions are met, A transmission means for transmitting input screen information relating to an input screen for inputting information to set data to be excluded from the items to be deleted to a communication terminal, A receiving means for receiving information regarding data to be excluded from deletion based on operations on the input screen displayed on the communication terminal based on the transmitted input screen information, Equipped with, The setting means is, Based on the received data regarding images to be excluded from deletion, the data to be excluded from deletion is set. When the aforementioned predetermined conditions are met, the information relating to the data to be deleted is deleted from the storage means. Information processing device.

18. A setting step of setting data stored in a storage means to be deleted from the storage means when a predetermined condition is met, A transmission step of transmitting input screen information relating to an input screen for inputting information to set data to be excluded from the items to be deleted to a communication terminal, A receiving step of receiving information regarding data to be excluded from deletion based on operations on the input screen displayed on the communication terminal based on the transmitted input screen information, Equipped with, The setting step includes a process of setting data to be excluded from deletion based on the received information about the data to be excluded from deletion, When the aforementioned predetermined conditions are met, the information relating to the data to be deleted is deleted from the storage means. Information processing methods.

19. An information processing system comprising a measuring device, an information processing device capable of communicating with the measuring device, and a communication terminal capable of communicating with the information processing device, The aforementioned information processing device is A setting means for setting data transmitted from the measuring device and stored in the storage means to be deleted from the storage means when predetermined conditions are met, A transmission means for transmitting input screen information relating to an input screen for inputting information to set data to be excluded from the items to be deleted to the communication terminal, A receiving means for receiving information regarding data to be excluded from deletion based on operations on the input screen displayed on the communication terminal based on the transmitted input screen information, Equipped with, The setting means sets the data to be excluded from deletion based on the received information regarding the data to be excluded from deletion. When the aforementioned predetermined conditions are met, the information relating to the data to be deleted is deleted from the storage means. Information processing system.

20. On the computer, A setting step of setting an image transmitted from the imaging device and stored in the storage means as an image to be deleted from the storage means when a predetermined condition is met, A transmission step of transmitting input screen information relating to an input screen for inputting information to set images to be excluded from the items to be deleted to a communication terminal, A receiving step of receiving information regarding images to be excluded from the items to be deleted based on operations on the input screen displayed on the communication terminal based on the transmitted input screen information, Make it run, The setting step includes a process of setting images to be excluded from deletion based on the received information about the images to be excluded from deletion, When the aforementioned predetermined conditions are met, the information relating to the image to be deleted is deleted from the storage means. A program that executes information processing methods.

21. On the computer, A setting step of setting data stored in the storage means to be deleted from the storage means when predetermined conditions are met, A transmission step of transmitting input screen information relating to an input screen for inputting information to set data to be excluded from the items to be deleted to a communication terminal, A receiving step of receiving information regarding data to be excluded from deletion based on operations on the input screen displayed on the communication terminal based on the transmitted input screen information, Make it run, The setting step includes a process of setting data to be excluded from deletion based on the received information about the data to be excluded from deletion, When the aforementioned predetermined conditions are met, the information relating to the data to be deleted is deleted from the storage means. A program that executes information processing methods.

Images