Management system, communication system, communication terminal, processing method and program
Patent Information
- Application Number
- JP2025112702
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2025-07-03
- Publication Date
- 2025-10-02
AI Technical Summary
Conventional methods require time-consuming user authentication processing when uploading data from devices like cameras or electronic whiteboards to external storage during remote communication events.
A management system that manages specified events by receiving operation requests from authenticated users, associating operation identification information with access information for external storage, and uploading data to the storage using the associated access information, thereby eliminating the need for user authentication on the device.
Reduces processing time and effort required for uploading data to external storage by handling user authentication centrally, allowing direct data upload without device-level authentication.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
[Technical Field]
[0001] The present disclosure relates to a management system, a communication system, a processing method, and a program. [Background technology]
[0002] 2. Description of the Related Art Systems are known that distribute video captured by a camera in real time, allowing the situation at a location where the camera is installed to be viewed in real time at another location.
[0003] Furthermore, there is already known a technology for storing data acquired by a device such as a camera participating in remote communication in an external storage service. For example, Patent Document 1 discloses a method for storing settings of an external storage service for each user in a server device and reading the setting information stored in the server device into an interactive whiteboard device, with the aim of reducing the effort required to select an external storage service as a destination. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2019-134399 Summary of the Invention [Problem to be solved by the invention]
[0005] However, with conventional methods, when data acquired by a device such as a camera or electronic whiteboard device participating in a remote communication event is uploaded to external storage with user authority, processing such as user authentication on the device is required, which poses a problem of time-consuming processing. [Means for solving the problem]
[0006] In order to solve the above-mentioned problem, the invention of claim 1 is a management system that manages specified events that are executed by communication between a communication terminal used by a user and a device that remotely communicates with the communication terminal, and includes: an operation request receiving means that receives an operation request for a specific device from a user authenticated by the management system, sent from the communication terminal; a storage means that associates and stores operation identification information that identifies a device operation related to the received operation request with access information for the user's external storage; and an upload means that uploads data acquired by the specific device in response to the device operation corresponding to the stored operation identification information to the external storage using the access information associated with the operation identification information. [Effects of the Invention]
[0007] According to the present invention, it is possible to reduce the processing time and effort required when uploading data acquired by a device to an external storage with user authority. [Brief explanation of the drawings]
[0008] [Figure 1] FIG. 1 is a diagram illustrating an example of the overall configuration of a communication system. [Figure 2] FIG. 1 is a diagram for explaining an outline of an example of a communication system. [Figure 3] FIG. 1 is a diagram for explaining an outline of an example of a communication system. [Figure 4] FIG. 2 is a diagram illustrating an example of a hardware configuration of a communication terminal. [Figure 5] FIG. 2 is a diagram illustrating an example of a hardware configuration of the imaging device. [Figure 6] FIG. 2 is a diagram illustrating an example of the hardware configuration of a management server and an authorization server. [Figure 7] FIG. 1 illustrates an example of a functional configuration of a communication system. [Figure 8] FIG. 10 is a conceptual diagram illustrating an example of a user information management table. [Figure 9]FIG. 10 is a conceptual diagram illustrating an example of a device management table. [Figure 10] FIG. 10 is a conceptual diagram illustrating an example of an operation information management table. [Figure 11] FIG. 10 is a conceptual diagram illustrating an example of an authentication information management table. [Figure 12] FIG. 10 is a sequence diagram illustrating an example of a user authentication process. [Figure 13] FIG. 10 is a sequence diagram illustrating an example of a file upload process to an external storage. [Figure 14] FIG. 10 is a sequence diagram illustrating an example of a file upload process to an external storage. [Figure 15] FIG. 10 is a diagram illustrating an example of an event screen. [Figure 16] FIG. 10 is a diagram illustrating an example of an event screen. [Figure 17] FIG. 10 is a diagram showing an example of a file viewing screen. DETAILED DESCRIPTION OF THE INVENTION
[0009] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. In the description of the drawings, the same elements are given the same reference numerals, and duplicated explanations will be omitted.
[0010] ●Embodiment● ●Outline of the communication system First, an outline of the configuration of a communication system according to an embodiment will be described with reference to Fig. 1. Fig. 1 is a diagram showing an example of the overall configuration of a communication system. The communication system 1 shown in Fig. 1 is a system that allows a user to view the status of a distribution center in real time by participating in a predetermined event such as remote communication provided by a management system 5 and displaying, at a viewing center, captured images such as video distributed from a remote distribution center. Here, the predetermined event includes a remote conference, remote class, remote medical examination, meeting or consultation, or inspection, monitoring, or patrol of a remote center, which are realized by communication between remote centers via the management system 5.
[0011] 1, the communication system 1 includes a communication terminal 10 located at a viewing base, an image capturing device 30 located at a site that is a distribution base, a management server 50, and an authorization server 70. The communication terminal 10, the image capturing device 30, the management server 50, and the authorization server 70 that constitute the communication system 1 can communicate via a communication network 100. The communication network 100 is constructed using the Internet, a mobile communication network, a LAN (Local Area Network), etc. Note that the communication network 100 may include not only wired communication networks but also wireless communication networks such as 3G (3rd Generation), 4G (4th Generation), 5G (5th Generation), Wi-Fi (Wireless Fidelity) (registered trademark), WiMAX (Worldwide Interoperability for Microwave Access), or LTE (Long Term Evolution).
[0012] The communication terminal 10 is a computer such as a notebook PC (Personal Computer) used by a user at a viewing location. For example, the communication terminal 10 undergoes user authentication by the management server 50 and then participates in a predetermined event provided by the management server 50. The communication terminal 10 displays images captured by a camera 30 installed at the distribution location, allowing the user to view the status of the distribution location.
[0013] The communication terminal 10 is not limited to a notebook PC, but may be, for example, a desktop PC, a smartphone, a tablet terminal, a wearable terminal, an HMD (head mounted display), or an IWB (Interactive White Board: an electronic whiteboard with a blackboard function that allows mutual communication), etc.
[0014] The camera device 30 is installed at a distribution center, such as an office or factory, and is a device that participates in a predetermined event provided by the management server 50. The camera device 30 is pre-registered in the management server 50, and when an event starts in response to a user request, the camera device 30 launches an installed application and participates in the event as a participant. The camera device 30 captures images of subjects, scenery, etc. within the distribution center, and transmits the captured images via the management server 50 to communication terminals 10 participating in the event. The captured images obtained by the camera device 30 may be video or still images, or may be both video and still images. The captured images may also include audio along with the images.
[0015] Here, the image capturing device 30 is an example of a device participating in an event provided by the management server 50. The device participating in the event is not limited to an image capturing device, but may be a moving object such as a video conference terminal, an IWB (Interactive White Board: an electronic whiteboard with a blackboard function that allows mutual communication), or a robot that moves within a distribution center.
[0016] Furthermore, the distribution base where the image capture device 30 is installed is not limited to an office or a factory, but may be, for example, an outdoor base such as a business office, construction site, substation, farm, rice field, plantation, cultivated land, or disaster site, or an indoor base such as a school, warehouse, commercial facility, hospital, or nursing home. In other words, the distribution base where the image capture device 30 is installed may be any base where there is a need to hold a remote conference or an event such as an inspection with a user present at a viewing base.
[0017] The management server 50 is a server computer that provides and manages events that are executed between the communication terminal 10 and the image capturing device 30. The management server 50 manages and controls communication between the communication terminal 10 and the image capturing device 30, and relays image data that is sent and received. The authorization server 70 is a server computer that performs authentication and authorization processes for users who participate in events, etc., provided by the management server 50. The authorization server 70 also works in conjunction with an external storage service that provides external storage 90, and stores authorization tokens (access information to the external storage 90) of users who have contracted with the external storage 90.
[0018] Here, the management server 50 and the authorization server 70 constitute the management system 5. The management system 5 may be, for example, a computer that aggregates all or part of the functions of the management server 50 and the authorization server 70. Furthermore, each of the management server 50 and the authorization server 70 may be configured to realize each function by distributing it among multiple computers. Furthermore, although the management server 50 and the authorization server 70 will be described as server computers existing in a cloud environment, they may also be servers existing in an on-premise environment.
[0019] The external storage 90 is a storage service (or online storage) provided by an external service provider via the communication network 100. The external storage 90 is, for example, a storage destination for storing data files on the cloud, and a user who subscribes to the external storage service can store and view data using his or her own authorization token.
[0020] An example of a usage scene of the communication system 1 will now be described with reference to Figures 2 and 3. Figures 2 and 3 are diagrams for explaining an outline of an example of the communication system.
[0021] First, FIG. 2 shows an example of remote communication between an image capturing device 30 (30A to 30C) installed at a viewing location and a communication terminal 10A used by an administrator A who is a user at the viewing location.
[0022] The viewing site shown in FIG. 2 is, for example, a site such as a factory or warehouse where a predetermined task is performed by multiple workers. As shown in FIG. 2, multiple image capturing devices 30 (30A to 30C) are installed at the viewing site. Of these, image capturing devices 30A and 30B are fixedly installed, for example, on a workbench or the like within the site and perform image capturing processing of the surrounding area. Image capturing device 30C is provided on a robot traveling within site A and captures images while the robot is traveling. The image capturing devices 30 (30A to 30C) transmit captured images acquired during an event held with administrator A to be displayed on communication terminal 10A used by administrator A. Administrator A, who is a user at viewing site A in a remote location, uses communication terminal 10A to remotely communicate with image capturing devices 30 installed at a distribution site to view captured images within the site or perform maintenance and management of the distribution site.
[0023] 3, a configuration may also be adopted in which multiple users located at different viewing locations participate in an event and perform remote communication with the image capturing device 30 installed at the distribution location. Fig. 3 shows an example in which an administrator A who is a user at viewing location A and an administrator B who is a user at viewing location B participate in the same event and perform remote communication with the image capturing device 30 installed at the distribution location using communication terminals 10A, 10B, and 10C, respectively.
[0024] In the usage scenarios shown in Figures 2 and 3, just as users participate in an event such as a web conference using communication terminals, devices such as photographing devices also participate in the event as one of the participating locations. In such cases, users participating in the event may wish to instruct a device in a remote location to take a photo and upload the photo to an external storage device subscribed to by the user.
[0025] However, in the past, when uploading data acquired by a device such as an image capture device participating in an event such as a remote conference to an external storage of a specific user, it was necessary to have the device itself store the user's authentication information and upload the data directly to the external storage from the device with the user's authority, or to transfer the data from the device to a communication terminal used by the user and then upload it.As a result, when uploading data acquired by the device to external storage with the user's authority, processing such as user authentication on the device is required, which posed a problem of increased processing time.
[0026] Therefore, in the communication system 1, based on a request from a user who is a subscriber of the external storage 90, the management server 50 acquires an authorization token for accessing the external storage 90 with the user's authority, and the photographing device 30 transmits information for identifying the authorization token along with the acquired data to the management server 50. More specifically, assuming that the management server 50 operates as an OAuth 2.0 resource server and can acquire the user's access token, the management server 50 temporarily stores the authorization token and provides it to the external storage 90 together with the data acquired from the photographing device 30, thereby enabling data to be uploaded without providing the photographing device 30 with user access information to the external storage 90, such as the authorization token.
[0027] This allows the communication system 1 to directly upload data acquired from a device to the external storage 90, without requiring a user to operate the device or to perform user authentication on the device. For example, image data acquired from a device installed at a distribution center as shown in Figures 2 and 3 can be uploaded to the external storage 90 subscribed to by a user at a viewing center, thereby reducing the effort required for the user to perform the upload process.
[0028] ●Hardware configuration Next, the hardware configuration of each device or terminal constituting the communication system according to the embodiment will be described with reference to Figures 4 to 6. Note that components may be added or deleted from the hardware configurations shown in Figures 4 to 6 as necessary.
[0029] ○Hardware configuration of communication terminal○ First, the hardware configuration of communication terminal 10 will be described with reference to Fig. 4. Fig. 4 is a diagram showing an example of the hardware configuration of a communication terminal. Communication terminal 10 is constructed by a computer, and as shown in Fig. 4, includes a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, a HD (Hard Disk) 104, an HDD (Hard Disk Drive) controller 105, a display 106, an external device connection I / F (Interface) 107, a network I / F 108, a bus line 110, a keyboard 111, a pointing device 112, an audio input / output I / F 113, a microphone 114, a speaker 115, a camera 116, a DVD-RW (Digital Versatile Disk Rewritable) drive 117, and a media I / F 119.
[0030] Of these, CPU 101 controls the overall operation of communication terminal 10. ROM 102 stores programs used to drive CPU 101, such as an IPL (Initial Program Loader). RAM 103 is used as a work area for CPU 101. HD 104 stores various data, such as programs. HDD controller 105 controls the reading and writing of various data from HD 104 under the control of CPU 101. Display 106 is a type of display means that displays various information, such as a cursor, menu, window, text, or image. Note that display 106 may be a touch panel display equipped with input means. External device connection I / F 107 is an interface for connecting various external devices. Network I / F 108 is an interface for data communication using communication network 100. Bus line 110 is an address bus, data bus, or the like, for electrically connecting each component, such as CPU 101, shown in FIG. 4.
[0031] The keyboard 111 is a type of input means having multiple keys for inputting characters, numbers, various instructions, etc. The pointing device 112 is a type of input means for selecting or executing various instructions, selecting a processing target, moving a cursor, etc. The input means may be not only the keyboard 111 and the pointing device 112, but also a touch panel, an audio input device, etc. The audio input / output I / F 113 is a circuit that processes the input and output of audio signals between the microphone 114 and the speaker 115 under the control of the CPU 101. The microphone 114 is a type of built-in sound collection means that inputs audio. The speaker 115 is a type of built-in output means that outputs audio signals. The camera 116 is a type of built-in imaging means that captures an image of a subject and obtains image data. The microphone 114, the speaker 115, and the camera 116 may be external devices rather than built into the communication terminal 10. The DVD-RW drive 117 controls the reading and writing of various data from and to a DVD-RW 118, which is an example of a removable recording medium. The removable recording medium is not limited to DVD-RW, but may be DVD-R or Blu-ray (registered trademark) Disc, etc. Media I / F 119 controls reading and writing (storing) of data from and to recording medium 121, such as a flash memory.
[0032] ○Hardware configuration of the imaging device○ Next, the hardware configuration of the imaging device 30 will be described with reference to FIG. 5. FIG. 5 is a diagram illustrating an example of the hardware configuration of an imaging device. FIG. 3 illustrates an example of an omnidirectional imaging device as the imaging device 30, which captures an object, a landscape, or the like to acquire a omnidirectional image. The imaging device 30 may be a camera that captures a normal planar image, such as a regular digital camera or a smartphone, or a wide-angle camera that can acquire a wide-angle image having a field of view equal to or greater than a predetermined value. In the following description, the imaging device 30 is described as an omnidirectional (omnidirectional) imaging device using two image sensors, but the number of image sensors may be two or more. Furthermore, the imaging device does not necessarily have to be a device dedicated to omnidirectional imaging; a regular digital camera, smartphone, or the like may have substantially the same functions as the imaging device 30 by attaching an omnidirectional imaging unit to it.
[0033] As shown in FIG. 5, the photographing device 30 is composed of an imaging unit 301, an image processing unit 304, an imaging control unit 305, a microphone 308, a sound processing unit 309, a CPU (Central Processing Unit) 311, a ROM (Read Only Memory) 312, an SRAM (Static Random Access Memory) 313, a DRAM (Dynamic Random Access Memory) 314, an operation unit 315, an input / output I / F (Interface) 316, a short-range communication circuit 317, an antenna 317a of the short-range communication circuit 317, an electronic compass 318, a gyro sensor 319, an acceleration sensor 320, and a network I / F 321.
[0034] Of these, imaging unit 301 includes wide-angle lenses (so-called fisheye lenses) 302a and 302b (hereinafter referred to as lenses 302 when there is no need to distinguish between them) each having a field angle of 180° or more for forming a hemispherical image, and two imaging elements 303a and 303b provided corresponding to each lens. Imaging elements 303a and 303b include image sensors such as CMOS (Complementary Metal Oxide Semiconductor) sensors or CCD (Charge Coupled Device) sensors that convert optical images captured by lenses 302a and 302b into image data in the form of electrical signals and output the image data, a timing generation circuit that generates horizontal or vertical synchronization signals and pixel clocks for the image sensors, and a group of registers in which various commands or parameters required for the operation of the imaging elements are set.
[0035] The imaging elements 303a and 303b of the imaging unit 301 are each connected to the image processing unit 304 via a parallel I / F bus. Meanwhile, the imaging elements 303a and 303b of the imaging unit 301 are each connected to the imaging control unit 305 via a serial I / F bus (such as an I2C bus). The image processing unit 304, the imaging control unit 305, and the sound processing unit 309 are connected to the CPU 311 via a bus 310. Furthermore, the bus 310 is also connected to a ROM 312, an SRAM 313, a DRAM 314, an operation unit 315, an input / output I / F 316, a short-range communication circuit 317, an electronic compass 318, a gyro sensor 319, an acceleration sensor 320, a network I / F 321, and the like.
[0036] The image processing unit 304 takes in the image data output from the image sensors 303a and 303b via a parallel I / F bus, performs predetermined processing on each piece of image data, and then synthesizes the image data to create equirectangular projection image data.
[0037] The imaging control unit 305 generally sets commands and the like in the registers of the imaging elements 303a and 303b using an I2C bus, with the imaging control unit 305 acting as a master device and the imaging elements 303a and 303b acting as slave devices. Necessary commands and the like are received from the CPU 311. The imaging control unit 305 also uses the I2C bus to retrieve status data and the like from the registers of the imaging elements 303a and 303b and send it to the CPU 311.
[0038] Furthermore, the imaging control unit 305 instructs the imaging elements 303a and 303b to output image data when the shutter button on the operation unit 315 is pressed. Some imaging devices 30 have a preview display function or a function for displaying moving images on a display (for example, a display of an external terminal such as a smartphone that performs short-range communication with the imaging device 30 using the short-range communication circuit 317). In this case, the image data is output continuously from the imaging elements 303a and 303b at a predetermined frame rate (frames per minute).
[0039] As will be described later, the imaging control unit 305 also functions as a synchronization control means that cooperates with the CPU 311 to synchronize the output timing of image data from the imaging elements 303a and 303b. In this embodiment, the imaging device 30 is not provided with a display unit, but a display unit may be provided. The microphone 308 converts sound into sound (signal) data. The sound processing unit 309 receives the sound data output from the microphone 308 via an I / F bus and performs predetermined processing on the sound data.
[0040] The CPU 311 controls the overall operation of the image capturing device 30 and executes necessary processing. The ROM 312 stores various programs for the CPU 311. The SRAM 313 and DRAM 314 are work memories that store programs executed by the CPU 311, data in the middle of processing, etc. In particular, the DRAM 314 stores image data in the middle of processing by the image processing unit 304 and data of processed equirectangular projection images.
[0041] The operation unit 315 is a collective term for various operation buttons, a power switch, a shutter button, a touch panel that combines display and operation functions, etc. The user operates the operation unit 315 to input various shooting modes, shooting conditions, etc.
[0042] The input / output I / F 316 is a general term for an interface circuit (such as a USB I / F) with an external medium such as an SD card or a personal computer. The input / output I / F 316 may be wireless or wired. The equirectangular projection image data stored in the DRAM 314 is recorded on an external medium via the input / output I / F 316, or transmitted to an external terminal (device) via the input / output I / F 316 as needed.
[0043] The short-range communication circuit 317 communicates with an external terminal (device) by short-range wireless communication technology such as NFC (Near Field Communication), Bluetooth (registered trademark), or Wi-Fi via an antenna 317a provided in the image capturing device 30. The short-range communication circuit 317 can transmit data of the equirectangular projection image to the external terminal (device).
[0044] The electronic compass 318 calculates the orientation of the image capture device 30 based on the Earth's magnetism and outputs orientation information. This orientation information is an example of related information (metadata) conforming to the Exif standard and is used for image processing such as image correction of captured images. The related information also includes data on the capture date and time of the image and the data size of the image data. The gyro sensor 319 detects angle changes (roll angle, pitch angle, and yaw angle) associated with the movement of the image capture device 30. The angle changes are an example of related information (metadata) conforming to the Exif standard and are used for image processing such as image correction of captured images. The acceleration sensor 320 detects acceleration in three axial directions. The image capture device 30 calculates the attitude (angle relative to the direction of gravity) of its own device (image capture device 30) based on the acceleration detected by the acceleration sensor 320. The inclusion of the acceleration sensor 320 in the image capture device 30 improves the accuracy of image correction. The network I / F 321 is an interface for data communication using a communication network 100 such as the Internet via a router or the like.
[0045] ○Management server hardware configuration○ Next, the hardware configuration of the management server 50 will be described with reference to Fig. 6. Fig. 6 is a diagram showing an example of the hardware configuration of the management server. Each piece of hardware configuration in the management server 50 is indicated by a reference number in the 500 series. The management server 50 is constructed by a computer, and as shown in Fig. 6, includes a CPU 501, a ROM 502, a RAM 503, a HD 504, an HDD controller 505, a display 506, an external device connection I / F 508, a network I / F 509, a bus line 510, a keyboard 511, a pointing device 512, a DVD-RW drive 514, and a media I / F 516.
[0046] Of these, the CPU 501 controls the overall operation of the management server 50. The ROM 502 stores programs used to drive the CPU 501, such as the IPL. The RAM 503 is used as a work area for the CPU 501. The HD 504 stores various data, such as programs. The HDD controller 505 controls the reading and writing of various data from and to the HD 504 under the control of the CPU 501. The display 506 displays various information, such as a cursor, menus, windows, characters, or images. The display 506 may be a touch panel display equipped with input means. The external device connection I / F 508 is an interface for connecting various external devices. The network I / F 509 is an interface for data communication using the communication network 100. The bus line 510 is an address bus, a data bus, or the like, for electrically connecting the components, such as the CPU 501, shown in FIG. 6.
[0047] The keyboard 511 is a type of input means having multiple keys for inputting characters, numbers, various instructions, etc. The pointing device 512 is a type of input means for selecting or executing various instructions, selecting a processing target, moving a cursor, etc. The input means may be not only the keyboard 511 and the pointing device 512, but also a touch panel, a voice input device, etc. The DVD-RW drive 514 controls reading and writing of various data from a DVD-RW 513, which is an example of a removable recording medium. The removable recording medium is not limited to a DVD-RW, but may also be a DVD-R or a Blu-ray Disc, etc. The media I / F 516 controls reading and writing (storing) of data from a recording medium 515, such as a flash memory.
[0048] ○Authorization server hardware configuration○ Fig. 6 is a diagram showing an example of the hardware configuration of the authorization server. Each piece of hardware configuration of the authorization server 70 is indicated by a reference number in the 700 series in parentheses. The authorization server 70 is constructed by a computer, and as shown in Fig. 6, has the same configuration as the management server 50, so a description of each piece of hardware configuration will be omitted.
[0049] Each of the above programs may be recorded as an installable or executable file on a computer-readable recording medium and distributed. Examples of recording media include CD-Rs (Compact Disc Recordables), DVDs (Digital Versatile Disks), Blu-ray Discs, SD cards, and USB memory sticks. The recording media may also be provided domestically or internationally as a program product. For example, the management system 5 realizes the processing method according to the present invention by executing the program according to the present invention.
[0050] ●Function configuration Next, the functional configuration of the communication system according to the embodiment will be described with reference to Fig. 7 to Fig. 11. Fig. 7 is a diagram showing an example of the functional configuration of the communication system. Fig. 7 shows devices or terminals shown in Fig. 1 that are related to the processing or operation described below.
[0051] ○Functional configuration of communication terminal○ First, the functional configuration of communication terminal 10 will be described with reference to Fig. 7. Communication terminal 10 has a transmitting / receiving unit 11, a receiving unit 12, a display control unit 13, a determining unit 14, and a storing / reading unit 19. Each of these units is a function or means realized by operating any of the components shown in Fig. 4 in response to an instruction from CPU 101 in accordance with a communication terminal program loaded from HD 104 onto RAM 103. Communication terminal 10 also has a storage unit 1000 constructed by ROM 102, HD 104, or recording medium 121 shown in Fig. 4.
[0052] The transmitting / receiving unit 11 is mainly realized by the processing of the CPU 101 for the network I / F 108, and transmits and receives various data or information to and from other devices or terminals via the communication network 100.
[0053] The reception unit 12 is mainly realized by the processing of the CPU 101 on the keyboard 111 or the pointing device 112, and receives various selections or inputs from the user.
[0054] The display control unit 13 is mainly realized by the processing of the CPU 101, and accesses the management server 50 using a web browser to display various screen data on the display 106. Specifically, the display control unit 13 accesses the management server 50 by, for example, starting and executing an application or a browser installed on the communication terminal 10. The display control unit 13 then downloads a WebAPP (WebApplication) that includes at least HTML (HyperText Markup Language) and also includes CSS (Cascading Style Sheets) or JAVA SCRIPT (registered trademark), and displays various image data generated by the WebAPP on the display 106. The display control unit 13 displays image data generated by HTML5 that includes data in, for example, Extensible Markup Language (XML), JavaScript Object Notation (JSON), or Simple Object Access Protocol (SOAP) format on the display 106.
[0055] The determination unit 14 is realized by the processing of the CPU 101, and performs various determinations.
[0056] The storage / readout unit 19 is mainly realized by the processing of the CPU 101 , and stores various data (or information) in the storage unit 1000 and reads out various data (or information) from the storage unit 1000 .
[0057] ○ Functional configuration of the imaging device ○ Next, the functional configuration of the photographing device 30 will be described with reference to Fig. 7. The photographing device 30 has a transmission / reception unit 31, an application launch unit 32, a photographing control unit 33, and a storage / readout unit 39. Each of these units is a function or means realized when any of the components shown in Fig. 5 operates in response to an instruction from the CPU 311 in accordance with a photographing device program loaded from the SRAM 313 onto the DRAM 314. The photographing device 30 also has a storage unit 3000 constructed by the ROM 312, SRAM 313, and DRAM 314 shown in Fig. 5. The storage unit 3000 stores the GUID (Globally Unique Identifier) of the photographing device itself.
[0058] The transmitting / receiving unit 31 is mainly realized by the processing of the CPU 311, and communicates various data or information with other devices or terminals. Furthermore, the transmitting / receiving unit 31 uses the network I / F 321 to communicate data with other devices or terminals via the communication network 100.
[0059] The application launch unit 32 is mainly realized by the processing of the CPU 311, and launches an application for participating in an event provided by the management server 50 in response to a request from the management server 50. The image capturing device 30 participates in the event provided by the management server 50 by launching the application installed by the application launch unit 32.
[0060] The photographing control unit 33 is mainly realized by the processing of the CPU 311 on the imaging unit 301, the image processing unit 304, and the imaging control unit 305, and photographs a subject such as a landscape and acquires photographed image data.
[0061] The storage / readout unit 39 is mainly realized by the processing of the CPU 311, and stores various data (or information) in the storage unit 3000 and reads out various data (or information) from the storage unit 3000. The storage unit 3000 also stores photographed image data acquired by the photographing processing by the photographing control unit 33. The photographed image data stored in the storage unit 3000 is associated with the photographed time of the photographed image as metadata.
[0062] ○ Management server functional configuration ○ Next, the functional configuration of management server 50 will be described with reference to Fig. 7. Management server 50 has a transmission / reception unit 51, a determination unit 52, an authorization processing unit 53, an operation information generation unit 54, a message processing unit 55, an upload processing unit 56, and a storage / readout unit 59. Each of these units is a function or means realized when any of the components shown in Fig. 6 operates in response to an instruction from CPU 501 in accordance with a management server program loaded from HD 504 onto RAM 503. Management server 50 also has a storage unit 5000 constructed using ROM 502, HD 504, or recording medium 515 shown in Fig. 6.
[0063] The transmitting / receiving unit 51 is mainly realized by the processing of the CPU 501 on the network I / F 509, and transmits and receives various data or information to and from other devices or terminals via the communication network 100.
[0064] The determination unit 52 performs various determinations and is realized by the processing of the CPU 501. The authorization processing unit 53 is mainly realized by the processing of the CPU 501 and performs authentication processing for a user using the authorization server .
[0065] The operation information generation unit 54 is mainly realized by processing of the CPU 501, and generates operation information related to an operation to be requested of a device such as the imaging device 30, based on an operation request for the device transmitted from the communication terminal 10. The operation information generation unit 54 generates operation information that associates, for example, operation identification information that identifies a device operation corresponding to the received operation request with an authorization token for the external storage 90 of the requesting user. The management server 50 stores the operation information generated by the operation information generation unit 54, and uses the authorization token included in the stored operation information in a subsequent process.
[0066] The message processor 55 is mainly realized by the processing of the CPU 501, and executes processing for exchanging arbitrary messages among participants in the event. For example, in response to a message transmission request transmitted from the communication terminal 10 used by a user who is a participant in the event, the message processor 55 transmits a message to devices such as the image capturing device 30 that are other participants in the event.
[0067] The upload processing unit 56 is mainly realized by the processing of the CPU 501, and uploads data acquired in response to device operations such as the photographing device 30 to the external storage 90 to which the requesting user has access authority, using the authorization token included in the operation information generated by the operation information generation unit 54.
[0068] The storage / reading unit 59 is mainly realized by the processing of the CPU 501, and stores various data (or information) in the storage unit 5000 and reads various data (or information) from the storage unit 5000. The storage unit 5000 may be configured to be built in a storage device external to the management server 50.
[0069] User information management table 8 is a conceptual diagram showing an example of a user information management table. In the storage unit 5000, a user information management DB 5001 configured by the user information management table shown in FIG.
[0070] The user information management table manages user information that associates user identification information (user ID and user name) that identifies a user managed by the management server 50 with an authorization token for the external storage 90. Of these, the authorization token is access information for accessing the external storage 90 with which the user has a contract, i.e., the external storage 90 to which the user has access authority. In other words, the authorization token is uniquely identified for each user. The user information management table stores the authorization token, which is access information for accessing the external storage 90, as user information for each user in association with the user information.
[0071] Device management table 9 is a conceptual diagram showing an example of a device management table. The device management table is a table for managing devices such as the image capturing device 30 registered in the management server 50. A device management DB 5002 configured by the device management table shown in FIG. 9 is created in the storage unit 5000.
[0072] The device management table manages the device IDs and device names of devices installed at each distribution base by associating them with each base ID that identifies the distribution base. When an event with a specific distribution base as a participant starts, the management server 50 starts an application installed on each device managed in the device management table, and uses the started application to have each device participate in the event.
[0073] Operation information management table Fig. 10 is a conceptual diagram showing an example of an operation information management table. The operation information management table is a table for managing operation information related to operations requested of devices such as the image capturing device 30. An operation information management DB 5003 configured by the operation information management table shown in Fig. 10 is constructed in the storage unit 5000.
[0074] The operation information management table manages, in association with each other, operation identification information (operation ID) for identifying a device operation requested of a device, a device ID for identifying a device requesting the device operation, and an authorization token for the user who is the requester of the device operation to the external storage 90. The management server 50 stores the operation information generated by the operation information generation unit 54 in response to a request from the user in the operation information management table.
[0075] ○Authorization server functional configuration○ Next, the functional configuration of the authorization server 70 will be described with reference to Fig. 7. The authorization server 70 has a transmission / reception unit 71, an authentication unit 72, and a storage / readout unit 79. Each of these units is a function or means realized when any of the components shown in Fig. 6 operates in response to an instruction from the CPU 701 in accordance with the authorization server program loaded from the HD 704 onto the RAM 703. The authorization server 70 also has a storage unit 7000 constructed using the ROM 702, HD 704, or recording medium 715 shown in Fig. 6.
[0076] The transmission / reception unit 71 is mainly realized by processing of the CPU 701 on the network I / F 709, and transmits and receives various data or information to and from other devices or terminals via the communication network 100. The authentication unit 72 is realized by processing of the CPU 701, and performs authentication processing for users managed by the authorization server 70.
[0077] The storage / readout unit 79 is mainly realized by the processing of the CPU 701 , and stores various data (or information) in the storage unit 7000 and reads out various data (or information) from the storage unit 7000 .
[0078] Authentication information management table 11 is a conceptual diagram showing an example of an authentication information management table. In the storage unit 7000, an authentication information management DB 7001 configured by the authentication information management table shown in FIG.
[0079] The authentication information management table manages user identification information (user ID and user name) that identifies a user managed by the authorization server 70, and authentication information of the user associated with a password. For example, the authentication information management table shown in Fig. 11 indicates that the user ID of the user name "Alice" is "A001" and the password is "a0101". Note that the user identification information only needs to include either the user ID or the user name that identifies the user.
[0080] Processing or operation of the embodiment ○User authentication process○ Next, the processing or operation of the communication system according to the embodiment will be described with reference to FIGS. 12 to 17. First, with reference to FIG. 12, an authentication process for a user to use a communication terminal 10 to participate in an event executed via the management server 50 will be described. FIG. 12 is a sequence diagram showing an example of user authentication processing. The communication system 1 will be described assuming that the management server 50 has delegated authentication to the authorization server 70 based on OAuth 2.0 / OpenID Connect processing and that use of the external storage 90 has also been authorized. FIG. 12 shows an example of a case where the communication terminal 10 accesses the management system 5 to perform authentication and authorization to start an event such as remote communication, and then starts the event. FIG. 12 also describes an example of authentication and authorization processing for a user "Alice" who uses a communication terminal 10A.
[0081] First, the reception unit 12 of the communication terminal 10A receives a predetermined input operation from the user (step S11). Specifically, the reception unit 12 starts, for example, an application or a browser installed on the communication terminal 10A, and receives input of a predetermined URL (Uniform Resource Locator).
[0082] Next, the transmitter / receiver 11 transmits a screen display request to the management server 50 to request participation in a predetermined event (step S12). Then, the authorization processing unit 53 of the management server 50 redirects the received screen display request to the requesting communication terminal 10A (step S13).
[0083] Next, the transmitter / receiver 11 of the communication terminal 10A transmits a login request for the predetermined event to the authorization server 70 (step S14). As a result, the transmitter / receiver 71 of the authorization server 70 receives the login request transmitted from the communication terminal 10A. Next, the transmitter / receiver 71 of the authorization server 70 transmits login screen information to the requesting communication terminal 10A (step S15). As a result, the transmitter / receiver 11 of the communication terminal 10A receives the login screen information transmitted from the authorization server 70.
[0084] Next, display control unit 13 of communication terminal 10A causes display 106 to display a login screen based on the login screen information received in step S15 (step S16). Then, when the user inputs authentication information into the login screen, reception unit 12 accepts the input of the authentication information (step S17). In this case, user "Alice" inputs her own user identification information (user ID or username) and password, and reception unit 12 accepts the input user identification information and password as authentication information.
[0085] Next, the transmitting / receiving unit 11 transmits the authentication information entered on the login screen in step S17 to the authorization server 70 (step S18). As a result, the transmitting / receiving unit 71 of the authorization server 70 receives the authentication information transmitted from the communication terminal 10A. Next, the authentication unit 72 of the authorization server 70 searches the authentication information management DB 7001 (see FIG. 11) using the user identification information and password included in the authentication information received in step S18 as search keys. Then, the authentication unit 72 performs authentication by determining whether the same set of user identification information and password is managed in the authentication information management DB 7001 (step S19). Below, a case will be described where the authentication unit 72 determines that the user "Alice" is a user with legitimate usage authority.
[0086] Next, the transmitter / receiver 71 of the authorization server 70 transmits an authentication success notification indicating that the authentication of the user "Alice" has been successful to the communication terminal 10A that transmitted the authentication information (step S20). As a result, the transmitter / receiver 11 of the communication terminal 10A receives the authentication success notification transmitted from the authorization server 70.
[0087] Next, the transmitter / receiver 11 of the communication terminal 10A communicates with the management server 50 to participate in the authenticated event (step S21). When the event starts, the communication terminal 10A displays an event screen 200, which will be described later, via a browser.
[0088] Furthermore, the authorization processing unit 53 of the management server 50 transmits to the authorization server 70 an authorization token acquisition request requesting acquisition of an authorization token (access_token) for the external storage 90 of user "Alice" who participated in the event (step S22). As a result, the transmission / reception unit 71 of the authorization server 70 receives the authorization token acquisition request transmitted from the management server 50. Then, the authorization server 70 transmits to the requesting management server 50 the authorization token for the external storage 90 of user "Alice" and user identification information that identifies user "Alice" (step S23). As a result, the authorization processing unit 53 of the management server 50 receives the authorization token and user identification information transmitted from the authorization server 70.
[0089] Then, the storage / readout unit 59 of the management server 50 stores the user information, which is the authorization token received in step S23 and the user identification information associated with each other, in the user information management DB 5001 (step S23).
[0090] In this way, the communication system 1 uses the management system 5 to perform authentication processing for users participating in the event, and stores an authorization token (access_token) for the authenticated user's external storage. When the event starts, a device such as the image capture device 30 participates in the event by starting an application and communicating directly with the management server 50 in response to a request from the management server 50.
[0091] ○File upload processing○ Next, referring to FIGS. 13 to 17, a process of uploading images captured by the camera 30, which is an example of a device, to external storage in response to a request from a communication terminal 10A participating in an event will be described. FIGS. 13 and 14 are sequence diagrams showing an example of a process of uploading a file to external storage. Here, the communication terminal 10A is participating in a remote inspection of a site where the camera 30, which is an example of an event, is installed, through the authentication process for the user "Alice" shown in FIG. 12. The description will be made assuming that multiple camera devices 30 (e.g., camera device 30A, camera device 30B) and other communication terminals 10 (e.g., communication terminal 10B) are also participating in the event in which the communication terminal 10A is participating. The communication terminals 10 and camera devices 30 participating in the event send and receive images captured at their respective locations via the management server 50.
[0092] First, the display control unit 13 of the communication terminal 10A displays an event screen 200 on the display 106 by participating in an event through the authentication process shown in Fig. 12. Figs. 15 and 16 are diagrams showing examples of the event screen. The event screen 200 shown in Fig. 15 is a display screen displayed in an event realized by remote communication via the management server 50 between the communication terminal 10 used by a user who is an event participant and a device such as the image capturing device 30 that is a participant of the event. The event screen 200 includes a base image display area 210 that displays captured images of each base participating in the event, a participant display area 230 that displays participants participating in the event, and an operation request button 250 that is pressed to request a device operation.
[0093] Of these, the base image display area 210 includes images of each base captured by a communication terminal 10 used by a user participating in the event or a device such as the camera 30 participating in the event. In the example shown in FIG. 15, the base image display area 210 displays an image 215a captured by the camera 30A, which is "device A," and an image 215b captured by the communication terminal 10A used by the user "Alice." The participant display area 230 also includes information that can identify the participant, such as the participant's name (user name or device name) or participant icon, indicating the participant participating in the event. In the example shown in FIG. 15, the participant display area indicates that the user "Alice," "device A," "device B," and user "Mary" are participating in the event.
[0094] 15 shows an example in which captured images of two participants are displayed in the base image display area 210, but the number of captured images displayed in the base image display area 210 is not limited to this. For example, the base image display area 210 may display captured images of all participants participating in the event, or may display captured images of a participant whose user name or the like displayed in the participant display area 230 is selected by the user.
[0095] Next, the reception unit 12 receives an operation instruction for a device such as the image capturing device 30 when the user presses the operation request button 250 on the event screen 200 (step S32). Specifically, when the user presses the operation request button 250, the display control unit 13 displays a device selection screen 260 as shown in FIG. 16. The device selection screen 260 is a display screen for selecting a device to perform a captured image capture operation for uploading an image data file of the captured image data to the external storage 90, which is an example of a device operation. The device selection screen 260 includes a selection area 265 for selecting a device to instruct the device operation, an “OK” button 268 to be pressed to instruct the device operation, and a “Close” button 269 to be pressed to cancel the device operation instruction. The reception unit 12 receives an operation instruction for the selected device when the user selects a user name or device name displayed in the selection area 265 and presses the “OK” button 268.
[0096] Here, in the selection area 265, not only devices such as the image capturing device 30 but also users "Alice" and "Mary" are displayed as selectable devices, but communication terminals 10 used by users other than user "Alice" who uses communication terminal 10A can be considered as devices similar to the image capturing device 30. In other words, in the broad sense, devices in this embodiment include terminals or devices that have not been authenticated by the user who issues the operation instruction.
[0097] 16 shows a state in which the user has selected the image capturing device 30A, which is "device A." An example in which a device operation request is made to the image capturing device 30A in response to an operation instruction from the user "Alice" will be described below.
[0098] The transmitter / receiver 11 transmits to the management server 50 an operation information generation request for generating operation information related to an operation to be requested of the camera device 30A (step S33). This operation information generation request includes user identification information (user ID or user name) of the authenticated user, device identification information (device ID or device name) for identifying the camera device 30A whose request was accepted in step S32, and information indicating the operation content to be executed by the camera device 30A. The operation information generation request here is, for example, a request for generating operation information related to an operation to request the camera device 30A to capture a captured image. As a result, the transmitter / receiver 51 of the management server 50 receives the operation information generation request transmitted from the communication terminal 10A.
[0099] Next, the storage / readout unit 59 of the management server 50 searches the user information management DB 5001 (see FIG. 8) using the user identification information received in step S33 as a search key, thereby reading out an authorization token (access_token) associated with the received user identification information (step S34). Next, the operation information generation unit 54 generates an operation ID for identifying an operation to be performed by the image capture device 30 (step S35). The operation information generation unit 54 also generates operation information that associates the device identification information received in step S33, the authorization token read out in step S34, and the operation ID generated in step S35. The operation information generation unit 54 then stores the generated operation information in the operation information management DB 5003 (see FIG. 10) via the storage / readout unit 59 (step S36). In this way, the management server 50 stores the authorization token for accessing the user's external storage 90 in association with the operation ID so that it can be used in subsequent processing.
[0100] Next, the transmitting / receiving unit 51 transmits to the communication terminal 10A destination information that serves as a temporary storage destination for data used to exchange operation results of the imaging device 30A (step S37). This destination information is uniquely identified for each device operation in response to the device operation request accepted in step S32. The destination information is, for example, a URL indicating a destination on the management server 50. As a result, the transmitting / receiving unit 11 of the communication terminal 10A receives the destination information transmitted from the management server 50.
[0101] Next, the transmitter / receiver 11 of the communication terminal 10A transmits a message transmission request to the photographing device 30A to the management server 50 (step S38). This message transmission request includes the device ID (D001) that identifies the photographing device 30A to which the message is to be sent, the operation command requested of the photographing device 30A, and the destination information received in step S37. As a result, the transmitter / receiver 51 of the management server 50 receives the message transmission request transmitted from the communication terminal 10A.
[0102] Next, the message processor 55 of the management server 50 transmits a message (an example of a first message) in response to the message transmission request received in step S38 to the image capturing device 30A identified by the device ID indicated in the received message transmission request (step S39). This message includes the operation command and destination information included in the message transmission request received in step S38. As a result, the transmitter / receiver 31 of the image capturing device 30A receives the message transmitted from the management server 50.
[0103] Next, the photographing device 30A performs processing based on the operation command indicated in the message received in step S39 (step S40). In this case, since the received operation command is "capture," the photographing device 30A performs photographing processing by the photographing control unit 33.
[0104] Next, the transmitting / receiving unit 31 of the photographing device 30A uses the destination information indicated in the message received in step S39 to transmit the image data file of the photographed image data acquired by the processing of step S40 to the management server 50 (step S41). As a result, the transmitting / receiving unit 51 of the management server 50 receives the image data file transmitted from the photographing device 30A.
[0105] Next, the storage / reading unit 59 of the management server 50 reads the authorization token (access_token) associated with the operation ID generated in step S53 from the operation information management DB 5003 (step S42). Then, the upload processing unit 56 transmits a file upload request to the external storage 90 (step S43). This file upload request includes the authorization token read in step S42 and the image data file received in step S41.
[0106] The external storage 90 performs authentication processing using the authorization token sent from the management server 50. Since this authorization token corresponds to the user "Alice," authentication is performed using the authentication information of "Alice." The external storage 90 then stores the image data file sent from the management server 50 in a folder for the authenticated "Alice."
[0107] Then, the external storage 90 transmits an upload completion notification to the management server 50 (step S44). As a result, the transmitting / receiving unit 51 of the management server 50 receives the upload completion notification transmitted from the external storage 90.
[0108] Next, the transmitting / receiving unit 51 of the management server 50 transmits a processing completion notification to the photographing device 30A that transmitted the image data file in step S41 (step S45). As a result, the transmitting / receiving unit 51 of the photographing device 30A receives the processing completion notification transmitted from the management server 50.
[0109] Next, the transmitter / receiver 31 of the photographing device 30A transmits a message transmission request to the management server 50 for transmission to the communication terminal 10A (step S46). This message transmission request includes the operation command and destination information included in the message received in step S39, as well as information indicating that the device operation has been completed. As a result, the transmitter / receiver 51 of the management server 50 receives the message transmission request transmitted from the photographing device 30A.
[0110] Next, in response to the message transmission request received in step S46, the message processing unit 55 of the management server 50 transmits a message (an example of a second message) indicating that the upload of the image data file by the photographing device 30A has been completed to the communication terminal 10A used by the user "Alice" identified by the user ID indicated in the received message transmission request (step S47). As a result, the transmitting / receiving unit 11 of the communication terminal 10A receives the message transmitted from the management server 50. Then, the communication terminal 10A displays a predetermined display screen indicating that the upload has been completed in response to the received message, thereby notifying the user "Alice" that the requested device operation has been completed.
[0111] Furthermore, the communication terminal 10A accesses the external storage 90 with the access authority of the user "Alice" to perform the process of viewing the uploaded file (step S48). Fig. 17 is a diagram showing an example of a file viewing screen. The display control unit 13 of the communication terminal 10A accesses the external storage 90 with the access authority of the user "Alice" to cause the file viewing screen 400 shown in Fig. 17 to be displayed on the display 106.
[0112] The file viewing screen 400 includes a list display area 410 that displays a list of data files uploaded to the folder of the user "Alice" in the external storage 90, and an "Open" button 420 that can be pressed to view the contents of the uploaded files. Of these, the list display area 410 includes the file names of the uploaded data files and the upload dates and times.
[0113] When user "Alice" selects a specific data file shown in the list display area 410 and presses the "Open" button 420, the display control unit 13 displays the selected data file. The example shown in Fig. 17 shows a state in which the uploaded file "deviceAyyyy.jpg" has been selected.
[0114] In this way, in response to a device operation request from a user participating in an event, the communication system 1 temporarily stores an authorization token for the user's external storage 90 in the management server 50. Then, the management server 50 uses the temporarily stored authorization token to upload data acquired by the requested device operation to the user's external storage 90.
[0115] Effect of the embodiment As described above, the communication system 1 allows a user to upload data acquired by a device to an external storage 90 for which the user has authority simply by selecting the device participating in the event, thereby reducing the effort required for the user to perform the upload process.
[0116] Furthermore, the communication system 1 can directly upload data acquired from the device to the user's external storage 90 without the user operating the device or performing user authentication on the device, so that the upload process can be performed without providing the device with access information to the external storage 90, such as the user's authorization token.
[0117] ●Summary● As described above, a management system according to one embodiment of the present invention is a management system 5 that manages a predetermined event executed through communication between a communication terminal 10 used by a user and a device (e.g., an image capturing device 30) that remotely communicates with the communication terminal 10. The management system 5 receives an operation request for a specific device from a user authenticated by the management system 5 and transmitted from the communication terminal 10, and associates and stores operation identification information (e.g., an operation ID) that identifies a device operation related to the received operation request with an authorization token (an example of access information) for the user's external storage 90. The management system 5 then uploads data acquired by the specific device in response to the device operation corresponding to the stored operation identification information to the external storage 90 using the authorization token associated with the operation identification information. This allows the management system 5 to reduce the processing effort required when uploading data acquired by a device to external storage with user authority.
[0118] Furthermore, a management system according to an embodiment of the present invention generates operation information associated with operation identification information (e.g., an operation ID), an authorization token (an example of access information), and device identification information (e.g., a device ID) that identifies a specific device, based on a received operation request, and stores the generated operation information. The management system 5 also transmits destination information (e.g., a URL) for exchanging data acquired by a device operation related to the received operation request to the communication terminal 10, and transmits a first message to the specific device in response to a message transmission request from the communication terminal 10 to the specific device, the message transmission request including the destination information. Furthermore, the management system 5 receives data acquired by a device operation according to the transmitted first message from the specific device, and uploads the received data to the external storage 90 using the stored authorization token. This allows the management system 5 to directly upload data acquired from the device to the user's external storage 90 without requiring the user to operate the device or perform user authentication on the device. Therefore, the upload process can be performed without providing the device with access information to the external storage 90, such as the user's authorization token.
[0119] Furthermore, a communication system according to an embodiment of the present invention is a communication system 1 including a management system 5 and a communication terminal 10, in which the communication terminal 10 displays on a display 108 (an example of a display unit) an image captured by a device (e.g., an image capturing device 30) installed at a remote site, accepts selection of a specific device that issues a capture request for the displayed captured image, and transmits an operation request for the accepted specific device to the management system 5. This allows the communication system 1 to upload data acquired by a device to an external storage 90 for which the user has authority, simply by selecting a device participating in an event, thereby reducing the effort required for the user's upload process.
[0120] Furthermore, in the communication system according to one embodiment of the present invention, the communication terminal 10 displays on the display 106 (an example of a display unit) a viewing screen (an example of a file viewing screen 400) for data uploaded to the external storage 90 based on an authorization token (an example of access information) of a user authenticated by the management system 5. This allows the communication system 1 to allow a user with access authority to access the external storage 90 and view the data uploaded directly from the device.
[0121] ●Additional Information● Each function of the above-described embodiments can be realized by one or more processing circuits. Here, the term "processing circuit" in the present embodiment includes a processor programmed to perform each function by software, such as a processor implemented by an electronic circuit, as well as devices designed to perform each function described above, such as an application specific integrated circuit (ASIC), a digital signal processor (DSP), a field programmable gate array (FPGA), a system on a chip (SOC), a graphics processing unit (GPU), and a conventional circuit module.
[0122] Furthermore, the various tables in the above-described embodiments may be generated by the learning effects of machine learning, and tables may not be used by classifying data for each associated item using machine learning. Here, machine learning refers to a technology that allows a computer to acquire human-like learning capabilities, in which the computer autonomously generates algorithms necessary for judgments such as data classification from previously acquired learning data and applies these algorithms to new data to make predictions. The learning method for machine learning may be any of supervised learning, unsupervised learning, semi-supervised learning, reinforcement learning, and deep learning, or may be a combination of these learning methods. Any learning method for machine learning is acceptable.
[0123] So far, we have described a management system, communication system, processing method, and program according to one embodiment of the present invention, but the present invention is not limited to the above-described embodiment, and other embodiments can be added, modified, or deleted, etc., within the scope that can be conceived by a person skilled in the art, and any aspect is within the scope of the present invention as long as it achieves the functions and effects of the present invention. [Explanation of symbols]
[0124] 1. Communication Systems 5 Management System 10. Communication terminals 11 Transmitting / receiving unit (an example of an operation request transmitting means) 12 Reception 13 Display control unit (an example of a display control means) 30 Imaging equipment 31 Transmitter / Receiver 33 Shooting control unit 50 Management Server 51 Transmitting / receiving unit (an example of an operation request receiving means, an example of a transmitting means, an example of a data receiving means) 54 Operation information generating unit (an example of operation information generating means) 55 Message processing unit (an example of a message processing means) 56 Upload processing unit (an example of upload processing means) 70 Authorization Server 90 External Storage 200 Event Screen 400 File viewing screen (example of viewing screen) 5000 Memory unit (an example of a memory means)
Claims
1. A management system for managing events executed between a communication terminal and a device used by a user, an operation request receiving means for receiving an operation request for the device transmitted from the communication terminal; a generating means for generating operation information that associates operation identification information that identifies an operation of the device corresponding to the operation request with access information of the user to a storage; a transmitting means for transmitting a message transmitted from the communication terminal to the device for executing an operation corresponding to the operation request; an upload processing means for uploading data acquired by the device in response to an operation of the device corresponding to the message to the storage using the access information associated with the operation identification information; A management system comprising:
2. the operation request is a request to capture an image taken by the device; The management system according to claim 1 , wherein the upload processing means uploads photographed image data acquired by operating the device to the storage.
3. A management system as described in claim 1 or 2, wherein the storage is external storage.
4. A management system described in any one of claims 1 to 3, further comprising an acquisition means for acquiring the user's access information to storage through an authentication process to the management system by the communication terminal.
5. A communication system comprising a communication terminal used by a user and a management system that manages events executed between the communication terminal and a device, an operation request receiving means for receiving an operation request for the device transmitted from the communication terminal; a generating means for generating operation information that associates operation identification information that identifies an operation of the device corresponding to the operation request with access information of the user to a storage; a transmitting means for transmitting a message transmitted from the communication terminal to the device for executing an operation corresponding to the operation request; an upload processing means for uploading data acquired by the device in response to an operation of the device corresponding to the message to the storage using the access information associated with the operation identification information; A communication system comprising:
6. A communication terminal in which management of events executed between the communication terminal and a device is performed by the management system according to any one of claims 1 to 4, an operation request sending means for sending an operation request for the device to the management system; a message sending means for sending a message to the management system for executing an operation corresponding to the operation request; A communication terminal comprising:
7. A processing method executed by a management system that manages events that are executed between a communication terminal used by a user and a device, comprising: an operation request receiving step of receiving an operation request for the device transmitted from the communication terminal; a generating step of generating operation information that associates operation identification information that identifies an operation of the device corresponding to the operation request with access information of the user to a storage; a sending step of sending a message, transmitted from the communication terminal, to the device for executing an operation corresponding to the operation request; an upload processing step of uploading data acquired by the device in response to the operation of the device corresponding to the message to the storage using the access information associated with the operation identification information; How to perform the processing.
8. A program for causing a computer to execute the processing method according to claim 7.